-- Logs begin at Thu 2022-07-14 13:44:38 UTC, end at Thu 2022-07-14 16:32:55 UTC. -- Jul 14 14:18:10.979223 n-d-768852-23 systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 14:18:10.987028 n-d-768852-23 devstack@keystone.service[80577]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:18:10 2022] *** Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: nodename: n-d-768852-23 Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: machine: x86_64 Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: clock source: unix Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: pcre jit disabled Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: detected number of CPU cores: 4 Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: current working directory: / Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: your processes number limit is 47680 Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: your memory page size is 4096 bytes Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: detected max file descriptor number: 2048 Jul 14 14:18:10.990260 n-d-768852-23 devstack@keystone.service[80577]: lock engine: pthread robust mutexes Jul 14 14:18:10.991010 n-d-768852-23 devstack@keystone.service[80577]: thunder lock: enabled Jul 14 14:18:10.991010 n-d-768852-23 devstack@keystone.service[80577]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 14:18:10.991010 n-d-768852-23 devstack@keystone.service[80577]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:18:11.034051 n-d-768852-23 devstack@keystone.service[80577]: Python main interpreter initialized at 0x5595d6ef79c0 Jul 14 14:18:11.034051 n-d-768852-23 devstack@keystone.service[80577]: python threads support enabled Jul 14 14:18:11.034051 n-d-768852-23 devstack@keystone.service[80577]: your server socket listen backlog is limited to 100 connections Jul 14 14:18:11.034051 n-d-768852-23 devstack@keystone.service[80577]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:18:11.034440 n-d-768852-23 devstack@keystone.service[80577]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:18:11.034516 n-d-768852-23 devstack@keystone.service[80577]: *** Operational MODE: preforking *** Jul 14 14:18:11.034754 n-d-768852-23 devstack@keystone.service[80577]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:18:11.034754 n-d-768852-23 devstack@keystone.service[80577]: spawned uWSGI master process (pid: 80577) Jul 14 14:18:11.034969 n-d-768852-23 systemd[1]: Started Devstack devstack@keystone.service. Jul 14 14:18:11.035723 n-d-768852-23 devstack@keystone.service[80577]: spawned uWSGI worker 1 (pid: 80581, cores: 1) Jul 14 14:18:11.035914 n-d-768852-23 devstack@keystone.service[80577]: spawned uWSGI worker 2 (pid: 80582, cores: 1) Jul 14 14:18:11.036057 n-d-768852-23 devstack@keystone.service[80577]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:18:16.505127 n-d-768852-23 devstack@keystone.service[80582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:18:16.505127 n-d-768852-23 devstack@keystone.service[80582]: from cryptography.utils import int_from_bytes Jul 14 14:18:16.505924 n-d-768852-23 devstack@keystone.service[80582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:18:16.505924 n-d-768852-23 devstack@keystone.service[80582]: from cryptography.utils import int_from_bytes Jul 14 14:18:16.514743 n-d-768852-23 devstack@keystone.service[80581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:18:16.514743 n-d-768852-23 devstack@keystone.service[80581]: from cryptography.utils import int_from_bytes Jul 14 14:18:16.515262 n-d-768852-23 devstack@keystone.service[80581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:18:16.515262 n-d-768852-23 devstack@keystone.service[80581]: from cryptography.utils import int_from_bytes Jul 14 14:18:16.554850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:18:16.555007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:18:16.555139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] command line args: [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:18:16.555443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:18:16.555623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ================================================================================ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:18:16.555875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] admin_token = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.556123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] config_dir = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.556311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.556530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] config_source = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.556712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] debug = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.556912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.557289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.557470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.557725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.557976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.558209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.558391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] log_config_append = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.558569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.558748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] log_dir = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.558927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] log_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.559164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.559439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.559690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.559986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.560210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.560890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.561135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.561385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.561622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.561858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.562093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.562325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.562650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.562849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.563087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.563691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.98/identity {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.563879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] publish_errors = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.564119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.564354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.564535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.564785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.565024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.565276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] standard_threads = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.565494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.565737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.565915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.566093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] use_journal = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.566270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] use_json = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.566446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] use_stderr = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.566623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] use_syslog = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.566857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.567120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.567396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.567663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.567906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.568159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.568401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.568653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.568891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.569140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.569390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.569643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.569880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.570130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.570367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.570617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.570871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.571111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.571395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.571651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.571898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.572136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.572391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.572655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.572909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.573159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.573392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.573624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.573856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.574004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:18:16.574086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.574212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:18:16.574329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.574417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] command line args: [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:18:16.574578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.574657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:18:16.574810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.574888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ================================================================================ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:18:16.575041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.575189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] admin_token = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.575306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] config_dir = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.575396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.575497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.575590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.575724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] config_source = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.575811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.575889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] debug = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.576048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.576128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.576282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.576371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.576472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.576554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.576721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.576800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.576957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.577047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.577182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.577265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.577365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_config_append = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.577444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.577541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.577629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.577707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_dir = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.577849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.577934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.578098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.578177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.578331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.578410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.578568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.578646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.578798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.578882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.578965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.579038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.579130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.579258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.579388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.579532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.579612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.579767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.579846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.580067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.580168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.580432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.580524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.580637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.580712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.580788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.580859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.580940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.581014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.581143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.581223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.581396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.581634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.581723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.98/identity {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.581847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] publish_errors = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.581925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.582079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.582166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.582307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.582394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.582472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.582568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.582711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.582798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.582945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.583023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.583176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] standard_threads = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.583260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.583429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.583517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.583670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.583749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.583847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.584001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.584118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_journal = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.584209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_json = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.584282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.584358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_stderr = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.584472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.584558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_syslog = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.584711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.584871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:18:16.584947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.585999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.586971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.587990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.588975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.589913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.590894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.591003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.591111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.591982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.592928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.external = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.593886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.password = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.token = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.594970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.595896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.596562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.596694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.596795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.596888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.596976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.597827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.598049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.598158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.598278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.598388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.600813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.600962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.601907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.602980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.603988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.604966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.605842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.606878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.607584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.607672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.607747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.607833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.607910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.607971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.608979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.609941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.external = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.610823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.611018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.611203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.611454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.611582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.611708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.password = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.611848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.611980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.token = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.612193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.612326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.612455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.612585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.612712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.612843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.612982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.613124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.613255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.613385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.613515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.613645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.613784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.613915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.614986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.615116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.615254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.615354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.615474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.615606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.615736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.615865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.616932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.617061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.617191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.617321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.617457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.617594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.617730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.617880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.618952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.619081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.619217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.619372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.619504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.619634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.619764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.619894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.620970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.621102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.621231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.621364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.621489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.621626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.621755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.621883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.622941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.623949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.624967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.625940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] role.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] role.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.626978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.627966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.628130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.628211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.628362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.628442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.628646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.628851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.628851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.629985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.630942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.631983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.632932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.633864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.634955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.635940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.636966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.637903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.638897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.639870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.640970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.641999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.642932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.643065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:18:16.643162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.643334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.643584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.643834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.644065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.644309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.644555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.644800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.645046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.645291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.645524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.645771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.646015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.646259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.646503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.646930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.647167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.647441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.647691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.647939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.648187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.648427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.648682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.648934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.649173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.649404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.649635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.649866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.650123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.650370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.650616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.650856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.651086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.651349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.651591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.651826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.652073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.652309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.652563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.652808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.653045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.653299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.653541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.654321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.654552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.654791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.655026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.655299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.655535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.655764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.656007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.656305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.656608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.656837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.657091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.657325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.657566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.657877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.658324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.658743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.659014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.659235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.659599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.660050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.660445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.660696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.660935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.661184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.661415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.661658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.661893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:18:16.662065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:18:16.674876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.675136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.675348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.683973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.688331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.688563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.688800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.697252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.712097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.712330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.715308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.715541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.857502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.857771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.908034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.908323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.908583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.908816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.975007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.975292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.975463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.975605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.975763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.975896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.976031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.976173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.976302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.976446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.976446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:16.976683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.001505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.001753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.001907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.002974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.003056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.003223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.003390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.015012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.015290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.028436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.028709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.029405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.029597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.029597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.029943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.030132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.030330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.030522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.030687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.030815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.030971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.031155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.031321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:18:17.047688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.047938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:18:17.048084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.048225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:18:17.048383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.048383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:18:17.048633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.048633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:18:17.048882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.049148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.049301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.049432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.049559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.049684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.049808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.049945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.060604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.060877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.061092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.061271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.061464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.061684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.061883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.062057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.069718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.070006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.073041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.073236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.073396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.073552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.073722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.073895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.074048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.074197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.074343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.074491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.074647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.074794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.074942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.075086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.075232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.075415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.076060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.076208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.076354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.076502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.076666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.076823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.103389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.103724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.105036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.105221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.105457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.105666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.110723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.110981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.111180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.111405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.111597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.111734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.118625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.118878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.119104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.119355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.123464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.123653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.123797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.123934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.124084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.124218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.124349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.124485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.124625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.124769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.124908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.125036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.125164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.125300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.125481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.125627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.144541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.144817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.144958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.145090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.149519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.149767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.153174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.153426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.153615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.154338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.159142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.159499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.162785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.163123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.166529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.166824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.166969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.167103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.167234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.167408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.167553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.167688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.167819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.167958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.168090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.168230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.187109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.187514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.187736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.187947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.188189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.188399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.188609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.188826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.195900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.196294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.197605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.197875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.198051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.198270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.201646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.201927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.202088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.202246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.202438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.202659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.202879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.203056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.203211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.203211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.216131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.217034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.217174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.217318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.217448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.217591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.217726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.217852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.218040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.218196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.218341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.218482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.218647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.218647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.238530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.239067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.242039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.242487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.245596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.246160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.247225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.247850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.249051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.249328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.249615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.249832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.250306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.250306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.257162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.257539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.258853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.259172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.262124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.262419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.262587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.262804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.263014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.263766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.264002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.264002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.272903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.273197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.273360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.273497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.273628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.273759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.281934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.282210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.282371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:18:17.282502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.282634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.282767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.282899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.283894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.284079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.284217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.284443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.284528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.284722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.284806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.284985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.285067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.285245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.285368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.285507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.285589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.285769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:18:17.324346 n-d-768852-23 devstack@keystone.service[80581]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595d6ef79c0 pid: 80581 (default app) Jul 14 14:18:17.324728 n-d-768852-23 devstack@keystone.service[80582]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595d6ef79c0 pid: 80582 (default app) Jul 14 14:18:17.327933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01a05d-f4ad-420d-93a5-a6f869f488a4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:17.328224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01a05d-f4ad-420d-93a5-a6f869f488a4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:17.328517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01a05d-f4ad-420d-93a5-a6f869f488a4 None None] PATH_INFO: `/v3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:17.332760 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 791 bytes} [Thu Jul 14 14:18:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:25.044421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761b49-5afc-4dd5-885c-7fcd887d8148 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:25.044994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761b49-5afc-4dd5-885c-7fcd887d8148 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:25.044994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761b49-5afc-4dd5-885c-7fcd887d8148 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:25.049284 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1/2] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:25.054653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:25.055099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:25.055219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:25.125491 n-d-768852-23 devstack@keystone.service[80581]: INFO dbcounter [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] Registered counter for database keystone Jul 14 14:18:25.147518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG oslo_db.sqlalchemy.engines [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:18:25.153768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writer thread running {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:18:25.337360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG passlib.handlers.bcrypt [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80581) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 14:18:25.337688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG passlib.handlers.bcrypt [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80581) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 14:18:25.393738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:25.395443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:25.521891 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2/3] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 14:18:25.662707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79761b49-5afc-4dd5-885c-7fcd887d8148 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:25.734145 n-d-768852-23 devstack@keystone.service[80582]: INFO dbcounter [None req-79761b49-5afc-4dd5-885c-7fcd887d8148 None None] Registered counter for database keystone Jul 14 14:18:25.754626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG oslo_db.sqlalchemy.engines [None req-79761b49-5afc-4dd5-885c-7fcd887d8148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:18:25.761044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writer thread running {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:18:25.880853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79761b49-5afc-4dd5-885c-7fcd887d8148 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:25.885364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df347a-24c9-41d8-9cde-abd2add3823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:25.886063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df347a-24c9-41d8-9cde-abd2add3823e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:25.886351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df347a-24c9-41d8-9cde-abd2add3823e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:25.886633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df347a-24c9-41d8-9cde-abd2add3823e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:25.897939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df347a-24c9-41d8-9cde-abd2add3823e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:25.953002 n-d-768852-23 devstack@keystone.service[80582]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5df347a-24c9-41d8-9cde-abd2add3823e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 14:18:25.953248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df347a-24c9-41d8-9cde-abd2add3823e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:25.964176 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2/4] 10.222.0.98 () {58 vars in 1324 bytes} [Thu Jul 14 14:18:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:18:25.971363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:25.987623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d8752-bda6-486f-a52e-4578de75f806 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:25.992216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd4367-c67a-417b-b6a8-61b6ea0c598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:25.993296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd4367-c67a-417b-b6a8-61b6ea0c598d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:25.993584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd4367-c67a-417b-b6a8-61b6ea0c598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:25.993864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd4367-c67a-417b-b6a8-61b6ea0c598d admin admin] PATH_INFO: `/v3/projects/8825e26169ac4a448a49e26a9c5f74ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:25.995447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd4367-c67a-417b-b6a8-61b6ea0c598d admin admin] RBAC: Authorizing `identity:get_project(project_id=8825e26169ac4a448a49e26a9c5f74ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:26.049865 n-d-768852-23 devstack@keystone.service[80581]: WARNING keystone.common.rbac_enforcer.enforcer [None req-95cd4367-c67a-417b-b6a8-61b6ea0c598d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 14:18:26.050199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd4367-c67a-417b-b6a8-61b6ea0c598d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:26.054907 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3/5] 10.222.0.98 () {56 vars in 1207 bytes} [Thu Jul 14 14:18:25 2022] GET /identity/v3/projects/8825e26169ac4a448a49e26a9c5f74ba => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:28.079146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a513680-d1be-40b9-9e78-032c2f69426c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:28.079734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a513680-d1be-40b9-9e78-032c2f69426c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:28.079734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a513680-d1be-40b9-9e78-032c2f69426c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:28.084047 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3/6] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:28.089713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44cc0-5968-4860-86d6-b1d890d81c49 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:28.090169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44cc0-5968-4860-86d6-b1d890d81c49 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:28.090257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44cc0-5968-4860-86d6-b1d890d81c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:28.110306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f8b44cc0-5968-4860-86d6-b1d890d81c49 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:28.111894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8b44cc0-5968-4860-86d6-b1d890d81c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:28.119964 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4/7] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 14:18:28.142113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a513680-d1be-40b9-9e78-032c2f69426c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:28.156563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a513680-d1be-40b9-9e78-032c2f69426c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:28.160912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81592837-f605-4ea2-9386-564c9debd8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:28.161571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592837-f605-4ea2-9386-564c9debd8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:28.161855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592837-f605-4ea2-9386-564c9debd8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:28.162135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592837-f605-4ea2-9386-564c9debd8fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:28.171121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81592837-f605-4ea2-9386-564c9debd8fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:28.172960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81592837-f605-4ea2-9386-564c9debd8fe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:28.181919 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4/8] 10.222.0.98 () {58 vars in 1324 bytes} [Thu Jul 14 14:18:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:18:28.188061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44cc0-5968-4860-86d6-b1d890d81c49 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:28.197387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44cc0-5968-4860-86d6-b1d890d81c49 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:28.202519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9731a6-aeb2-420f-8444-036eff2ef39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:28.203437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9731a6-aeb2-420f-8444-036eff2ef39a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:28.203731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9731a6-aeb2-420f-8444-036eff2ef39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:28.204061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9731a6-aeb2-420f-8444-036eff2ef39a admin admin] PATH_INFO: `/v3/users/c8378d889c17447db6fd8aa498751f4a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:28.205442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9731a6-aeb2-420f-8444-036eff2ef39a admin admin] RBAC: Authorizing `identity:get_user(user_id=c8378d889c17447db6fd8aa498751f4a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:28.207309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9731a6-aeb2-420f-8444-036eff2ef39a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:28.208929 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 5/9] 10.222.0.98 () {56 vars in 1198 bytes} [Thu Jul 14 14:18:28 2022] GET /identity/v3/users/c8378d889c17447db6fd8aa498751f4a => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:30.334933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb09d-000c-496c-b4f9-fdca8260c3b6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.335490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb09d-000c-496c-b4f9-fdca8260c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.335587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb09d-000c-496c-b4f9-fdca8260c3b6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.336886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 5/10] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:30.343212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0693be2-431f-487c-a78f-78f2c6386f73 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.343717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0693be2-431f-487c-a78f-78f2c6386f73 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.343833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0693be2-431f-487c-a78f-78f2c6386f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.362423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0693be2-431f-487c-a78f-78f2c6386f73 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:30.363762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0693be2-431f-487c-a78f-78f2c6386f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:30.409911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab06a3-0cdb-4b62-a2c5-9a2320d28504 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.410198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab06a3-0cdb-4b62-a2c5-9a2320d28504 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.410483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab06a3-0cdb-4b62-a2c5-9a2320d28504 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.411878 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 6/11] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:30.417339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.417628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.417938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.446836 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 6/12] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:30.460388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG passlib.handlers.bcrypt [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80582) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 14:18:30.460801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG passlib.handlers.bcrypt [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80582) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 14:18:30.470889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0693be2-431f-487c-a78f-78f2c6386f73 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:30.494947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:30.507181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:30.509194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:30.589661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0693be2-431f-487c-a78f-78f2c6386f73 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:30.625620 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 7/13] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:30.633229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:30.634030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.634318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.634602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.646758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:30.653959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:30.658923 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:30.659906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:30.660765 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 7/14] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:18:30.666176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:30.755285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:30.765799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0016e14-6cb0-41af-b3f8-a2aa231ed885 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:30.768236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:30.775713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aedc1f-5581-4c0c-a133-5e31a9a80d77 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:30.808425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:30.809902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.810192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.810473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.814308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:30.814993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.815408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.815646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.816355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:30.816669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:30.818155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:30.830506 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 8/15] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:30.836389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:30.885719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:30.887216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:30.956225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2f6a-acea-4d1e-b2de-64e4fa7b8211 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:30.994375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:30.995304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:30.995594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:30.995878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] PATH_INFO: `/v3/users/c8378d889c17447db6fd8aa498751f4a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:30.997193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] RBAC: Authorizing `identity:get_user(user_id=c8378d889c17447db6fd8aa498751f4a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:30.998715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:30.999117 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 8/16] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:18:31.009811 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 9/17] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:30 2022] GET /identity/v3/users/c8378d889c17447db6fd8aa498751f4a => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:31.010007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:31.011367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:31.011494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:31.028343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:31.122179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2826deb-2726-43fc-aaee-0ac6647507d9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:31.150315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2788da-7016-4031-97e5-faffab1e1913 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:31.172182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:31.173006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:31.173297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:31.173583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:31.174866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:31.176359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:31.178006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 10/18] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:31.183797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:31.191451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:31.192577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:31.192859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:31.193577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:31.213396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:31.214904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:18:31.237600 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:31.238497 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:31.239363 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:18:31.239363 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:18:31.239363 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:18:31.239363 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:31.239363 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 9/19] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:31.246406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:31.280799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:31.301733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92867990-4313-4730-8333-4711fbd42a77 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:31.314387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:31.337676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aa47b-afb4-456b-9532-90c55d513886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:31.338358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa47b-afb4-456b-9532-90c55d513886 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:31.338647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa47b-afb4-456b-9532-90c55d513886 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:31.338933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa47b-afb4-456b-9532-90c55d513886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:31.339814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aa47b-afb4-456b-9532-90c55d513886 None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.domain.id=default, user.id=c8378d889c17447db6fd8aa498751f4a) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:31.340131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aa47b-afb4-456b-9532-90c55d513886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:31.342049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aa47b-afb4-456b-9532-90c55d513886 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:31.349413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 11/20] 10.222.0.98 () {56 vars in 1322 bytes} [Thu Jul 14 14:18:31 2022] GET /identity/v3/role_assignments?user.id=c8378d889c17447db6fd8aa498751f4a&scope.domain.id=default&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:31.363828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca92d5-844d-40a4-b6d0-b401164bf688 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:31.405048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd74f20-9e00-4604-b07d-fbdc4a5be6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:31.405772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd74f20-9e00-4604-b07d-fbdc4a5be6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:31.406057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd74f20-9e00-4604-b07d-fbdc4a5be6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:31.406338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd74f20-9e00-4604-b07d-fbdc4a5be6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:31.407134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd74f20-9e00-4604-b07d-fbdc4a5be6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:31.407484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd74f20-9e00-4604-b07d-fbdc4a5be6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:31.409041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd74f20-9e00-4604-b07d-fbdc4a5be6a0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:31.431691 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 10/21] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:33.729208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c338-67a9-4caa-a0af-805c66bd1185 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:33.729720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c338-67a9-4caa-a0af-805c66bd1185 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:33.729899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c338-67a9-4caa-a0af-805c66bd1185 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:33.731907 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 12/22] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:33.737437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ee1ec-d86c-4456-913e-c2d7bdad34bd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:33.738321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ee1ec-d86c-4456-913e-c2d7bdad34bd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:33.738820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ee1ec-d86c-4456-913e-c2d7bdad34bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:33.764392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-019ee1ec-d86c-4456-913e-c2d7bdad34bd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:33.765951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-019ee1ec-d86c-4456-913e-c2d7bdad34bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:33.869328 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 11/23] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:33.905735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c338-67a9-4caa-a0af-805c66bd1185 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:33.953304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31d73b-375a-4dd7-9a7f-015fa94712ab None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:33.953976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31d73b-375a-4dd7-9a7f-015fa94712ab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:33.954469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31d73b-375a-4dd7-9a7f-015fa94712ab None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:33.956379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 12/24] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:33.961677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b4460-72eb-4fae-8077-390a52c3bb0a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:33.962254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b4460-72eb-4fae-8077-390a52c3bb0a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:33.962760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b4460-72eb-4fae-8077-390a52c3bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:33.990596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e90b4460-72eb-4fae-8077-390a52c3bb0a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:33.992168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e90b4460-72eb-4fae-8077-390a52c3bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:34.103122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:34.133114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c338-67a9-4caa-a0af-805c66bd1185 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:34.190447 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 13/25] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:34.226815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b4460-72eb-4fae-8077-390a52c3bb0a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:34.229760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:34.230602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.231468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.231752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.260603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:34.269133 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:34.270033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:34.270802 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:34.275794 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 13/26] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:34.282259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:34.287903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:34.445771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b61ff-edec-4cf8-9204-e9ce0c8b0a2c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:34.506950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:34.507676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.507972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.508372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.509155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:34.509474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:34.510948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:34.517596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b4460-72eb-4fae-8077-390a52c3bb0a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:34.534132 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 14/27] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:34.539916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:34.588803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333c1de-2b52-4368-8ca1-97557063e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:34.589637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c1de-2b52-4368-8ca1-97557063e78d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.589930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c1de-2b52-4368-8ca1-97557063e78d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.591176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c1de-2b52-4368-8ca1-97557063e78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.621137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333c1de-2b52-4368-8ca1-97557063e78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:34.623260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333c1de-2b52-4368-8ca1-97557063e78d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e333c1de-2b52-4368-8ca1-97557063e78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:18:34.661033 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:34.661908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:34.662712 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:18:34.662712 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:18:34.662712 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:18:34.662712 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:34.667960 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 14/28] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:18:34.670789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2833aba-462a-4fbc-b640-41d40edb6469 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.671141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2833aba-462a-4fbc-b640-41d40edb6469 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.671544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2833aba-462a-4fbc-b640-41d40edb6469 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.673226 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 15/29] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:34.674147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2833aba-462a-4fbc-b640-41d40edb6469 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:34.693273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:34.736409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:34.756644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb4423-f007-4df2-8b3d-6ed76f26fe8b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:34.794202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a83c-0b9f-45c3-a0fe-cf1a0a8ff67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:34.795072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a83c-0b9f-45c3-a0fe-cf1a0a8ff67e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.799307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a83c-0b9f-45c3-a0fe-cf1a0a8ff67e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.799307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a83c-0b9f-45c3-a0fe-cf1a0a8ff67e None admin] PATH_INFO: `/v3/users/c8378d889c17447db6fd8aa498751f4a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.799307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a83c-0b9f-45c3-a0fe-cf1a0a8ff67e None admin] RBAC: Authorizing `identity:get_user(user_id=c8378d889c17447db6fd8aa498751f4a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:34.799307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a83c-0b9f-45c3-a0fe-cf1a0a8ff67e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:34.805319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 15/30] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:34 2022] GET /identity/v3/users/c8378d889c17447db6fd8aa498751f4a => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:34.806878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5856ba2-1c85-400d-ba10-d9dd49591e7d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.807326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5856ba2-1c85-400d-ba10-d9dd49591e7d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.807762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5856ba2-1c85-400d-ba10-d9dd49591e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.826559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a5856ba2-1c85-400d-ba10-d9dd49591e7d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:34.828034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5856ba2-1c85-400d-ba10-d9dd49591e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:34.828400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2833aba-462a-4fbc-b640-41d40edb6469 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:34.866166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a37b81-c92e-4f79-944a-9d3b31fe7e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:34.866849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37b81-c92e-4f79-944a-9d3b31fe7e32 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.867140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37b81-c92e-4f79-944a-9d3b31fe7e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.867471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37b81-c92e-4f79-944a-9d3b31fe7e32 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.868214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a37b81-c92e-4f79-944a-9d3b31fe7e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:34.868532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a37b81-c92e-4f79-944a-9d3b31fe7e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:34.869938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a37b81-c92e-4f79-944a-9d3b31fe7e32 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:34.882874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 16/31] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:34.884227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbfb6-5df4-4751-bd2f-2c8cb0538df4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:34.884526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbfb6-5df4-4751-bd2f-2c8cb0538df4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:34.884813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbfb6-5df4-4751-bd2f-2c8cb0538df4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:34.890610 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 17/32] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:34.890610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbfb6-5df4-4751-bd2f-2c8cb0538df4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:34.907110 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 16/33] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:34.908271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5856ba2-1c85-400d-ba10-d9dd49591e7d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:34.978844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:34.987341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:35.002480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbfb6-5df4-4751-bd2f-2c8cb0538df4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:35.020324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5856ba2-1c85-400d-ba10-d9dd49591e7d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:35.041016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950cc2e-f035-425b-a3dc-94f563fa3bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:35.042186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950cc2e-f035-425b-a3dc-94f563fa3bba None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.042546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950cc2e-f035-425b-a3dc-94f563fa3bba None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.042839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950cc2e-f035-425b-a3dc-94f563fa3bba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.044461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950cc2e-f035-425b-a3dc-94f563fa3bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:35.045889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950cc2e-f035-425b-a3dc-94f563fa3bba None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:35.047570 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 18/34] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:35.048835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e211f1d-d967-465c-b108-e4165acf6993 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.049129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e211f1d-d967-465c-b108-e4165acf6993 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.049416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e211f1d-d967-465c-b108-e4165acf6993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.063539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464f607-4486-497f-a789-782f4bba572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:35.064219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464f607-4486-497f-a789-782f4bba572c None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.064514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464f607-4486-497f-a789-782f4bba572c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.064802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464f607-4486-497f-a789-782f4bba572c None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.065524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464f607-4486-497f-a789-782f4bba572c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:35.066374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5e211f1d-d967-465c-b108-e4165acf6993 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:35.067004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464f607-4486-497f-a789-782f4bba572c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:35.067685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e211f1d-d967-465c-b108-e4165acf6993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:35.143279 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 19/35] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:35.151515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e211f1d-d967-465c-b108-e4165acf6993 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:35.216097 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 17/36] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:18:34 2022] POST /identity/v3/projects => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:18:35.218011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258fe54-c4c9-41bd-9fbf-db4100db073e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.218312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258fe54-c4c9-41bd-9fbf-db4100db073e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.218591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258fe54-c4c9-41bd-9fbf-db4100db073e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.227433 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 18/37] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:35.227433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258fe54-c4c9-41bd-9fbf-db4100db073e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:35.274358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:35.295735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e211f1d-d967-465c-b108-e4165acf6993 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:35.348475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26666c-68d0-42e1-9cf4-96094239e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:35.349378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26666c-68d0-42e1-9cf4-96094239e435 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.349906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26666c-68d0-42e1-9cf4-96094239e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.350293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26666c-68d0-42e1-9cf4-96094239e435 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.351232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26666c-68d0-42e1-9cf4-96094239e435 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:35.353296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26666c-68d0-42e1-9cf4-96094239e435 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:35.375498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258fe54-c4c9-41bd-9fbf-db4100db073e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:35.400720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:35.422032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:35.422933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.423227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.423545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] PATH_INFO: `/v3/domains/default/users/c8378d889c17447db6fd8aa498751f4a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.425829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c8378d889c17447db6fd8aa498751f4a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:35.427555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:35.444104 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 19/38] 10.222.0.98 () {58 vars in 1361 bytes} [Thu Jul 14 14:18:35 2022] PUT /identity/v3/domains/default/users/c8378d889c17447db6fd8aa498751f4a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:18:35.444796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:35.518683 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 20/39] 10.222.0.98 () {60 vars in 1131 bytes} [Thu Jul 14 14:18:35 2022] POST /identity/v3/roles => generated 225 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:18:35.520339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbef04-3afa-46c3-8769-7a92312eb15c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.520639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbef04-3afa-46c3-8769-7a92312eb15c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.520930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbef04-3afa-46c3-8769-7a92312eb15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.540698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-03fbef04-3afa-46c3-8769-7a92312eb15c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:35.542299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-03fbef04-3afa-46c3-8769-7a92312eb15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:35.598057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdc13f-e2b8-453e-88e4-f5eb66ecd4a7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:35.627847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 21/40] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:35.656754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbef04-3afa-46c3-8769-7a92312eb15c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:35.769478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:35.785567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668faa8d-e361-426d-bceb-8d37885100da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:35.786908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668faa8d-e361-426d-bceb-8d37885100da None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.787205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668faa8d-e361-426d-bceb-8d37885100da None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.787823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668faa8d-e361-426d-bceb-8d37885100da None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.788627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668faa8d-e361-426d-bceb-8d37885100da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:35.790747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668faa8d-e361-426d-bceb-8d37885100da None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:35.802018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbef04-3afa-46c3-8769-7a92312eb15c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:35.812634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 20/41] 10.222.0.98 () {60 vars in 1131 bytes} [Thu Jul 14 14:18:35 2022] POST /identity/v3/roles => generated 219 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:18:35.814071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c2c9-2c59-4d81-99d7-520646173f03 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.814372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c2c9-2c59-4d81-99d7-520646173f03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.816110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c2c9-2c59-4d81-99d7-520646173f03 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.817634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 21/42] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:35.824643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb98fc-fa4f-4af7-9626-316cb6a36ba9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.824943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb98fc-fa4f-4af7-9626-316cb6a36ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.825224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb98fc-fa4f-4af7-9626-316cb6a36ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.846402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2fb98fc-fa4f-4af7-9626-316cb6a36ba9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:35.848160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2fb98fc-fa4f-4af7-9626-316cb6a36ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:35.850504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:35.851209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:35.854424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:35.854424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:35.854424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:35.854424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:35.877350 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 22/43] 10.222.0.98 () {60 vars in 1131 bytes} [Thu Jul 14 14:18:35 2022] POST /identity/v3/roles => generated 223 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:18:35.894426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:35.951328 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 22/44] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:35.976292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:36.096367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbc8c-e772-47e8-9b84-4484ee40628d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:36.134727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500858b-014a-49c0-89fc-ca9688d17314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:36.135523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500858b-014a-49c0-89fc-ca9688d17314 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:36.135816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500858b-014a-49c0-89fc-ca9688d17314 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:36.136101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500858b-014a-49c0-89fc-ca9688d17314 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:36.137929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500858b-014a-49c0-89fc-ca9688d17314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:36.139441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500858b-014a-49c0-89fc-ca9688d17314 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:36.141080 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 23/45] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:36.146774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb98fc-fa4f-4af7-9626-316cb6a36ba9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:36.257314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb98fc-fa4f-4af7-9626-316cb6a36ba9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:36.294313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efbb2b-2ee8-4b82-9f53-ed61a1b08924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:36.294992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efbb2b-2ee8-4b82-9f53-ed61a1b08924 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:36.295301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efbb2b-2ee8-4b82-9f53-ed61a1b08924 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:36.295680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efbb2b-2ee8-4b82-9f53-ed61a1b08924 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:36.296512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efbb2b-2ee8-4b82-9f53-ed61a1b08924 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:36.298006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efbb2b-2ee8-4b82-9f53-ed61a1b08924 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:36.324484 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 23/46] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:18:36 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:18:37.656723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902ee6b-24c3-4f58-a6a1-fd02ca589417 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:37.657227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902ee6b-24c3-4f58-a6a1-fd02ca589417 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:37.657310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902ee6b-24c3-4f58-a6a1-fd02ca589417 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:37.658675 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 24/47] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:37.664191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e5469-cc9e-4824-b394-56c047922bc5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:37.664609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e5469-cc9e-4824-b394-56c047922bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:37.664800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e5469-cc9e-4824-b394-56c047922bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:37.682443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f66e5469-cc9e-4824-b394-56c047922bc5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:37.683685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f66e5469-cc9e-4824-b394-56c047922bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:37.696833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:37.753813 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 24/48] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:37.776295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902ee6b-24c3-4f58-a6a1-fd02ca589417 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:37.780988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:37.887429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902ee6b-24c3-4f58-a6a1-fd02ca589417 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:37.924990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:37.925725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:37.926021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:37.926306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.042297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:38.051239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:38.052308 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:38.053276 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 25/49] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:38.058405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e5469-cc9e-4824-b394-56c047922bc5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:38.160319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e5469-cc9e-4824-b394-56c047922bc5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:38.194953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:38.195601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.195898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.196185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.196944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:38.197259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:38.198665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:38.207620 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 25/50] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:38.213122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:38.285980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:38.325302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f279029-b3ed-4742-8074-3db25863dbe3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:38.360676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692a3ae-5d99-4de3-817e-9c5133d4e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:38.361571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692a3ae-5d99-4de3-817e-9c5133d4e7bd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.361862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692a3ae-5d99-4de3-817e-9c5133d4e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.362145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692a3ae-5d99-4de3-817e-9c5133d4e7bd None admin] PATH_INFO: `/v3/users/c8378d889c17447db6fd8aa498751f4a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.363610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692a3ae-5d99-4de3-817e-9c5133d4e7bd None admin] RBAC: Authorizing `identity:get_user(user_id=c8378d889c17447db6fd8aa498751f4a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:38.365099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692a3ae-5d99-4de3-817e-9c5133d4e7bd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:38.366900 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 26/51] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:38 2022] GET /identity/v3/users/c8378d889c17447db6fd8aa498751f4a => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:38.372169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:38.383253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e343dc0-e084-43cf-b392-ff009a27ba3e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.383582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e343dc0-e084-43cf-b392-ff009a27ba3e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.383858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e343dc0-e084-43cf-b392-ff009a27ba3e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.385154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:38.385256 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 27/52] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:38.390328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acefa0-e7d8-4f79-a193-5490944c259a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.390618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acefa0-e7d8-4f79-a193-5490944c259a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.390908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acefa0-e7d8-4f79-a193-5490944c259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.408328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-32acefa0-e7d8-4f79-a193-5490944c259a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:38.409538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32acefa0-e7d8-4f79-a193-5490944c259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:38.477413 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 28/53] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:18:38.477643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bbffa-f9c0-42bd-b66c-8d94d75e9f0a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:38.500725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acefa0-e7d8-4f79-a193-5490944c259a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:38.514729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:38.515584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.515866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.516149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.517395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:38.518875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:38.520735 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 26/54] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:38.528304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:38.564048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:38.609180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acefa0-e7d8-4f79-a193-5490944c259a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:38.611173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:38.634093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816881-c3d8-49ad-af2f-ab3dc0abc3c7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:38.644546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:38.645363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.645647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.645928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.647113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:38.648617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:38.650248 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 29/55] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:38.656373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:38.672061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed16543-3473-4fd8-94a7-439645aff34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:38.672778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16543-3473-4fd8-94a7-439645aff34c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.673051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16543-3473-4fd8-94a7-439645aff34c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.673343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16543-3473-4fd8-94a7-439645aff34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.674140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed16543-3473-4fd8-94a7-439645aff34c None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.domain.id=default, user.id=c8378d889c17447db6fd8aa498751f4a) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:38.674467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed16543-3473-4fd8-94a7-439645aff34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:38.676167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed16543-3473-4fd8-94a7-439645aff34c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:38.682445 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 27/56] 10.222.0.98 () {56 vars in 1322 bytes} [Thu Jul 14 14:18:38 2022] GET /identity/v3/role_assignments?user.id=c8378d889c17447db6fd8aa498751f4a&scope.domain.id=default&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:38.774785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9cfc8-e1da-403f-8d9a-083417ab76c4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:38.806745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:38.824347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7fbd2-308e-40c9-a9ee-017712685801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:38.824347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7fbd2-308e-40c9-a9ee-017712685801 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:38.824347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7fbd2-308e-40c9-a9ee-017712685801 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:38.824347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7fbd2-308e-40c9-a9ee-017712685801 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:38.824762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7fbd2-308e-40c9-a9ee-017712685801 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:38.824762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7fbd2-308e-40c9-a9ee-017712685801 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:38.852942 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 30/57] 10.222.0.98 () {60 vars in 1140 bytes} [Thu Jul 14 14:18:38 2022] POST /identity/v3/projects => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:18:40.909609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238212-8dc6-49b8-8246-2b5231dbbb58 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:40.910124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238212-8dc6-49b8-8246-2b5231dbbb58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:40.910236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238212-8dc6-49b8-8246-2b5231dbbb58 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:40.911569 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 28/58] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:40.916728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6a7e8-01fa-4f6d-a1fc-d9cd672f7196 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:40.917087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6a7e8-01fa-4f6d-a1fc-d9cd672f7196 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:40.917295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6a7e8-01fa-4f6d-a1fc-d9cd672f7196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:40.934427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5dc6a7e8-01fa-4f6d-a1fc-d9cd672f7196 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:40.935669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5dc6a7e8-01fa-4f6d-a1fc-d9cd672f7196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:41.000440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 31/59] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:41.026087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238212-8dc6-49b8-8246-2b5231dbbb58 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:41.126558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238212-8dc6-49b8-8246-2b5231dbbb58 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:41.160620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4538895-e85c-49bc-9683-166841381893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:41.161393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4538895-e85c-49bc-9683-166841381893 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:41.161632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4538895-e85c-49bc-9683-166841381893 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:41.161911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4538895-e85c-49bc-9683-166841381893 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:41.163094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4538895-e85c-49bc-9683-166841381893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:41.164581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4538895-e85c-49bc-9683-166841381893 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:41.166209 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 29/60] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:41.172089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6a7e8-01fa-4f6d-a1fc-d9cd672f7196 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:41.271468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6a7e8-01fa-4f6d-a1fc-d9cd672f7196 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:41.285312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:41.307003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6926b-29a5-4477-ab57-412164b326df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:41.307715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6926b-29a5-4477-ab57-412164b326df None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:41.308002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6926b-29a5-4477-ab57-412164b326df None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:41.308280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6926b-29a5-4477-ab57-412164b326df None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:41.309503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6926b-29a5-4477-ab57-412164b326df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:41.311076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6926b-29a5-4477-ab57-412164b326df None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:41.337347 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 32/61] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:18:41 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:18:44.474774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cce974-7c22-425d-bf82-36d30d82aaf2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:44.475819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cce974-7c22-425d-bf82-36d30d82aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:44.476309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cce974-7c22-425d-bf82-36d30d82aaf2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:44.477889 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 30/62] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:44.484219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be33a-e25d-4885-8807-0080d0bd27d3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:44.485197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be33a-e25d-4885-8807-0080d0bd27d3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:44.485671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be33a-e25d-4885-8807-0080d0bd27d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:44.512843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1a3be33a-e25d-4885-8807-0080d0bd27d3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:44.514078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1a3be33a-e25d-4885-8807-0080d0bd27d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:44.576374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba622a6-dc59-4433-9a67-f528d49f7dfc None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:44.576954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba622a6-dc59-4433-9a67-f528d49f7dfc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:44.577434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba622a6-dc59-4433-9a67-f528d49f7dfc None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:44.579022 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 31/63] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:44.584340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f34ff-c743-447a-9a95-4fc20a69187b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:44.584900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f34ff-c743-447a-9a95-4fc20a69187b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:44.585374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f34ff-c743-447a-9a95-4fc20a69187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:44.610457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7e3f34ff-c743-447a-9a95-4fc20a69187b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:44.613427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e3f34ff-c743-447a-9a95-4fc20a69187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:44.617762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:44.638078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 33/64] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:44.666718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be33a-e25d-4885-8807-0080d0bd27d3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:44.763443 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 32/65] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:18:44.773082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:44.782260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be33a-e25d-4885-8807-0080d0bd27d3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:44.792083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f34ff-c743-447a-9a95-4fc20a69187b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:44.836670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:44.837412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:44.837701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:44.837985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:44.859495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:44.874993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:44.876069 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:44.877139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 34/66] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:18:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:18:44.885842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:44.971387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f34ff-c743-447a-9a95-4fc20a69187b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.011421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894eecb-f4ae-44f5-9d1b-3ee21c9ce1ef None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.027874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60985844-36d2-4d36-82af-eae203040fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.028964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985844-36d2-4d36-82af-eae203040fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.029445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985844-36d2-4d36-82af-eae203040fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.029877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985844-36d2-4d36-82af-eae203040fc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.039128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.043890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60985844-36d2-4d36-82af-eae203040fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:45.049912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.050724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.051120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.051558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.052437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:45.052858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-60985844-36d2-4d36-82af-eae203040fc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:45.053288 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:45.054126 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:45.054913 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:45.055527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:45.064899 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 33/67] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:18:45.064899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404b3c-6c42-4756-aa0c-4b2463121d4d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.064899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404b3c-6c42-4756-aa0c-4b2463121d4d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.064899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404b3c-6c42-4756-aa0c-4b2463121d4d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.064899 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 34/68] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:45.068734 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 35/69] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:45.072831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f6dc4-7c95-49ca-b6f1-ba93f2023a10 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.073123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f6dc4-7c95-49ca-b6f1-ba93f2023a10 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.073407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f6dc4-7c95-49ca-b6f1-ba93f2023a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.076297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.095050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fa1f6dc4-7c95-49ca-b6f1-ba93f2023a10 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:45.096395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa1f6dc4-7c95-49ca-b6f1-ba93f2023a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:45.102106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.177076 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 35/70] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:18:45.178403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f6dc4-7c95-49ca-b6f1-ba93f2023a10 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.192615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc5718-bba2-4194-830f-100bdddb345f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.230881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d2f0-bdba-4270-a50a-32e0008d9c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.231855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d2f0-bdba-4270-a50a-32e0008d9c46 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.232089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d2f0-bdba-4270-a50a-32e0008d9c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.232369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d2f0-bdba-4270-a50a-32e0008d9c46 None admin] PATH_INFO: `/v3/users/c8378d889c17447db6fd8aa498751f4a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.233600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d2f0-bdba-4270-a50a-32e0008d9c46 None admin] RBAC: Authorizing `identity:get_user(user_id=c8378d889c17447db6fd8aa498751f4a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:45.235069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d2f0-bdba-4270-a50a-32e0008d9c46 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:45.236760 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 36/71] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/users/c8378d889c17447db6fd8aa498751f4a => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:45.238057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de903-6e6f-45e0-817e-3e4e6f0afcce None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.238357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de903-6e6f-45e0-817e-3e4e6f0afcce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.238646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de903-6e6f-45e0-817e-3e4e6f0afcce None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.242307 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 37/72] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:45.242307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de903-6e6f-45e0-817e-3e4e6f0afcce None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.300725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f6dc4-7c95-49ca-b6f1-ba93f2023a10 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.329306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.335632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de1b7-9d76-4d1f-b349-d8810ab744ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.336253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.336370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de1b7-9d76-4d1f-b349-d8810ab744ee None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.336592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de1b7-9d76-4d1f-b349-d8810ab744ee None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.336869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de1b7-9d76-4d1f-b349-d8810ab744ee None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.337723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de1b7-9d76-4d1f-b349-d8810ab744ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:45.338067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de1b7-9d76-4d1f-b349-d8810ab744ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:45.340063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de1b7-9d76-4d1f-b349-d8810ab744ee None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:45.348505 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 36/73] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:45.349678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cebf-caf8-48e2-aa68-33d7a688a9fe None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.349972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cebf-caf8-48e2-aa68-33d7a688a9fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.350252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cebf-caf8-48e2-aa68-33d7a688a9fe None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.351518 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 37/74] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:45.352305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cebf-caf8-48e2-aa68-33d7a688a9fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.357604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de903-6e6f-45e0-817e-3e4e6f0afcce None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.392961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99acc66-fbc8-4e69-a349-6aa50fccea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.394068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99acc66-fbc8-4e69-a349-6aa50fccea11 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.394365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99acc66-fbc8-4e69-a349-6aa50fccea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.394649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99acc66-fbc8-4e69-a349-6aa50fccea11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.405721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99acc66-fbc8-4e69-a349-6aa50fccea11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a99acc66-fbc8-4e69-a349-6aa50fccea11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:45.413403 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:45.414302 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:45.415087 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 38/75] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:45.415900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cefba-b4dd-4221-bbae-cbb7fd82ccfc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.416188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cefba-b4dd-4221-bbae-cbb7fd82ccfc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.416476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cefba-b4dd-4221-bbae-cbb7fd82ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.433812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-530cefba-b4dd-4221-bbae-cbb7fd82ccfc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:45.435029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-530cefba-b4dd-4221-bbae-cbb7fd82ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:45.461421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cebf-caf8-48e2-aa68-33d7a688a9fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.498237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.498935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.499178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.499498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.506889 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 39/76] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:45.507798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cefba-b4dd-4221-bbae-cbb7fd82ccfc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.573029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.583795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:45.585270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:45.590584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.615712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cefba-b4dd-4221-bbae-cbb7fd82ccfc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.651418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded4d17-cf70-4823-928a-dbf923acb410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.652313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4d17-cf70-4823-928a-dbf923acb410 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.652603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4d17-cf70-4823-928a-dbf923acb410 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.652886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4d17-cf70-4823-928a-dbf923acb410 None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.669081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded4d17-cf70-4823-928a-dbf923acb410 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:45.670584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded4d17-cf70-4823-928a-dbf923acb410 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:45.672410 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 40/77] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:45.673721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccd8e1-2da6-4d19-989a-a640002deb07 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.674016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccd8e1-2da6-4d19-989a-a640002deb07 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.674303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccd8e1-2da6-4d19-989a-a640002deb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.692390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-17ccd8e1-2da6-4d19-989a-a640002deb07 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:45.693624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-17ccd8e1-2da6-4d19-989a-a640002deb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:45.697731 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 38/78] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:45.697731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.764401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 41/79] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:45.765584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccd8e1-2da6-4d19-989a-a640002deb07 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.790533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.801607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff97188-d6c9-4744-ae1b-36f69445cc05 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.834890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:45.838781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.839992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.840526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.840803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.841558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:45.841866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:45.844631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:45.858826 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 39/80] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:45.858826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.871520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccd8e1-2da6-4d19-989a-a640002deb07 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:45.906306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:45.907140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:45.907483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:45.907739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:45.920004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:45.928293 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:45.929457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 42/81] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:45.930408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:45.967458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372818-0ce5-4474-9654-307aedd09544 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.002859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.003623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.003907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.004186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.029218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.036463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5eaa4-5bdc-447f-bcda-695c1d7ac216 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.062834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.071709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.072579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.072866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.073147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.074372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.074838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.075896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.076361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.077649 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 43/82] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:46.078441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.184487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4cc8-3685-46ea-9f53-ad832df5beac None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.189559 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 40/83] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:46.189559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.240250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.241546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.242031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.242493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.244431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.247566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.250336 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 44/84] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:46.251183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.266410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.311146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1f877-789c-4adb-bb4a-dea1dd08048b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.319185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.354781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.356226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.356515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.356797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.358173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.359685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.359966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b63c51-3919-4525-8be9-c1e1bdc005fd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.361366 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 41/85] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:46.366504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.399257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.399959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.400249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.400541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.401301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:46.401612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.403071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.411429 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 45/86] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:46.412733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.476154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de114a-ec2c-409a-9a9b-0807b2a28483 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.501877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.517444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.518220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.518580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.518932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.519927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=c8378d889c17447db6fd8aa498751f4a) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:46.520325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.521863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.528209 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 42/87] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/role_assignments?user.id=c8378d889c17447db6fd8aa498751f4a&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:46.529024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.557381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20b384-d670-40ac-bf28-bbc8bf3a3c60 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.594272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.612098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.613008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.613365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.613656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.619290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.620958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.628472 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 46/88] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:46.629473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.678391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc6f6b-723b-4edb-95e6-5c89ff9cd67a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.718158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.719145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.719255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.719553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.720282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.721967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.750347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 43/89] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:18:46 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:18:46.750928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:46.764432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c23e1-0992-4c25-8592-585559d7fbb0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.809604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.810256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.810600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.810887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.825654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.894122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:46.907819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.910094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.919019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda834d1-2275-476c-afe3-2cedbe0c594d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:46.971514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:46.972592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:46.972890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:46.973178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:46.978687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:46.978687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:46.980624 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 44/90] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:46.981929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:47.045144 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 47/91] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:47.045763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:47.123783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaadc-eb6d-4aaf-abf6-8944b31b6e24 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:47.139106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:47.169316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:47.169987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:47.170304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:47.170556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:47.171437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=c5e7b7279bcd44ffae1520de252f481d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:47.171759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:47.173227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:47.173727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:47.179484 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 45/92] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:46 2022] GET /identity/v3/role_assignments?user.id=c5e7b7279bcd44ffae1520de252f481d&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=963435a25dbf491c8b345da8e43344c3 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:47.182411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:47.192501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16414831-6e87-46ed-aefd-5bfebeaf400f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:47.278498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:47.280680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:47.282324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:47.284362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:47.382965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c0512-75b8-491e-9e5f-9a3f85dd7d49 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:47.398612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:47.400529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:47.480665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:47.481575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:47.481865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:47.482150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] PATH_INFO: `/v3/projects/a92adcd48c324e7791a0f07cbdde072c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:47.488378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] RBAC: Authorizing `identity:get_project(project_id=a92adcd48c324e7791a0f07cbdde072c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:47.491301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:47.491682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 46/93] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:47 2022] GET /identity/v3/projects/a92adcd48c324e7791a0f07cbdde072c => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:47.503450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:47.547580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:47.563098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 48/94] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:47.569035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:47.657008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:47.742048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3685-616f-433f-9a42-18a63aa56742 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:47.786089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137af045-a04c-4250-a8b8-a27d48312d77 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:47.836037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:47.836951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:47.837242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:47.837528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:47.838806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:47.841153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:47.843115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 49/95] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:47 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:47.849181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:47.853982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b8a3e-826b-4890-8573-aca2fa5ca5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:47.854980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b8a3e-826b-4890-8573-aca2fa5ca5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:47.855493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b8a3e-826b-4890-8573-aca2fa5ca5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:47.855995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b8a3e-826b-4890-8573-aca2fa5ca5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:47.857045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b8a3e-826b-4890-8573-aca2fa5ca5b8 None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=a92adcd48c324e7791a0f07cbdde072c, user.id=c5e7b7279bcd44ffae1520de252f481d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:47.857569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b8a3e-826b-4890-8573-aca2fa5ca5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:47.864701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b8a3e-826b-4890-8573-aca2fa5ca5b8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:47.876123 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 47/96] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:47 2022] GET /identity/v3/role_assignments?user.id=c5e7b7279bcd44ffae1520de252f481d&scope.project.id=a92adcd48c324e7791a0f07cbdde072c&role.id=963435a25dbf491c8b345da8e43344c3 => generated 259 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:47.956923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:48.017598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eccec-0cdf-4144-9eac-d096ecb9edf2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:48.062937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef34b2-fc03-4686-b26f-0d52ae8031a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:48.063960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef34b2-fc03-4686-b26f-0d52ae8031a1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:48.064811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef34b2-fc03-4686-b26f-0d52ae8031a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:48.065517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef34b2-fc03-4686-b26f-0d52ae8031a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:48.066389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef34b2-fc03-4686-b26f-0d52ae8031a1 None admin] RBAC: Adding query filter params (role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=c5e7b7279bcd44ffae1520de252f481d) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:48.066706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef34b2-fc03-4686-b26f-0d52ae8031a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:48.068246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef34b2-fc03-4686-b26f-0d52ae8031a1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:48.082801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 50/97] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:47 2022] GET /identity/v3/role_assignments?user.id=c5e7b7279bcd44ffae1520de252f481d&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:48.792632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae1772-43c8-4d9a-856f-2b8d27f10cca None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:48.793145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae1772-43c8-4d9a-856f-2b8d27f10cca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:48.793496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae1772-43c8-4d9a-856f-2b8d27f10cca None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:48.795443 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 48/98] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:48.800415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6d981-80c5-4709-ae64-b6801cc7beab None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:48.800844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6d981-80c5-4709-ae64-b6801cc7beab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:48.801177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6d981-80c5-4709-ae64-b6801cc7beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:48.825024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-83a6d981-80c5-4709-ae64-b6801cc7beab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:48.826298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-83a6d981-80c5-4709-ae64-b6801cc7beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:48.909375 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 51/99] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:48.944513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae1772-43c8-4d9a-856f-2b8d27f10cca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:49.094483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae1772-43c8-4d9a-856f-2b8d27f10cca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:49.107768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:49.157575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:49.158981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:49.159546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:49.160073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:49.188697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:49.209118 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:49.210043 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:49.210806 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:49.212299 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 49/100] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:18:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:18:49.222062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6d981-80c5-4709-ae64-b6801cc7beab None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:49.322757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:49.431186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6d981-80c5-4709-ae64-b6801cc7beab None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:49.505648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:49.506852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:49.507450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:49.507949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:49.509438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:49.510028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:49.512750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:49.535358 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 52/101] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:49.541855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:49.799535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317ff0d-b739-45e8-b9da-8873b28668bf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:49.858827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca2b4b-2f00-4d08-812d-2dfa66477c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:49.860115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2b4b-2f00-4d08-812d-2dfa66477c30 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:49.860594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2b4b-2f00-4d08-812d-2dfa66477c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:49.861082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2b4b-2f00-4d08-812d-2dfa66477c30 None admin] PATH_INFO: `/v3/users/c8378d889c17447db6fd8aa498751f4a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:49.862499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca2b4b-2f00-4d08-812d-2dfa66477c30 None admin] RBAC: Authorizing `identity:get_user(user_id=c8378d889c17447db6fd8aa498751f4a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:49.864224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca2b4b-2f00-4d08-812d-2dfa66477c30 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:49.867127 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 50/102] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:49 2022] GET /identity/v3/users/c8378d889c17447db6fd8aa498751f4a => generated 247 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:49.877170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:50.021597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e6c1-3d50-4e73-ac51-be5d13e97195 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.022273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e6c1-3d50-4e73-ac51-be5d13e97195 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.022783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e6c1-3d50-4e73-ac51-be5d13e97195 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.024422 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 51/103] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:50.030138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61fd4d-7991-4337-a85d-e39a35896a04 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.030660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61fd4d-7991-4337-a85d-e39a35896a04 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.031152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61fd4d-7991-4337-a85d-e39a35896a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.060436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ee61fd4d-7991-4337-a85d-e39a35896a04 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:50.061955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ee61fd4d-7991-4337-a85d-e39a35896a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:50.105375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:50.192982 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 52/104] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 14:18:50.195080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8edcc0-ee3d-444b-b3fd-0fa90e9f098b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:50.234098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61fd4d-7991-4337-a85d-e39a35896a04 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:50.248997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:50.321927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:50.323263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.324030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.324519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.333181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:50.334995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:50.337399 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 53/105] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:49 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:50.343622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:50.442082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61fd4d-7991-4337-a85d-e39a35896a04 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:50.480905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85248c-002b-4900-957e-c4e0b51e4bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:50.481254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8193f3-a861-470b-b02b-fbe6538cc264 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:50.482166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85248c-002b-4900-957e-c4e0b51e4bae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.482647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85248c-002b-4900-957e-c4e0b51e4bae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.483412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85248c-002b-4900-957e-c4e0b51e4bae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.495039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85248c-002b-4900-957e-c4e0b51e4bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ec85248c-002b-4900-957e-c4e0b51e4bae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:50.503646 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:50.504524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:18:50.505305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:50.507871 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 53/106] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:50.509425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5774-bf08-446c-9c5a-f6d94f724f3c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.509907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5774-bf08-446c-9c5a-f6d94f724f3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.510425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5774-bf08-446c-9c5a-f6d94f724f3c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.512089 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 54/107] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:50.515664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5774-bf08-446c-9c5a-f6d94f724f3c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:50.528347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf219067-a8b7-49d6-8a72-2a4de1ae0e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:50.529702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf219067-a8b7-49d6-8a72-2a4de1ae0e14 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.530002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf219067-a8b7-49d6-8a72-2a4de1ae0e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.530290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf219067-a8b7-49d6-8a72-2a4de1ae0e14 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/c8378d889c17447db6fd8aa498751f4a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.533120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf219067-a8b7-49d6-8a72-2a4de1ae0e14 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef84209ba73f44d5af154b4c3dbe77a8, user_id=c8378d889c17447db6fd8aa498751f4a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:50.534782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf219067-a8b7-49d6-8a72-2a4de1ae0e14 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:50.559354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:50.586305 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 54/108] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:18:50 2022] PUT /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/c8378d889c17447db6fd8aa498751f4a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:18:50.587605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c981-bece-4eda-b57f-21873c68dd52 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.587887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c981-bece-4eda-b57f-21873c68dd52 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.588177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c981-bece-4eda-b57f-21873c68dd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.626828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6d92c981-bece-4eda-b57f-21873c68dd52 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:50.628126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d92c981-bece-4eda-b57f-21873c68dd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:50.670120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5774-bf08-446c-9c5a-f6d94f724f3c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:50.715667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e45f4-3024-4b36-a04d-53ee200c0cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:50.716979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e45f4-3024-4b36-a04d-53ee200c0cbe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.717479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e45f4-3024-4b36-a04d-53ee200c0cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.717989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e45f4-3024-4b36-a04d-53ee200c0cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.719033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e45f4-3024-4b36-a04d-53ee200c0cbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:50.719812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e45f4-3024-4b36-a04d-53ee200c0cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:50.721763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e45f4-3024-4b36-a04d-53ee200c0cbe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:50.733871 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 55/109] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:50.735329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:50.737140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e8e6-725a-4035-86d7-5539e091112f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.737430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e8e6-725a-4035-86d7-5539e091112f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.737518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e8e6-725a-4035-86d7-5539e091112f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.739210 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 56/110] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:50.740221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e8e6-725a-4035-86d7-5539e091112f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:50.772593 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 55/111] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:50.774524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa99e1-6127-4f3c-9efe-c29a1efbff1b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:50.775018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa99e1-6127-4f3c-9efe-c29a1efbff1b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:50.775542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa99e1-6127-4f3c-9efe-c29a1efbff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:50.801662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e9fa99e1-6127-4f3c-9efe-c29a1efbff1b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:50.807431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e9fa99e1-6127-4f3c-9efe-c29a1efbff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:50.903587 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 56/112] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:50.905282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa99e1-6127-4f3c-9efe-c29a1efbff1b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:50.936900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:50.959817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e8e6-725a-4035-86d7-5539e091112f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.005028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:51.007011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.007886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.008481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] PATH_INFO: `/v3/users/e27c24a0e8064a9a93b02eec755bb04a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.032990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=e27c24a0e8064a9a93b02eec755bb04a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:51.035336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:51.038403 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 57/113] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:50 2022] GET /identity/v3/users/e27c24a0e8064a9a93b02eec755bb04a => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:51.039605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:51.102260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa99e1-6127-4f3c-9efe-c29a1efbff1b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.104795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:51.154219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:51.154965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.155375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.155543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.156770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:51.158270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:51.159982 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 57/114] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:51.164595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:51.165027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0591ed-bb7e-4692-98db-0adc7bf71cf5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.218274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7428-b0db-4c70-abc1-1145358eed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:51.219221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7428-b0db-4c70-abc1-1145358eed44 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.219623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7428-b0db-4c70-abc1-1145358eed44 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.219935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7428-b0db-4c70-abc1-1145358eed44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.236636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7428-b0db-4c70-abc1-1145358eed44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0a3c7428-b0db-4c70-abc1-1145358eed44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:51.246756 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:51.247693 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:51.248478 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:51.251573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 58/115] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:51.253375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa20042-0f64-41e7-9ea6-e394d0da0a28 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.254321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa20042-0f64-41e7-9ea6-e394d0da0a28 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.254834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa20042-0f64-41e7-9ea6-e394d0da0a28 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.256936 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 59/116] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:51.258294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa20042-0f64-41e7-9ea6-e394d0da0a28 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:51.262912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:51.311665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49233a93-3717-4625-84ae-2ae57d85b257 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.350659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012940f-58df-472f-93cd-5beb96855002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:51.351397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012940f-58df-472f-93cd-5beb96855002 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.351686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012940f-58df-472f-93cd-5beb96855002 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.351966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012940f-58df-472f-93cd-5beb96855002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.386717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa20042-0f64-41e7-9ea6-e394d0da0a28 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.395897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:51.426802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012940f-58df-472f-93cd-5beb96855002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:51.428302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012940f-58df-472f-93cd-5beb96855002 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:51.429201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:51.430190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.430645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.431188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.432125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:51.433810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:51.463554 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 60/117] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:18:51 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:18:51.472673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:51.547019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:51.556832 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 58/118] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:51.558969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbde38-7917-45c4-a137-f28273614a67 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.559262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbde38-7917-45c4-a137-f28273614a67 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.559581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbde38-7917-45c4-a137-f28273614a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.577580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-69dbde38-7917-45c4-a137-f28273614a67 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:51.579127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69dbde38-7917-45c4-a137-f28273614a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:51.606138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32830b55-8d54-4f35-befd-cc4506cfa9eb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.649995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:51.651312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.651312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.651312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.652716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:51.653032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:51.654654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:51.662446 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 59/119] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:51.663640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcf08a-57a5-49b0-b8a0-ae35bb109604 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.663982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcf08a-57a5-49b0-b8a0-ae35bb109604 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.664268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcf08a-57a5-49b0-b8a0-ae35bb109604 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.664912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 61/120] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:51.665754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:51.665860 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 60/121] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:51.672263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a682-d367-4f7c-9d07-cd7c15499ac1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.672555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a682-d367-4f7c-9d07-cd7c15499ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.672841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a682-d367-4f7c-9d07-cd7c15499ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.678029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:51.695901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-39d0a682-d367-4f7c-9d07-cd7c15499ac1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:51.697283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-39d0a682-d367-4f7c-9d07-cd7c15499ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:51.789964 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 61/122] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:51.791334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a682-d367-4f7c-9d07-cd7c15499ac1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:51.800052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e96f8-d6d5-46f6-af0a-a54ee4552a2c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.831147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:51.855602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:51.856562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:51.856901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:51.857189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:51.858943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:51.860480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:51.862686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 62/123] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:51 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:51.863507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:51.939709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a682-d367-4f7c-9d07-cd7c15499ac1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:51.992740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ff672-1731-46cd-8c47-850ead2717b6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.001076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:52.012922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.014858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.015934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.017372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.020239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:52.023709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:52.028210 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 62/124] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:51 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:52.030018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.031233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.032183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.032546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.032956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.048862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:52.059200 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:52.060139 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 63/125] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:52.065778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.123582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:52.172160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f361bf3-5a3d-4a77-8cf7-8f12155cafa7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.188948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa5e-a464-4b8a-99b7-cfdc1a49bc1d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.217610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.218655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.219052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.219551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.231863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.232824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.233449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.233912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.234425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:52.235141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] RBAC: Adding query filter params (role.id=48feeeecfc894491b5070d387fe04c8a, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=e27c24a0e8064a9a93b02eec755bb04a) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:52.235645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:52.237297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:52.243055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:52.244124 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:18:52.244900 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:52.250236 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 63/126] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:52.251249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.255093 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 64/127] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/role_assignments?user.id=e27c24a0e8064a9a93b02eec755bb04a&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=48feeeecfc894491b5070d387fe04c8a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:52.256337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.362375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:52.415979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7a641-e20c-4f77-bc78-4147f192e6a2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.461939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.463843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.465184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.465690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.467451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:52.470162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:52.472282 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 64/128] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:52.473476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.488170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b695-005e-4c37-b6b6-861919b543d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.502942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:52.529761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.530812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.530812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.531177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.532054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:52.532402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:52.533962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:52.544168 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 65/129] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:52.548362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.616142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2fd1a-c98e-4c45-bf3a-99d4daf75273 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.648877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:52.660737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.662215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.662788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.663447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.664562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:52.665135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:52.668818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:52.680378 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 65/130] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:52.681672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.754401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c1e1-c76c-48f0-9dcc-6e1d1feeba91 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.803956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74191-e60b-4ce8-b874-62da6cae6776 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:52.847063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.848031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.848323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.848611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/c5e7b7279bcd44ffae1520de252f481d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.849785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:52.850891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:52.851432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:52.851903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:52.853432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:52.854605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef84209ba73f44d5af154b4c3dbe77a8, user_id=c5e7b7279bcd44ffae1520de252f481d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:52.855425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:52.856102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:52.857513 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 66/131] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:52.859156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.887720 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 66/132] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:18:52 2022] PUT /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/c5e7b7279bcd44ffae1520de252f481d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:18:52.888374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:52.935166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:52.963192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:53.000958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4b25-3571-47b2-94d9-46409149c5d2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:53.077309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:53.080611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.081126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.082343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.085243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:53.087115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:53.089599 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 67/133] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:53.095834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:53.115653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28dac4-e055-4e99-86d6-f5ad227e0bb4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:53.189452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:53.190350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.190637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.190918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] PATH_INFO: `/v3/projects/a92adcd48c324e7791a0f07cbdde072c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.193948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] RBAC: Authorizing `identity:get_project(project_id=a92adcd48c324e7791a0f07cbdde072c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:53.195481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:53.199002 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 67/134] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:52 2022] GET /identity/v3/projects/a92adcd48c324e7791a0f07cbdde072c => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:53.205159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:53.283156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40428-0fbd-4cd3-97d0-6692a7c46e04 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:53.332341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:53.344700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0074d4-5959-46d7-a1d5-6d91fee53368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:53.346176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0074d4-5959-46d7-a1d5-6d91fee53368 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.346658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0074d4-5959-46d7-a1d5-6d91fee53368 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.347160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0074d4-5959-46d7-a1d5-6d91fee53368 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.348867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0074d4-5959-46d7-a1d5-6d91fee53368 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:53.350627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0074d4-5959-46d7-a1d5-6d91fee53368 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:53.353255 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 68/135] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:53 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:53.355551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37dde5-cb02-4b1f-9e22-c30645dc9766 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.356064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37dde5-cb02-4b1f-9e22-c30645dc9766 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.356533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37dde5-cb02-4b1f-9e22-c30645dc9766 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.358531 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 69/136] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:53.363544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37dde5-cb02-4b1f-9e22-c30645dc9766 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:53.421741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:53.426615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb055d-fa42-4168-8b14-17b619488a81 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:53.501205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e944a01-5307-47ed-899c-ae6101f80e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:53.502123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e944a01-5307-47ed-899c-ae6101f80e8a None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.502413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e944a01-5307-47ed-899c-ae6101f80e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.502698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e944a01-5307-47ed-899c-ae6101f80e8a None admin] PATH_INFO: `/v3/projects/a92adcd48c324e7791a0f07cbdde072c/users/c5e7b7279bcd44ffae1520de252f481d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.504945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e944a01-5307-47ed-899c-ae6101f80e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=a92adcd48c324e7791a0f07cbdde072c, user_id=c5e7b7279bcd44ffae1520de252f481d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:53.506421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e944a01-5307-47ed-899c-ae6101f80e8a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:53.530993 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 68/137] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:18:53 2022] PUT /identity/v3/projects/a92adcd48c324e7791a0f07cbdde072c/users/c5e7b7279bcd44ffae1520de252f481d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:18:53.533277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1f1b-5b38-4789-83d4-162ef1db06d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.534667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1f1b-5b38-4789-83d4-162ef1db06d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.534976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1f1b-5b38-4789-83d4-162ef1db06d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.568817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70ca1f1b-5b38-4789-83d4-162ef1db06d7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:53.570686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37dde5-cb02-4b1f-9e22-c30645dc9766 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:53.574175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70ca1f1b-5b38-4789-83d4-162ef1db06d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:53.654807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:53.655758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.656047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.656327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/c5e7b7279bcd44ffae1520de252f481d/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.667849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef84209ba73f44d5af154b4c3dbe77a8, user_id=c5e7b7279bcd44ffae1520de252f481d, role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:53.669379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:53.704497 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 70/138] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:18:53 2022] PUT /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/c5e7b7279bcd44ffae1520de252f481d/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:18:53.716733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 69/139] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:53.744364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:53.822167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:53.883689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4cc98-04ea-4a1b-be81-d47c801cdf64 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:53.924380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:53.924380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:53.924771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:53.925010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:53.939416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:53.947209 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:53.948867 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:53.950259 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 71/140] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:53.954934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca1f1b-5b38-4789-83d4-162ef1db06d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:54.052902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:54.063081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca1f1b-5b38-4789-83d4-162ef1db06d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:54.100760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:54.101441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:54.101733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:54.102016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:54.102776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:54.103089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:54.104607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:54.113191 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 70/141] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:54.118970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:54.260024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4f0fa-d35c-42b6-91a6-82e6720b2f9c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:54.282143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:54.307050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a364a2-52de-4692-9fd0-463b97a96343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:54.308242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a364a2-52de-4692-9fd0-463b97a96343 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:54.308669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a364a2-52de-4692-9fd0-463b97a96343 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:54.309103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a364a2-52de-4692-9fd0-463b97a96343 None admin] PATH_INFO: `/v3/users/c8378d889c17447db6fd8aa498751f4a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:54.310466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a364a2-52de-4692-9fd0-463b97a96343 None admin] RBAC: Authorizing `identity:get_user(user_id=c8378d889c17447db6fd8aa498751f4a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:54.312335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a364a2-52de-4692-9fd0-463b97a96343 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:54.314154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 72/142] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:54 2022] GET /identity/v3/users/c8378d889c17447db6fd8aa498751f4a => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:54.319894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:54.475671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43aaa8-efe5-49f7-9537-0fabe3d1d7b3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:54.490907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2e4d-d74f-416c-9bec-c0b33916c55f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:54.491603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2e4d-d74f-416c-9bec-c0b33916c55f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:54.492081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2e4d-d74f-416c-9bec-c0b33916c55f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:54.493763 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 73/143] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:54.507083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ca67-4d02-4dfc-8440-95267a65212e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:54.507714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ca67-4d02-4dfc-8440-95267a65212e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:54.508211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ca67-4d02-4dfc-8440-95267a65212e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:54.518271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:54.518917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:54.519214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:54.519533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:54.545295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:54.548813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e279ca67-4d02-4dfc-8440-95267a65212e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:54.550033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e279ca67-4d02-4dfc-8440-95267a65212e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:54.643127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:54.644993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:54.704778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 74/144] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:18:54.750073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ca67-4d02-4dfc-8440-95267a65212e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:54.764020 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 71/145] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:54.769521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:54.859766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ca67-4d02-4dfc-8440-95267a65212e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:54.877107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:54.890880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:54.900728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:54.902297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:54.902693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:54.903123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:54.904558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:54.906340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:54.908615 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 75/146] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:18:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:54.914214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:55.022740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3af0df-56da-4ccd-8de8-0fd0d0f4fcd9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:55.064101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:55.065367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:55.065780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:55.066165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:55.067848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:55.069443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:55.072017 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 72/147] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:54 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:55.078577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:55.094468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77b4ec-ddb1-465b-8a78-848b90465663 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:55.164652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac3e8-478d-40dd-8111-c9a41654b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:55.166172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac3e8-478d-40dd-8111-c9a41654b2c0 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:55.166463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac3e8-478d-40dd-8111-c9a41654b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:55.166743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac3e8-478d-40dd-8111-c9a41654b2c0 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:55.168041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fac3e8-478d-40dd-8111-c9a41654b2c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:55.169524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fac3e8-478d-40dd-8111-c9a41654b2c0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:55.208515 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 76/148] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:18:54 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:18:55.210841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0167b-909b-4a70-8ac9-3fd8fb8e0ff7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:55.211132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0167b-909b-4a70-8ac9-3fd8fb8e0ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:55.211444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0167b-909b-4a70-8ac9-3fd8fb8e0ff7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:55.221685 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 77/149] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:55.228574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205d9b6-38f9-487b-bec6-ebf440b75ad7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:55.228868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205d9b6-38f9-487b-bec6-ebf440b75ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:55.229141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205d9b6-38f9-487b-bec6-ebf440b75ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:55.235238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2894093-38e2-4d7e-9c86-235789b46d83 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:55.271577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e205d9b6-38f9-487b-bec6-ebf440b75ad7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:55.271577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e205d9b6-38f9-487b-bec6-ebf440b75ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:55.299799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:55.338459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:55.339259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:55.339518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:55.340064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:55.340946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=c8378d889c17447db6fd8aa498751f4a) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:55.342040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:55.343655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:55.357015 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 73/150] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:55 2022] GET /identity/v3/role_assignments?user.id=c8378d889c17447db6fd8aa498751f4a&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:55.371695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:55.447871 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 78/151] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:55.473502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:55.641679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e26c-e816-43b1-80fe-ea6180b6b95e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:55.683912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:55.684729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:55.685016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:55.685300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:55.696087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:55.704034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:55.704989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:55.705954 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 74/152] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:55.711289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205d9b6-38f9-487b-bec6-ebf440b75ad7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:55.848230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205d9b6-38f9-487b-bec6-ebf440b75ad7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:55.889863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:55.890558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:55.890841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:55.891118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:55.891959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:55.892216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:55.893610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:55.904834 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 79/153] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:55.910455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:55.975671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:56.046290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94d6f-c63c-43ee-bc88-e40eaa5ca115 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:56.088179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542e3d7-1041-4d38-afe7-1ed0751fc278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:56.089882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542e3d7-1041-4d38-afe7-1ed0751fc278 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.090213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542e3d7-1041-4d38-afe7-1ed0751fc278 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.090500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542e3d7-1041-4d38-afe7-1ed0751fc278 None admin] PATH_INFO: `/v3/users/e27c24a0e8064a9a93b02eec755bb04a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.091810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542e3d7-1041-4d38-afe7-1ed0751fc278 None admin] RBAC: Authorizing `identity:get_user(user_id=e27c24a0e8064a9a93b02eec755bb04a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:56.093382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542e3d7-1041-4d38-afe7-1ed0751fc278 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:56.095170 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 75/154] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:55 2022] GET /identity/v3/users/e27c24a0e8064a9a93b02eec755bb04a => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:56.100946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:56.149132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:56.208660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930b4d-20fd-48b6-bbb3-5218a47449b6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.208952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930b4d-20fd-48b6-bbb3-5218a47449b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.209396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930b4d-20fd-48b6-bbb3-5218a47449b6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.211030 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 76/155] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:18:56.217337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409cdd-c35b-46b2-b449-64ccf3c6b89c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.218024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409cdd-c35b-46b2-b449-64ccf3c6b89c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.218507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409cdd-c35b-46b2-b449-64ccf3c6b89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.252217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-95409cdd-c35b-46b2-b449-64ccf3c6b89c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:56.253422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95409cdd-c35b-46b2-b449-64ccf3c6b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:56.274589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75193c9c-eb18-438e-8e5f-631873b9c84a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:56.346671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:56.347579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.347861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.348134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.349655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:56.351487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:56.356199 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 80/156] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:56 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:56.364300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:56.384711 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 77/157] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:18:56.411738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95409cdd-c35b-46b2-b449-64ccf3c6b89c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:56.503657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:56.555541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:56.581560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce058eb5-54df-4ac2-897d-51e48096336a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:56.595909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95409cdd-c35b-46b2-b449-64ccf3c6b89c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:56.634441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:56.635710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.636625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.637040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/e27c24a0e8064a9a93b02eec755bb04a/roles/48feeeecfc894491b5070d387fe04c8a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.639282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] RBAC: Authorizing `identity:create_grant(project_id=ef84209ba73f44d5af154b4c3dbe77a8, user_id=e27c24a0e8064a9a93b02eec755bb04a, role_id=48feeeecfc894491b5070d387fe04c8a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:56.642298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:56.652434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e0034-db5e-4add-8242-e1badba67024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:56.653381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e0034-db5e-4add-8242-e1badba67024 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.653672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e0034-db5e-4add-8242-e1badba67024 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.653949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e0034-db5e-4add-8242-e1badba67024 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.664622 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 81/158] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:18:56 2022] PUT /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/users/e27c24a0e8064a9a93b02eec755bb04a/roles/48feeeecfc894491b5070d387fe04c8a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:18:56.676094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e0034-db5e-4add-8242-e1badba67024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5b6e0034-db5e-4add-8242-e1badba67024 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:56.692626 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:56.693696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:56.694609 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 78/159] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:18:56.700569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:56.766686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fd281-b546-4a7f-b792-bb71443e2725 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.766981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fd281-b546-4a7f-b792-bb71443e2725 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.767286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fd281-b546-4a7f-b792-bb71443e2725 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.769054 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 79/160] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:56.775123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3192-6126-45d1-837a-aab77c82030b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.775442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3192-6126-45d1-837a-aab77c82030b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.775731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3192-6126-45d1-837a-aab77c82030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.812480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2cec3192-6126-45d1-837a-aab77c82030b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:56.813712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cec3192-6126-45d1-837a-aab77c82030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:56.872561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec301b-a1f0-4859-a7fa-d7c4af4804fc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:56.895413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 80/161] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:56.897019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602672-8364-407e-8a8c-f4a280bd7c56 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.897487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602672-8364-407e-8a8c-f4a280bd7c56 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.897922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602672-8364-407e-8a8c-f4a280bd7c56 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.899555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 81/162] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:56.916551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790204-b111-45d8-b9f6-d7db974eb73b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.917571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790204-b111-45d8-b9f6-d7db974eb73b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.918006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790204-b111-45d8-b9f6-d7db974eb73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.939160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:56.944077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:56.944380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:56.944669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:56.945462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:56.945779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:56.947194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:56.960421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0d790204-b111-45d8-b9f6-d7db974eb73b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:56.961624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d790204-b111-45d8-b9f6-d7db974eb73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:56.969524 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 82/163] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:56.969763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:57.012484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:57.021295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:57.108967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 82/164] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:57.109856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790204-b111-45d8-b9f6-d7db974eb73b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:57.188793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89669c-02d3-40e1-99fd-36c168123134 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:57.256775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790204-b111-45d8-b9f6-d7db974eb73b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:57.288154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:57.288978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:57.289267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:57.289552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:57.299585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:57.300966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:57.301351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:57.301705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:57.303161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:57.304744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:57.306707 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 83/165] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:57 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:57.307374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:57.322476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:57.330972 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:57.331937 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:18:57.332721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:18:57.334220 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 83/166] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:57.334220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:57.387660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:57.480042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795a8a-3986-4953-8fae-091febcd224e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:57.508215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:57.551310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14e968-e29f-42c4-9a73-630d359b26b6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:57.564521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28663296-ab20-4747-8817-d092517f6617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:57.565363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28663296-ab20-4747-8817-d092517f6617 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:57.565650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28663296-ab20-4747-8817-d092517f6617 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:57.565934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28663296-ab20-4747-8817-d092517f6617 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:57.588932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28663296-ab20-4747-8817-d092517f6617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-28663296-ab20-4747-8817-d092517f6617 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:57.601189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:57.602334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:18:57.603314 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:57.606255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 84/167] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:18:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:57.607147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28663296-ab20-4747-8817-d092517f6617 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:57.629580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:57.630259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:57.630544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:57.630821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:57.761173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:57.762571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:57.795823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:57.813246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28663296-ab20-4747-8817-d092517f6617 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:57.876483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:57.877160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:57.877447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:57.877726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:57.878478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:57.878789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:57.883290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:57.889524 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 85/168] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:18:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:57.890134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:57.931103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:58.003971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abf46f-fc4b-4951-95b9-f57ed815f1ef None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:58.019143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 84/169] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:58.022224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:58.044514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:58.045561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:58.046018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:58.046482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:58.047455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:58.047938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:58.049743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:58.059142 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 86/170] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:18:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:58.060203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:58.077897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:58.176005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7a26d-3bb4-456a-8647-c2648b94bb5b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:58.253709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38f68-6441-4188-9e7e-0040a9faa502 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:58.258163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:58.259943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:58.265837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:58.266319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:58.271165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:58.271165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:58.271165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 87/171] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:58 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:58.273118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:58.331772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:58.334167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:58.334456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:58.334738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:58.339842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:58.344138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:58.345939 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 85/172] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:58 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:58.346733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:58.415645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:58.435193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c430fc8-d1ec-4b52-aefc-cd9acb9ffbf7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:58.450756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:58.472780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:58.474010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:58.474473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:58.474892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] PATH_INFO: `/v3/users/c5e7b7279bcd44ffae1520de252f481d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:58.476339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e7b7279bcd44ffae1520de252f481d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:58.477975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:58.480472 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 88/173] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:58 2022] GET /identity/v3/users/c5e7b7279bcd44ffae1520de252f481d => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:58.481480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:58.558509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db706-19e7-40d3-8e9b-4716a803e46d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:58.597548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6acaa-c7d4-4176-9036-28df2b6b2e10 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:58.631766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:58.632432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:58.632716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:58.632991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:58.633831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=c5e7b7279bcd44ffae1520de252f481d) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:58.634140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:58.636381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:58.636930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:58.637750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:58.638180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:58.638920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:58.651866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 86/174] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:58 2022] GET /identity/v3/role_assignments?user.id=c5e7b7279bcd44ffae1520de252f481d&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=963435a25dbf491c8b345da8e43344c3 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:58.652987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:58.665192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:58.770663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:58.772206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:58.909263 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 89/175] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:58.915136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:58.937350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab2493-cba7-4a64-bd82-6d890682ba39 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:58.967678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:58.982197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:59.034480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819ba6-411d-4c44-aa2b-4dbbe884dc23 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:59.036025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:59.036723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.037030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.037307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.073743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:59.074906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.075386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.075822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] PATH_INFO: `/v3/projects/a92adcd48c324e7791a0f07cbdde072c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.077260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=a92adcd48c324e7791a0f07cbdde072c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:59.079802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:59.082202 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 90/176] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:58 2022] GET /identity/v3/projects/a92adcd48c324e7791a0f07cbdde072c => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:59.089353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:59.148153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:59.150134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:59.202005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5ef1-6c5b-49d2-87ba-e1921456f4b8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:59.220802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:59.238439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188729a9-5912-416a-b91e-748ccdb01453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:59.239395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188729a9-5912-416a-b91e-748ccdb01453 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.239827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188729a9-5912-416a-b91e-748ccdb01453 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.240281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188729a9-5912-416a-b91e-748ccdb01453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.241273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188729a9-5912-416a-b91e-748ccdb01453 None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=a92adcd48c324e7791a0f07cbdde072c, user.id=c5e7b7279bcd44ffae1520de252f481d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:59.241733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188729a9-5912-416a-b91e-748ccdb01453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:59.243566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188729a9-5912-416a-b91e-748ccdb01453 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:59.250410 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 91/177] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:59 2022] GET /identity/v3/role_assignments?user.id=c5e7b7279bcd44ffae1520de252f481d&scope.project.id=a92adcd48c324e7791a0f07cbdde072c&role.id=963435a25dbf491c8b345da8e43344c3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:59.252768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfbe8a-1caf-4fc6-a4cb-653fbb53f826 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.253265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfbe8a-1caf-4fc6-a4cb-653fbb53f826 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.253748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfbe8a-1caf-4fc6-a4cb-653fbb53f826 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.255308 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 92/178] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:59.261320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61203-60a6-4502-9bda-bdfde5289353 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.261970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61203-60a6-4502-9bda-bdfde5289353 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.262471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61203-60a6-4502-9bda-bdfde5289353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.282055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-34e61203-60a6-4502-9bda-bdfde5289353 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:59.285369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34e61203-60a6-4502-9bda-bdfde5289353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:59.292902 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 87/179] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:18:59.299358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:59.316948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:59.367371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 93/180] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:59.413474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e61203-60a6-4502-9bda-bdfde5289353 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:59.496160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59be3-58cd-467a-bf1c-8bb913892b50 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:59.560138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:59.561269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.561702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.562145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.563689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:59.565521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:59.567490 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 88/181] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:18:59 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:59.573474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e61203-60a6-4502-9bda-bdfde5289353 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:59.575021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:59.597018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:59.622781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:59.624009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.627403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.627934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.646671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:18:59.656507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:18:59.657432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:18:59.658236 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:18:59.660892 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 94/182] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:18:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:18:59.667749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:59.723042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:18:59.751907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4189b5-6d3e-4476-879d-908abe3c4362 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:59.803015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfc4c0-5195-44ee-8a67-1bd8bb091117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:59.804176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc4c0-5195-44ee-8a67-1bd8bb091117 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.804671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc4c0-5195-44ee-8a67-1bd8bb091117 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.805157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc4c0-5195-44ee-8a67-1bd8bb091117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.807395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc4c0-5195-44ee-8a67-1bd8bb091117 None admin] RBAC: Adding query filter params (role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=c5e7b7279bcd44ffae1520de252f481d) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:59.808461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc4c0-5195-44ee-8a67-1bd8bb091117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:59.810538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc4c0-5195-44ee-8a67-1bd8bb091117 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:59.819595 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 89/183] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:18:59 2022] GET /identity/v3/role_assignments?user.id=c5e7b7279bcd44ffae1520de252f481d&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:18:59.821210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c889f3-f6c4-40ad-b539-90c5495fa17e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.821701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c889f3-f6c4-40ad-b539-90c5495fa17e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.822145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c889f3-f6c4-40ad-b539-90c5495fa17e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.823712 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 90/184] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:59.835016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa04fab-dc3f-4876-954a-8ee3b81f8091 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.835607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa04fab-dc3f-4876-954a-8ee3b81f8091 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.836098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa04fab-dc3f-4876-954a-8ee3b81f8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.871968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-daa04fab-dc3f-4876-954a-8ee3b81f8091 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:18:59.873631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-daa04fab-dc3f-4876-954a-8ee3b81f8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:18:59.884901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f14f38-b6a1-4ee8-908e-8baa663c47c1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:18:59.942544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5b967-ecdd-410d-9a6f-b7187192daf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:18:59.943255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b967-ecdd-410d-9a6f-b7187192daf3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.943735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b967-ecdd-410d-9a6f-b7187192daf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.944796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b967-ecdd-410d-9a6f-b7187192daf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.945747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5b967-ecdd-410d-9a6f-b7187192daf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:18:59.946210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5b967-ecdd-410d-9a6f-b7187192daf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:18:59.949266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5b967-ecdd-410d-9a6f-b7187192daf3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:18:59.963491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 95/185] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:18:59.966246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8cc6f-18bb-4610-9a74-508d436c3627 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.966847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8cc6f-18bb-4610-9a74-508d436c3627 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.967302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8cc6f-18bb-4610-9a74-508d436c3627 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:18:59.969517 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 96/186] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:18:59.970462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8cc6f-18bb-4610-9a74-508d436c3627 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:18:59.986449 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 91/187] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:18:59.988486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ceac8-ac8a-48cc-bf25-d7fae96a0c2d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:18:59.988827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ceac8-ac8a-48cc-bf25-d7fae96a0c2d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:18:59.989117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ceac8-ac8a-48cc-bf25-d7fae96a0c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.013086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-532ceac8-ac8a-48cc-bf25-d7fae96a0c2d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:00.015043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-532ceac8-ac8a-48cc-bf25-d7fae96a0c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:00.019742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.102015 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 92/188] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:00.103664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ceac8-ac8a-48cc-bf25-d7fae96a0c2d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.106713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.108536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8cc6f-18bb-4610-9a74-508d436c3627 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.153198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.154446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.154932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.155485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] PATH_INFO: `/v3/users/b2e2a5fe5000408aa06ea2c860e4d733` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.174220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e2a5fe5000408aa06ea2c860e4d733)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:00.176199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:00.178298 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 97/189] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:18:59 2022] GET /identity/v3/users/b2e2a5fe5000408aa06ea2c860e4d733 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:00.179476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.230487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ceac8-ac8a-48cc-bf25-d7fae96a0c2d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.267024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.267886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.268176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.268458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.269724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:00.271329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:00.272963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 93/190] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:00.275566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.292564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.302338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535df891-c2cf-43a2-aca9-b96345196726 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.338387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191febd-b072-4e04-b1f7-7f554d49fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.339219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191febd-b072-4e04-b1f7-7f554d49fd9e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.339783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191febd-b072-4e04-b1f7-7f554d49fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.340064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191febd-b072-4e04-b1f7-7f554d49fd9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.350492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191febd-b072-4e04-b1f7-7f554d49fd9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:00.351010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c191febd-b072-4e04-b1f7-7f554d49fd9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:00.358968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:00.359964 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 98/191] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:00.362719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f31d-3509-4d91-8ab6-e868d0c781f0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.365783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f31d-3509-4d91-8ab6-e868d0c781f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.365783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f31d-3509-4d91-8ab6-e868d0c781f0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.365783 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 99/192] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:00.365783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2f31d-3509-4d91-8ab6-e868d0c781f0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.390312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d552-c5e5-4d10-ae53-0c59a9974ec2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.424980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc172b73-2d39-48a5-bc7b-b170f57f8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.425638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc172b73-2d39-48a5-bc7b-b170f57f8326 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.425923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc172b73-2d39-48a5-bc7b-b170f57f8326 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.426226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc172b73-2d39-48a5-bc7b-b170f57f8326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.468292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2f31d-3509-4d91-8ab6-e868d0c781f0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.497173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc172b73-2d39-48a5-bc7b-b170f57f8326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:00.498664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc172b73-2d39-48a5-bc7b-b170f57f8326 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:00.503752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.504439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.504727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.505006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.505728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:00.507197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:00.528154 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 100/193] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:00 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:00.528894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.540758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.608920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.655440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 94/194] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:00.655440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035fbc3-e229-4aca-a144-9c83c58fc447 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.655440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035fbc3-e229-4aca-a144-9c83c58fc447 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.655440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035fbc3-e229-4aca-a144-9c83c58fc447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.671624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e035fbc3-e229-4aca-a144-9c83c58fc447 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:00.672074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da7230-e4f7-4521-b74f-3a437054c964 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.672837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e035fbc3-e229-4aca-a144-9c83c58fc447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:00.715367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.715793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.716089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.716375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.717924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:00.717924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:00.718853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:00.731391 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 101/195] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:00.732691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.763152 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 95/196] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:00.764286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035fbc3-e229-4aca-a144-9c83c58fc447 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.824175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.863048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a965392-f3c2-4b26-b081-78120939291e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.908496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.909429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.909752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.910039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.911455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:00.913380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:00.915166 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 102/197] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:00.916071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:00.922066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:00.926646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035fbc3-e229-4aca-a144-9c83c58fc447 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:00.967535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:00.968552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:00.968839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:00.969118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] PATH_INFO: `/v3/users/b2e2a5fe5000408aa06ea2c860e4d733` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:00.970378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e2a5fe5000408aa06ea2c860e4d733)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:00.971895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:00.973771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 96/198] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/users/b2e2a5fe5000408aa06ea2c860e4d733 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:00.974431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:01.086517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f5c0d-5da1-453c-a703-c29857872c6d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:01.103592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9670ee-943b-4377-8f1d-a4881be0dad6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:01.134123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:01.135967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:01.136262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:01.136538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:01.146427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:01.155510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:01.162014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:01.162689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:01.162974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:01.163253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:01.164121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=b2e2a5fe5000408aa06ea2c860e4d733) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:01.164432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:01.165321 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:01.166381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:01.167976 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:01.168605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:01.173048 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 97/199] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/role_assignments?user.id=b2e2a5fe5000408aa06ea2c860e4d733&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:01.173953 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 103/200] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:01.174078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:01.180217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:01.221151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:01.332504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c273a3-f115-4465-8903-5b7f7f638908 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:01.352946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfeca8b-2c7d-4428-8259-ffc2b5816464 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:01.391447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:01.392243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:01.392536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:01.392812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:01.415475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:01.416416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:01.417098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:01.417486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:01.418499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:01.418922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:01.420623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:01.442824 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 104/201] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:01.449260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:01.514067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:01.515945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:01.570420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:01.643634 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 98/202] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:01.656994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:01.658368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:01.744198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb489-900a-42d8-8440-c96105437774 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:01.788559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2f87-36c1-46b6-82a4-c2ebefcff36c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:01.812911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0208596-0269-42b8-999c-e823193a047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:01.814185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0208596-0269-42b8-999c-e823193a047f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:01.814672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0208596-0269-42b8-999c-e823193a047f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:01.815147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0208596-0269-42b8-999c-e823193a047f None admin] PATH_INFO: `/v3/users/e27c24a0e8064a9a93b02eec755bb04a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:01.820029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0208596-0269-42b8-999c-e823193a047f None admin] RBAC: Authorizing `identity:get_user(user_id=e27c24a0e8064a9a93b02eec755bb04a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:01.821768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0208596-0269-42b8-999c-e823193a047f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:01.824671 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 105/203] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:01 2022] GET /identity/v3/users/e27c24a0e8064a9a93b02eec755bb04a => generated 289 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:01.824947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:01.829423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:01.830583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:01.831051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:01.831539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:01.831960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0208596-0269-42b8-999c-e823193a047f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:01.833410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:01.835069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:01.837549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 99/204] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:01 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:01.848630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:02.001912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0208596-0269-42b8-999c-e823193a047f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:02.035831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:02.050154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:02.051184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:02.051699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:02.053750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:02.060951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09350f-186e-4c63-a934-abebc5e8e385 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:02.164038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:02.164739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:02.165028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:02.165313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:02.166166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] RBAC: Adding query filter params (role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=b2e2a5fe5000408aa06ea2c860e4d733) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:02.166512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:02.168137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:02.176043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:02.177896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:02.189472 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 100/205] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:01 2022] GET /identity/v3/role_assignments?user.id=b2e2a5fe5000408aa06ea2c860e4d733&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:02.297032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 106/206] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:02.304488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:02.399730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:02.441775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7c42-d1ec-4e70-b9c0-6d09767748a6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:02.478429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4230e-71e6-4350-ae34-2ffd53244e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:02.479908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4230e-71e6-4350-ae34-2ffd53244e7b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:02.480200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4230e-71e6-4350-ae34-2ffd53244e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:02.480484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4230e-71e6-4350-ae34-2ffd53244e7b None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:02.481746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4230e-71e6-4350-ae34-2ffd53244e7b None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:02.483258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4230e-71e6-4350-ae34-2ffd53244e7b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:02.485021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 101/207] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:02 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:02.491120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:02.536496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:02.627088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03792e-289e-49b8-8467-939daa48236c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:02.683171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57dd6d-79fa-4a16-9d99-96860b0cac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:02.683902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57dd6d-79fa-4a16-9d99-96860b0cac5a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:02.684186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57dd6d-79fa-4a16-9d99-96860b0cac5a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:02.684467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57dd6d-79fa-4a16-9d99-96860b0cac5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:02.685319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57dd6d-79fa-4a16-9d99-96860b0cac5a None admin] RBAC: Adding query filter params (role.id=48feeeecfc894491b5070d387fe04c8a, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8, user.id=e27c24a0e8064a9a93b02eec755bb04a) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:02.685636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57dd6d-79fa-4a16-9d99-96860b0cac5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:02.687390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57dd6d-79fa-4a16-9d99-96860b0cac5a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:02.694793 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 107/208] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:02 2022] GET /identity/v3/role_assignments?user.id=e27c24a0e8064a9a93b02eec755bb04a&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=48feeeecfc894491b5070d387fe04c8a => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:03.046586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c16cb-8122-41be-b79f-ffe090372018 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.047098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c16cb-8122-41be-b79f-ffe090372018 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.047173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c16cb-8122-41be-b79f-ffe090372018 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.048713 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 102/209] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:03.053814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6affc0-b717-4d86-99c6-1300d375aef6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.054229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6affc0-b717-4d86-99c6-1300d375aef6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.054378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6affc0-b717-4d86-99c6-1300d375aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.074068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e6affc0-b717-4d86-99c6-1300d375aef6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:03.075315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e6affc0-b717-4d86-99c6-1300d375aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:03.161237 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 108/210] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:03.184848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c16cb-8122-41be-b79f-ffe090372018 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:03.259791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e337ad2-52b9-41f1-baa2-f813a6c67c91 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.260122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e337ad2-52b9-41f1-baa2-f813a6c67c91 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.260390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e337ad2-52b9-41f1-baa2-f813a6c67c91 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.261777 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 109/211] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:03.272937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9a70-196f-4959-bc24-4b7cc797e367 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.273602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9a70-196f-4959-bc24-4b7cc797e367 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.274087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9a70-196f-4959-bc24-4b7cc797e367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.292665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-573a9a70-196f-4959-bc24-4b7cc797e367 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:03.294293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-573a9a70-196f-4959-bc24-4b7cc797e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:03.313096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:03.323829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c16cb-8122-41be-b79f-ffe090372018 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:03.365371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:03.369701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 110/212] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:03.375997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:03.376811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.377097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.377374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.388880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:03.395862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a9a70-196f-4959-bc24-4b7cc797e367 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:03.396945 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:03.397829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:03.398625 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 103/213] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:03.404893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:03.524640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a9a70-196f-4959-bc24-4b7cc797e367 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:03.550437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d41d29-42a1-4db1-a338-5e6b42502242 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:03.565436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:03.566426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.566712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.567473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.569003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:03.571141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:03.573421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 111/214] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:03.584315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:03.594745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:03.594745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.594745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.594745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.595727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:03.597249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:03.597551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:03.608092 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 104/215] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:03.613032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:03.613971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:03.678484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:03.707347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba109-affb-491a-a00c-df73ad2b8e61 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:03.728627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ccbb6-abf9-429b-abf6-e8778c48f035 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:03.748004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:03.749081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.749565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.750020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.750979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:03.752720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:03.766864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da134d4-0d1a-4d43-ae1a-eb713ec25828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:03.767482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da134d4-0d1a-4d43-ae1a-eb713ec25828 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.767930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da134d4-0d1a-4d43-ae1a-eb713ec25828 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.768142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da134d4-0d1a-4d43-ae1a-eb713ec25828 None admin] PATH_INFO: `/v3/users/5b7b80fa34d44b9c8fca1a04caccece4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.783701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 112/216] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:03 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:03.787155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da134d4-0d1a-4d43-ae1a-eb713ec25828 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b80fa34d44b9c8fca1a04caccece4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:03.788805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da134d4-0d1a-4d43-ae1a-eb713ec25828 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:03.790706 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 105/217] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:03 2022] GET /identity/v3/users/5b7b80fa34d44b9c8fca1a04caccece4 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:03.797412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:03.833313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c88f-32f0-4e2d-b900-3b2a83875b85 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.833555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c88f-32f0-4e2d-b900-3b2a83875b85 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.833981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c88f-32f0-4e2d-b900-3b2a83875b85 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.836258 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 106/218] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:03.844371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fca53-7b2c-4006-8f41-f3f6703260c6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.844702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fca53-7b2c-4006-8f41-f3f6703260c6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.844933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fca53-7b2c-4006-8f41-f3f6703260c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.869331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-579fca53-7b2c-4006-8f41-f3f6703260c6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:03.870915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-579fca53-7b2c-4006-8f41-f3f6703260c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:03.898304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:03.927580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcda11-b41d-45f9-b6e4-e206a99c7a8c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:03.972023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:03.972799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:03.973097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:03.973379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:03.973835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 107/219] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:04.003225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fca53-7b2c-4006-8f41-f3f6703260c6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:04.056854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:04.058952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:04.059629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:04.138622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fca53-7b2c-4006-8f41-f3f6703260c6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:04.189575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:04.190780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:04.193007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.193470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.194181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.212231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:04.222113 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 113/220] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:04.224106 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:04.225018 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:04.225991 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:04.228059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:04.229615 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 108/221] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:04.235748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:04.374793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baa59d-aadb-4450-982d-c69c15c141ad None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:04.376868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:04.380264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340da69-d819-471e-a32a-6c9bd2463762 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:04.417349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:04.418426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.418787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.419137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.420027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:04.420385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:04.421858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:04.422130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:04.423193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.423771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.424240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.425683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:04.427344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:04.429368 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 114/222] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:04 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:04.438549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 109/223] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:04.439995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:04.448414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:04.518523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:04.563297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e53b6-5a66-46a5-a0e0-c3f92e853055 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:04.567313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef929-8a9d-4c25-ae13-aa63081662f8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:04.605857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:04.606892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.607985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.608470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.609528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=5b7b80fa34d44b9c8fca1a04caccece4) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:04.610092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:04.612073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:04.618966 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 115/224] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:04 2022] GET /identity/v3/role_assignments?user.id=5b7b80fa34d44b9c8fca1a04caccece4&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=963435a25dbf491c8b345da8e43344c3 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:04.627858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8a21d-cdf2-4869-ba48-ff808ceaaf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:04.629242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a21d-cdf2-4869-ba48-ff808ceaaf8e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.629888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a21d-cdf2-4869-ba48-ff808ceaaf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.630393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a21d-cdf2-4869-ba48-ff808ceaaf8e None admin] PATH_INFO: `/v3/users/b2e2a5fe5000408aa06ea2c860e4d733` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.632117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8a21d-cdf2-4869-ba48-ff808ceaaf8e None admin] RBAC: Authorizing `identity:get_user(user_id=b2e2a5fe5000408aa06ea2c860e4d733)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:04.633884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8a21d-cdf2-4869-ba48-ff808ceaaf8e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:04.636428 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 110/225] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:04 2022] GET /identity/v3/users/b2e2a5fe5000408aa06ea2c860e4d733 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:04.642418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:04.693146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b29e-5dc4-4238-9621-5ba57f7a6a09 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.693328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b29e-5dc4-4238-9621-5ba57f7a6a09 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.694102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b29e-5dc4-4238-9621-5ba57f7a6a09 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.695432 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 111/226] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:04.701351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4fe2-5492-41ec-80da-fe57c064eb97 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.701644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4fe2-5492-41ec-80da-fe57c064eb97 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.701909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4fe2-5492-41ec-80da-fe57c064eb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.740056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9a1b4fe2-5492-41ec-80da-fe57c064eb97 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:04.741402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9a1b4fe2-5492-41ec-80da-fe57c064eb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:04.811077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:04.834535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de9ea-8a85-463c-8821-e9eb3ca8c501 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:04.851660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:04.888774 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 112/227] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:04.899391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:04.900275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:04.900558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:04.901364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:04.902574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:04.904074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:04.905939 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 116/228] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:04 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:04.912006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4fe2-5492-41ec-80da-fe57c064eb97 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:04.970920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:05.033901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4fe2-5492-41ec-80da-fe57c064eb97 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:05.079460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:05.100168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:05.100850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:05.101376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218/users/b2e2a5fe5000408aa06ea2c860e4d733/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:05.107926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] RBAC: Authorizing `identity:create_grant(project_id=67210f5643274f11b0bf0b2085608218, user_id=b2e2a5fe5000408aa06ea2c860e4d733, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:05.109708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:05.126085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589fd7-851e-4588-8851-16ef03bcb17b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:05.145555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 113/229] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:04 2022] PUT /identity/v3/projects/67210f5643274f11b0bf0b2085608218/users/b2e2a5fe5000408aa06ea2c860e4d733/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:19:05.165332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:05.166268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:05.166697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:05.166972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:05.180249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:05.190181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:05.191154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:05.192027 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:05.192638 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 117/230] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:05.200472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:05.245445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:05.368049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6234-36e3-41c3-a51b-281bcc8a7c5b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:05.409613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:05.410660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:05.411182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:05.411686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:05.412659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:05.413194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:05.414814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:05.431206 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 114/231] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:05.437206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:05.489573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:05.560401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc7c4b-38bd-4add-98bc-2a38bacb9c85 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:05.597288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:05.598251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:05.598529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:05.598834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] PATH_INFO: `/v3/users/b2e2a5fe5000408aa06ea2c860e4d733` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:05.600221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] RBAC: Authorizing `identity:get_user(user_id=b2e2a5fe5000408aa06ea2c860e4d733)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:05.601821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:05.604499 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 118/232] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:05 2022] GET /identity/v3/users/b2e2a5fe5000408aa06ea2c860e4d733 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:05.609891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:05.767341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:05.790170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112842d-b364-4ab2-b735-5708aace74b2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:05.839578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59485-ccc8-41c9-b37f-576c78014355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:05.840409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59485-ccc8-41c9-b37f-576c78014355 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:05.840697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59485-ccc8-41c9-b37f-576c78014355 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:05.840971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59485-ccc8-41c9-b37f-576c78014355 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:05.843393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd59485-ccc8-41c9-b37f-576c78014355 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:05.844973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd59485-ccc8-41c9-b37f-576c78014355 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:05.846895 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 115/233] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:05 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:05.852899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:05.964657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d9fe2-de04-43e1-a479-b9cfa39f404d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:05.967084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:06.000787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a95a7-0e18-45e8-9cc8-dfe7c07b7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:06.001691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a95a7-0e18-45e8-9cc8-dfe7c07b7f3f None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:06.001972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a95a7-0e18-45e8-9cc8-dfe7c07b7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:06.002248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a95a7-0e18-45e8-9cc8-dfe7c07b7f3f None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218/users/b2e2a5fe5000408aa06ea2c860e4d733/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:06.006477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a95a7-0e18-45e8-9cc8-dfe7c07b7f3f None admin] RBAC: Authorizing `identity:create_grant(project_id=67210f5643274f11b0bf0b2085608218, user_id=b2e2a5fe5000408aa06ea2c860e4d733, role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:06.008014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a95a7-0e18-45e8-9cc8-dfe7c07b7f3f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:06.029595 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 119/234] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:05 2022] PUT /identity/v3/projects/67210f5643274f11b0bf0b2085608218/users/b2e2a5fe5000408aa06ea2c860e4d733/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:06.554990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671148-cb11-4402-8df6-2be0b86874b0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:06.556021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671148-cb11-4402-8df6-2be0b86874b0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:06.556506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671148-cb11-4402-8df6-2be0b86874b0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:06.558729 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 116/235] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:06.564188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1ffb-20cf-4cda-a3cd-a0f4d910f3dd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:06.565045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1ffb-20cf-4cda-a3cd-a0f4d910f3dd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:06.565521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1ffb-20cf-4cda-a3cd-a0f4d910f3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:06.587172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3dd1ffb-20cf-4cda-a3cd-a0f4d910f3dd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:06.588749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3dd1ffb-20cf-4cda-a3cd-a0f4d910f3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:06.684239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887dc8a-e390-4947-8024-1ff37f32ac99 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:06.684869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887dc8a-e390-4947-8024-1ff37f32ac99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:06.685486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887dc8a-e390-4947-8024-1ff37f32ac99 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:06.687776 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 117/236] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:06.695367 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 120/237] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:06.695538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54f138-f614-41a9-b2df-e627e377686c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:06.695538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54f138-f614-41a9-b2df-e627e377686c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:06.695538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54f138-f614-41a9-b2df-e627e377686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:06.711547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2c54f138-f614-41a9-b2df-e627e377686c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:06.712751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c54f138-f614-41a9-b2df-e627e377686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:06.730701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1ffb-20cf-4cda-a3cd-a0f4d910f3dd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:06.825496 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 118/238] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:06.888911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54f138-f614-41a9-b2df-e627e377686c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:06.913586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:06.931015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1ffb-20cf-4cda-a3cd-a0f4d910f3dd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:06.993943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:06.995438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:06.999602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.000758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.001819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:07.024203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:07.039255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:07.040233 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:07.041032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 121/239] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:07.046273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54f138-f614-41a9-b2df-e627e377686c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:07.048887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:07.109146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:07.110470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.111838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.112850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.116208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:07.117981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:07.122301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 119/240] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:07.133049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:07.250057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bfad-6431-44ba-8f02-f91f60c17477 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:07.314268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6e22-b28c-497e-8373-36c6e2e7c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:07.315627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6e22-b28c-497e-8373-36c6e2e7c360 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.316134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6e22-b28c-497e-8373-36c6e2e7c360 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.316606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6e22-b28c-497e-8373-36c6e2e7c360 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.316869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036378f-16c9-4699-b88a-5483fc7a1f8d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:07.317799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d6e22-b28c-497e-8373-36c6e2e7c360 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:07.318307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d6e22-b28c-497e-8373-36c6e2e7c360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:07.321226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d6e22-b28c-497e-8373-36c6e2e7c360 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:07.331966 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 122/241] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:07.334394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e7af-2492-42c7-9277-585436aea564 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.334952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e7af-2492-42c7-9277-585436aea564 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.335562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e7af-2492-42c7-9277-585436aea564 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.342477 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 123/242] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:07.342477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e7af-2492-42c7-9277-585436aea564 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:07.361763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:07.370850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791bdc1-a07e-48f5-8da5-13606e29ca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:07.372472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791bdc1-a07e-48f5-8da5-13606e29ca2b None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.372961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791bdc1-a07e-48f5-8da5-13606e29ca2b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.373431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791bdc1-a07e-48f5-8da5-13606e29ca2b None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.374784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791bdc1-a07e-48f5-8da5-13606e29ca2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:07.376886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791bdc1-a07e-48f5-8da5-13606e29ca2b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:07.403899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 120/243] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:07 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:19:07.405736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bef80-a9f7-464f-903f-7c0168f312a4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.406230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bef80-a9f7-464f-903f-7c0168f312a4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.406706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bef80-a9f7-464f-903f-7c0168f312a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.422202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:07.430052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a98bef80-a9f7-464f-903f-7c0168f312a4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:07.433366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a98bef80-a9f7-464f-903f-7c0168f312a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:07.520497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e7af-2492-42c7-9277-585436aea564 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:07.529789 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 121/244] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:07.562907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bef80-a9f7-464f-903f-7c0168f312a4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:07.595670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:07.596673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.596955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.597234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] PATH_INFO: `/v3/users/caec0f281d3d465db409208cd5e3dff6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.633953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] RBAC: Authorizing `identity:get_user(user_id=caec0f281d3d465db409208cd5e3dff6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:07.636120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:07.637985 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 124/245] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:07 2022] GET /identity/v3/users/caec0f281d3d465db409208cd5e3dff6 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:07.648376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:07.716110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bef80-a9f7-464f-903f-7c0168f312a4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:07.762687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42476b49-17a9-4e15-b18b-cb688d07c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:07.763527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476b49-17a9-4e15-b18b-cb688d07c168 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.763818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476b49-17a9-4e15-b18b-cb688d07c168 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.764103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476b49-17a9-4e15-b18b-cb688d07c168 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.770218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:07.782596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42476b49-17a9-4e15-b18b-cb688d07c168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:07.783666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-42476b49-17a9-4e15-b18b-cb688d07c168 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:07.794142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:07.795570 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:07.796562 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 122/246] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:07.797561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2dc1-291b-48cb-9374-b43a89e48d70 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.797561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2dc1-291b-48cb-9374-b43a89e48d70 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.797784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2dc1-291b-48cb-9374-b43a89e48d70 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.799610 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 123/247] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:07.802329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2dc1-291b-48cb-9374-b43a89e48d70 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:07.823368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153806-20cc-468a-ab94-251e38c9f795 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:07.894048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:07.894722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:07.895008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:07.896310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:07.966726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2dc1-291b-48cb-9374-b43a89e48d70 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:07.995154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:07.997415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:08.017877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add31fa-833a-4e5b-bad5-4bd5c68bb3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:08.018905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add31fa-833a-4e5b-bad5-4bd5c68bb3fd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.019505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add31fa-833a-4e5b-bad5-4bd5c68bb3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.019981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add31fa-833a-4e5b-bad5-4bd5c68bb3fd None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.020933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add31fa-833a-4e5b-bad5-4bd5c68bb3fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:08.021460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add31fa-833a-4e5b-bad5-4bd5c68bb3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:08.023181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add31fa-833a-4e5b-bad5-4bd5c68bb3fd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:08.034839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 124/248] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:08.040722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c3cd-49a3-496c-a7a3-67a0cd9e6ba7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.041298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c3cd-49a3-496c-a7a3-67a0cd9e6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.041798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c3cd-49a3-496c-a7a3-67a0cd9e6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.059686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5ff6c3cd-49a3-496c-a7a3-67a0cd9e6ba7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:08.061199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5ff6c3cd-49a3-496c-a7a3-67a0cd9e6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:08.094585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:08.126492 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 125/249] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:08.127810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:08.136599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:08.161704 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 125/250] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:08.165387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c3cd-49a3-496c-a7a3-67a0cd9e6ba7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:08.331324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd47b9-dddd-4a35-beb3-302970157d45 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:08.366756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c3cd-49a3-496c-a7a3-67a0cd9e6ba7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:08.398517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:08.399445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.399731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.400009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] PATH_INFO: `/v3/users/5b7b80fa34d44b9c8fca1a04caccece4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.402764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b80fa34d44b9c8fca1a04caccece4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:08.404272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:08.405937 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 126/251] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:08 2022] GET /identity/v3/users/5b7b80fa34d44b9c8fca1a04caccece4 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:08.406707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:08.449589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:08.450388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.450673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.450943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.453969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:08.455503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:08.457241 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 126/252] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:08 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:08.458010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:08.496146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:08.585023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:08.589837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819965e-9901-4546-b2b7-c01c4054ea18 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:08.669261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:08.670201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.670496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.670864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.675584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b93dad-8957-479b-8cc8-b577b2ace034 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:08.685831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:08.695899 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:08.696803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:08.698717 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 127/253] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:08.699750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:08.730732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:08.731637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.731915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.732185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.733459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:08.734924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:08.737139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 127/254] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:08 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:08.740617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:08.861663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab614f15-c132-47a7-94df-291042973f16 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:08.863239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:08.876943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b1458-9955-436c-be77-0f2232d3d72f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:08.899835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:08.900683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.901605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.901957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.902408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:08.904226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] RBAC: Adding query filter params (role.id=48feeeecfc894491b5070d387fe04c8a, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=caec0f281d3d465db409208cd5e3dff6) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:08.904739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:08.906458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:08.913523 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 128/255] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:08 2022] GET /identity/v3/role_assignments?user.id=caec0f281d3d465db409208cd5e3dff6&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=48feeeecfc894491b5070d387fe04c8a => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:08.913958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f70f-8947-4b87-8c7e-7192498a89ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:08.914706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:08.914822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f70f-8947-4b87-8c7e-7192498a89ce None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.915067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f70f-8947-4b87-8c7e-7192498a89ce None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.915372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f70f-8947-4b87-8c7e-7192498a89ce None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.916166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f70f-8947-4b87-8c7e-7192498a89ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:08.916481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f70f-8947-4b87-8c7e-7192498a89ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:08.917922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f70f-8947-4b87-8c7e-7192498a89ce None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:08.927999 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 128/256] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:08.929510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff422a8-fdcb-4568-aeb7-7b9131e7a42c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:08.929808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff422a8-fdcb-4568-aeb7-7b9131e7a42c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:08.930090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff422a8-fdcb-4568-aeb7-7b9131e7a42c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:08.931750 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 129/257] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:08.937045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff422a8-fdcb-4568-aeb7-7b9131e7a42c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:09.050969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a84d08-9634-4a6e-b840-500048603d9e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:09.092758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b22d2e-f505-4372-8647-598c805332ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:09.093674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22d2e-f505-4372-8647-598c805332ef None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:09.093962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22d2e-f505-4372-8647-598c805332ef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:09.094253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22d2e-f505-4372-8647-598c805332ef None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218/users/5b7b80fa34d44b9c8fca1a04caccece4/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:09.096484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b22d2e-f505-4372-8647-598c805332ef None admin] RBAC: Authorizing `identity:create_grant(project_id=67210f5643274f11b0bf0b2085608218, user_id=5b7b80fa34d44b9c8fca1a04caccece4, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:09.098239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b22d2e-f505-4372-8647-598c805332ef None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:09.122452 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 129/258] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:08 2022] PUT /identity/v3/projects/67210f5643274f11b0bf0b2085608218/users/5b7b80fa34d44b9c8fca1a04caccece4/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:09.124106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6bc5d-1e17-4d6f-ae10-0b1076a4d841 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:09.124602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6bc5d-1e17-4d6f-ae10-0b1076a4d841 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:09.125085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6bc5d-1e17-4d6f-ae10-0b1076a4d841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:09.131302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff422a8-fdcb-4568-aeb7-7b9131e7a42c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:09.164716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-00b6bc5d-1e17-4d6f-ae10-0b1076a4d841 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:09.167250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00b6bc5d-1e17-4d6f-ae10-0b1076a4d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:09.211843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:09.212438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:09.214845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:09.215140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:09.215498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] PATH_INFO: `/v3/users/b2e2a5fe5000408aa06ea2c860e4d733` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:09.217130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e2a5fe5000408aa06ea2c860e4d733)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:09.218787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:09.221198 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 130/259] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:08 2022] GET /identity/v3/users/b2e2a5fe5000408aa06ea2c860e4d733 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:09.229874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:09.322137 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 130/260] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:09.346438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:09.366534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6bc5d-1e17-4d6f-ae10-0b1076a4d841 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:09.426839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c6b3e-e871-40c5-a52f-16dda21b8628 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:09.510887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:09.511595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:09.511886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:09.512195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:09.534008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6bc5d-1e17-4d6f-ae10-0b1076a4d841 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:09.582483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:09.583233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:09.583544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:09.583822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:09.598908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:09.609092 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:09.610520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:09.611694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 131/261] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:09.618634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:09.640037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:09.669077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:09.670601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:09.749139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae7d82-2036-41d8-8f04-cdcc7c1cf774 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:09.787656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:09.812375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:09.813077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:09.813361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:09.813640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:09.814411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:09.814723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:09.816300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:09.832454 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 132/262] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:09.837044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:09.880979 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 131/263] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:09.888624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:09.992721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d80f-a2a9-4f25-a269-69f0d17b80c4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:09.995625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:10.036194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:10.037526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.037812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.038091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] PATH_INFO: `/v3/users/b2e2a5fe5000408aa06ea2c860e4d733` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.043016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] RBAC: Authorizing `identity:get_user(user_id=b2e2a5fe5000408aa06ea2c860e4d733)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:10.044834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:10.046787 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 133/264] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:09 2022] GET /identity/v3/users/b2e2a5fe5000408aa06ea2c860e4d733 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:10.053014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:10.168508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893c58-8200-4f1a-aff6-38c0ec2e46c3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:10.233584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:10.234480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.234765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.235044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.240092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:10.241602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:10.243879 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 132/265] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:09 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:10.250736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:10.290222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714288e-6aa9-459b-892a-c15cc09143be None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:10.305410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:10.360730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:10.362339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.363129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.363970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.388531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:10.490966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77d5fd-7707-4003-b6bd-e643c01ff539 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:10.505685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:10.507550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:10.569209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a450792-bd7d-4f9a-b235-a4d679ff2bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:10.570247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450792-bd7d-4f9a-b235-a4d679ff2bfa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.570769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450792-bd7d-4f9a-b235-a4d679ff2bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.571137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450792-bd7d-4f9a-b235-a4d679ff2bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.573017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a450792-bd7d-4f9a-b235-a4d679ff2bfa None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=b2e2a5fe5000408aa06ea2c860e4d733) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:10.573885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a450792-bd7d-4f9a-b235-a4d679ff2bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:10.576860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a450792-bd7d-4f9a-b235-a4d679ff2bfa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:10.586467 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 133/266] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:10 2022] GET /identity/v3/role_assignments?user.id=b2e2a5fe5000408aa06ea2c860e4d733&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:10.593006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116000c-3724-4cab-a2cf-7f51d8d3ed8d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.593539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116000c-3724-4cab-a2cf-7f51d8d3ed8d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.593993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116000c-3724-4cab-a2cf-7f51d8d3ed8d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.595920 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 134/267] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:10.612967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930fd3b-840b-46fc-9d73-ba9d7971725f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.613527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930fd3b-840b-46fc-9d73-ba9d7971725f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.613975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930fd3b-840b-46fc-9d73-ba9d7971725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.639782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f930fd3b-840b-46fc-9d73-ba9d7971725f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:10.642306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f930fd3b-840b-46fc-9d73-ba9d7971725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:10.707065 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 134/268] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:19:10.715562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:10.759497 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 135/269] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:10.780403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930fd3b-840b-46fc-9d73-ba9d7971725f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:10.802027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:10.822283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:10.935876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c775a-697c-46ff-bcdc-430281ed3795 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:10.968326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930fd3b-840b-46fc-9d73-ba9d7971725f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:10.983911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568d26d-8663-40ec-b726-ba61588cc557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:10.984796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568d26d-8663-40ec-b726-ba61588cc557 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.985148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568d26d-8663-40ec-b726-ba61588cc557 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.985437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568d26d-8663-40ec-b726-ba61588cc557 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.986881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568d26d-8663-40ec-b726-ba61588cc557 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:10.988807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568d26d-8663-40ec-b726-ba61588cc557 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:10.991231 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 135/270] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:10 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:10.992503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdca4c-472d-4735-9291-61ae49d955ec None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:10.992794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdca4c-472d-4735-9291-61ae49d955ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:10.993078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdca4c-472d-4735-9291-61ae49d955ec None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:10.994759 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 136/271] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:10.999488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdca4c-472d-4735-9291-61ae49d955ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:11.029137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda513da-aa0f-4a4a-9073-d7d845ed2e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:11.029977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda513da-aa0f-4a4a-9073-d7d845ed2e2c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.030305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda513da-aa0f-4a4a-9073-d7d845ed2e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.030598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda513da-aa0f-4a4a-9073-d7d845ed2e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.042523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda513da-aa0f-4a4a-9073-d7d845ed2e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-cda513da-aa0f-4a4a-9073-d7d845ed2e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:11.052830 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:11.053753 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:11.054573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:11.059683 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 136/272] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:11.060865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273a8d-b419-4936-a30c-d4fb3dc6dffb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.061153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273a8d-b419-4936-a30c-d4fb3dc6dffb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.061588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273a8d-b419-4936-a30c-d4fb3dc6dffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.083048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-05273a8d-b419-4936-a30c-d4fb3dc6dffb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:11.084289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05273a8d-b419-4936-a30c-d4fb3dc6dffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:11.149801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdca4c-472d-4735-9291-61ae49d955ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:11.172690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:11.176573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 137/273] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:11.184153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05273a8d-b419-4936-a30c-d4fb3dc6dffb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:11.198419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:11.199403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:11.200511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.200803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.201151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.202063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] RBAC: Adding query filter params (role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=b2e2a5fe5000408aa06ea2c860e4d733) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:11.202384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:11.204137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:11.212655 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 137/274] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:10 2022] GET /identity/v3/role_assignments?user.id=b2e2a5fe5000408aa06ea2c860e4d733&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:11.227832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:11.376005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05273a8d-b419-4936-a30c-d4fb3dc6dffb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:11.402385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8be54-d094-4955-a9c1-47d61029b16b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:11.442841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:11.444003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.444437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.444861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.446234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:11.448496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:11.449859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:11.450544 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 138/275] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:11.450910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.451205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.451519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.452296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:11.452612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:11.454027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:11.460566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:11.465404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 138/276] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:11.471044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:11.538528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:11.572093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:11.616712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20f6f-1583-4843-8ce5-9ca182113c97 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:11.617908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fa0e-45af-4e44-a71a-10884464e6cf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:11.662028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b30de-915c-41fa-a3ba-08e8ac8e2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:11.662719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b30de-915c-41fa-a3ba-08e8ac8e2fcc None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.663581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b30de-915c-41fa-a3ba-08e8ac8e2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.663916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b30de-915c-41fa-a3ba-08e8ac8e2fcc None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.667233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b30de-915c-41fa-a3ba-08e8ac8e2fcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:11.667233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b30de-915c-41fa-a3ba-08e8ac8e2fcc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:11.670002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:11.670905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.671197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.671503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] PATH_INFO: `/v3/users/a1d44ed36f1148d383474e76a85813e3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.692517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] RBAC: Authorizing `identity:get_user(user_id=a1d44ed36f1148d383474e76a85813e3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:11.694410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:11.696794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 139/277] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:11 2022] GET /identity/v3/users/a1d44ed36f1148d383474e76a85813e3 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:11.698850 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 139/278] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:11 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:11.704932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:11.828648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a0744-6e8a-449a-b143-0a654ebceaeb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:11.859711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:11.874385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47643a-fc08-48ca-9215-8232c19dbe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:11.875580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47643a-fc08-48ca-9215-8232c19dbe21 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.876222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47643a-fc08-48ca-9215-8232c19dbe21 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.876722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47643a-fc08-48ca-9215-8232c19dbe21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.877799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47643a-fc08-48ca-9215-8232c19dbe21 None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, user.id=a1d44ed36f1148d383474e76a85813e3, scope.system=all) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:11.878386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47643a-fc08-48ca-9215-8232c19dbe21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:11.880151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47643a-fc08-48ca-9215-8232c19dbe21 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:11.884265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3b40-4dfd-4806-8881-16ff8d6b4e82 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.885321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3b40-4dfd-4806-8881-16ff8d6b4e82 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.885400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3b40-4dfd-4806-8881-16ff8d6b4e82 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.886773 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 140/279] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:19:11.888656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 140/280] 10.222.0.98 () {56 vars in 1308 bytes} [Thu Jul 14 14:19:11 2022] GET /identity/v3/role_assignments?user.id=a1d44ed36f1148d383474e76a85813e3&scope.system=all&role.id=963435a25dbf491c8b345da8e43344c3 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:11.894745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42740-4657-4669-82b8-121bfff8f92b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.894745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42740-4657-4669-82b8-121bfff8f92b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.894745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42740-4657-4669-82b8-121bfff8f92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.912944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2dc42740-4657-4669-82b8-121bfff8f92b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:11.914266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2dc42740-4657-4669-82b8-121bfff8f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:11.936512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5dae9-0d27-450d-ab7c-0552771e72a9 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.936825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5dae9-0d27-450d-ab7c-0552771e72a9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.937086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5dae9-0d27-450d-ab7c-0552771e72a9 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.938697 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 141/281] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:19:11.944314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f9f6-e7fb-4192-bf89-6220bdb4d970 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:11.944609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f9f6-e7fb-4192-bf89-6220bdb4d970 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:11.944897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f9f6-e7fb-4192-bf89-6220bdb4d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:11.966658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2256f9f6-e7fb-4192-bf89-6220bdb4d970 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:11.968359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2256f9f6-e7fb-4192-bf89-6220bdb4d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:12.004498 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 141/282] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:12.034201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc42740-4657-4669-82b8-121bfff8f92b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.055506 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 142/283] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:12.080022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f9f6-e7fb-4192-bf89-6220bdb4d970 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.095668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:12.178301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc42740-4657-4669-82b8-121bfff8f92b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:12.213969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f9f6-e7fb-4192-bf89-6220bdb4d970 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:12.223574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:12.224159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:12.224441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:12.224716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:12.237832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:12.245208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:12.248858 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:12.249775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:12.250603 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 142/284] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:12.256089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.270906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:12.271558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:12.271908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:12.272252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:12.292146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:12.303598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:12.304548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:12.305343 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:12.308817 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 143/285] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:12.315872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.441215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12660e0-7928-4fbb-9631-a94acfe5f1f2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:12.469293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:12.487868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1b618-1073-4567-95d8-a3b3357f6368 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:12.522641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:12.523347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:12.523635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:12.523913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:12.524674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:12.525040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:12.526547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:12.544783 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 144/286] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:12.547904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.560475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:12.561158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:12.561438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:12.561714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:12.562470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:12.562773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:12.564227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:12.581319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 143/287] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:12.584854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.627947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:12.731819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af376c0-f226-4426-9a89-0866f3a5f4dd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:12.777755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0e6ea-e793-4173-b638-932930bb9c19 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:12.797300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:12.798545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:12.799094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:12.799593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] PATH_INFO: `/v3/users/5b7b80fa34d44b9c8fca1a04caccece4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:12.802580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b80fa34d44b9c8fca1a04caccece4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:12.804330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:12.809097 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 145/288] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/users/5b7b80fa34d44b9c8fca1a04caccece4 => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:12.816657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.854392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:12.855665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:12.856236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:12.856715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] PATH_INFO: `/v3/users/caec0f281d3d465db409208cd5e3dff6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:12.858341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] RBAC: Authorizing `identity:get_user(user_id=caec0f281d3d465db409208cd5e3dff6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:12.860089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:12.862472 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 144/289] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/users/caec0f281d3d465db409208cd5e3dff6 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:12.869068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:12.919637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:13.015171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5295a9-a033-4de4-9fc9-2370e0de2b4a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:13.032910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:13.054284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0075-aec4-44e3-811e-a10de098b84b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:13.083302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:13.083969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:13.084259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:13.084540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:13.118694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:13.120113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:13.120398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:13.120681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:13.122464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:13.125909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:13.131347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 145/290] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:13.134284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:13.236731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:13.239251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:13.335680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:13.355600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb88f0-9d1a-421c-a100-ccbe9c17e155 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:13.407419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:13.408337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:13.408625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:13.408905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218/users/caec0f281d3d465db409208cd5e3dff6/roles/48feeeecfc894491b5070d387fe04c8a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:13.413403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=67210f5643274f11b0bf0b2085608218, user_id=caec0f281d3d465db409208cd5e3dff6, role_id=48feeeecfc894491b5070d387fe04c8a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:13.414898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:13.440417 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 146/291] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:13 2022] PUT /identity/v3/projects/67210f5643274f11b0bf0b2085608218/users/caec0f281d3d465db409208cd5e3dff6/roles/48feeeecfc894491b5070d387fe04c8a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:13.460768 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 146/292] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:13.467599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:13.599962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9b535-c8ee-4aff-9505-3524e59860d8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:13.667734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0156a-9451-42e0-8922-dc17c3c6102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:13.668660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0156a-9451-42e0-8922-dc17c3c6102f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:13.668950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0156a-9451-42e0-8922-dc17c3c6102f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:13.669301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0156a-9451-42e0-8922-dc17c3c6102f None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:13.670961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0156a-9451-42e0-8922-dc17c3c6102f None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:13.672965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0156a-9451-42e0-8922-dc17c3c6102f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:13.675676 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 147/293] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:13 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:13.681664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:13.694890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:13.801697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835dac7-85e0-4849-97f6-96462c359e39 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:13.840233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227f0e-e936-4cba-b712-5314b759758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:13.840905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227f0e-e936-4cba-b712-5314b759758a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:13.841196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227f0e-e936-4cba-b712-5314b759758a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:13.841474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227f0e-e936-4cba-b712-5314b759758a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:13.842319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227f0e-e936-4cba-b712-5314b759758a None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=5b7b80fa34d44b9c8fca1a04caccece4) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:13.842635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227f0e-e936-4cba-b712-5314b759758a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:13.844401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227f0e-e936-4cba-b712-5314b759758a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:13.851590 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 147/294] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:13 2022] GET /identity/v3/role_assignments?user.id=5b7b80fa34d44b9c8fca1a04caccece4&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=963435a25dbf491c8b345da8e43344c3 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:14.353214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f30248-9f25-4990-ae3d-300565b5cccb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.354310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f30248-9f25-4990-ae3d-300565b5cccb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.354385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f30248-9f25-4990-ae3d-300565b5cccb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.356038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 148/295] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:14.361787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e97f61-b9fb-45fc-a320-278ffa5935dc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.362354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e97f61-b9fb-45fc-a320-278ffa5935dc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.362354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e97f61-b9fb-45fc-a320-278ffa5935dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.382865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-02e97f61-b9fb-45fc-a320-278ffa5935dc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:14.384112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02e97f61-b9fb-45fc-a320-278ffa5935dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:14.398815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a9f3-6b3c-4d92-b21b-c520a3ded83c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.399133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a9f3-6b3c-4d92-b21b-c520a3ded83c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.399451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7a9f3-6b3c-4d92-b21b-c520a3ded83c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.401362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 149/296] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:14.407075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd258c1-9d15-413b-b818-ec4d834075ec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.407883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd258c1-9d15-413b-b818-ec4d834075ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.408172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd258c1-9d15-413b-b818-ec4d834075ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.430339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ccd258c1-9d15-413b-b818-ec4d834075ec None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:14.432604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ccd258c1-9d15-413b-b818-ec4d834075ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:14.451855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:14.481154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 148/297] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:14.503600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e97f61-b9fb-45fc-a320-278ffa5935dc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:14.507135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:14.515708 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 150/298] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:14.541788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd258c1-9d15-413b-b818-ec4d834075ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:14.615921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e97f61-b9fb-45fc-a320-278ffa5935dc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:14.657190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ee40-23de-4e97-9304-36d9c167d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:14.658009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ee40-23de-4e97-9304-36d9c167d943 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.658303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ee40-23de-4e97-9304-36d9c167d943 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.658578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ee40-23de-4e97-9304-36d9c167d943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.662631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd258c1-9d15-413b-b818-ec4d834075ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:14.670897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ee40-23de-4e97-9304-36d9c167d943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-da49ee40-23de-4e97-9304-36d9c167d943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:14.679357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:14.683707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 149/299] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:14.684829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06bdb-546f-4f0d-ae1a-b1d68deda5b3 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.685536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06bdb-546f-4f0d-ae1a-b1d68deda5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.685536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06bdb-546f-4f0d-ae1a-b1d68deda5b3 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.687803 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 150/300] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:14.688870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06bdb-546f-4f0d-ae1a-b1d68deda5b3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:14.708541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee6cda-a793-4bb9-9457-cb9518dcbf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:14.709285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6cda-a793-4bb9-9457-cb9518dcbf8f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.709572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6cda-a793-4bb9-9457-cb9518dcbf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.709857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6cda-a793-4bb9-9457-cb9518dcbf8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.720817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee6cda-a793-4bb9-9457-cb9518dcbf8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e3ee6cda-a793-4bb9-9457-cb9518dcbf8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:14.729373 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:14.730271 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:14.731835 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 151/301] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:14.732528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f09c-ead0-4718-abea-2218959df44f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.732528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f09c-ead0-4718-abea-2218959df44f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.732647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f09c-ead0-4718-abea-2218959df44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.751380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0c3f09c-ead0-4718-abea-2218959df44f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:14.752572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0c3f09c-ead0-4718-abea-2218959df44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:14.754724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:14.772563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:14.818954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06bdb-546f-4f0d-ae1a-b1d68deda5b3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:14.835295 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 152/302] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:14.835295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3f09c-ead0-4718-abea-2218959df44f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:14.870219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:14.870894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.871178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.871491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.872238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:14.872546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:14.873935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:14.887146 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 151/303] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:14.887146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:14.946131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3f09c-ead0-4718-abea-2218959df44f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:14.982938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:14.983677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:14.983957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:14.984231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:14.985019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:14.985323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:14.986778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:14.992797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:14.999543 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 153/304] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:15.001373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:15.003817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3b21-0986-46a6-a3d1-786153242cef None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:15.033337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:15.043757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:15.044567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.044847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.045125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.046342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:15.047788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:15.049585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 152/305] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:15.054605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:15.116359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0b874-af56-4fa1-91d5-606bf7d48f30 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:15.151737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:15.152732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.153088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.153431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] PATH_INFO: `/v3/users/a1d44ed36f1148d383474e76a85813e3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.154835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d44ed36f1148d383474e76a85813e3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:15.156392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:15.158080 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 154/306] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:14 2022] GET /identity/v3/users/a1d44ed36f1148d383474e76a85813e3 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:15.158080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:15.169360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119987fc-779b-4a55-a025-725f26202d54 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:15.206224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:15.207561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.208030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.208610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] PATH_INFO: `/v3/users/05dbe9a12ed94c1b932b7e6aac07988f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.225011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] RBAC: Authorizing `identity:get_user(user_id=05dbe9a12ed94c1b932b7e6aac07988f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:15.226482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:15.236648 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 153/307] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:15 2022] GET /identity/v3/users/05dbe9a12ed94c1b932b7e6aac07988f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:15.236648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:15.246206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:15.290082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db234cc3-b04a-4473-96c6-d439967e46c2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:15.298844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:15.328037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:15.328832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.329132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.329446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.330149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:15.331742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:15.350842 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 155/308] 10.222.0.98 () {60 vars in 1134 bytes} [Thu Jul 14 14:19:15 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:15.351948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:15.359382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0cc3c-b9d5-4067-884b-2daf43a25c37 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:15.405896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0209142-da14-4f13-b9b1-239f2cdcb7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:15.406870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0209142-da14-4f13-b9b1-239f2cdcb7f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.407310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0209142-da14-4f13-b9b1-239f2cdcb7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.407522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0209142-da14-4f13-b9b1-239f2cdcb7f8 None admin] PATH_INFO: `/v3/system/users/a1d44ed36f1148d383474e76a85813e3/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.409631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0209142-da14-4f13-b9b1-239f2cdcb7f8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a1d44ed36f1148d383474e76a85813e3, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:15.411167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0209142-da14-4f13-b9b1-239f2cdcb7f8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:15.432564 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 154/309] 10.222.0.98 () {58 vars in 1334 bytes} [Thu Jul 14 14:19:15 2022] PUT /identity/v3/system/users/a1d44ed36f1148d383474e76a85813e3/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:15.500664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897df9f6-9a46-46b9-99a4-71a9a6460945 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:15.534375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:15.544620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c926a5-aa1c-4e10-834d-c9333b398fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:15.545777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c926a5-aa1c-4e10-834d-c9333b398fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.546403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c926a5-aa1c-4e10-834d-c9333b398fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.547066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c926a5-aa1c-4e10-834d-c9333b398fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.548160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c926a5-aa1c-4e10-834d-c9333b398fd6 None admin] RBAC: Adding query filter params (role.id=48feeeecfc894491b5070d387fe04c8a, user.id=05dbe9a12ed94c1b932b7e6aac07988f, scope.system=all) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:15.548670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c926a5-aa1c-4e10-834d-c9333b398fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:15.550352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c926a5-aa1c-4e10-834d-c9333b398fd6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:15.557774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 156/310] 10.222.0.98 () {56 vars in 1308 bytes} [Thu Jul 14 14:19:15 2022] GET /identity/v3/role_assignments?user.id=05dbe9a12ed94c1b932b7e6aac07988f&scope.system=all&role.id=48feeeecfc894491b5070d387fe04c8a => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:15.903118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8539-6a93-4504-aa18-842490f4d8d7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.903493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8539-6a93-4504-aa18-842490f4d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.903727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8539-6a93-4504-aa18-842490f4d8d7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.905399 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 155/311] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:15.911101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7831b3-9c0f-4788-a22b-d4369a1f836b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:15.911422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7831b3-9c0f-4788-a22b-d4369a1f836b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:15.911714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7831b3-9c0f-4788-a22b-d4369a1f836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:15.929131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f7831b3-9c0f-4788-a22b-d4369a1f836b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:15.930321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f7831b3-9c0f-4788-a22b-d4369a1f836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:16.006558 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 157/312] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:16.030084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b8539-6a93-4504-aa18-842490f4d8d7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:16.148657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b8539-6a93-4504-aa18-842490f4d8d7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:16.175717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:16.187577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:16.188499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:16.189183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:16.189819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:16.202333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:16.210607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:16.211617 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:16.212422 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 156/313] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:16.219187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7831b3-9c0f-4788-a22b-d4369a1f836b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:16.342653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7831b3-9c0f-4788-a22b-d4369a1f836b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:16.368399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:16.380705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:16.381386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:16.381674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:16.381956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:16.382711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:16.383022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:16.384472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:16.393654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 158/314] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:16.399067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:16.536095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd2e88-82f2-448e-9ec3-1176d6e57f7a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:16.576876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:16.577770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:16.578059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:16.578342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] PATH_INFO: `/v3/users/caec0f281d3d465db409208cd5e3dff6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:16.579629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] RBAC: Authorizing `identity:get_user(user_id=caec0f281d3d465db409208cd5e3dff6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:16.581122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:16.583123 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 157/315] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:16 2022] GET /identity/v3/users/caec0f281d3d465db409208cd5e3dff6 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:16.589781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:16.742577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56695f99-05f5-4c7a-a340-65f72dfdb025 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:16.805916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:16.807556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:16.808088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:16.808597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:16.882255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:16.883766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:16.887620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:16.995642 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 159/316] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:17.005097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:17.085342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:17.153220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603059b7-8976-413a-ad74-03e5730f7b1e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:17.190038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34999be5-0452-455b-820f-2999107cbd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:17.190906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999be5-0452-455b-820f-2999107cbd75 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.191194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999be5-0452-455b-820f-2999107cbd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.191499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34999be5-0452-455b-820f-2999107cbd75 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.192691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34999be5-0452-455b-820f-2999107cbd75 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:17.194157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34999be5-0452-455b-820f-2999107cbd75 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:17.195914 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 158/317] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:17 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:17.202146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:17.315417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:17.338460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac8740-41ce-4fd8-98d9-2a8aadc0ebd4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:17.397338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1924581-5bf1-416c-ab78-85c00514ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:17.398392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924581-5bf1-416c-ab78-85c00514ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.398842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924581-5bf1-416c-ab78-85c00514ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.399301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924581-5bf1-416c-ab78-85c00514ef3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.401278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1924581-5bf1-416c-ab78-85c00514ef3d None admin] RBAC: Adding query filter params (role.id=48feeeecfc894491b5070d387fe04c8a, scope.project.id=67210f5643274f11b0bf0b2085608218, user.id=caec0f281d3d465db409208cd5e3dff6) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:17.401813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1924581-5bf1-416c-ab78-85c00514ef3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:17.404425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1924581-5bf1-416c-ab78-85c00514ef3d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:17.414081 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 160/318] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:17 2022] GET /identity/v3/role_assignments?user.id=caec0f281d3d465db409208cd5e3dff6&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=48feeeecfc894491b5070d387fe04c8a => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:17.596352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827fe47-b03a-4e61-9aca-5653d36afea6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.596352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827fe47-b03a-4e61-9aca-5653d36afea6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.596352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827fe47-b03a-4e61-9aca-5653d36afea6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.596980 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 159/319] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:17.603980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212aa58-8acd-4ebf-940b-91cfea7d4b1d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.604927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212aa58-8acd-4ebf-940b-91cfea7d4b1d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.605416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212aa58-8acd-4ebf-940b-91cfea7d4b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.623233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5212aa58-8acd-4ebf-940b-91cfea7d4b1d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:17.624859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5212aa58-8acd-4ebf-940b-91cfea7d4b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:17.702416 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 161/320] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:17.726758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827fe47-b03a-4e61-9aca-5653d36afea6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:17.765146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1cdb7-1460-4296-8f61-a2beb03d79ca None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.765689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1cdb7-1460-4296-8f61-a2beb03d79ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.765689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1cdb7-1460-4296-8f61-a2beb03d79ca None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.767071 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 162/321] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:17.772390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56185-d7ee-4883-ad2f-f08f498c2185 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.772752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56185-d7ee-4883-ad2f-f08f498c2185 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.773100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56185-d7ee-4883-ad2f-f08f498c2185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.789525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1fb56185-d7ee-4883-ad2f-f08f498c2185 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:17.791232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fb56185-d7ee-4883-ad2f-f08f498c2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:17.835740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827fe47-b03a-4e61-9aca-5653d36afea6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:17.849335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:17.858232 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 163/322] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:17.859600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c33c5-02b5-4c85-b882-f790852c16c5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.859895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c33c5-02b5-4c85-b882-f790852c16c5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.860174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c33c5-02b5-4c85-b882-f790852c16c5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.861598 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 164/323] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:17.870169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1dc1f-bfcf-4c18-b3b2-25ea5abba293 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.870470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1dc1f-bfcf-4c18-b3b2-25ea5abba293 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.870752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1dc1f-bfcf-4c18-b3b2-25ea5abba293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.876743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:17.877545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:17.877875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:17.878126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:17.889379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:17.890042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2df1dc1f-bfcf-4c18-b3b2-25ea5abba293 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:17.891236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2df1dc1f-bfcf-4c18-b3b2-25ea5abba293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:17.893335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:17.897460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:17.898402 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 160/324] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:17.904648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:17.964181 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 165/325] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:17.965058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1dc1f-bfcf-4c18-b3b2-25ea5abba293 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.007168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5724-7b90-42f9-b76e-4abcaf1b02ba None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.041721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.042512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.042798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.043080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.044282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.046075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.047745 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 161/326] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:18.048528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.069435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1dc1f-bfcf-4c18-b3b2-25ea5abba293 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.096321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:18.106874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.107501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.107787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.108065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.108823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:18.109134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.110528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.115617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:18.124233 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 166/327] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:18.124233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.182560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0732-bc34-44b1-94f8-f8250bc40b8b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.219232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.220062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.220337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.220611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.230965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:18.238688 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:18.239607 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:18.240442 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 162/328] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:18.241099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.250017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4fd62-a729-4000-a557-ff0268fffc17 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.286365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.287030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.287339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.287616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.288297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.289728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.305692 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 167/329] 10.222.0.98 () {60 vars in 1134 bytes} [Thu Jul 14 14:19:18 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:18.307011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.363391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:18.367029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11260363-d34d-4648-997b-c31e235063f0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.384282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:18.409124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.409813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.410100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.410381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] PATH_INFO: `/v3/users/a1d44ed36f1148d383474e76a85813e3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.411677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d44ed36f1148d383474e76a85813e3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.413208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.414948 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 163/330] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:18 2022] GET /identity/v3/users/a1d44ed36f1148d383474e76a85813e3 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:18.421475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.439379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cee0a1-3ae9-4aae-bd54-b09ef6f4a877 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.482850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.483566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.483853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.484133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.485019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:18.485335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.486720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.496096 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 168/331] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:18.501721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.541187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13c312-8aca-409f-be43-4ac821cbb5e7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.602125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.603690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.604156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.604635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.606060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] RBAC: Adding query filter params (role.id=963435a25dbf491c8b345da8e43344c3, user.id=a1d44ed36f1148d383474e76a85813e3, scope.system=all) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:18.606591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.610054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.630933 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 164/332] 10.222.0.98 () {56 vars in 1308 bytes} [Thu Jul 14 14:19:18 2022] GET /identity/v3/role_assignments?user.id=a1d44ed36f1148d383474e76a85813e3&scope.system=all&role.id=963435a25dbf491c8b345da8e43344c3 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:18.637798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7775-f819-45cf-9852-764fa1540ec1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.667838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:18.686905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47549aae-9bb9-4fa2-b488-2b251e88b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.687906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47549aae-9bb9-4fa2-b488-2b251e88b545 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.688192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47549aae-9bb9-4fa2-b488-2b251e88b545 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.688470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47549aae-9bb9-4fa2-b488-2b251e88b545 None admin] PATH_INFO: `/v3/users/05dbe9a12ed94c1b932b7e6aac07988f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.689879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47549aae-9bb9-4fa2-b488-2b251e88b545 None admin] RBAC: Authorizing `identity:get_user(user_id=05dbe9a12ed94c1b932b7e6aac07988f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.691504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47549aae-9bb9-4fa2-b488-2b251e88b545 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.693721 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 169/333] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:18 2022] GET /identity/v3/users/05dbe9a12ed94c1b932b7e6aac07988f => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:18.699499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:18.735646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:18.821743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d85c4-ac8d-4361-bef9-789d2143d0a2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:18.862377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebed3-b4c8-462f-98f8-bf46651a19b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:18.863261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebed3-b4c8-462f-98f8-bf46651a19b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:18.863577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebed3-b4c8-462f-98f8-bf46651a19b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:18.863858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebed3-b4c8-462f-98f8-bf46651a19b9 None admin] PATH_INFO: `/v3/system/users/05dbe9a12ed94c1b932b7e6aac07988f/roles/48feeeecfc894491b5070d387fe04c8a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:18.865413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ebed3-b4c8-462f-98f8-bf46651a19b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=05dbe9a12ed94c1b932b7e6aac07988f, role_id=48feeeecfc894491b5070d387fe04c8a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:18.866826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ebed3-b4c8-462f-98f8-bf46651a19b9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:18.876161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 165/334] 10.222.0.98 () {58 vars in 1334 bytes} [Thu Jul 14 14:19:18 2022] PUT /identity/v3/system/users/05dbe9a12ed94c1b932b7e6aac07988f/roles/48feeeecfc894491b5070d387fe04c8a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:20.927643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9ef0-eee1-4e3e-8b5f-d7c301f2b328 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:20.928300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9ef0-eee1-4e3e-8b5f-d7c301f2b328 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:20.928300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9ef0-eee1-4e3e-8b5f-d7c301f2b328 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:20.929870 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 170/335] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:20.938698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a9f1c-407c-4d65-9785-53f44e9798b0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:20.939201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a9f1c-407c-4d65-9785-53f44e9798b0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:20.939327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a9f1c-407c-4d65-9785-53f44e9798b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:20.960286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-038a9f1c-407c-4d65-9785-53f44e9798b0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:20.961500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-038a9f1c-407c-4d65-9785-53f44e9798b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:21.065093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 166/336] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:21.108879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9ef0-eee1-4e3e-8b5f-d7c301f2b328 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:21.253420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9ef0-eee1-4e3e-8b5f-d7c301f2b328 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:21.304630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8865-01a3-4d36-8e57-2ee38f5a9f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:21.305468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8865-01a3-4d36-8e57-2ee38f5a9f14 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:21.305751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8865-01a3-4d36-8e57-2ee38f5a9f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:21.306055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8865-01a3-4d36-8e57-2ee38f5a9f14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:21.322535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae8865-01a3-4d36-8e57-2ee38f5a9f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b7ae8865-01a3-4d36-8e57-2ee38f5a9f14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:21.330747 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:21.331771 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:21.332566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 171/337] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:21.339158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a9f1c-407c-4d65-9785-53f44e9798b0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:21.359037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626265a-8e1a-4381-8923-8b643537de7d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:21.359398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626265a-8e1a-4381-8923-8b643537de7d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:21.359637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626265a-8e1a-4381-8923-8b643537de7d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:21.361490 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 172/338] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:21.367382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac1d17-88b0-4ce2-8794-8fad9d8302d4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:21.367668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac1d17-88b0-4ce2-8794-8fad9d8302d4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:21.367939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac1d17-88b0-4ce2-8794-8fad9d8302d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:21.379045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:21.397620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13ac1d17-88b0-4ce2-8794-8fad9d8302d4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:21.398928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13ac1d17-88b0-4ce2-8794-8fad9d8302d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:21.503725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:21.537172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a9f1c-407c-4d65-9785-53f44e9798b0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:21.558616 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 173/339] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:21.584033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac1d17-88b0-4ce2-8794-8fad9d8302d4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:21.584469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:21.585167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:21.585453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:21.585795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:21.586974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:21.587324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:21.589026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:21.601525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 167/340] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:21.611405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:21.763379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:21.795514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac1d17-88b0-4ce2-8794-8fad9d8302d4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:21.811996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12261b-6ef9-4036-934b-84c75ccdcf51 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:21.840450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db03e-364c-4d62-ad96-035e508ff47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:21.841650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db03e-364c-4d62-ad96-035e508ff47f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:21.841940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db03e-364c-4d62-ad96-035e508ff47f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:21.842208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db03e-364c-4d62-ad96-035e508ff47f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:21.855029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73db03e-364c-4d62-ad96-035e508ff47f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e73db03e-364c-4d62-ad96-035e508ff47f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:21.867357 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:21.868339 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:21.869181 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 174/341] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:21.875307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1339-f5e6-4c87-926c-84dc72641d0a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:21.875307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1339-f5e6-4c87-926c-84dc72641d0a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:21.875307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1339-f5e6-4c87-926c-84dc72641d0a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:21.875307 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 175/342] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:21.878688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1339-f5e6-4c87-926c-84dc72641d0a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:21.908073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a46ec-bed2-4c12-8c34-acf645051502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:21.908771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a46ec-bed2-4c12-8c34-acf645051502 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:21.909059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a46ec-bed2-4c12-8c34-acf645051502 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:21.909350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a46ec-bed2-4c12-8c34-acf645051502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:21.945536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:21.999496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a46ec-bed2-4c12-8c34-acf645051502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:22.001070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a46ec-bed2-4c12-8c34-acf645051502 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:22.040295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1339-f5e6-4c87-926c-84dc72641d0a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:22.080266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89587f58-6c2f-4b4f-b433-db8da32a919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:22.080962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587f58-6c2f-4b4f-b433-db8da32a919d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.081253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587f58-6c2f-4b4f-b433-db8da32a919d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.081533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89587f58-6c2f-4b4f-b433-db8da32a919d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.082305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89587f58-6c2f-4b4f-b433-db8da32a919d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:22.082628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89587f58-6c2f-4b4f-b433-db8da32a919d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:22.085227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89587f58-6c2f-4b4f-b433-db8da32a919d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:22.095478 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 176/343] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:22.096367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:22.098395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78310a0-a9f0-4a0e-9f74-07bc691c26cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.099437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78310a0-a9f0-4a0e-9f74-07bc691c26cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.099437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78310a0-a9f0-4a0e-9f74-07bc691c26cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.123928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 168/344] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:19:22.124119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b78310a0-a9f0-4a0e-9f74-07bc691c26cd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:22.125343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50abfa-0461-4d01-9b50-7b9f56858a54 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.125450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b78310a0-a9f0-4a0e-9f74-07bc691c26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:22.125626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50abfa-0461-4d01-9b50-7b9f56858a54 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.125866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50abfa-0461-4d01-9b50-7b9f56858a54 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.127760 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 169/345] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:22.128647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50abfa-0461-4d01-9b50-7b9f56858a54 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:22.244267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 177/346] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:22.245262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78310a0-a9f0-4a0e-9f74-07bc691c26cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:22.305070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:22.331591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50abfa-0461-4d01-9b50-7b9f56858a54 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:22.375786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:22.376469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.376759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.377155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.421392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78310a0-a9f0-4a0e-9f74-07bc691c26cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:22.442920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:22.470178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:22.472751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:22.480112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdf1c4-6193-48ee-8d93-635566dd740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:22.481004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf1c4-6193-48ee-8d93-635566dd740b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.481291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf1c4-6193-48ee-8d93-635566dd740b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.481577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf1c4-6193-48ee-8d93-635566dd740b None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.482988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdf1c4-6193-48ee-8d93-635566dd740b None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:22.485091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdf1c4-6193-48ee-8d93-635566dd740b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:22.487441 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 178/347] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:22 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:22.488833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9de9d9-890b-4867-9c28-b69e2469079d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.489132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9de9d9-890b-4867-9c28-b69e2469079d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.489417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9de9d9-890b-4867-9c28-b69e2469079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.515398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ce9de9d9-890b-4867-9c28-b69e2469079d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:22.516660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce9de9d9-890b-4867-9c28-b69e2469079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:22.608426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 170/348] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:22.609456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:22.616162 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 179/349] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:22.617090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9de9d9-890b-4867-9c28-b69e2469079d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:22.671367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:22.721863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:22.742981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e35e21-064e-4768-80ed-4968e645fe99 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:22.772768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9de9d9-890b-4867-9c28-b69e2469079d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:22.782845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:22.783732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.784021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.784301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.797357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:22.805430 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:22.808207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 171/350] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:22.810154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:22.825400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:22.826457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.826750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.827028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.834410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:22.836309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:22.840269 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 180/351] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:22 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:22.840935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:22.943629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e8287-165b-46eb-9065-3ebd3e41c426 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:22.978893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:22.988978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf7be-3981-45b2-94ab-6107ed63c679 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:22.992835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:22.993755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:22.994035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:22.994310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:22.995622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:22.997153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:22.999069 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 172/352] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:22 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:22.999694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:23.017763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:23.058542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:23.059407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.059695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.059988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.075521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:23.085518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:23.090900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 181/353] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:23.091761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:23.156757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153d38-14b1-469c-9cae-d0148b44e2ab None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:23.204231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:23.204823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.205125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.205434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.206784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:23.207105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:23.208568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:23.222366 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 173/354] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:23.224226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:23.258382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0cc15-96dc-4d91-8d26-b6658e527739 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:23.331976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:23.339711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84d513-0455-48a3-a4d3-3e72e10904d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:23.340412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d513-0455-48a3-a4d3-3e72e10904d7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.340850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d513-0455-48a3-a4d3-3e72e10904d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.341277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d513-0455-48a3-a4d3-3e72e10904d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.342362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d513-0455-48a3-a4d3-3e72e10904d7 None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:23.342685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d513-0455-48a3-a4d3-3e72e10904d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:23.344237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d513-0455-48a3-a4d3-3e72e10904d7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:23.354368 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 182/355] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:23 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=963435a25dbf491c8b345da8e43344c3 => generated 260 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:23.356222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcacda-6f82-4b4c-95d4-0e013d17f7c6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.356520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcacda-6f82-4b4c-95d4-0e013d17f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.356794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcacda-6f82-4b4c-95d4-0e013d17f7c6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.358429 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 183/356] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:23.359163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcacda-6f82-4b4c-95d4-0e013d17f7c6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:23.376617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd070bab-3d07-45fd-a1b9-b2b981fe42d1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:23.396597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:23.431782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:23.432981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.433522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.434029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.436655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:23.438531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:23.441056 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 174/357] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:23 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:23.442298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:23.526702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcacda-6f82-4b4c-95d4-0e013d17f7c6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:23.574122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34858ba-90cd-4511-b666-0d423a40c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:23.575027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34858ba-90cd-4511-b666-0d423a40c27e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.575399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34858ba-90cd-4511-b666-0d423a40c27e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.575680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34858ba-90cd-4511-b666-0d423a40c27e None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.576533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34858ba-90cd-4511-b666-0d423a40c27e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:23.576845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34858ba-90cd-4511-b666-0d423a40c27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:23.578422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34858ba-90cd-4511-b666-0d423a40c27e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:23.590892 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 184/358] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:23.592047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c64f-0d6e-4ce2-879f-3207de21d26e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.592341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c64f-0d6e-4ce2-879f-3207de21d26e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.592659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c64f-0d6e-4ce2-879f-3207de21d26e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.594094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 185/359] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:23.595028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115198c2-8059-40fd-ace9-4854687a9df1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.595337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115198c2-8059-40fd-ace9-4854687a9df1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.595621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115198c2-8059-40fd-ace9-4854687a9df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.611616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e19837-f2ce-4382-8fdb-f4c21d34d412 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:23.617719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-115198c2-8059-40fd-ace9-4854687a9df1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:23.619048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-115198c2-8059-40fd-ace9-4854687a9df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:23.659612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:23.660282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.660572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.660851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.675010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:23.724212 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 186/360] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:23.725095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115198c2-8059-40fd-ace9-4854687a9df1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:23.744704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:23.766132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:23.768515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:23.867876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115198c2-8059-40fd-ace9-4854687a9df1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:23.914874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 175/361] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:23.915970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:23.926582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a7170-db03-4570-bf95-f46bf213b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:23.928029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a7170-db03-4570-bf95-f46bf213b02f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.928314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a7170-db03-4570-bf95-f46bf213b02f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.930832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a7170-db03-4570-bf95-f46bf213b02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.931107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a7170-db03-4570-bf95-f46bf213b02f None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:23.931421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a7170-db03-4570-bf95-f46bf213b02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:23.934038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a7170-db03-4570-bf95-f46bf213b02f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:23.942336 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 187/362] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:23 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:23.942512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79808fcb-ac56-4d4e-a0d7-b5d4718b7e5c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:23.942882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79808fcb-ac56-4d4e-a0d7-b5d4718b7e5c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:23.943063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79808fcb-ac56-4d4e-a0d7-b5d4718b7e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:23.970828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79808fcb-ac56-4d4e-a0d7-b5d4718b7e5c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:23.972537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79808fcb-ac56-4d4e-a0d7-b5d4718b7e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:23.979444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.057359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c9381-5f40-4240-82d5-dc29f9afbffe None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.081654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 188/363] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:24.085256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79808fcb-ac56-4d4e-a0d7-b5d4718b7e5c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.089740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.126462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.127839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.128135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.128415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] PATH_INFO: `/v3/users/05dbe9a12ed94c1b932b7e6aac07988f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.130566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] RBAC: Authorizing `identity:get_user(user_id=05dbe9a12ed94c1b932b7e6aac07988f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:24.133440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:24.136147 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 176/364] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:19:23 2022] GET /identity/v3/users/05dbe9a12ed94c1b932b7e6aac07988f => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:24.139304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.235877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79808fcb-ac56-4d4e-a0d7-b5d4718b7e5c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.280860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.281676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.282032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.282385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.296689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38445b-b8f7-445a-a04c-eeb0953df6fa None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.299671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:24.307804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:24.308333 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:24.309226 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:24.310086 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 189/365] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:24.310838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.362052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.363690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.363690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.364095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.366358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:24.367960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:24.369864 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 177/366] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:24.371377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.398668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.442197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48cc75-f237-4cf3-a921-4b88ec39e6b9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.481136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.482323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.482811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.483315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.489300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a0d4d-e3d5-47d6-a122-ee83391131fe None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.495244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:24.504062 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:24.505000 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:24.505804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:24.508576 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 190/367] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:24.510246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.529877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.530562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.530852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.531135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.532020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] RBAC: Adding query filter params (role.id=48feeeecfc894491b5070d387fe04c8a, user.id=05dbe9a12ed94c1b932b7e6aac07988f, scope.system=all) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:24.532400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:24.533940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:24.547919 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 178/368] 10.222.0.98 () {56 vars in 1308 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/role_assignments?user.id=05dbe9a12ed94c1b932b7e6aac07988f&scope.system=all&role.id=48feeeecfc894491b5070d387fe04c8a => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:24.548590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.592536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.645217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e980f-04c0-4241-98e5-45f0555f1dd4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.677073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c74cf6-f3a4-4b3f-8019-82d5edf0027d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.678883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.688340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.689223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.689626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.690014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.690967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:24.691441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:24.693001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:24.703305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 191/369] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:24.704345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.723764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.724655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.724944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.725226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.726489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:24.729815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:24.731880 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 179/370] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:24.732487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.831713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a911b-6433-406b-8c19-2a2b5059ee0f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.849484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62614530-70d3-4de3-9619-bbb01192361e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:24.851253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.877345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.878390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.879009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.879481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.880505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:24.880959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:24.882704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:24.890130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:24.890810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:24.891107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:24.891654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:24.894194 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 192/371] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:24.895592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:24.958012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:24.981383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:24.982915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:25.019102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f7a72-5706-4646-8e5b-7bf6c1fd045a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:25.058273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:25.059314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:25.059801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:25.060278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:25.061309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=67210f5643274f11b0bf0b2085608218) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:25.061820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:25.063496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:25.070941 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 193/372] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=963435a25dbf491c8b345da8e43344c3 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:25.072389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:25.144538 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 180/373] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:25.150609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:25.153180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:25.203668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865331e-5dd6-4b97-ac7b-84d4c1dddd4c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:25.218667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:25.251754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:25.252455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:25.252750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:25.253039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:25.379121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7af01d-6a18-4eba-9267-1935bd6a957b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:25.392365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:25.394516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:25.444259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:25.445626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:25.447730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:25.449007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:25.450906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:25.453377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:25.455596 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 181/374] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:25 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:25.462004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:25.583332 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 194/375] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:25.590338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:25.613725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:25.618410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:25.678680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2578f2-ec10-425f-bc91-9a37e733980b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:25.737161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:25.739061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:25.739061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:25.739061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:25.744784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:25.746304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:25.747685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab80fa3-6635-44f5-8fe9-f674a52b9c74 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:25.748115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 182/376] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:25 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:25.754111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:25.811678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:25.812960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:25.813450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:25.813921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] PATH_INFO: `/v3/projects/8825e26169ac4a448a49e26a9c5f74ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:25.822522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] RBAC: Authorizing `identity:get_project(project_id=8825e26169ac4a448a49e26a9c5f74ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:25.824502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:25.827167 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 195/377] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:25 2022] GET /identity/v3/projects/8825e26169ac4a448a49e26a9c5f74ba => generated 344 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:25.832936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:25.970004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18fcc7-c959-415f-b8d1-71d91173092c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:25.977991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:26.003431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab21ab-5cbb-4bde-82d2-91eed8198d1f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:26.021416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d1d49-a392-4b8d-b033-2b938a1fe4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:26.022431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1d49-a392-4b8d-b033-2b938a1fe4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.022975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1d49-a392-4b8d-b033-2b938a1fe4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.023430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1d49-a392-4b8d-b033-2b938a1fe4a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.024455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d1d49-a392-4b8d-b033-2b938a1fe4a6 None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=67210f5643274f11b0bf0b2085608218) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:26.025513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d1d49-a392-4b8d-b033-2b938a1fe4a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:26.027406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d1d49-a392-4b8d-b033-2b938a1fe4a6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:26.034506 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 183/378] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:25 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:26.036313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e7c3-c060-4bcf-b489-aa0458326599 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.036801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e7c3-c060-4bcf-b489-aa0458326599 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.037239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e7c3-c060-4bcf-b489-aa0458326599 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.038966 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 184/379] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:26.045741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08291-93c9-46ba-a796-812f87aabd55 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.046290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08291-93c9-46ba-a796-812f87aabd55 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.046711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08291-93c9-46ba-a796-812f87aabd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.052275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:26.056991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:26.057901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.058191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.058476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] PATH_INFO: `/v3/groups/9944ed16fa3b4924809e2b9d589773ad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.069204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b7b08291-93c9-46ba-a796-812f87aabd55 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:26.070923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7b08291-93c9-46ba-a796-812f87aabd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:26.071964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] RBAC: Authorizing `identity:get_group(group_id=9944ed16fa3b4924809e2b9d589773ad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:26.073512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:26.079332 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 196/380] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:25 2022] GET /identity/v3/groups/9944ed16fa3b4924809e2b9d589773ad => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:26.091591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:26.197822 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 185/381] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:26.230104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08291-93c9-46ba-a796-812f87aabd55 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:26.285651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e97360-0ffc-4179-8208-04b6a2bc44fb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:26.332297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:26.333546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.333834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.334114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.335130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] RBAC: Adding query filter params (group.id=9944ed16fa3b4924809e2b9d589773ad, role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=8825e26169ac4a448a49e26a9c5f74ba) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:26.335477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:26.337620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:26.363313 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 197/382] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:26 2022] GET /identity/v3/role_assignments?group.id=9944ed16fa3b4924809e2b9d589773ad&scope.project.id=8825e26169ac4a448a49e26a9c5f74ba&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:26.401017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08291-93c9-46ba-a796-812f87aabd55 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:26.436835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:26.444288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:26.445113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.445396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.445665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.459489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:26.468633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:26.470383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:26.472036 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:26.473369 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 186/383] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:26.477217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:26.490980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:26.621688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73a557-bb28-4544-adae-a66dcfc7b582 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:26.662266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200fa9-fb5a-4ff6-96ba-27b2378f6cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:26.662978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200fa9-fb5a-4ff6-96ba-27b2378f6cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.663294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200fa9-fb5a-4ff6-96ba-27b2378f6cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.663580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200fa9-fb5a-4ff6-96ba-27b2378f6cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.669163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200fa9-fb5a-4ff6-96ba-27b2378f6cd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:26.669476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200fa9-fb5a-4ff6-96ba-27b2378f6cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:26.670899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200fa9-fb5a-4ff6-96ba-27b2378f6cd0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:26.686288 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 198/384] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:26.692412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:26.717235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac31c-7ddc-4d33-82dd-b920c8e65a5d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.717574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac31c-7ddc-4d33-82dd-b920c8e65a5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.717796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac31c-7ddc-4d33-82dd-b920c8e65a5d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.719338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 199/385] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:19:26.724857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c574-5e19-4efa-b98e-60668ac29dc0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.725174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c574-5e19-4efa-b98e-60668ac29dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.725422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c574-5e19-4efa-b98e-60668ac29dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.752462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d277c574-5e19-4efa-b98e-60668ac29dc0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:26.753589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d277c574-5e19-4efa-b98e-60668ac29dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:26.851878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ef54-009f-464d-86f1-aeb95e66693f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:26.859645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:26.866426 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 200/386] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:26.901575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:26.902805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:26.903354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:26.903907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:26.906305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:26.907592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277c574-5e19-4efa-b98e-60668ac29dc0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:26.908337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:26.910224 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 187/387] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:26 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:26.917271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:27.014542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:27.097011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d38ac1-b57b-4a56-891b-73b21d6d913d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:27.117615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277c574-5e19-4efa-b98e-60668ac29dc0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:27.161943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:27.163136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:27.163633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:27.163914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:27.166201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:27.167712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:27.169650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 188/388] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:26 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:27.176521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:27.194676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:27.195589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:27.195880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:27.196162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:27.219937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:27.234108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:27.235071 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:27.235936 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:27.236539 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 201/389] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:27.242336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:27.390538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:27.430001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b863-595a-4c69-9d4b-22f96e22bfd8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:27.478498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8037c-b18d-4d6d-8638-9e62932f1c25 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:27.491664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:27.504061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:27.505017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:27.505299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:27.505574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:27.508535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef84209ba73f44d5af154b4c3dbe77a8, group_id=4a553ad013fc4a71904ffc4ee4b06acf, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:27.510033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:27.532487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 189/390] 10.222.0.98 () {58 vars in 1442 bytes} [Thu Jul 14 14:19:27 2022] PUT /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:27.548196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:27.548911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:27.549196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:27.549486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:27.550364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:27.550729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:27.552187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:27.566398 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 202/391] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:27.572594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:27.710300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e14d-21fb-4b9c-b638-5d03ef5ecf57 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:27.750697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:27.751600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:27.751885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:27.752162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:27.753329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:27.754775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:27.756734 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 190/392] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:27 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:27.762172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:27.877078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f72d6e-1a24-4658-83b8-b1ccafe7690a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:27.906174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:27.920037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e7096-8037-41a7-88ba-48d4a3a7c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:27.920912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7096-8037-41a7-88ba-48d4a3a7c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:27.921195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7096-8037-41a7-88ba-48d4a3a7c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:27.921535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7096-8037-41a7-88ba-48d4a3a7c6c9 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:27.922893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e7096-8037-41a7-88ba-48d4a3a7c6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:27.924388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e7096-8037-41a7-88ba-48d4a3a7c6c9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:27.926090 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 203/393] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:27 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:27.932490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:28.035822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:28.095278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a8fff-6982-4f77-ae72-c0c0ff0538d8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:28.130607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040999-c62a-4508-a4ac-dbc7ec56327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:28.131443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040999-c62a-4508-a4ac-dbc7ec56327b None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:28.131729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040999-c62a-4508-a4ac-dbc7ec56327b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:28.132004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040999-c62a-4508-a4ac-dbc7ec56327b None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:28.134466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040999-c62a-4508-a4ac-dbc7ec56327b None admin] RBAC: Authorizing `identity:create_grant(project_id=ef84209ba73f44d5af154b4c3dbe77a8, group_id=4a553ad013fc4a71904ffc4ee4b06acf, role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:28.135960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040999-c62a-4508-a4ac-dbc7ec56327b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:28.155334 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 191/394] 10.222.0.98 () {58 vars in 1442 bytes} [Thu Jul 14 14:19:27 2022] PUT /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:28.231440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754d2e-c591-47e6-8ce8-f001c5fcbf6a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:28.231781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754d2e-c591-47e6-8ce8-f001c5fcbf6a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:28.232048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c754d2e-c591-47e6-8ce8-f001c5fcbf6a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:28.233970 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 204/395] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:28.243761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425f91-5d72-4264-a409-ed7a3416ae5c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:28.243761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425f91-5d72-4264-a409-ed7a3416ae5c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:28.243761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425f91-5d72-4264-a409-ed7a3416ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:28.264085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-96425f91-5d72-4264-a409-ed7a3416ae5c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:28.264085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96425f91-5d72-4264-a409-ed7a3416ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:28.369735 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 192/396] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:28.395132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c754d2e-c591-47e6-8ce8-f001c5fcbf6a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:28.507774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c754d2e-c591-47e6-8ce8-f001c5fcbf6a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:28.546100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:28.547144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:28.547617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:28.548032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:28.569279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:28.577808 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:28.578910 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:28.579842 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:28.587449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 205/397] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:28.588980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425f91-5d72-4264-a409-ed7a3416ae5c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:28.697939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:28.790963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425f91-5d72-4264-a409-ed7a3416ae5c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:28.866690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2265-5406-4fc8-900e-3f1544b74eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:28.867401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2265-5406-4fc8-900e-3f1544b74eff None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:28.867685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2265-5406-4fc8-900e-3f1544b74eff None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:28.867962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2265-5406-4fc8-900e-3f1544b74eff None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:28.869295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2265-5406-4fc8-900e-3f1544b74eff None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:28.869675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2265-5406-4fc8-900e-3f1544b74eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:28.871124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2265-5406-4fc8-900e-3f1544b74eff None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:28.891323 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 193/398] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:28.896029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.043752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:29.104070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40777f5-137e-4c68-abab-90ba3ba339b7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.104360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40777f5-137e-4c68-abab-90ba3ba339b7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.104645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40777f5-137e-4c68-abab-90ba3ba339b7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.106015 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 194/399] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:29.111812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc1ac-bfb9-4b5a-a661-cabae868d7ee None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.112099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc1ac-bfb9-4b5a-a661-cabae868d7ee None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.112376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc1ac-bfb9-4b5a-a661-cabae868d7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.141602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-575dc1ac-bfb9-4b5a-a661-cabae868d7ee None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:29.142863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-575dc1ac-bfb9-4b5a-a661-cabae868d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:29.150862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c6bf-0a11-48e3-a741-67d21a46a877 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:29.238296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:29.252205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.252497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.252828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.259760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:29.269939 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 195/400] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:29.270083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:29.271753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac020df-b341-43c9-a1fd-88daf1139f93 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.272253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac020df-b341-43c9-a1fd-88daf1139f93 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.272862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac020df-b341-43c9-a1fd-88daf1139f93 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.278446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 206/402] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:28 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:29.278446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.278893 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 196/402] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:29.280680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ab1b-2d8f-4065-8336-b55ceebd957b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.281167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ab1b-2d8f-4065-8336-b55ceebd957b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.281662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ab1b-2d8f-4065-8336-b55ceebd957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.301401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-83e4ab1b-2d8f-4065-8336-b55ceebd957b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:29.303194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-83e4ab1b-2d8f-4065-8336-b55ceebd957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:29.341490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:29.385203 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 197/403] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:29.386405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ab1b-2d8f-4065-8336-b55ceebd957b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.452457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5216-1592-4b89-80bf-05fee3b5e8f6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:29.470368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:29.490451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:29.491348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.491640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.491918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.493797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:29.495045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:29.497293 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 207/404] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:29 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:29.497906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.500532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ab1b-2d8f-4065-8336-b55ceebd957b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:29.537886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:29.539047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.539561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.540131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.551158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:29.559886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:29.560769 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:29.561573 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:29.563974 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 198/405] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:29.564957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.597189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:29.609540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2c78-f3bd-4e9e-b6be-8fea7578072c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:29.645462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:29.646562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.646562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.646846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.658308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:29.667317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:29.668284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:29.669075 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:29.673345 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 208/406] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:29.674639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.685161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937396d-ae68-4d97-982f-9f1a62507738 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:29.722955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:29.724231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.724719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.725228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.728166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] RBAC: Authorizing `identity:create_grant(project_id=67210f5643274f11b0bf0b2085608218, group_id=4a553ad013fc4a71904ffc4ee4b06acf, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:29.729992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:29.735993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:29.753040 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 199/407] 10.222.0.98 () {58 vars in 1442 bytes} [Thu Jul 14 14:19:29 2022] PUT /identity/v3/projects/67210f5643274f11b0bf0b2085608218/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:29.755327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.824214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4e91-11f5-4bc9-8944-453b1433202e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:29.919937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:29.928727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:29.929737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.930198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.930484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.931335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:29.931626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:29.933032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:29.934985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84914012-2de2-40ca-8f25-2d825030e5de None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:29.945580 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 209/408] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:29.952071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:29.978175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:29.978864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:29.979153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:29.979470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:29.980233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:29.980547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:29.982476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:29.994023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 200/409] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:29.999467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:30.140029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b481724-412d-405b-b7e2-4bb752f500ca None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:30.161661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba271eb-be5a-459f-b5d8-ac42f450c843 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:30.178398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:30.211703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:30.212645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.213029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.213320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] PATH_INFO: `/v3/groups/9944ed16fa3b4924809e2b9d589773ad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.214398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:30.214775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] RBAC: Authorizing `identity:get_group(group_id=9944ed16fa3b4924809e2b9d589773ad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:30.215932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.216338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:30.216627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.217092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.223304 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 210/410] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:29 2022] GET /identity/v3/groups/9944ed16fa3b4924809e2b9d589773ad => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:30.223455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:30.223455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:30.223455 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 201/411] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:29 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:30.228432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:30.245832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:30.277164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:30.372094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58701-9d2d-4d47-92e0-2bf5d7d48673 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:30.380063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985253-09f8-4c20-bbae-1d065e3a854b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:30.409780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba3d7-0468-4e80-96b4-5502f0a0332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:30.410659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba3d7-0468-4e80-96b4-5502f0a0332f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.410942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba3d7-0468-4e80-96b4-5502f0a0332f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.411221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba3d7-0468-4e80-96b4-5502f0a0332f None admin] PATH_INFO: `/v3/projects/8825e26169ac4a448a49e26a9c5f74ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.412487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba3d7-0468-4e80-96b4-5502f0a0332f None admin] RBAC: Authorizing `identity:get_project(project_id=8825e26169ac4a448a49e26a9c5f74ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:30.413989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba3d7-0468-4e80-96b4-5502f0a0332f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:30.416640 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 211/412] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:30 2022] GET /identity/v3/projects/8825e26169ac4a448a49e26a9c5f74ba => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:30.418171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b21e83-a8b4-4706-8745-1c90441d9966 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.418456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b21e83-a8b4-4706-8745-1c90441d9966 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.418736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b21e83-a8b4-4706-8745-1c90441d9966 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.420032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 212/413] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:30.422451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:30.423609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.424096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.424601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.425342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0bee-7e86-42d4-a29b-22b39513015b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.425595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0bee-7e86-42d4-a29b-22b39513015b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.425887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0bee-7e86-42d4-a29b-22b39513015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.426593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:30.428283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:30.430470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 202/414] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:30 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:30.436991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:30.443468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-137f0bee-7e86-42d4-a29b-22b39513015b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:30.444661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-137f0bee-7e86-42d4-a29b-22b39513015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:30.488864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:30.517308 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 213/415] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:30.527787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0bee-7e86-42d4-a29b-22b39513015b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:30.541487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:30.559996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164581b-5104-4538-98a8-921007fa11e8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:30.627767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:30.630615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.631426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.632480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] PATH_INFO: `/v3/projects/8825e26169ac4a448a49e26a9c5f74ba/groups/9944ed16fa3b4924809e2b9d589773ad/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.637214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] RBAC: Authorizing `identity:create_grant(project_id=8825e26169ac4a448a49e26a9c5f74ba, group_id=9944ed16fa3b4924809e2b9d589773ad, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:30.640582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:30.648944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0bee-7e86-42d4-a29b-22b39513015b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:30.663995 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 203/416] 10.222.0.98 () {58 vars in 1442 bytes} [Thu Jul 14 14:19:30 2022] PUT /identity/v3/projects/8825e26169ac4a448a49e26a9c5f74ba/groups/9944ed16fa3b4924809e2b9d589773ad/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:30.666996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:30.692306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a39ba-3bb9-4a83-9ada-d7079b733e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:30.693285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a39ba-3bb9-4a83-9ada-d7079b733e43 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.693660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a39ba-3bb9-4a83-9ada-d7079b733e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.693948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a39ba-3bb9-4a83-9ada-d7079b733e43 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.696361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a39ba-3bb9-4a83-9ada-d7079b733e43 None admin] RBAC: Authorizing `identity:create_grant(project_id=67210f5643274f11b0bf0b2085608218, group_id=4a553ad013fc4a71904ffc4ee4b06acf, role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:30.697993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a39ba-3bb9-4a83-9ada-d7079b733e43 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:30.725573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 214/417] 10.222.0.98 () {58 vars in 1442 bytes} [Thu Jul 14 14:19:30 2022] PUT /identity/v3/projects/67210f5643274f11b0bf0b2085608218/groups/4a553ad013fc4a71904ffc4ee4b06acf/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:30.828447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1070-b4c3-4e0b-b1a5-31d887cbae3a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.828835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1070-b4c3-4e0b-b1a5-31d887cbae3a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.829025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1070-b4c3-4e0b-b1a5-31d887cbae3a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.830752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25e53a-27f7-4ea9-bbd7-aacbee750d49 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:30.830918 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 215/418] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:19:30.836367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabc30b-e9f1-4c4d-9f87-14793b4a70c9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.836695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabc30b-e9f1-4c4d-9f87-14793b4a70c9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.837482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabc30b-e9f1-4c4d-9f87-14793b4a70c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.857358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7eabc30b-e9f1-4c4d-9f87-14793b4a70c9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:30.858673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7eabc30b-e9f1-4c4d-9f87-14793b4a70c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:30.884355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:30.885711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:30.886468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:30.890440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:30.912853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:30.915131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:30.925410 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:30.926421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:30.927229 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:30.929606 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 204/419] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:30.941135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:30.954962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:30.999433 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 216/420] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:31.028355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabc30b-e9f1-4c4d-9f87-14793b4a70c9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:31.106384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a53ce0-b34b-415d-8096-962bd6e71547 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:31.181270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:31.182189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:31.182624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:31.183049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:31.183998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:31.184487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:31.186084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:31.207839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 205/421] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:31.214652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:31.223252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabc30b-e9f1-4c4d-9f87-14793b4a70c9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:31.302919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:31.303811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:31.304100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:31.304523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:31.317654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:31.333002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:31.343392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:31.344356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:31.345320 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 217/422] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:31.353505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:31.402458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:31.405801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eced9b-2ef0-49e3-898f-22043907b1a0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:31.480590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:31.481163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:31.481447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:31.481726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:31.561247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a78b51-d43f-4782-a70c-566465e4e911 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:31.617741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:31.619570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:31.656978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:31.657684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:31.657971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:31.658253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:31.659021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:31.659358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:31.660792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:31.680541 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 218/423] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:31.686153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:31.694065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:31.733803 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 206/424] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:19:31.739496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:31.875673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:31.890603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d6a4-805a-4869-9312-971eba43313d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:31.927549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed34491-36d0-478a-8f19-8e6435953522 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:31.971036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:31.971968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:31.972257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:31.972539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:31.974020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:31.975662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:31.978025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 207/425] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:31 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:31.983040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:31.998243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2def5ba-f1f8-4554-b3cc-e2b6cf736e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:31.998835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2def5ba-f1f8-4554-b3cc-e2b6cf736e74 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:31.999123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2def5ba-f1f8-4554-b3cc-e2b6cf736e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:31.999431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2def5ba-f1f8-4554-b3cc-e2b6cf736e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.062265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:32.138818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2def5ba-f1f8-4554-b3cc-e2b6cf736e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:32.140633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2def5ba-f1f8-4554-b3cc-e2b6cf736e74 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:32.157353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075a26d-219b-454b-a374-61eb1d95444a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:32.194196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c61e3e-5ba9-4202-8607-5bbb99bf9cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:32.195068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61e3e-5ba9-4202-8607-5bbb99bf9cdf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.195385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61e3e-5ba9-4202-8607-5bbb99bf9cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.195669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61e3e-5ba9-4202-8607-5bbb99bf9cdf None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.197580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c61e3e-5ba9-4202-8607-5bbb99bf9cdf None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:32.199166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c61e3e-5ba9-4202-8607-5bbb99bf9cdf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:32.201281 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 208/426] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:31 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:32.202745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c086c1-e634-4f64-9a4b-07f06f44d864 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.203036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c086c1-e634-4f64-9a4b-07f06f44d864 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.203345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c086c1-e634-4f64-9a4b-07f06f44d864 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.204996 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 209/427] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:32.209790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c086c1-e634-4f64-9a4b-07f06f44d864 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:32.311925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:32.316546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 219/428] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:32.318085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935da9-21f8-4013-91c0-fff57821b129 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.318503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935da9-21f8-4013-91c0-fff57821b129 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.318894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935da9-21f8-4013-91c0-fff57821b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.336598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09935da9-21f8-4013-91c0-fff57821b129 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:32.338695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09935da9-21f8-4013-91c0-fff57821b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:32.340299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c086c1-e634-4f64-9a4b-07f06f44d864 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:32.342940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:32.382379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:32.383043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.383353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.383686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.385476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:32.385476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:32.386884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:32.399579 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 210/429] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:32 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=963435a25dbf491c8b345da8e43344c3 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:32.400581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:32.415964 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 220/430] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:32.440036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935da9-21f8-4013-91c0-fff57821b129 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:32.595118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935da9-21f8-4013-91c0-fff57821b129 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:32.614854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8415721-380e-4db6-8f3d-da7218ba091d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:32.632795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:32.660984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:32.662661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.662953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.663243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.667462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:32.668348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.668625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.668904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] PATH_INFO: `/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.670502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] RBAC: Authorizing `identity:get_project(project_id=ef84209ba73f44d5af154b4c3dbe77a8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:32.672053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:32.674482 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 211/431] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:32 2022] GET /identity/v3/projects/ef84209ba73f44d5af154b4c3dbe77a8 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:32.679797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:32.684202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:32.693167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:32.694196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:19:32.694996 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:32.699553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 221/432] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:32.710683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:32.732949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:32.815151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd98bd-42b0-47da-9f9f-f402e3d399b1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:32.833079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752dcec-86bd-4a33-aaa8-3d9a73687424 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:32.855687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:32.856487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.856761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.857041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.858254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:32.859763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:32.861748 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 212/433] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:32 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:32.867574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:32.875672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:32.876660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:32.877146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:32.877684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:32.878794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:32.879337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:32.881099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:32.895520 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 222/434] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:32.897357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:32.944501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:32.980750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328121-45fc-4ca9-b359-a3ccc4c9fb0f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:32.983932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:33.018818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60065c-8bed-4ea4-923a-a02a182dc8f8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.019900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1dfc6-d8c6-4121-97ce-476242bf9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.020587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1dfc6-d8c6-4121-97ce-476242bf9788 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.020894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1dfc6-d8c6-4121-97ce-476242bf9788 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.021136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1dfc6-d8c6-4121-97ce-476242bf9788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.021989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1dfc6-d8c6-4121-97ce-476242bf9788 None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:33.022436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1dfc6-d8c6-4121-97ce-476242bf9788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:33.024273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1dfc6-d8c6-4121-97ce-476242bf9788 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:33.031744 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 213/435] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:32 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=ef84209ba73f44d5af154b4c3dbe77a8&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:33.071906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.072956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.073534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.074037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.161289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:33.163223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:33.215575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:33.241322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5b78-9844-4278-af0e-70aab7d3faee None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.241962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5b78-9844-4278-af0e-70aab7d3faee None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.242458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5b78-9844-4278-af0e-70aab7d3faee None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.244346 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 214/436] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:33.250255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d4a4-2867-4153-a668-5750c9b221df None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.250854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d4a4-2867-4153-a668-5750c9b221df None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.251385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d4a4-2867-4153-a668-5750c9b221df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.286588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6633d4a4-2867-4153-a668-5750c9b221df None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:33.287881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6633d4a4-2867-4153-a668-5750c9b221df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:33.290931 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 223/437] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:33.296250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.381656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 215/438] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:33.383472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa40e-9419-48ed-a933-df2ae98dde23 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.384036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa40e-9419-48ed-a933-df2ae98dde23 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.384519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa40e-9419-48ed-a933-df2ae98dde23 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.386142 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 216/439] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:33.392880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264e31-258d-484b-8ce3-2cc05ce390aa None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.393203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264e31-258d-484b-8ce3-2cc05ce390aa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.393451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264e31-258d-484b-8ce3-2cc05ce390aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.413896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5d264e31-258d-484b-8ce3-2cc05ce390aa None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:33.415631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5d264e31-258d-484b-8ce3-2cc05ce390aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:33.422322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65841ee-2c06-4c8d-9ec1-7d1930dda6c2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.467592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.468504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.468791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.469075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.470345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:33.471889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:33.475322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 224/440] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:33.475322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.485083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:33.505856 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 217/441] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:33.507053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d264e31-258d-484b-8ce3-2cc05ce390aa None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.547778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:33.598270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204e55b-ef09-4988-9303-e20afdf2c212 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.622990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d264e31-258d-484b-8ce3-2cc05ce390aa None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.634451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.635249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.635561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.635844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.646296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:33.654089 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:33.655015 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 225/442] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:33.656297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.659512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.660454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.660743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.661027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.662222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:33.663763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:33.666023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 218/443] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:33.666736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.734980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:33.765030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:33.771336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4077a-2fe2-42d1-9072-76ecae45d66e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.771478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39a5af-dd99-48e3-890d-2f214ee4f602 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.806245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.806609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.807058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.807297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.807391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.807583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.807701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.807865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.808603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:33.808908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:33.810287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:33.818369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:33.818663 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 219/444] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:33.819556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:33.827115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:33.828256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:33.829069 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 226/445] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:33.829765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.922630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0cb5f-fc74-48c9-81f7-2e454ff08803 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.931538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bfbc-c9f2-4059-95a8-20e3e0f4977b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:33.956262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.956505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:33.956921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.957204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.957486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:33.958304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=963435a25dbf491c8b345da8e43344c3, scope.project.id=67210f5643274f11b0bf0b2085608218) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:33.958619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:33.960090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:33.967378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:33.967537 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 220/446] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=963435a25dbf491c8b345da8e43344c3 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:33.968043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:33.968226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:33.968317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:33.968657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.006788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:34.055590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.057540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.101797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6deed-c5ae-4818-bc94-009b2af6065d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.145074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.145763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.146047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.146328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.147080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:34.147423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.148817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.160297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 221/447] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:34.166485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:34.179912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 227/448] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:34.185740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:34.222830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:34.278681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:34.298271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24e21-46c7-4a9a-829b-b08bc42f3ae7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.325560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba474-06a4-4a05-b99f-a4e5236bc066 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.341002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.341677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.341972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.342256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.364600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.366246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.366246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.366246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] PATH_INFO: `/v3/projects/8825e26169ac4a448a49e26a9c5f74ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.367170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] RBAC: Authorizing `identity:get_project(project_id=8825e26169ac4a448a49e26a9c5f74ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.369306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.371161 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 228/449] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:34 2022] GET /identity/v3/projects/8825e26169ac4a448a49e26a9c5f74ba => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:34.376556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:34.412876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.414367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.469962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:34.477828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baf7b5-92ea-4f97-833b-d5925326fe47 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.498947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:34.511913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.512778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.513061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.513339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] PATH_INFO: `/v3/groups/9944ed16fa3b4924809e2b9d589773ad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.514538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] RBAC: Authorizing `identity:get_group(group_id=9944ed16fa3b4924809e2b9d589773ad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.515051 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 222/450] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:19:34.518327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.518327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 229/451] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:34 2022] GET /identity/v3/groups/9944ed16fa3b4924809e2b9d589773ad => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:34.520867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:34.523535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:34.624998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef80f4-f597-459e-b77b-c50c7a139f86 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.628798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9a2f9-6f4a-4a9d-b14c-c6d810e65472 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.659857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.660720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.661005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.661280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] PATH_INFO: `/v3/projects/67210f5643274f11b0bf0b2085608218` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.662448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] RBAC: Authorizing `identity:get_project(project_id=67210f5643274f11b0bf0b2085608218)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.662999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.663678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.663940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.664024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.664239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.665739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] RBAC: Adding query filter params (group.id=9944ed16fa3b4924809e2b9d589773ad, role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=8825e26169ac4a448a49e26a9c5f74ba) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:34.666053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.666200 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 223/452] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:19:34 2022] GET /identity/v3/projects/67210f5643274f11b0bf0b2085608218 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:34.667515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.671630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:34.674063 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 230/453] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:34 2022] GET /identity/v3/role_assignments?group.id=9944ed16fa3b4924809e2b9d589773ad&scope.project.id=8825e26169ac4a448a49e26a9c5f74ba&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:34.730792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:34.782652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f4779-bf70-42fc-99a7-e0143924613b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.819629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd287678-f6cc-4a50-84b6-37e1972087bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.820499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287678-f6cc-4a50-84b6-37e1972087bc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.820783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287678-f6cc-4a50-84b6-37e1972087bc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.821097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287678-f6cc-4a50-84b6-37e1972087bc None admin] PATH_INFO: `/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.822818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd287678-f6cc-4a50-84b6-37e1972087bc None admin] RBAC: Authorizing `identity:get_group(group_id=4a553ad013fc4a71904ffc4ee4b06acf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.824309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd287678-f6cc-4a50-84b6-37e1972087bc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.826217 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 224/454] 10.222.0.98 () {56 vars in 1180 bytes} [Thu Jul 14 14:19:34 2022] GET /identity/v3/groups/4a553ad013fc4a71904ffc4ee4b06acf => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:34.832118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:34.862413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:34.938372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776360ed-b160-4c62-9fd0-2d7e7443efd3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:34.970680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d88cf3-e111-47e5-a7c4-b3a8ff189cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:34.971347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d88cf3-e111-47e5-a7c4-b3a8ff189cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:34.971631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d88cf3-e111-47e5-a7c4-b3a8ff189cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:34.971904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d88cf3-e111-47e5-a7c4-b3a8ff189cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:34.972725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d88cf3-e111-47e5-a7c4-b3a8ff189cb4 None admin] RBAC: Adding query filter params (group.id=4a553ad013fc4a71904ffc4ee4b06acf, role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=67210f5643274f11b0bf0b2085608218) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:34.973035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d88cf3-e111-47e5-a7c4-b3a8ff189cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:34.974468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d88cf3-e111-47e5-a7c4-b3a8ff189cb4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:34.980730 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 231/455] 10.222.0.98 () {56 vars in 1376 bytes} [Thu Jul 14 14:19:34 2022] GET /identity/v3/role_assignments?group.id=4a553ad013fc4a71904ffc4ee4b06acf&scope.project.id=67210f5643274f11b0bf0b2085608218&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:37.646543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861743a-b337-462d-b72c-a09d7c1133d3 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:37.647030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861743a-b337-462d-b72c-a09d7c1133d3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:37.647030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861743a-b337-462d-b72c-a09d7c1133d3 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:37.648668 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 225/456] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:37.655064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925943e-346e-457d-9aba-ff830a662d01 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:37.655964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925943e-346e-457d-9aba-ff830a662d01 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:37.656463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925943e-346e-457d-9aba-ff830a662d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:37.678835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3925943e-346e-457d-9aba-ff830a662d01 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:37.683212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3925943e-346e-457d-9aba-ff830a662d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:37.685005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54b7e-c332-4765-bd9f-10f3e3d9fcb8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:37.685503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54b7e-c332-4765-bd9f-10f3e3d9fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:37.686091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54b7e-c332-4765-bd9f-10f3e3d9fcb8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:37.687786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 226/457] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:37.693431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8e40-3233-45c7-a2eb-ca89d541ba17 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:37.694038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8e40-3233-45c7-a2eb-ca89d541ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:37.694512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8e40-3233-45c7-a2eb-ca89d541ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:37.722124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-72ae8e40-3233-45c7-a2eb-ca89d541ba17 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:37.723380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-72ae8e40-3233-45c7-a2eb-ca89d541ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:37.799426 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 232/458] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:37.822283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925943e-346e-457d-9aba-ff830a662d01 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:37.844953 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 227/459] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:37.845138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:37.882255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8e40-3233-45c7-a2eb-ca89d541ba17 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:37.941653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925943e-346e-457d-9aba-ff830a662d01 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:37.974996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:38.023116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.024084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.024381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.025162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.044635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.046112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:38.084284 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:38.085218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:38.086051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:38.086051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:38.086051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.086051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:38.087988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8e40-3233-45c7-a2eb-ca89d541ba17 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:38.096726 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 233/460] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:38.104331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:38.152921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be58c19-3cce-479f-a60d-9f8b7a2da39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.153920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be58c19-3cce-479f-a60d-9f8b7a2da39a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.154205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be58c19-3cce-479f-a60d-9f8b7a2da39a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.154485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be58c19-3cce-479f-a60d-9f8b7a2da39a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.166222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be58c19-3cce-479f-a60d-9f8b7a2da39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.167833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be58c19-3cce-479f-a60d-9f8b7a2da39a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0be58c19-3cce-479f-a60d-9f8b7a2da39a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:38.187835 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:38.189814 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 228/461] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0dda-b34b-47ea-9e5a-4c53437cb63c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0dda-b34b-47ea-9e5a-4c53437cb63c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.191911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0dda-b34b-47ea-9e5a-4c53437cb63c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.195357 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 229/462] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:38.199588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9cf2-93fa-4689-9631-b4b634de7424 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.199955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9cf2-93fa-4689-9631-b4b634de7424 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.200307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9cf2-93fa-4689-9631-b4b634de7424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.208380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:38.220931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-eccc9cf2-93fa-4689-9631-b4b634de7424 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:38.222247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eccc9cf2-93fa-4689-9631-b4b634de7424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:38.250994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89041f67-7ed0-4a30-aa35-6b9511753a9c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:38.299084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beadd9-fcde-436e-bd08-1ce2db6f50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.299801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beadd9-fcde-436e-bd08-1ce2db6f50d0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.300083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beadd9-fcde-436e-bd08-1ce2db6f50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.300361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beadd9-fcde-436e-bd08-1ce2db6f50d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.301090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beadd9-fcde-436e-bd08-1ce2db6f50d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:38.301394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beadd9-fcde-436e-bd08-1ce2db6f50d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.302778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beadd9-fcde-436e-bd08-1ce2db6f50d0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.311644 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 230/463] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:38.312851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc9cf2-93fa-4689-9631-b4b634de7424 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:38.331306 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 234/464] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:38.331306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38232dc7-67f2-45df-a6a7-568ac8d00ec8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.331306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38232dc7-67f2-45df-a6a7-568ac8d00ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.331306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38232dc7-67f2-45df-a6a7-568ac8d00ec8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.335198 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 235/465] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:38.337182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886d62-0990-442a-b833-6bfbe6264224 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.337478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886d62-0990-442a-b833-6bfbe6264224 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.337762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886d62-0990-442a-b833-6bfbe6264224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.353063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:38.357125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-31886d62-0990-442a-b833-6bfbe6264224 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:38.359245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-31886d62-0990-442a-b833-6bfbe6264224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:38.431519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc9cf2-93fa-4689-9631-b4b634de7424 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:38.439488 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 236/466] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:38.439488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31886d62-0990-442a-b833-6bfbe6264224 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:38.479754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.480685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.481129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.481562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.482435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:38.483319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.484848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.499151 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 231/467] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:38.499513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:38.514587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:38.558397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31886d62-0990-442a-b833-6bfbe6264224 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:38.599456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.600225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.600509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.600887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.601752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.603881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.609542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:38.623354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30febc-1c7c-43de-84c8-6f476ec4571b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:38.626497 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 237/468] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:38 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:38.627487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:38.695901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.698114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.698669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.699182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.717905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.720263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:38.748192 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:38.749090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:38.749974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:38.749974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:38.749974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.749974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:38.757800 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 232/469] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:38.757800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:38.771538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47372bd-f741-4782-a35f-6e54a969dc10 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:38.799786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:38.830769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.831640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.831926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.832211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.845386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.848532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:38.877868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:38.878989 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:38.879928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:38.879928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:38.879928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:38.879928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:38.879928 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 238/470] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:38.880832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:38.892799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551893f-ff28-4804-833d-a23649a93ba7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:38.948308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:38.949004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:38.949290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:38.949569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:38.950583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:38.952674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:38.977016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:38.987348 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 233/471] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:38 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:38.987348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:39.049433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce86b1-8e37-40f5-b7c0-8fcb541ec508 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:39.126617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93882-5322-48b8-863b-e1092c23e36a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:39.142858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:39.143817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:39.144268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:39.144696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:39.145615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:39.146080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:39.147734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:39.179032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a9062-ead4-4cd0-a6f7-7acb70267e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:39.179767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9062-ead4-4cd0-a6f7-7acb70267e19 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:39.180058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9062-ead4-4cd0-a6f7-7acb70267e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:39.180371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9062-ead4-4cd0-a6f7-7acb70267e19 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:39.181119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a9062-ead4-4cd0-a6f7-7acb70267e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:39.181428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a9062-ead4-4cd0-a6f7-7acb70267e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:39.184382 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 239/472] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:39.185325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a9062-ead4-4cd0-a6f7-7acb70267e19 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:39.190271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:39.215048 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 234/473] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:39.217230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cc6-7d46-4123-b6c0-3d5006000d54 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:39.217518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cc6-7d46-4123-b6c0-3d5006000d54 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:39.217801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cc6-7d46-4123-b6c0-3d5006000d54 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:39.220623 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 235/474] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:39.221660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80659cc6-7d46-4123-b6c0-3d5006000d54 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:39.235150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:39.312065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:39.338477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab29d4-dd7c-4cb6-9457-11a10f7d5e95 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:39.361342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80659cc6-7d46-4123-b6c0-3d5006000d54 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:39.382612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52924d64-2435-4e59-9000-d8ffe03e0eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:39.383769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52924d64-2435-4e59-9000-d8ffe03e0eda None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:39.384063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52924d64-2435-4e59-9000-d8ffe03e0eda None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:39.384338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52924d64-2435-4e59-9000-d8ffe03e0eda None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:39.385335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52924d64-2435-4e59-9000-d8ffe03e0eda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:39.387305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52924d64-2435-4e59-9000-d8ffe03e0eda None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:39.397207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:39.398095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:39.398513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:39.399575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:39.400304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:39.402135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:39.415157 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 240/475] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:39 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:19:39.417256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83aba01-df95-404b-8674-7cafae15f734 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:39.417548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83aba01-df95-404b-8674-7cafae15f734 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:39.417927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83aba01-df95-404b-8674-7cafae15f734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:39.431452 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 236/476] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:39 2022] POST /identity/v3/users => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:39.437915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c83aba01-df95-404b-8674-7cafae15f734 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:39.439344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c83aba01-df95-404b-8674-7cafae15f734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:39.533908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 241/477] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:39.597389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:39.741725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe89d-f029-4dc7-ab02-c0a852066a08 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:39.763160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:39.782975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:39.783699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:39.783989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:39.784273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:39.785028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:39.786423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:39.793849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.sql.core [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 14:19:39.793849 n-d-768852-23 devstack@keystone.service[80582]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 14:19:39.793849 n-d-768852-23 devstack@keystone.service[80582]: [parameters: {'id': '1071639d3c8f44a3bce374ebba62bd3b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 14:19:39.793849 n-d-768852-23 devstack@keystone.service[80582]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80582) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 14 14:19:39.812147 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:19:39.813117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application yield resource Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise self.value Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application session.commit() Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 14:19:39.814455 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.flush() Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application compat.raise_( Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:19:39.815472 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:19:39.816424 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:19:39.817266 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [parameters: {'id': '1071639d3c8f44a3bce374ebba62bd3b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:39.818062 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 14:19:39.818854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:39.821356 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 237/478] 10.222.0.98 () {60 vars in 1131 bytes} [Thu Jul 14 14:19:39 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:39.824509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83aba01-df95-404b-8674-7cafae15f734 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:39.854089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:39.966681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83aba01-df95-404b-8674-7cafae15f734 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:40.016410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34cbf5-14f1-4b73-9b12-f089652e7949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:40.017245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34cbf5-14f1-4b73-9b12-f089652e7949 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:40.017528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34cbf5-14f1-4b73-9b12-f089652e7949 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:40.017812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34cbf5-14f1-4b73-9b12-f089652e7949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:40.036251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34cbf5-14f1-4b73-9b12-f089652e7949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ae34cbf5-14f1-4b73-9b12-f089652e7949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:40.045268 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:40.046231 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:19:40.047029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:40.049146 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 242/479] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:19:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:40.054372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:40.216109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fdf05-b7f7-44d9-af63-ff6a9d6e998c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:40.265215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7ccb8-7574-4918-828c-665c3b4d8fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:40.265903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ccb8-7574-4918-828c-665c3b4d8fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:40.266194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ccb8-7574-4918-828c-665c3b4d8fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:40.266474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ccb8-7574-4918-828c-665c3b4d8fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:40.267235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7ccb8-7574-4918-828c-665c3b4d8fe3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:40.267573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7ccb8-7574-4918-828c-665c3b4d8fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:40.268967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7ccb8-7574-4918-828c-665c3b4d8fe3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:40.283254 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 238/480] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:41.062196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba4391-bd88-44a7-8b49-1071d9a6dffc None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:41.062709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba4391-bd88-44a7-8b49-1071d9a6dffc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:41.062783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba4391-bd88-44a7-8b49-1071d9a6dffc None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:41.064453 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 243/481] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:41.069847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238208e-90be-4b84-ad55-ead646502143 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:41.070398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238208e-90be-4b84-ad55-ead646502143 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:41.070398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238208e-90be-4b84-ad55-ead646502143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:41.096893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5238208e-90be-4b84-ad55-ead646502143 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:41.098097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5238208e-90be-4b84-ad55-ead646502143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:41.148406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:41.201783 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 239/482] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:41.248056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba4391-bd88-44a7-8b49-1071d9a6dffc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:41.338722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:41.364068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba4391-bd88-44a7-8b49-1071d9a6dffc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:41.398620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:41.399982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:41.400268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:41.400552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:41.420666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:41.432753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:41.433783 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:41.435088 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 244/483] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:41.440419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238208e-90be-4b84-ad55-ead646502143 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:41.575940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238208e-90be-4b84-ad55-ead646502143 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:41.634467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303bf29-8142-41b0-aab9-170316ffbb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:41.635120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303bf29-8142-41b0-aab9-170316ffbb90 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:41.635444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303bf29-8142-41b0-aab9-170316ffbb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:41.635727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303bf29-8142-41b0-aab9-170316ffbb90 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:41.636487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303bf29-8142-41b0-aab9-170316ffbb90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:41.636801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303bf29-8142-41b0-aab9-170316ffbb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:41.638201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303bf29-8142-41b0-aab9-170316ffbb90 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:41.647481 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 240/484] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:41.653876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:41.786647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceddfbd-c906-4be7-81a9-ebd2c1b5747d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:41.822256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:41.823063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:41.823378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:41.823664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:41.826575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:41.839557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:41.846325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235d9b-53ed-42c5-86d9-27670029149e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:41.846619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235d9b-53ed-42c5-86d9-27670029149e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:41.846902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235d9b-53ed-42c5-86d9-27670029149e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:41.847717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:41.848590 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 241/485] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:19:41.856110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f8623-ea93-4e13-a017-a85d87a03116 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:41.856403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f8623-ea93-4e13-a017-a85d87a03116 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:41.856679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f8623-ea93-4e13-a017-a85d87a03116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:41.868407 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:41.869332 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:41.870182 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:41.870182 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:41.870182 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:41.870182 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:41.872538 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 245/486] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:41.878357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:41.897244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3d9f8623-ea93-4e13-a017-a85d87a03116 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:41.899079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3d9f8623-ea93-4e13-a017-a85d87a03116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:41.959653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:42.035244 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 242/487] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:42.061271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f8623-ea93-4e13-a017-a85d87a03116 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.082516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8dc3f-0f12-40ad-ac6c-27ec50532ee9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.139255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c84336-5512-4670-afb1-c459e30a200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.140059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c84336-5512-4670-afb1-c459e30a200c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.140476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c84336-5512-4670-afb1-c459e30a200c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.140884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c84336-5512-4670-afb1-c459e30a200c None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.141710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c84336-5512-4670-afb1-c459e30a200c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:42.142081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c84336-5512-4670-afb1-c459e30a200c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:42.143816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c84336-5512-4670-afb1-c459e30a200c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:42.167294 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 246/488] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:42.167294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bfa32-f036-4884-9525-8447926d4815 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.167294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bfa32-f036-4884-9525-8447926d4815 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.167294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bfa32-f036-4884-9525-8447926d4815 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.167294 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 247/489] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:42.167294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bfa32-f036-4884-9525-8447926d4815 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.232080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:42.237502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f8623-ea93-4e13-a017-a85d87a03116 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.292344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bfa32-f036-4884-9525-8447926d4815 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.292844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb321342-200e-4694-9cdd-bec71ab87558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.294099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb321342-200e-4694-9cdd-bec71ab87558 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.294605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb321342-200e-4694-9cdd-bec71ab87558 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.295082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb321342-200e-4694-9cdd-bec71ab87558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.307899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb321342-200e-4694-9cdd-bec71ab87558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-cb321342-200e-4694-9cdd-bec71ab87558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:42.316773 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:42.317706 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:42.318536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:42.323171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 243/490] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:42.324950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49da8-1fbb-4ecb-a983-b9ab28d3af3c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.325455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49da8-1fbb-4ecb-a983-b9ab28d3af3c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.325938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49da8-1fbb-4ecb-a983-b9ab28d3af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.328935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.329808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.330098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.330436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.339536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:42.341022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:42.345983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a9b49da8-1fbb-4ecb-a983-b9ab28d3af3c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:42.347200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9b49da8-1fbb-4ecb-a983-b9ab28d3af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:42.359258 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:42.360239 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:42.361218 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 248/491] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:42.361773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.372518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:42.425689 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 244/492] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:42.427412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a9f13-206c-4edf-9c44-9bd32b12caf5 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.427778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a9f13-206c-4edf-9c44-9bd32b12caf5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.428139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a9f13-206c-4edf-9c44-9bd32b12caf5 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.431321 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 245/493] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:42.431321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a9f13-206c-4edf-9c44-9bd32b12caf5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.486382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453a81-035c-4605-8541-b396482d76d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.497492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:42.526839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c279-a6e4-4e5e-b9bf-619196497f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.527546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c279-a6e4-4e5e-b9bf-619196497f6d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.527831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c279-a6e4-4e5e-b9bf-619196497f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.528110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c279-a6e4-4e5e-b9bf-619196497f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.528878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c279-a6e4-4e5e-b9bf-619196497f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:42.529188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c279-a6e4-4e5e-b9bf-619196497f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:42.530618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c279-a6e4-4e5e-b9bf-619196497f6d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:42.544872 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 249/494] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:42.544872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7369-4169-43df-8b58-e13de5aa3124 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.544872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7369-4169-43df-8b58-e13de5aa3124 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.544872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7369-4169-43df-8b58-e13de5aa3124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.561006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9b9b7369-4169-43df-8b58-e13de5aa3124 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:42.562231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b9b7369-4169-43df-8b58-e13de5aa3124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:42.568581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a9f13-206c-4edf-9c44-9bd32b12caf5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.620796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.621510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.621806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.622091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.622956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:42.623972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:42.625851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:42.647646 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 250/495] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:42.647646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7369-4169-43df-8b58-e13de5aa3124 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.686233 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 246/496] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:42.687014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.707805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:42.763901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:42.766830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7369-4169-43df-8b58-e13de5aa3124 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.804695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359082d-c779-4309-b681-766fbe594240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.806146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359082d-c779-4309-b681-766fbe594240 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.806434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359082d-c779-4309-b681-766fbe594240 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.806715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359082d-c779-4309-b681-766fbe594240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.811209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b596cc-66fe-4210-8f66-3f9bd4d0d31d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.818249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359082d-c779-4309-b681-766fbe594240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5359082d-c779-4309-b681-766fbe594240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:42.826157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:42.827058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 251/497] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:42.832615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359082d-c779-4309-b681-766fbe594240 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.858145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.859007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.859323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.859599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.872556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:42.874053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:42.893462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:42.894498 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:42.895394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:42.895394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:42.895394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:42.895394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:42.895394 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 247/498] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:42.895654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:42.944356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359082d-c779-4309-b681-766fbe594240 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:42.963377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:42.981262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:42.982070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:42.982365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:42.982640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:42.993404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:43.001223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:43.002151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:43.002947 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 252/499] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:43.003657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.013576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d73d07-96c4-4073-92a6-08392510a5c5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.028732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.053711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.054376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.054666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.054975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.114969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642764b-ccfe-4eec-adad-0ebe58af903e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.128956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.130447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.150203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.150880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.151172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.151496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.152254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:43.152571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.153972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.162289 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 253/500] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:43.163113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.196293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.244652 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 248/501] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:43.244652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.255137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.274335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ca3b-a65a-4216-b478-ad9ed73d4333 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.309360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f60b7-e895-4a65-ba4e-89a622485a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.310067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f60b7-e895-4a65-ba4e-89a622485a24 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.310356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f60b7-e895-4a65-ba4e-89a622485a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.310639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f60b7-e895-4a65-ba4e-89a622485a24 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.311408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f60b7-e895-4a65-ba4e-89a622485a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:43.311730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f60b7-e895-4a65-ba4e-89a622485a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.313114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f60b7-e895-4a65-ba4e-89a622485a24 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.326107 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 254/502] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:43.327486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd356678-36ed-4d4e-b3ac-5412626199e3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.327782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd356678-36ed-4d4e-b3ac-5412626199e3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.328068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd356678-36ed-4d4e-b3ac-5412626199e3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.329382 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 255/503] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:43.330116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd356678-36ed-4d4e-b3ac-5412626199e3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.350637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0631c-b5d5-416c-98cd-a6226fb42164 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.385490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.386158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.386444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.386723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.387502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:43.387811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.389184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.398117 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 249/504] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:43.399585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.432562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.442947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd356678-36ed-4d4e-b3ac-5412626199e3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.479319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.480007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.480291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.480591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.490786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.492298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.494236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.507795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697221c-726d-48d8-adb6-90e2e1bc4435 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:43.511739 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:43.512588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:43.513467 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:43.513467 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:43.513467 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:43.513467 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:43.513467 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 256/505] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:43.513739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.548645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9dbb9-88e7-47cf-ab3e-c3f466730851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.549445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9dbb9-88e7-47cf-ab3e-c3f466730851 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.549725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9dbb9-88e7-47cf-ab3e-c3f466730851 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.549999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9dbb9-88e7-47cf-ab3e-c3f466730851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.561970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9dbb9-88e7-47cf-ab3e-c3f466730851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.563479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9dbb9-88e7-47cf-ab3e-c3f466730851 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b2f9dbb9-88e7-47cf-ab3e-c3f466730851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:43.584353 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:43.585358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:43.586754 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:43.586754 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:43.586754 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:43.586754 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:43.586754 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 250/506] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:43.587320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ecfdb-781d-4ec4-8fa2-6b064128aad0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.587603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ecfdb-781d-4ec4-8fa2-6b064128aad0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.587853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ecfdb-781d-4ec4-8fa2-6b064128aad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.609005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6d0ecfdb-781d-4ec4-8fa2-6b064128aad0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:43.610222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d0ecfdb-781d-4ec4-8fa2-6b064128aad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:43.628207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac2a47-4dec-47b6-95f5-4b61d6d65f89 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.662973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.663902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.664191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.664505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.672791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.674575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.684546 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 251/507] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:43.685408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ecfdb-781d-4ec4-8fa2-6b064128aad0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:43.691440 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:43.692453 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:43.693352 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 257/508] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:43.693957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.700135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.756459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.790861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ecfdb-781d-4ec4-8fa2-6b064128aad0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.804384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e2c3-24fc-452d-8326-63a399345f0a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.828092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.829187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.829466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.829741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.839797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:43.840381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.840513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:43.840733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:43.841011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:43.841732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:43.841849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.842038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:43.843457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:43.855799 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 258/509] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:43.856646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:43.859780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:43.860995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:43.862207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:43.862207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:43.862207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:43.862207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:43.862207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 252/510] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:43.862207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:43.926720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.963558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37c6bc-63b2-4d72-acfc-a1ae0af62338 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.970041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308620a-7836-46f3-9962-90d21f7469bc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:43.977990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:43.999532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.000202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.000485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.000763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.001481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:44.001900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.003309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.005389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.006063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.006343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.006668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.007486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:44.007798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.009760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.016546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 259/511] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:44.017378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.028663 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 253/512] 10.222.0.98 () {56 vars in 1137 bytes} [Thu Jul 14 14:19:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:44.029353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.123465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099afa-0837-44b2-918a-609e9672a50d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.127540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba9bb2-0a7a-44b5-a9e3-f779815b1412 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.146847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.160587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.161396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.161681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.161958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.165354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.166172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.166459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.166743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.172976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.174522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.174631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.176025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:44.192523 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:44.193454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:19:44.194342 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:44.194847 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:44.196155 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:44.197037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:44.197037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:44.197037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:44.197037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:44.197267 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 254/513] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:44.197335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 260/514] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:44.197399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.197464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.224720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.302868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dc51b-d966-460f-95bd-d0e2f1075c95 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.307751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e48b21-ea56-40be-a180-e772118689f8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.340641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.341451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.341726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.342004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.344267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.344937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.345223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.345504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.346234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:44.346540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.347970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.348850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.350284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.359730 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 255/515] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:44.360376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:44.365447 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:44.366382 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:44.367248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 261/516] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:44.368734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.403007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.464064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.466395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51687e3-7142-4e56-ad7d-deae8c7cbed8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.480712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8681b9-9437-4764-b468-cdcd8c78ca6d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.502038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.502696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.502980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.503255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.515673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.516407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.516641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.516928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.517778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:44.518119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.519604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.563643 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 262/517] 10.222.0.98 () {56 vars in 1137 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:44.563643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.575404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.576887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.620944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.672830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b227e0-b302-4579-b757-a4ffbc6ff848 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.685070 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 256/518] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:44.686241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.714868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.715595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.715884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.716163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.716946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:44.717220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.718600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.730047 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 263/519] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:44.730854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.734885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.801127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fb0f0-3f36-4fc3-a431-64ee20ffd3a1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.833423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97dd07-00d5-4006-b0d1-542bce797603 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:44.836831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.837631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.838171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.838443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.846286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.847794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.849588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:44.863726 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:44.864758 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:44.865645 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 257/520] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:44.866826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.869813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:44.870489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:44.870799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:44.871052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:44.872001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:44.872194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:44.873657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:44.892075 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 264/521] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:44.892919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:44.970235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:44.977566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1a4d4-df87-4d85-9678-5188fd7f9f0b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.007870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e54685-f066-4406-b875-0e67448a1603 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.011136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.011951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.012241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.012516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.043298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.044092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.044378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.044660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.055937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.057496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:45.075781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:45.077067 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:45.077934 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:45.077934 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:45.077934 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:45.077934 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:45.077934 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 265/522] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:45.078347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.079384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:45.084743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.086239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.181679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c98a79-0a1d-46d6-9906-1d5e1dbf93b8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.187850 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 258/523] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:45.188691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.199134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:45.218531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.219220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.219542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.219830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.220548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.222005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.248602 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 266/524] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:19:45 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:19:45.249446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.312756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:45.317410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ba9bc-e3d3-4730-b8b5-ba4422748717 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.361046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.361738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.362131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.362414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.363294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:45.363613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.365115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.376240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4434-5360-4ef8-88cb-96bf2ff24783 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.385968 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 259/525] 10.222.0.98 () {56 vars in 1139 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:45.387504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.423011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.424205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.424205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.424370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.425102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=eecb3bcddba54aca9316af7a0ec3b923) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:45.425420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.426883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.433833 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 267/526] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/role_assignments?user.id=eecb3bcddba54aca9316af7a0ec3b923&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:45.434904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.496835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:45.523908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46ecb-6aff-416e-927a-e924c0922f0b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.569218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.569819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.570110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.570395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.571177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:45.571529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.572955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.585825 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 260/527] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:45.587018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8e8b7-5644-45c4-a900-4674eb979196 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.587133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.607816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:45.631293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.632126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.632415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.632695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.644907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.646709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:45.666659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:45.667711 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:45.668596 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:45.668596 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:45.668596 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:45.668596 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:45.670667 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 268/528] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:45.671771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.707991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5355-0157-48db-a74f-13a2d358273e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.745842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.746518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.746811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.747096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.770738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:45.784715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd736-0664-43ee-ac7e-40e46fbf1cde None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:45.822590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.824247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.825848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:45.826954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:45.827517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:45.828054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:45.835627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:45.837441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:45.852617 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:45.853529 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:45.854388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:45.861103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:45.861698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 269/529] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:45.862782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:45.961531 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 261/530] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:45.961531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.010471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c1460-5b54-4f60-b072-f9d38c2237fe None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.058805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.060048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.060343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.060630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.061379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:46.061743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.063192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.079963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69c6c-8d08-4a09-a839-e1f0e58cc958 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.084566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 270/531] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:46.085657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.098978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:46.104469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:46.130091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.131110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.131624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.132121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.133699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:46.134223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.136489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.167773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 262/532] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:46.167773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.206473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0decc9-9c80-4d76-a6ae-47f578f991b5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.245529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.246716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.246930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.247156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.258885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.260409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:46.279523 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:46.280512 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:46.281354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:46.281354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:46.281354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:46.281354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:46.281354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 271/533] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:46.287287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.289970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a554c-109b-468b-a9ef-b6c7eb0d86cd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.327992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.328921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.329273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.329621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.337306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.339041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.352888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:46.355074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:46.356978 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:46.358669 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 263/534] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:46.359481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.398897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:46.404480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167562e3-3fe4-4dc9-b35a-d22020006cce None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.443580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.444768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.445054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.445333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.446719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=0ded1996761b4d7d8ec89534d2103dea) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:46.447038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.449242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.455709 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 272/535] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/role_assignments?user.id=0ded1996761b4d7d8ec89534d2103dea&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:46.456558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.497309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110854d-1055-40ae-9977-a28b6f43b517 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.585821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.587229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.587609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.588131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.588977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:46.589296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.591312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.626867 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 264/536] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:46.632500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.666973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df91e51-3db7-45cc-a950-3ee38bf065a5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.694034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:46.737635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.738471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.738767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.739053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.743482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:46.743812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.745290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.750866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0067f2-df02-4f01-9a19-be69b5912f44 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.775660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:46.780917 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 273/537] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:46.786874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.787736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.788028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.788308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.789898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.796301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.797929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:46.813620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:46.814513 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:46.815386 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 265/538] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:46.821269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:46.926338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb940-1f59-4aa7-8554-312916e243bf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:46.963144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:46.963847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:46.964133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:46.964410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:46.965320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:46.965662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:46.967200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:46.981187 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 266/539] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:46.986877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:47.027662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:47.073867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb63-de90-4e0b-83da-df7a3b50c61b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:47.114350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daedbd5-45a6-4fe7-9a31-e52530dff7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:47.115029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daedbd5-45a6-4fe7-9a31-e52530dff7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:47.115444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daedbd5-45a6-4fe7-9a31-e52530dff7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:47.115732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daedbd5-45a6-4fe7-9a31-e52530dff7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:47.116590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daedbd5-45a6-4fe7-9a31-e52530dff7d4 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=3db64ff447674dd2a2f15b005696075b) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:47.116909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daedbd5-45a6-4fe7-9a31-e52530dff7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:47.118668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daedbd5-45a6-4fe7-9a31-e52530dff7d4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:47.125332 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 274/540] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/role_assignments?user.id=3db64ff447674dd2a2f15b005696075b&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:47.184474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bb85d-4c4b-48ce-83d1-30d4f00b1211 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:47.248994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b80d8-7fd8-42df-9f99-b795c52adaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:47.249714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b80d8-7fd8-42df-9f99-b795c52adaeb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:47.249998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b80d8-7fd8-42df-9f99-b795c52adaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:47.250276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b80d8-7fd8-42df-9f99-b795c52adaeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:47.251130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b80d8-7fd8-42df-9f99-b795c52adaeb None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=0f0c4ffb0c9a4de08091b6a7493e2fc8) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:47.251474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b80d8-7fd8-42df-9f99-b795c52adaeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:47.253069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b80d8-7fd8-42df-9f99-b795c52adaeb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:47.264121 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 267/541] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:46 2022] GET /identity/v3/role_assignments?user.id=0f0c4ffb0c9a4de08091b6a7493e2fc8&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:47.561928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d9ac-34a9-4a23-98e0-bff17398ded9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:47.562416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d9ac-34a9-4a23-98e0-bff17398ded9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:47.562416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d9ac-34a9-4a23-98e0-bff17398ded9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:47.564069 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 275/542] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:47.573366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96a22-4610-4e23-9383-66b99c540f0a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:47.574258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96a22-4610-4e23-9383-66b99c540f0a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:47.574763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96a22-4610-4e23-9383-66b99c540f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:47.604539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-edb96a22-4610-4e23-9383-66b99c540f0a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:47.606191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-edb96a22-4610-4e23-9383-66b99c540f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:47.671809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395ca2-3520-4f50-9b34-f3f17b71bbd1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:47.672443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395ca2-3520-4f50-9b34-f3f17b71bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:47.672922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395ca2-3520-4f50-9b34-f3f17b71bbd1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:47.674782 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 276/543] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:47.681534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f217029-a99d-4b8b-ad76-ff1d01701777 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:47.682128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f217029-a99d-4b8b-ad76-ff1d01701777 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:47.682663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f217029-a99d-4b8b-ad76-ff1d01701777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:47.701130 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 268/544] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:19:47.703905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f217029-a99d-4b8b-ad76-ff1d01701777 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:47.705361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f217029-a99d-4b8b-ad76-ff1d01701777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:47.736678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96a22-4610-4e23-9383-66b99c540f0a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:47.751682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:47.799682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:47.833880 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 277/545] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:47.859844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f217029-a99d-4b8b-ad76-ff1d01701777 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:47.959166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96a22-4610-4e23-9383-66b99c540f0a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.002044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.003127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.003585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.004179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.017035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:48.026805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:48.027770 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:48.028574 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:48.031063 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 269/546] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:48.032606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f217029-a99d-4b8b-ad76-ff1d01701777 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.041339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.098506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.100597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.101974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.102475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.126986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:48.141480 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:48.142454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:48.143237 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:48.155053 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 278/547] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:48.156291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.201302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:48.239657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:48.257923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98871-a2b4-436e-9df8-d0e3dd3f5bcf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.298545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.300412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.301528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.302158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.304074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:48.304800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.307773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.320862 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 270/548] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:48.326829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.374214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ded818-43d5-4377-bc3b-a8f4048e6e7b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.409991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.411009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.411538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.412035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.412990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:48.413503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.415702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.425174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 279/549] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:48.430834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.438769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe5bce-888b-4f76-8f1d-dd21d7b912a3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.473023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:48.479930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.481063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.481491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.481906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.494309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.496116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:48.515802 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:48.517341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:48.518274 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:48.518274 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:48.518274 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:48.518274 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:48.520399 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 271/550] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:48.526542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.536106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:48.539709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7995a-3b4f-4ab7-a3ac-ce14557ddfe6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.576236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.577248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.577637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.578019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.591233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.592967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:48.613758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:48.614725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:48.615776 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:48.615776 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:48.615776 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:48.615776 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:48.619978 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 280/551] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:48.622261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.655795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a1b2-78e7-42fe-91e4-41dd92499629 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.699501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.700500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.701058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.701564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.702522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:48.703003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.704646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.719067 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 272/552] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:48.724926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.735690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2680723-5027-4ce4-a894-93064b0dfa8d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.774056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.775161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.775549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.776175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.776807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:48.777189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.778646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.779824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:48.793081 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 281/553] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:48.798556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.814338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:48.860450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9b9a8-4880-42a5-b988-22fd200a9dbc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.907388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb841a19-723a-4c75-a39d-2068b66dd0ab None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:48.923088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.924183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.924666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.925198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.935438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.941926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.942069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:48.942069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:48.942069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:48.942069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:48.948213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:48.949972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:48.963595 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:48.964517 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:19:48.965420 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:48.968062 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 273/554] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:48.973679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:48.981452 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:48.982432 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:48.983897 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 282/555] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:48.992466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.084161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50458e4-e660-4c96-b1fb-8229870284f7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:49.087596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:49.129864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:49.130549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.130831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.131104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.132218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:49.132528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:49.134631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:49.156298 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 274/556] 10.222.0.98 () {56 vars in 1135 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:49.162287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.196214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:49.214185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95605237-3db0-4058-941c-8e0a88b7900e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:49.254403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a768c0d-029e-4f2f-9753-93edf136b3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:49.255087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a768c0d-029e-4f2f-9753-93edf136b3ca None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.255401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a768c0d-029e-4f2f-9753-93edf136b3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.255681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a768c0d-029e-4f2f-9753-93edf136b3ca None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.256531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a768c0d-029e-4f2f-9753-93edf136b3ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:49.256842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a768c0d-029e-4f2f-9753-93edf136b3ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:49.258342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a768c0d-029e-4f2f-9753-93edf136b3ca None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:49.283259 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 283/557] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:19:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:49.284634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84719b9-1ebe-4aa7-8006-64765da62dc9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.284750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f5469-41f1-4310-a227-721b49befdd2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:49.284920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84719b9-1ebe-4aa7-8006-64765da62dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.285198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84719b9-1ebe-4aa7-8006-64765da62dc9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.286915 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 284/558] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:49.296861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3c44b-c7d5-4650-b0c9-eb184e6634f5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.297255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3c44b-c7d5-4650-b0c9-eb184e6634f5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.297545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3c44b-c7d5-4650-b0c9-eb184e6634f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.315851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-40d3c44b-c7d5-4650-b0c9-eb184e6634f5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:49.317156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-40d3c44b-c7d5-4650-b0c9-eb184e6634f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:49.322840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:49.323535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.323816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.324091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.357738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:49.406012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:49.407650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:49.420941 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 285/559] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:49.421849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3c44b-c7d5-4650-b0c9-eb184e6634f5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.515100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:49.551512 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 275/560] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:19:49.552677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.569073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3c44b-c7d5-4650-b0c9-eb184e6634f5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:49.617242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:49.618064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.618461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.618858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.636008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:49.636354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:49.638380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:49.659329 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:49.661211 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:49.663633 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:49.663633 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:49.663633 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:49.663633 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:49.663633 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 286/561] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:49.663633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.693403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1182b9-82a5-4ec5-b542-ee1814fbb477 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:49.740818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:49.742792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.743747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.744033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.757194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:49.765859 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:49.766855 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:49.767750 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 276/562] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:49.768554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.795734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003004b-035c-41d9-b56a-c00e554be17c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:49.810759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:49.833508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffcced-a63e-4a1a-8c9e-99f19a487a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:49.834307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffcced-a63e-4a1a-8c9e-99f19a487a05 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.834590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffcced-a63e-4a1a-8c9e-99f19a487a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.834870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffcced-a63e-4a1a-8c9e-99f19a487a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.846594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffcced-a63e-4a1a-8c9e-99f19a487a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:49.848129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffcced-a63e-4a1a-8c9e-99f19a487a05 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f4ffcced-a63e-4a1a-8c9e-99f19a487a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:49.865498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:49.866412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:49.867809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:49.867809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:49.867809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:49.867809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:49.867809 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 287/563] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:49.868621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1eabc-d46c-45d2-8f34-653c7831f676 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.869205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1eabc-d46c-45d2-8f34-653c7831f676 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.869205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1eabc-d46c-45d2-8f34-653c7831f676 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.874642 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 288/564] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:49.874642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1eabc-d46c-45d2-8f34-653c7831f676 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.879118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa5033-6704-4511-b6f4-9b7dfec394a7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:49.901992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:49.915856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f340650-688f-4423-b4da-c03515fc5aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:49.916552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f340650-688f-4423-b4da-c03515fc5aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.916846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f340650-688f-4423-b4da-c03515fc5aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.917440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f340650-688f-4423-b4da-c03515fc5aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.918166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f340650-688f-4423-b4da-c03515fc5aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:49.918481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f340650-688f-4423-b4da-c03515fc5aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:49.919906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f340650-688f-4423-b4da-c03515fc5aa7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:49.932573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 277/565] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:49.933772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172a24-c9fc-44dc-a403-3a0b042726dc None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:49.934062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172a24-c9fc-44dc-a403-3a0b042726dc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:49.934342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172a24-c9fc-44dc-a403-3a0b042726dc None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:49.935892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 278/566] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:49.936594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172a24-c9fc-44dc-a403-3a0b042726dc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:49.980672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1eabc-d46c-45d2-8f34-653c7831f676 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.016716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cbd6a-3002-4a33-8284-e2673d8d0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.017416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cbd6a-3002-4a33-8284-e2673d8d0957 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.017708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cbd6a-3002-4a33-8284-e2673d8d0957 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.017989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cbd6a-3002-4a33-8284-e2673d8d0957 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.018745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cbd6a-3002-4a33-8284-e2673d8d0957 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:50.019055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cbd6a-3002-4a33-8284-e2673d8d0957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.020469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cbd6a-3002-4a33-8284-e2673d8d0957 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.030432 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 289/567] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:50.031897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926c4c-fe26-43a8-9e55-a09e51db7f3f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.032189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926c4c-fe26-43a8-9e55-a09e51db7f3f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.032576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926c4c-fe26-43a8-9e55-a09e51db7f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.041828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172a24-c9fc-44dc-a403-3a0b042726dc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.048702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8f926c4c-fe26-43a8-9e55-a09e51db7f3f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:50.050007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f926c4c-fe26-43a8-9e55-a09e51db7f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:50.070874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.077208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.077877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.078167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.078451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.079176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:50.079518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.080894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.093440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 279/568] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:50.094263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.126351 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 290/569] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:50.128110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fb65-e3d8-48c7-a539-462dc618cc09 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.128562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fb65-e3d8-48c7-a539-462dc618cc09 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.128847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fb65-e3d8-48c7-a539-462dc618cc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.140240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.151794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f6c2fb65-e3d8-48c7-a539-462dc618cc09 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:50.152989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6c2fb65-e3d8-48c7-a539-462dc618cc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:50.202220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149856-a06b-40d2-bc82-1bff81277c1c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.222677 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 291/570] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:50.223557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2fb65-e3d8-48c7-a539-462dc618cc09 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.253949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.254672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.254956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.255232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.263039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.264716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:50.281144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:50.282212 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 280/571] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:50.283225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.333916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.351005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2fb65-e3d8-48c7-a539-462dc618cc09 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.387782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.388581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.388867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.389145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.392427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c3a56-c285-4eef-a2b7-bfba33f99256 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.394018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.400428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.401885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:50.420424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:50.421412 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:50.422390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:50.422390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:50.422390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:50.422390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:50.422390 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 292/572] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:50.422676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.431463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b0707-23db-4bde-92a7-08420039758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.432481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b0707-23db-4bde-92a7-08420039758c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.432766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b0707-23db-4bde-92a7-08420039758c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.433040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b0707-23db-4bde-92a7-08420039758c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.440975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b0707-23db-4bde-92a7-08420039758c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.442434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b0707-23db-4bde-92a7-08420039758c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-698b0707-23db-4bde-92a7-08420039758c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:50.456973 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:50.458105 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:50.458979 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 281/573] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:50.459524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b0707-23db-4bde-92a7-08420039758c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.536854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818c81-c6af-4c06-b0f7-78a009725009 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.573271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b0707-23db-4bde-92a7-08420039758c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.574893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.575796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.576079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.576367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.584362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.589227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:50.597414 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:50.598584 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 293/574] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:50.599498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.616494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.617879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.618168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.618443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.629610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:50.638092 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:50.645006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 282/575] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:50.645854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.671860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.711553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e197d-3409-4145-83fc-7d72f33c2f8c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.748381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.749066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.749338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.749618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.750416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:50.750731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.752227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.757507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec46e42-454e-411d-bb8a-a928ddf169fa None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.764939 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 294/576] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:50.765790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.795905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.796489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.796770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.797045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.797846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:50.798066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.799462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.812426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 283/577] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:50.813273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.830988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.879627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d32a1-62b1-43f5-91d8-b9671aca465e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.907059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:50.920976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.921650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.921935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.922212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.923005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:50.923346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.924780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:50.935974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99295985-82a5-4d6b-a319-a623dbc40c7d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:50.937379 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 295/578] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:50.938185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:50.988293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:50.988968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:50.989279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:50.989530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:50.990275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:50.990588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:50.991981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.000992 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 284/579] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:51.001766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.052207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0ca33-9d08-4a8e-aa0c-05a025adcb4c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.071008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:51.093718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.094401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.094682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.094958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.095743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:51.096051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.097441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.106354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 296/580] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:51.107155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.126454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3dc3f-c028-4376-a743-b786a01bdf1a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.161490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.162377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.162657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.162935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/eecb3bcddba54aca9316af7a0ec3b923/roles/f5ed3686a3a84f21964d92c84c9170b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.179778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=eecb3bcddba54aca9316af7a0ec3b923, role_id=f5ed3686a3a84f21964d92c84c9170b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.182687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.186571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:51.199298 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 285/581] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:51 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/eecb3bcddba54aca9316af7a0ec3b923/roles/f5ed3686a3a84f21964d92c84c9170b1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:51.200116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.222015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8de86-83fb-471e-b5b5-1e498900aa56 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.270825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.271690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.271981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.272315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.283629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.285350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:51.303030 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:51.304064 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:51.305058 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 297/582] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:51.305674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.330522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb139fb-ba3c-42b5-bc28-f57e7a47eca0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.360707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:51.378138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.378813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.379102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.379478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.380284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=e4c56829e4af4b609ab6c986b745a4fd) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:51.380606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.382079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.388091 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 286/583] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/role_assignments?user.id=e4c56829e4af4b609ab6c986b745a4fd&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:51.388910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.437451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abedd3c-653f-47ea-b16f-fec2fdf76584 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.464904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:51.484760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.485614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.485921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.486197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.500117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.501668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.519207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d498f35-2f3b-4862-9178-dac3fda84a64 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:51.521581 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:51.522485 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:51.523499 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:51.523499 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:51.523499 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:51.523499 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:51.523917 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 298/584] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:51.525771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.563472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.564515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.564950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.565441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.577862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.579649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:51.599597 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:51.600687 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:51.602128 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:51.602128 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:51.602128 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:51.602128 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:51.608756 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 287/585] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:51.609901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.634262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:51.647846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82be01-e46d-4726-8126-e4a49f6a703a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.696684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.697658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.697948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.698229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.699379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:51.699700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.702131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.728716 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 299/586] 10.222.0.98 () {56 vars in 1137 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:51.729661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.738647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798765d-2e80-41f4-9fda-8bdcd26d714a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.751121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:51.779989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.781647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.782196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.782815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.783938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:51.784523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.786140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.801771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 288/587] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:51.803025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.861472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3a2d-309f-4eda-8e28-b6262e7b393a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.906504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.907643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.908127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.908608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.909639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:51.910146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.912279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:51.925810 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 300/588] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:51.927082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:51.927491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181bc07-91e0-4a98-8dfd-4fafa88aed8e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:51.940600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:51.969310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:51.970123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:51.970420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:51.970690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:51.983026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:51.984695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:52.004417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:52.005366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:52.006254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:52.006254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:52.006254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:52.006254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:52.010335 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 289/589] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:52.011218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.038702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.043235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa45ca9-7f1b-43ca-ba6b-2579aafaa7e9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.078880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.080082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.080565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.081141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.090537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.092527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:52.108256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:52.109254 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:19:52.110201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:52.112911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 301/590] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:52.114008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.132156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563372-71a8-4cc0-9f88-2eae14cda382 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.171969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.173182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.173182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.173462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.181949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.183959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.191614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:52.202318 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:52.203330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 290/591] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:52.204918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.234734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729befda-854d-48b6-9379-7b64e9a9234c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.272164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.273113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.274178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.274653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.275736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:52.276267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.277889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.291659 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 302/592] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:52.292970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.307047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.328918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec58675-8886-4082-b281-dd42e3d24bbc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.369300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.369908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.370206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.370563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.371351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:52.371670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.373245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.397971 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 291/593] 10.222.0.98 () {56 vars in 1137 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:52.398966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.407496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e6c7-b19c-4045-a871-9a94e9f9ca5f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.438863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.446573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.447568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.448133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.448657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.449760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:52.450284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.451994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.471024 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 303/594] 10.222.0.98 () {56 vars in 1139 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:52.472284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.510620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e6e9-ec64-4d4d-963e-bff4110597b2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.550111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.550963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.551239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.551558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.562645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.564205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.568328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:52.584861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:52.586501 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:52.587448 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 292/595] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:52.588212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.609138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ed65-3ebe-4443-b0eb-a8c1baa0ec1e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.659735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.661356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.662054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.662504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.677782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.679873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:52.704980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:52.706106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:52.707189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:52.707189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:52.707189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:52.707189 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:52.714388 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 304/596] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:52.714388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.724310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3b41-ceba-4a21-9c35-fff5a13b21e3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.758089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.765130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.766343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.766864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.767414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.780489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.782785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:52.802551 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:52.803598 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:52.805008 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:52.805008 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:52.805008 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:52.805008 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:52.811646 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 293/597] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:52.813018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.822005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb906-f118-4e9a-a196-5a414c4bf655 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.858043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.858718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.859007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.859321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.860136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:52.860456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.861927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.875027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.880335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 305/598] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:52.881297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:52.933025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19b4a-b05f-4178-ad71-10f18dd2edeb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.972206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:52.973494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:52.974001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:52.974489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:52.975466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:52.975970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:52.977732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:52.986004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:52.989149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf01fe3-bc68-4c95-9a95-9854ad16e147 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:52.999585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 294/599] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:53.000861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.028567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.029243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.029592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.029879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.030616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:53.030930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.032351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.047438 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 306/600] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:53.047438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.121323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95ce4-76e9-4a3a-8c53-6705f3ec94eb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:53.136620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:53.156119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081c5db-28ea-4c16-879c-54195b70ca69 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:53.168472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.169775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.170214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.170810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/0ded1996761b4d7d8ec89534d2103dea/roles/f5ed3686a3a84f21964d92c84c9170b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.192369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=0ded1996761b4d7d8ec89534d2103dea, role_id=f5ed3686a3a84f21964d92c84c9170b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.194224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.196867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.198062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.198442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.198815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.208770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.210795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.223638 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 295/601] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:52 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/0ded1996761b4d7d8ec89534d2103dea/roles/f5ed3686a3a84f21964d92c84c9170b1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:53.225084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:53.234952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:53.236157 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:53.237214 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:53.243715 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 307/602] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:53.246885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.290630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:53.403829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464600f8-4a6e-431b-b0f3-b46929ec28c4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:53.425815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169034ec-334e-4e9c-b209-1e48eb79a5cd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:53.450950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da9674-e413-49a9-ae14-f3390464fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.451717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9674-e413-49a9-ae14-f3390464fa04 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.452077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9674-e413-49a9-ae14-f3390464fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.452263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da9674-e413-49a9-ae14-f3390464fa04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.460619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da9674-e413-49a9-ae14-f3390464fa04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.462866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da9674-e413-49a9-ae14-f3390464fa04 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.465990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.466664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.466950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.467232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.468065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:53.468383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.469908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-58da9674-e413-49a9-ae14-f3390464fa04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:53.477877 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:53.478849 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:53.480935 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 296/603] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:53.483105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9086dc-5773-4b14-9892-f59df52f5704 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.483722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9086dc-5773-4b14-9892-f59df52f5704 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.484216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9086dc-5773-4b14-9892-f59df52f5704 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.489817 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 308/605] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:53.489817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.490255 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 297/605] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:53.491672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9086dc-5773-4b14-9892-f59df52f5704 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.519747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:53.579140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:53.609106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72824676-b98d-45cc-b59c-de3260cb76da None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:53.615011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9086dc-5773-4b14-9892-f59df52f5704 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:53.648543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702165d-1855-4515-87a4-cba9a6dfd224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.649362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702165d-1855-4515-87a4-cba9a6dfd224 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.649753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702165d-1855-4515-87a4-cba9a6dfd224 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.650190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702165d-1855-4515-87a4-cba9a6dfd224 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.651042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702165d-1855-4515-87a4-cba9a6dfd224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:53.651513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702165d-1855-4515-87a4-cba9a6dfd224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.652093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdf51c-83b2-46fc-80c2-524aebdbf1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.652987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdf51c-83b2-46fc-80c2-524aebdbf1ef None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.653246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702165d-1855-4515-87a4-cba9a6dfd224 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.653337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdf51c-83b2-46fc-80c2-524aebdbf1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.653530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdf51c-83b2-46fc-80c2-524aebdbf1ef None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/3db64ff447674dd2a2f15b005696075b/roles/f5ed3686a3a84f21964d92c84c9170b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.671304 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 309/606] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:53.671304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad37533-d1ac-4b0a-8781-389e0b826fc1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.671304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad37533-d1ac-4b0a-8781-389e0b826fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.671304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad37533-d1ac-4b0a-8781-389e0b826fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.678125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdf51c-83b2-46fc-80c2-524aebdbf1ef None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=3db64ff447674dd2a2f15b005696075b, role_id=f5ed3686a3a84f21964d92c84c9170b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.680300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdf51c-83b2-46fc-80c2-524aebdbf1ef None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.691298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dad37533-d1ac-4b0a-8781-389e0b826fc1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:53.692867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dad37533-d1ac-4b0a-8781-389e0b826fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:53.696167 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 298/607] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:53 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/3db64ff447674dd2a2f15b005696075b/roles/f5ed3686a3a84f21964d92c84c9170b1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:53.697574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848625b-9ab1-4e47-8121-3bb519516df2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.697861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848625b-9ab1-4e47-8121-3bb519516df2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.698166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848625b-9ab1-4e47-8121-3bb519516df2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.699851 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 299/608] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:53.700482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848625b-9ab1-4e47-8121-3bb519516df2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.790428 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 310/609] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:53.791942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd0665-0064-4314-bf32-11ff5c5bef70 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.792239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd0665-0064-4314-bf32-11ff5c5bef70 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.792632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd0665-0064-4314-bf32-11ff5c5bef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.830155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cacd0665-0064-4314-bf32-11ff5c5bef70 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:53.831381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cacd0665-0064-4314-bf32-11ff5c5bef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:53.842220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:53.877040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848625b-9ab1-4e47-8121-3bb519516df2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:53.929041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:53.931338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:53.931857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:53.932409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/0f0c4ffb0c9a4de08091b6a7493e2fc8/roles/f5ed3686a3a84f21964d92c84c9170b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:53.933844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:53.939666 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 311/610] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:53.941753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd0665-0064-4314-bf32-11ff5c5bef70 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:53.962884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=0f0c4ffb0c9a4de08091b6a7493e2fc8, role_id=f5ed3686a3a84f21964d92c84c9170b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:53.966149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:53.988829 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 300/611] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:53 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/0f0c4ffb0c9a4de08091b6a7493e2fc8/roles/f5ed3686a3a84f21964d92c84c9170b1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:53.990598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:54.117673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd0665-0064-4314-bf32-11ff5c5bef70 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:54.191188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4c2a2-c6e3-4ed5-a13d-80e5f9946f16 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:54.195650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:54.196651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:54.197118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:54.197541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:54.209988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:54.219982 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:54.221196 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:54.222205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:54.223725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:54.226042 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 312/612] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:54.233679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:54.239726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:54.239726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:54.240021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:54.242187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:54.252806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:54.264888 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:54.266074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:54.267142 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 301/613] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:54.271813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:54.328103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:54.378038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343386fb-d6c7-48b3-96db-7cc6d4d2e14d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:54.419546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:54.421014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:54.421574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:54.422003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:54.422916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:54.423457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:54.425035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:54.435420 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 313/614] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:54.440765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:54.503080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f789dd9-4f5e-4720-bcd7-83c8998cdb84 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:54.543652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:54.544910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:54.546669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:54.547190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:54.548381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:54.549817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:54.554254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:54.570449 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 302/615] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:19:54.577749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:54.652139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f452-1afe-43f3-84fa-ff5ee4f7baea None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:54.666231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:54.684969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:54.702567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:54.703718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:54.704381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:54.704837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:54.718523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:54.720870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:54.756560 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:54.757582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:54.758541 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:54.758541 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:54.758541 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:54.758541 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:54.761455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 314/616] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:54.766937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:54.778501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0843-7bb7-4939-ac53-8ae2cd5541a5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:54.850059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:54.851037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:54.852102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:54.853560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:54.869856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:54.875312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:54.906755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:54.907883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:54.908955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:54.908955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:54.908955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:54.908955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:54.917892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 303/617] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:54.925601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:54.949933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671424-37c3-48b1-9a6d-e0471355911d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:55.022673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:55.023417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.023760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.024047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.024789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:55.025102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:55.026724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:55.049011 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 315/618] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:55.072152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:55.076788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:55.098014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a7d15-237b-4c8e-80f5-a67934154174 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:55.110817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:55.188542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0fda1-adf4-4d01-b157-c57cfd1da6a5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:55.193716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:55.194413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.194707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.195520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.196274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:55.196585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:55.197993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:55.224683 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 304/619] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:55.230232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:55.230987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:55.231508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.231969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.232432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.240683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:55.242997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:55.259714 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:55.260980 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:19:55.261919 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:55.264690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 316/620] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:19:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:55.272914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:55.377714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:55.387050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cae09-6269-41d5-b2c9-005a2e3d82bd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:55.427808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:55.428499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.428781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.429057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.430457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:55.430767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:55.432298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:55.470076 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 317/621] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:19:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:55.476015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:55.496737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c89fc-cbe0-4c57-803e-cae4be66adb3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:55.562894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:55.565033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.565796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.567731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.582925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:55.586705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:55.615876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:55.617459 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:19:55.618439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:55.629918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 305/622] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:19:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:19:55.637757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:55.664602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:55.689488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b014a0-580e-497a-8d1c-31b5fb069113 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:55.762099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb209f-4fc8-4e63-82e5-0fcb10f368b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:55.764164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb209f-4fc8-4e63-82e5-0fcb10f368b2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.764854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb209f-4fc8-4e63-82e5-0fcb10f368b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.766530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb209f-4fc8-4e63-82e5-0fcb10f368b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.796950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:55.852041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb209f-4fc8-4e63-82e5-0fcb10f368b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:55.853898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb209f-4fc8-4e63-82e5-0fcb10f368b2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:55.854018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db491-0a1e-4c0a-9ab3-260fe70f1a56 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:55.899248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c534fa7-9be6-4a01-a9ce-94825a752f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:55.899988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c534fa7-9be6-4a01-a9ce-94825a752f24 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.900269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c534fa7-9be6-4a01-a9ce-94825a752f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.900539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c534fa7-9be6-4a01-a9ce-94825a752f24 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.901477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c534fa7-9be6-4a01-a9ce-94825a752f24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:55.901786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c534fa7-9be6-4a01-a9ce-94825a752f24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:55.903711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c534fa7-9be6-4a01-a9ce-94825a752f24 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:55.933931 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 306/623] 10.222.0.98 () {56 vars in 1135 bytes} [Thu Jul 14 14:19:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:55.936202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f146-9529-47fe-a3b1-e42c746e26fd None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.936499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f146-9529-47fe-a3b1-e42c746e26fd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.936776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f146-9529-47fe-a3b1-e42c746e26fd None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:55.938469 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 307/624] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:55.939172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f146-9529-47fe-a3b1-e42c746e26fd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:55.987002 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 318/625] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:55.988433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343e9b-8454-40ca-b461-483fb0838fab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:55.988726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343e9b-8454-40ca-b461-483fb0838fab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:55.989007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343e9b-8454-40ca-b461-483fb0838fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.005944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-07343e9b-8454-40ca-b461-483fb0838fab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:56.007127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07343e9b-8454-40ca-b461-483fb0838fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:56.032745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.058729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.064522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f146-9529-47fe-a3b1-e42c746e26fd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.087295 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 319/626] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:56.087295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343e9b-8454-40ca-b461-483fb0838fab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.127013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.128338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.128818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.129240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.146083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:56.148136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:56.168780 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:56.169926 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:56.170985 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:56.170985 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:56.170985 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:56.170985 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:56.172771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 308/627] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:56.174178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.192104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343e9b-8454-40ca-b461-483fb0838fab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.230293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da6384-5881-4964-b264-7f55baa51c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.231558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6384-5881-4964-b264-7f55baa51c63 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.231847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6384-5881-4964-b264-7f55baa51c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.232126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6384-5881-4964-b264-7f55baa51c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.247001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da6384-5881-4964-b264-7f55baa51c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:56.248526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da6384-5881-4964-b264-7f55baa51c63 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e3da6384-5881-4964-b264-7f55baa51c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:56.268154 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:56.269188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:56.270091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:56.270091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:56.270091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:56.270091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:56.274692 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 320/628] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:56.276167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa1f5-9d22-4b63-ae50-7e85311102e3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.276487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa1f5-9d22-4b63-ae50-7e85311102e3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.276748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa1f5-9d22-4b63-ae50-7e85311102e3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.278358 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 321/629] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:56.282742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caa1f5-9d22-4b63-ae50-7e85311102e3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.303995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af7193-e82c-4b93-98d4-63fba29670e1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.321288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.335163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.346141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab812a-1d43-4196-b799-c604608927af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.347344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab812a-1d43-4196-b799-c604608927af None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.347639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab812a-1d43-4196-b799-c604608927af None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.347921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab812a-1d43-4196-b799-c604608927af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.359665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab812a-1d43-4196-b799-c604608927af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7aab812a-1d43-4196-b799-c604608927af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:56.367507 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:56.368495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:56.369338 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 309/630] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:56.370265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab812a-1d43-4196-b799-c604608927af None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.406878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caa1f5-9d22-4b63-ae50-7e85311102e3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.444671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81e352-e1d5-40fb-a125-ce0dc4355604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.445379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81e352-e1d5-40fb-a125-ce0dc4355604 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.445668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81e352-e1d5-40fb-a125-ce0dc4355604 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.445953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81e352-e1d5-40fb-a125-ce0dc4355604 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.446696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81e352-e1d5-40fb-a125-ce0dc4355604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:56.446999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81e352-e1d5-40fb-a125-ce0dc4355604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:56.448439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81e352-e1d5-40fb-a125-ce0dc4355604 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:56.461094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 322/631] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:56.462199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612801a-2e2b-4bf3-baed-91c1b2497b7b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.462738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612801a-2e2b-4bf3-baed-91c1b2497b7b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.463030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612801a-2e2b-4bf3-baed-91c1b2497b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.480527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b612801a-2e2b-4bf3-baed-91c1b2497b7b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:56.481736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b612801a-2e2b-4bf3-baed-91c1b2497b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:56.490957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab812a-1d43-4196-b799-c604608927af None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.529079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.529884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.530173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.530452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.531186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:56.531529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:56.532914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:56.551003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 310/632] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:56.551003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.561824 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 323/633] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:56.562972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612801a-2e2b-4bf3-baed-91c1b2497b7b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.600812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.623667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.678930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612801a-2e2b-4bf3-baed-91c1b2497b7b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.679292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdee2a-cace-4a27-90b5-15259b2db12c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.717322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.717763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.718243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.718450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.718585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.718734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.718828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.719047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.719831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:56.720144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:56.721534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:56.725611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:56.727582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:56.731071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 311/634] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:56.732036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:56.741520 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:56.743187 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 324/635] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:56.744335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.828178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.837404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2067f-c443-4e0e-b653-af64a512591b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.845950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be791-f9e7-42b6-b3ed-ea5dd02dda85 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:56.846552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:56.873069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d1cf1-d69d-4588-93ad-8f3a2ae63eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.873865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d1cf1-d69d-4588-93ad-8f3a2ae63eac None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.874149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d1cf1-d69d-4588-93ad-8f3a2ae63eac None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.874519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d1cf1-d69d-4588-93ad-8f3a2ae63eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.880357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:56.881149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.881254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d1cf1-d69d-4588-93ad-8f3a2ae63eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:56.881432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.881708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.883059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d1cf1-d69d-4588-93ad-8f3a2ae63eac None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:56.892451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3d8d1cf1-d69d-4588-93ad-8f3a2ae63eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:56.897380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:56.898413 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:56.899576 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 312/636] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:56.900161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c048-f592-4128-9ef5-21fec80415f1 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:56.900246 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:56.901165 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:56.902804 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:56.903772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c048-f592-4128-9ef5-21fec80415f1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:56.903772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c048-f592-4128-9ef5-21fec80415f1 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:56.903935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 325/637] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:56.903935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:56.905859 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 313/638] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:56.906644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0c048-f592-4128-9ef5-21fec80415f1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.013585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e5dcb-1f6a-4a8d-aa82-a25acc95759d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.015142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0c048-f592-4128-9ef5-21fec80415f1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.051298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423937b-6bb5-4716-9a7c-804e11cd53a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.052120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423937b-6bb5-4716-9a7c-804e11cd53a1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.052410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423937b-6bb5-4716-9a7c-804e11cd53a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.052693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423937b-6bb5-4716-9a7c-804e11cd53a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.054217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.055462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.055762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.056022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.056828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:57.057155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.058600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.064961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423937b-6bb5-4716-9a7c-804e11cd53a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.066466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423937b-6bb5-4716-9a7c-804e11cd53a1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.069382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.073073 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 314/639] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:57.073773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2423937b-6bb5-4716-9a7c-804e11cd53a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:57.092548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:57.093721 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:57.094629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:57.094629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:57.094629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:57.094629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:57.094629 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 326/640] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:57.094917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e2951-1505-48b5-9ec8-f679b87d21f1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.095175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e2951-1505-48b5-9ec8-f679b87d21f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.095485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e2951-1505-48b5-9ec8-f679b87d21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.105655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.112705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c2e2951-1505-48b5-9ec8-f679b87d21f1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:57.113932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c2e2951-1505-48b5-9ec8-f679b87d21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:19:57.177692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a50eb4-584b-48e1-a2b9-9058e66b4938 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.182334 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 327/641] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:19:57.183173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e2951-1505-48b5-9ec8-f679b87d21f1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.215657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.216328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.216604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.216884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.217676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:57.217992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.219493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.232740 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 315/642] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:57.233542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.290866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e2951-1505-48b5-9ec8-f679b87d21f1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.316411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.323566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.326328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.327023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.327340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.327629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.328387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:57.328705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.330091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.336859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2a8e8-b33b-465e-bd82-e32a337e57d3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.339452 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 328/643] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:57.340292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.379139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.380532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.381000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.381468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/e4c56829e4af4b609ab6c986b745a4fd/roles/f5ed3686a3a84f21964d92c84c9170b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.404164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=e4c56829e4af4b609ab6c986b745a4fd, role_id=f5ed3686a3a84f21964d92c84c9170b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.406706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.425874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 316/644] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:19:57 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/e4c56829e4af4b609ab6c986b745a4fd/roles/f5ed3686a3a84f21964d92c84c9170b1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:19:57.427209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.494072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053ab25-ad52-4c18-ab13-4534b0bf840e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.536699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.537393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.537675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.537953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.539231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:57.539575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.541000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.560187 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 329/645] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:57.560187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.576480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e151-2f16-4bd0-ba0f-c8e9754da286 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.618105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.623830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.624646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.624936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.625222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.633357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.639405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:19:57.647887 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:57.649502 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 317/646] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:57.651345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.683702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f69d-022a-4e3e-9d49-ce0616c4a123 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.720312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.721203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.721662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.722009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.722921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=eecb3bcddba54aca9316af7a0ec3b923) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:57.723460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.724921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.731911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 330/647] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/role_assignments?user.id=eecb3bcddba54aca9316af7a0ec3b923&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:57.732739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.769562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea6efa-082b-4c88-8fef-e7527787948b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.812007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.813218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.813652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.814138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.827386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.829263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:57.850183 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:57.851975 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:57.853070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:57.853070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:57.853070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:57.853070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:57.855080 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 318/648] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:57.856140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:57.881959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097f2a-4d7d-4643-8908-a1476f1100be None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:57.903966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.926082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:57.945706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:57.946544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:57.947210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:57.947210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:57.958072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:57.959933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:57.977228 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:57.978911 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 331/649] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:57.981826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.014826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c72b9-e0c1-434b-8c3a-aa076bcc1b3e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.070190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.070882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.071174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.071513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.072287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:58.072603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.074039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.083940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 319/650] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:58.084823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.124486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd9991-97e9-43e3-9ac9-34163542a5b9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.163080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.163733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.164583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.164859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.165591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:58.165898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.167333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.181243 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 332/651] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:58.182182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.198861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93386-1939-421b-980d-8458de5cde11 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.214095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:58.219237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:58.244521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.245315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.245607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.245883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.246873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:58.247193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.248781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.275655 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 320/652] 10.222.0.98 () {56 vars in 1137 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:58.276753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.296778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f972f5-4cdc-47f4-81c8-b52163f8e6f0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.334121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.335056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.335349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.335663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.347086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.348574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:58.370620 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:58.372777 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:58.374948 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:58.374948 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:58.374948 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:58.374948 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:58.383319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 333/653] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:58.383319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.387203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b02ae-1018-433e-bdcc-caa9b9c3b88d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.428665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.430165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.430398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.430682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.439163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.440782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:58.458108 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:58.460348 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 321/654] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:58.464347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.473813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:58.491371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b5bb7-f0b7-4a2a-bd63-f54e070011ad None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.499871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:58.534416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.535167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.535558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.535901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.586812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c64a-7a8a-485e-8431-6eedd63807c0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.622242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.624845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.636459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.637151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.637437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.637715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.638441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:58.638749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.640535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.659371 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 322/655] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:58.660642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.760041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:58.779406 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 334/656] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:58.780719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.790836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:58.801244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045105c5-a97e-4042-ae24-85ea6e1432f2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.838149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.839153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.839291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.839514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.840364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:58.840681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.842138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.860953 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 323/657] 10.222.0.98 () {56 vars in 1137 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:58.862102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:58.895773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c19c4-e507-4f0f-a7d8-2a00de747d1c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.934542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:58.935679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:58.936141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:58.936620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:58.945553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:58.947444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:19:58.965125 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:58.966147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:19:58.967074 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:19:58.974182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e092f-5887-426b-ab14-1f95dfa5479e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:58.974872 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 335/658] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:58.976007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.009702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.010605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.010886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.011174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.022360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.024695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.031868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.035325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:59.047732 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:59.048700 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:59.049576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:59.049576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:59.049576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:59.049576 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:59.049576 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 324/659] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:59.050320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.097563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc5026-ea54-4094-b843-5f42425e859e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:59.138808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.140199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.140711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.141131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.167032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275b05-3bec-48af-8e9c-ad13f7749db7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:59.206116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.206835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.207233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.207564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.208520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:59.208840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.210311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.219899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.222165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.237071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 325/660] 10.222.0.98 () {56 vars in 1139 bytes} [Thu Jul 14 14:19:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:59.237071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.292865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.331524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.368679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 336/661] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:59.370035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.391893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a1a5-2e52-4b13-b74e-ac8c5996648d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:59.436042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.437104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.437537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.437986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.439153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:59.439724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.441245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.456851 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 326/662] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:59.458134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.508159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada15770-c441-47d6-b4d7-fca9a7e1828d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:59.553312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10956c7-fb64-42d3-868b-090b40358b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.554781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10956c7-fb64-42d3-868b-090b40358b45 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.555292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10956c7-fb64-42d3-868b-090b40358b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.555783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10956c7-fb64-42d3-868b-090b40358b45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.580287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.601114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d783-918c-4a79-ada4-8f550bb25d45 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:59.623930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.645381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.645589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10956c7-fb64-42d3-868b-090b40358b45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.646202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.646490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.646772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.646943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10956c7-fb64-42d3-868b-090b40358b45 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.660249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.661808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:19:59.687446 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:59.688421 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:59.689339 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:19:59.689339 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:19:59.689339 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:19:59.689339 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:59.696237 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 327/663] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:59.696237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.762927 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 337/664] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:19:59.764473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223e75d-0b41-4a45-b76b-b940a1145ff0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.764769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223e75d-0b41-4a45-b76b-b940a1145ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.765082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223e75d-0b41-4a45-b76b-b940a1145ff0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.770461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 338/665] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:19:59.770461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223e75d-0b41-4a45-b76b-b940a1145ff0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.821759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03a8b3-6ae9-4f71-bffd-9cb102e4585f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:59.823322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.860337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.861143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.861462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.861709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.868842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.870337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:19:59.885495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:19:59.886475 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:19:59.887418 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 328/666] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:19:59.888669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:19:59.899121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223e75d-0b41-4a45-b76b-b940a1145ff0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:19:59.920760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:19:59.940311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a799e7d-1037-4a55-a4ec-0797cb2dcb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:19:59.941097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a799e7d-1037-4a55-a4ec-0797cb2dcb7b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.941442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a799e7d-1037-4a55-a4ec-0797cb2dcb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.941724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a799e7d-1037-4a55-a4ec-0797cb2dcb7b None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.942484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a799e7d-1037-4a55-a4ec-0797cb2dcb7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:19:59.942793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a799e7d-1037-4a55-a4ec-0797cb2dcb7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:19:59.944216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a799e7d-1037-4a55-a4ec-0797cb2dcb7b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:19:59.956481 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 339/667] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:19:59.957746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd322d7-d782-4d1c-8ae8-14904200f98a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:19:59.958039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd322d7-d782-4d1c-8ae8-14904200f98a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:19:59.958317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd322d7-d782-4d1c-8ae8-14904200f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:19:59.975576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3cd322d7-d782-4d1c-8ae8-14904200f98a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:19:59.976876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3cd322d7-d782-4d1c-8ae8-14904200f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:00.007182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61cc8-bfa8-4ed8-93f1-ba7ec4137b8a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.043051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.043913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.044179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.044456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.051897 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 340/668] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:00.053178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd322d7-d782-4d1c-8ae8-14904200f98a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.062063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.063817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:00.082923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:00.083928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:00.085454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:00.085454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:00.085454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:00.085454 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:00.085454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 329/669] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:00.085454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.096602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:00.165631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd322d7-d782-4d1c-8ae8-14904200f98a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.168421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:00.188944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac01b52-4471-466f-8a3a-2c74c84f749d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.201823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8510dd7-1dc7-4f6d-94c9-b32ad8d75f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.202489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8510dd7-1dc7-4f6d-94c9-b32ad8d75f8e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.202827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8510dd7-1dc7-4f6d-94c9-b32ad8d75f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.203112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8510dd7-1dc7-4f6d-94c9-b32ad8d75f8e None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.203934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8510dd7-1dc7-4f6d-94c9-b32ad8d75f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:00.204248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8510dd7-1dc7-4f6d-94c9-b32ad8d75f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.205686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8510dd7-1dc7-4f6d-94c9-b32ad8d75f8e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.218484 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 341/670] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:00.220029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec58e-77c8-49ae-ba15-9074e6dd2b76 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.220213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec58e-77c8-49ae-ba15-9074e6dd2b76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.220505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec58e-77c8-49ae-ba15-9074e6dd2b76 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.221753 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 342/671] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:00.222449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ec58e-77c8-49ae-ba15-9074e6dd2b76 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.231107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.231948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.232231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.232510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.239726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.241181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:00.256545 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:00.257536 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:00.258457 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 330/672] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:00.259040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.331240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:00.340338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ec58e-77c8-49ae-ba15-9074e6dd2b76 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.370136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578084-8dde-4899-8bd6-fef1110a67a2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.375966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.376774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.377062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.377343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.388109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:00.396019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:00.396987 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:00.397846 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 343/673] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:00.399143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.410115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d8947-12cb-45df-9318-c97ac2aa4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.410797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d8947-12cb-45df-9318-c97ac2aa4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.411085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d8947-12cb-45df-9318-c97ac2aa4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.411409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d8947-12cb-45df-9318-c97ac2aa4dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.412143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d8947-12cb-45df-9318-c97ac2aa4dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:00.412465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d8947-12cb-45df-9318-c97ac2aa4dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.414488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d8947-12cb-45df-9318-c97ac2aa4dc8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.426386 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 331/674] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:00.427672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0e7e-9475-464d-bb53-8c1acd742f56 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.427964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0e7e-9475-464d-bb53-8c1acd742f56 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.428259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0e7e-9475-464d-bb53-8c1acd742f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.433279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:00.446992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7edd0e7e-9475-464d-bb53-8c1acd742f56 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:00.448267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7edd0e7e-9475-464d-bb53-8c1acd742f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:00.502039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083db1-1a81-4c01-a20b-1677e8c246ba None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.516282 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 332/675] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:00.517134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0e7e-9475-464d-bb53-8c1acd742f56 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.542561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.543230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.543558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.543842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.544691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=0ded1996761b4d7d8ec89534d2103dea) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:00.545009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.546455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.552529 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 344/676] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/role_assignments?user.id=0ded1996761b4d7d8ec89534d2103dea&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:00.553326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.597031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:00.639697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0e7e-9475-464d-bb53-8c1acd742f56 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.687428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:00.692973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.693808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.694021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.694286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.695817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:00.696140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.697709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.708842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3f03-69e2-49da-8703-bcce905c05a2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.711969 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 333/677] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:00.713550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.755145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.755945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.756239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.756862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.757316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:00.757630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.759013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.768562 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 345/678] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:00.768745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.838012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bd0c0-c7fa-4c27-80a7-49f37241bbbf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.865960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:00.883047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.883993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.884469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.884668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.887149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe6ecc-3051-4c77-9635-867f99e91687 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:00.892345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:00.893812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:00.909944 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:00.910904 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:00.911886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 334/679] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:00.912381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.927985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:00.928794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:00.929712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:00.930008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:00.941126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:00.949816 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:00.950833 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:00.951730 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 346/680] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:00.953173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:00.979362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:01.032553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38732416-d920-422c-abbb-4232d72e18ae None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.069848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.070504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.070796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.071082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.071957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=3db64ff447674dd2a2f15b005696075b) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:01.072274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.073312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ea0a-c08d-41fa-acf7-40abebd55e04 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.073763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.087742 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 335/681] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/role_assignments?user.id=3db64ff447674dd2a2f15b005696075b&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:01.089455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.119836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.120751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.121047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.121328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.133431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:01.136713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.138585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:01.166849 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:01.168280 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:01.169400 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:01.169400 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:01.169400 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:01.169400 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:01.176379 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 347/682] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:01.177613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.224434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a10ff-0b1c-464c-b5cf-2438500b7859 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.242919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:01.266312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.271241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.271241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.271241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.271241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:01.271241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.271241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.284568 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 336/683] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:01.285522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.299346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab0bec-12f3-4a46-bcf1-b8b4e7261c88 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.340305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.341348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.341840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.342305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.343250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:01.343858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.345441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.355989 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 348/684] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:01.357227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.398441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ff7f-2f3a-40b3-86dd-96cc2f627b88 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.420416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:01.436071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.436841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.437220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.437571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.438371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:01.438759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.440267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.453103 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 337/685] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:01.454049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.474852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a6b73-68d9-49b3-96ff-946d7d437b7f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.503650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:01.513464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.514433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.514904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.515415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.516635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=0f0c4ffb0c9a4de08091b6a7493e2fc8) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:01.517141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.518924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.526228 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 349/686] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/role_assignments?user.id=0f0c4ffb0c9a4de08091b6a7493e2fc8&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:01.527335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.591341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad769c72-4ec8-4e6c-8766-71a72cb0f6fb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.629806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.630637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.630927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.631343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.645248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.646855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:01.667713 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:01.668715 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:01.669897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:01.669897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:01.669897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:01.669897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:01.669897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 338/687] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:01.674776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.700674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18896893-e58a-45c4-b824-7c59f2a694cc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.740012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:01.789300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.790513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.791006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.792942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.803228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.803654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:01.807195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.818094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d2c6-30b2-44aa-8d93-cb274c289326 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:01.825505 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:01.826574 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:01.828482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:01.830967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 350/688] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:01.836926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.872258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:01.873182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:01.873472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:01.873754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:01.874926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:01.875245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:01.877015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:01.896887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 339/689] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:01.903002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:01.972864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb53a-8943-4bc6-ae69-1dbe1775f7b8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:02.013206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:02.014255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:02.014755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:02.015378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:02.016803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:02.017345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:02.019475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:02.039820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f523b96-6719-46ec-9923-3eaf4319a6aa None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:02.043658 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 351/690] 10.222.0.98 () {56 vars in 1135 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:02.052441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:02.086311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:02.087865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:02.088159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:02.088442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:02.098310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:02.098479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:02.100405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:02.118132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:02.119458 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:02.121139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 340/691] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:20:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:02.125410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:02.137709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:02.179538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e772-3083-49bd-a8aa-643c6984f40f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:02.222150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:02.223258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:02.223803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:02.224295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:02.238342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85554800-4330-4e55-9dd6-837db8b0e091 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:02.279310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:02.279310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:02.279310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:02.279310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:02.280141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:02.280460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:02.282038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:02.302295 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 341/692] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:20:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:02.309007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:02.389654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:02.391147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:02.415718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:02.456141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92599c-2177-4079-b26a-3674be21a41a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:02.481678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:02.513458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:02.514518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:02.515015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:02.515571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:02.567054 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 352/693] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:20:02.575160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:02.673614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:02.675314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:02.692321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b726d5-059a-4147-ac09-4fcf3dfc2a36 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:02.731913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:02.732716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:02.733009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:02.733290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:02.736235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:02.745568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:02.747062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:02.766660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:02.767675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:02.769029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:02.769029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:02.769029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:02.769029 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:02.769029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 353/694] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:02.777868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:02.799694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:02.883119 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 342/695] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:20:02.888874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:02.950319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bfd66-7586-4522-89c2-eea8966c42cd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.019560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.020620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.021178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.021662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.022615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:03.027930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.029575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.042851 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 354/696] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:03.049360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.083013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095023-0638-440e-a1e0-b96ee906627d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.141085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:03.159692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548a824-b941-4cfb-b131-ec77997e0a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.160507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a824-b941-4cfb-b131-ec77997e0a20 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.160789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a824-b941-4cfb-b131-ec77997e0a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.161065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a824-b941-4cfb-b131-ec77997e0a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.173598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548a824-b941-4cfb-b131-ec77997e0a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.175067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548a824-b941-4cfb-b131-ec77997e0a20 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c548a824-b941-4cfb-b131-ec77997e0a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:03.193748 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:03.194812 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:03.196197 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:03.196197 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:03.196197 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:03.196197 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:03.196197 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 343/697] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:03.196834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23860f-4508-4467-892e-01b417f95a69 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.196921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23860f-4508-4467-892e-01b417f95a69 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.197402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23860f-4508-4467-892e-01b417f95a69 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.198951 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 344/698] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:03.204658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23860f-4508-4467-892e-01b417f95a69 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.219447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fbe49-4d64-4733-9ea0-e1d76927206b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.229622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:03.263300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12846e01-5055-4348-a989-00548dc3b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.264563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846e01-5055-4348-a989-00548dc3b25f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.264859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846e01-5055-4348-a989-00548dc3b25f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.265144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846e01-5055-4348-a989-00548dc3b25f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.274966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12846e01-5055-4348-a989-00548dc3b25f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.276687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12846e01-5055-4348-a989-00548dc3b25f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-12846e01-5055-4348-a989-00548dc3b25f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:03.296051 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:03.297032 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:03.297968 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:03.302205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 355/699] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:03.304300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4db3b-db89-4b5b-81c2-c6cf84263f1b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.304608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4db3b-db89-4b5b-81c2-c6cf84263f1b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.304899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4db3b-db89-4b5b-81c2-c6cf84263f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.325558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5bb4db3b-db89-4b5b-81c2-c6cf84263f1b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:03.326919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bb4db3b-db89-4b5b-81c2-c6cf84263f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:03.345863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23860f-4508-4467-892e-01b417f95a69 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.390226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.391173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.391491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.391771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.392497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:03.392804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.394185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.415093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 345/700] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:03.415093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.415494 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 356/701] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:03.416512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4db3b-db89-4b5b-81c2-c6cf84263f1b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.472590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:03.521355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:03.547194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61eb7-ed95-4641-a9db-a17a7287adf4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.551391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4db3b-db89-4b5b-81c2-c6cf84263f1b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.587930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abac62a-2c34-4b93-a181-d38300822039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.588713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abac62a-2c34-4b93-a181-d38300822039 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.589006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abac62a-2c34-4b93-a181-d38300822039 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.589283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abac62a-2c34-4b93-a181-d38300822039 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.590085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abac62a-2c34-4b93-a181-d38300822039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:03.590399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abac62a-2c34-4b93-a181-d38300822039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.591916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abac62a-2c34-4b93-a181-d38300822039 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.614751 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 346/702] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:03.616092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f859-333a-40b0-90ca-bed5e5a586b8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.616381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f859-333a-40b0-90ca-bed5e5a586b8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.616677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f859-333a-40b0-90ca-bed5e5a586b8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.618058 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 347/703] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:03.620855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f859-333a-40b0-90ca-bed5e5a586b8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.622603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.623455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.623744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.624025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.631883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.634445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:03.649952 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:03.651094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:03.652248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 357/704] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:03.652751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.747067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f859-333a-40b0-90ca-bed5e5a586b8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.767866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:03.772099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750216-9fc2-43bb-8b20-f6f011212f56 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:03.786950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88b14-8135-48be-9b9e-c13fc9b066f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.787782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88b14-8135-48be-9b9e-c13fc9b066f3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.788073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88b14-8135-48be-9b9e-c13fc9b066f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.789097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88b14-8135-48be-9b9e-c13fc9b066f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.795956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:03.799614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88b14-8135-48be-9b9e-c13fc9b066f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.801128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88b14-8135-48be-9b9e-c13fc9b066f3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.814237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:03.814901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.815181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.815484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.816317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=e4c56829e4af4b609ab6c986b745a4fd) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:03.816631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:03.818203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3ae88b14-8135-48be-9b9e-c13fc9b066f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:03.820405 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:03.821349 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:03.822284 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:03.822284 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:03.822284 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:03.822284 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:03.822284 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 348/705] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:03.823636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1bd9-d1b5-4733-b761-05ab2f97e427 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:03.823636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1bd9-d1b5-4733-b761-05ab2f97e427 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:03.823636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1bd9-d1b5-4733-b761-05ab2f97e427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:03.836000 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 358/706] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/role_assignments?user.id=e4c56829e4af4b609ab6c986b745a4fd&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:03.838006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.841699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-480d1bd9-d1b5-4733-b761-05ab2f97e427 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:03.842988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-480d1bd9-d1b5-4733-b761-05ab2f97e427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:03.939750 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 349/707] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:03.940772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1bd9-d1b5-4733-b761-05ab2f97e427 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:03.999318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775894ba-82bf-475e-834b-9a31e82710ae None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.051460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.052015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.052299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.052574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.053365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:04.054531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.055681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.070624 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 359/708] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:04.071511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:04.088254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1bd9-d1b5-4733-b761-05ab2f97e427 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.101199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:04.113894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:04.131664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.133051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.133559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.133671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.134333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:04.134645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.136760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.153583 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 350/709] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:04.154834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:04.206159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10510f46-0a42-450e-8baf-641696778f6d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.245632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.247331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.247331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.247331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.247673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.249061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:04.264544 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:04.265758 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:04.267305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 360/710] 10.222.0.98 () {56 vars in 1129 bytes} [Thu Jul 14 14:20:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:04.268254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:04.281702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0625-09d1-4eb8-9bc1-a9a54741d833 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.319162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de4131-b1b8-47bb-86f6-470184a1762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.319989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4131-b1b8-47bb-86f6-470184a1762f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.320333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4131-b1b8-47bb-86f6-470184a1762f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.320674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4131-b1b8-47bb-86f6-470184a1762f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.321594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de4131-b1b8-47bb-86f6-470184a1762f None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=eecb3bcddba54aca9316af7a0ec3b923) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:04.321982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de4131-b1b8-47bb-86f6-470184a1762f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.323514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de4131-b1b8-47bb-86f6-470184a1762f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.329906 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 351/711] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:04 2022] GET /identity/v3/role_assignments?user.id=eecb3bcddba54aca9316af7a0ec3b923&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:04.331385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509e80-ecdb-4b3c-85a1-f3c3c174874f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.331742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509e80-ecdb-4b3c-85a1-f3c3c174874f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.332091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509e80-ecdb-4b3c-85a1-f3c3c174874f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.333676 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 352/712] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:04.339057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d509e80-ecdb-4b3c-85a1-f3c3c174874f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:04.378162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:04.396479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9cbf-fd8e-48aa-8f86-4b2a930cf110 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.398250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:04.458724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a80b2-fabb-4ccd-9b77-0bea3c97f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.459858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a80b2-fabb-4ccd-9b77-0bea3c97f1b3 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.461142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a80b2-fabb-4ccd-9b77-0bea3c97f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.461648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a80b2-fabb-4ccd-9b77-0bea3c97f1b3 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.464980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a80b2-fabb-4ccd-9b77-0bea3c97f1b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.466515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a80b2-fabb-4ccd-9b77-0bea3c97f1b3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.485405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d509e80-ecdb-4b3c-85a1-f3c3c174874f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.494474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 361/713] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:20:04 2022] POST /identity/v3/users => generated 254 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:04.496093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38054e-5623-454a-be77-443beffb3b5d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.496389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38054e-5623-454a-be77-443beffb3b5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.496679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38054e-5623-454a-be77-443beffb3b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.534150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e38054e-5623-454a-be77-443beffb3b5d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:04.537182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e38054e-5623-454a-be77-443beffb3b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:04.556033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.556829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.557156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.558542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.559059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:04.559445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.560898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.568567 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 353/714] 10.222.0.98 () {56 vars in 1124 bytes} [Thu Jul 14 14:20:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:04.574441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:04.685042 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 362/715] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:04.707996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38054e-5623-454a-be77-443beffb3b5d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:04.745999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2733f-2b37-48d6-862d-8a8993d6371b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.758229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:04.789099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.789786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.790078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.790357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.791070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:04.791416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.792859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.799362 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 354/716] 10.222.0.98 () {56 vars in 1124 bytes} [Thu Jul 14 14:20:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:04.802009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:04.843738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38054e-5623-454a-be77-443beffb3b5d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:04.888577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:04.889422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:04.889713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:04.889997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] PATH_INFO: `/v3/services/network` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:04.890675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:04.892167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:04.907531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:04.908588 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:04.909424 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 363/717] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:04 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:04.915814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:05.031529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24754dd3-a1d9-4038-9841-7cf33513d54c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:05.067607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80df0-238b-4b09-8194-e3b9672f5e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:05.068284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80df0-238b-4b09-8194-e3b9672f5e08 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:05.068573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80df0-238b-4b09-8194-e3b9672f5e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:05.068858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80df0-238b-4b09-8194-e3b9672f5e08 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:05.070095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec80df0-238b-4b09-8194-e3b9672f5e08 None admin] RBAC: Adding query filter params (name=network) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:05.070399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec80df0-238b-4b09-8194-e3b9672f5e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:05.071817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec80df0-238b-4b09-8194-e3b9672f5e08 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:05.077195 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 355/718] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:05.083048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:05.206595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e7cb-e597-44cd-86e9-6865d276ee32 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:05.270044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6ecc-3abb-4c2a-a9ae-36bd89d7e65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:05.270740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6ecc-3abb-4c2a-a9ae-36bd89d7e65b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:05.271031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6ecc-3abb-4c2a-a9ae-36bd89d7e65b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:05.275387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6ecc-3abb-4c2a-a9ae-36bd89d7e65b None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:05.276182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6ecc-3abb-4c2a-a9ae-36bd89d7e65b None admin] RBAC: Adding query filter params (type=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:05.276560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6ecc-3abb-4c2a-a9ae-36bd89d7e65b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:05.278092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6ecc-3abb-4c2a-a9ae-36bd89d7e65b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:05.282144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:05.290021 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 364/719] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:06.388198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97f6cb-d4cc-4075-97a0-947074de5ed0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:06.388927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97f6cb-d4cc-4075-97a0-947074de5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:06.388927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97f6cb-d4cc-4075-97a0-947074de5ed0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:06.390387 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 356/720] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:06.404998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6025b-6bf8-4a80-9abf-1add0f1843c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:06.405630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6025b-6bf8-4a80-9abf-1add0f1843c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:06.405630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6025b-6bf8-4a80-9abf-1add0f1843c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:06.424607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7fd6025b-6bf8-4a80-9abf-1add0f1843c4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:06.425803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7fd6025b-6bf8-4a80-9abf-1add0f1843c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:06.517537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 365/721] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:06.552235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97f6cb-d4cc-4075-97a0-947074de5ed0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:06.596365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:06.670708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97f6cb-d4cc-4075-97a0-947074de5ed0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:06.708261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2615f55-784c-42d7-a406-bd05a6023e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:06.709073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2615f55-784c-42d7-a406-bd05a6023e85 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:06.709358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2615f55-784c-42d7-a406-bd05a6023e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:06.709639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2615f55-784c-42d7-a406-bd05a6023e85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:06.721498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2615f55-784c-42d7-a406-bd05a6023e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c2615f55-784c-42d7-a406-bd05a6023e85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:06.730121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:06.732084 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:06.733160 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 357/722] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:06.740418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6025b-6bf8-4a80-9abf-1add0f1843c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:06.855440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc215299-a00d-4bf3-b57c-b5fa4831fae7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:06.855440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc215299-a00d-4bf3-b57c-b5fa4831fae7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:06.855440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc215299-a00d-4bf3-b57c-b5fa4831fae7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:06.856296 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 358/723] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:06.864162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b569-0a77-4f20-92b5-f387f87b8b70 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:06.864162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b569-0a77-4f20-92b5-f387f87b8b70 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:06.864162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b569-0a77-4f20-92b5-f387f87b8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:06.879499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a5f3b569-0a77-4f20-92b5-f387f87b8b70 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:06.880696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a5f3b569-0a77-4f20-92b5-f387f87b8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:06.886203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6025b-6bf8-4a80-9abf-1add0f1843c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:06.953014 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 359/724] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:06.953583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:06.967292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:06.967992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:06.968281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:06.968562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:06.969320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:06.969633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:06.971012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:06.976667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b569-0a77-4f20-92b5-f387f87b8b70 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:06.990058 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 366/725] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:06.995874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:07.037227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:07.118511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21ae38-4a8b-47c6-b833-be23887ec884 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:07.185257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:07.186067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.186364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.186647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.204147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:07.205774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:07.215228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b569-0a77-4f20-92b5-f387f87b8b70 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:07.240215 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:07.241176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:07.242654 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:07.242654 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:07.242654 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:07.242654 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:07.242654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 367/726] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:07.250977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:07.291216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:07.292078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.292370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.292653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.315969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:07.331024 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:07.332074 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:07.332923 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:07.335108 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 360/727] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:07.345929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:07.350062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:07.429999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d514af-31af-435d-8d52-0c2cf7724dae None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:07.471334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a530b-c8d8-4c74-8176-19d257dae3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:07.472381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a530b-c8d8-4c74-8176-19d257dae3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.472867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a530b-c8d8-4c74-8176-19d257dae3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.473395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a530b-c8d8-4c74-8176-19d257dae3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.474221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:07.475168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a530b-c8d8-4c74-8176-19d257dae3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:07.475704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a530b-c8d8-4c74-8176-19d257dae3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:07.478739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a530b-c8d8-4c74-8176-19d257dae3c5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:07.492708 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 368/728] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:07.497403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271089b7-d050-4367-a6c3-890ff23ec5f0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:07.499160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564e06a-0237-42ba-9d30-33b38c0ffd47 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.499684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564e06a-0237-42ba-9d30-33b38c0ffd47 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.500148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564e06a-0237-42ba-9d30-33b38c0ffd47 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.502077 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 369/729] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:07.503035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564e06a-0237-42ba-9d30-33b38c0ffd47 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:07.546590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f5a5d-8580-405d-b3f9-2c56ccf890ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:07.547293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5a5d-8580-405d-b3f9-2c56ccf890ba None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.548064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5a5d-8580-405d-b3f9-2c56ccf890ba None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.548342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5a5d-8580-405d-b3f9-2c56ccf890ba None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.549103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5a5d-8580-405d-b3f9-2c56ccf890ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:07.549407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5a5d-8580-405d-b3f9-2c56ccf890ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:07.550786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5a5d-8580-405d-b3f9-2c56ccf890ba None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:07.565071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 361/730] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:07.565071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d55d-8f14-4c31-a9e8-f018543209b0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.565071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d55d-8f14-4c31-a9e8-f018543209b0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.565071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d55d-8f14-4c31-a9e8-f018543209b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.582149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8e60d55d-8f14-4c31-a9e8-f018543209b0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:07.583523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8e60d55d-8f14-4c31-a9e8-f018543209b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:07.652958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564e06a-0237-42ba-9d30-33b38c0ffd47 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:07.656546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:07.683533 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 362/731] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:07.684588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60d55d-8f14-4c31-a9e8-f018543209b0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:07.701942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63aeb8-4cb1-491e-9b41-1b71b197a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:07.703053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63aeb8-4cb1-491e-9b41-1b71b197a55f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.703550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63aeb8-4cb1-491e-9b41-1b71b197a55f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.704083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63aeb8-4cb1-491e-9b41-1b71b197a55f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.714021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63aeb8-4cb1-491e-9b41-1b71b197a55f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:07.716025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63aeb8-4cb1-491e-9b41-1b71b197a55f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bf63aeb8-4cb1-491e-9b41-1b71b197a55f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:07.733629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:07.734731 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:07.735725 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 370/732] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:07.736950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39dc1-7dbf-49ba-b8f8-947883755520 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.737540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39dc1-7dbf-49ba-b8f8-947883755520 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.737823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee39dc1-7dbf-49ba-b8f8-947883755520 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.739326 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 371/733] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:07.740460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee39dc1-7dbf-49ba-b8f8-947883755520 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:07.782767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:07.808036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60d55d-8f14-4c31-a9e8-f018543209b0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:07.848116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:07.848926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.849210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.849490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.860288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:07.861753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:07.868828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee39dc1-7dbf-49ba-b8f8-947883755520 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:07.881623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:07.883225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:07.884200 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:07.884200 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:07.884200 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:07.884200 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:07.884200 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 363/734] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:07.884200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:07.911084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b48556-7dab-471b-927e-169cd3fd68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:07.911921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b48556-7dab-471b-927e-169cd3fd68ad None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.912207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b48556-7dab-471b-927e-169cd3fd68ad None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.912485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b48556-7dab-471b-927e-169cd3fd68ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.932395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b48556-7dab-471b-927e-169cd3fd68ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-80b48556-7dab-471b-927e-169cd3fd68ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:07.940422 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:07.941524 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:07.942386 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 372/735] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:20:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:07.943081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b438-495d-4597-984a-00ec3bfad4a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:07.943081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b438-495d-4597-984a-00ec3bfad4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:07.943390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b438-495d-4597-984a-00ec3bfad4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:07.961342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9332b438-495d-4597-984a-00ec3bfad4a2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:07.962837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9332b438-495d-4597-984a-00ec3bfad4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:07.980503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.001321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4804ce-f345-4c4c-9cc2-4128d5f11b56 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.031684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.055181 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 373/736] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:08.055181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa695df-7a02-4ba9-ab76-49587de7ae01 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.055181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa695df-7a02-4ba9-ab76-49587de7ae01 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.055181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa695df-7a02-4ba9-ab76-49587de7ae01 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.055652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.055755 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 374/737] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:08.055755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa695df-7a02-4ba9-ab76-49587de7ae01 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.055887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.055887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.055887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.055887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:08.055887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.055887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.066486 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 364/738] 10.222.0.98 () {56 vars in 1135 bytes} [Thu Jul 14 14:20:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:08.067434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.145034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa695df-7a02-4ba9-ab76-49587de7ae01 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.168133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601299-3329-4e03-8f67-77bea8f85e7f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.180391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb4a0-622a-4ca9-8803-56e168480a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.181062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb4a0-622a-4ca9-8803-56e168480a67 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.181346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb4a0-622a-4ca9-8803-56e168480a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.181629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb4a0-622a-4ca9-8803-56e168480a67 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.182366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb4a0-622a-4ca9-8803-56e168480a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:08.182674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb4a0-622a-4ca9-8803-56e168480a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.184121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb4a0-622a-4ca9-8803-56e168480a67 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.196690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 375/739] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:08.198182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603a008-0e37-4de9-aab2-ba0da0a63abe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.198473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603a008-0e37-4de9-aab2-ba0da0a63abe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.198751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603a008-0e37-4de9-aab2-ba0da0a63abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.206153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.206962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.207385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.207776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.208612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:08.209002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.211064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.218047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1603a008-0e37-4de9-aab2-ba0da0a63abe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:08.219263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1603a008-0e37-4de9-aab2-ba0da0a63abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:08.220235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 365/740] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:20:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:08.221037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.230581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.281813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.294363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 376/741] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:20:08.295216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603a008-0e37-4de9-aab2-ba0da0a63abe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.342858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4707-7a11-4371-b674-a2d7579676af None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.378458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.379137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.379461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.379743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.380473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.381907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.397445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603a008-0e37-4de9-aab2-ba0da0a63abe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.398423 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 366/742] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:08 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:08.399300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.446090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.446931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.447184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.447506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.460659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.532340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b5bc9-6649-4965-9a70-f6f2b79957f4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.534002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.535654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.544890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.578048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.578872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.579161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.579479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.588865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.590736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:08.606871 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:08.608096 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:08.609170 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:08.611517 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 367/743] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:20:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:08.612643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.661568 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 377/744] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:20:08.662713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.713551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.735347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d68b94-6a50-4601-ab89-7de0a1cc1d6d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.772614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.773921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.774206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.774481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.780594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12575a6-f060-4c7e-82e0-a1dc5239ea10 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.786071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.787648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:08.805875 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:08.806831 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:08.807755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:08.807755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:08.807755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:08.807755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:08.807755 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 368/745] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:08.808042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.827671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:08.828740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:08.829239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:08.829722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:08.830677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:08.832175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:08.841066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.850629 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 378/746] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:08 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:08.851836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:08.958188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e539637-34fc-4d98-b840-ea623f4f0d6f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:08.983631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:08.996820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837a930-7383-4b95-9267-6723b01a2879 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.017043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.018546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.019616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.020174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.021336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:09.021876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.025788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.044010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.044548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.044839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.045188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.047932 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 369/747] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:20:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:09.048814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.060018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.061496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:09.083379 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:09.084350 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:09.085317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:09.085317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:09.085317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:09.085317 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:09.085317 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 379/748] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:09.086047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.145441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:09.170506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca804-cdbc-4d60-bf4f-98278614c596 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.209080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.209906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.210795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.211157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.212020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:09.212749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.214418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.230733 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 370/749] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:09.231773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.350964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500a10a-ffcd-46bd-9223-8c752462cf9d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.364068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc435d95-1555-42ef-b78e-f623e918754e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.389685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.390483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.390763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.391033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.402002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.403693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.408797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.409481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.409771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.410054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.411243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:09.411592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.412619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:09.412991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.424313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:09.424518 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:09.425334 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:09.426251 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:09.426251 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:09.426251 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:09.426251 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:09.426251 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 380/750] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:09.427239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.430338 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 371/751] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:09.435003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.558253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abb39-1df2-46bb-8bc5-66a685fb30df None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.573026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7296-9b7b-4fa2-b002-baec50073fa8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.598843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.599841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.600130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.600411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.610511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.612224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.623468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.624647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.625134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.625607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:09.630176 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:09.631132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:09.632656 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 381/752] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:09.633258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.638550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.640338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:09.660359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:09.661303 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:09.662198 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:09.665517 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 372/753] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:09.667302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.704605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:09.748422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:09.763811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b38bd-7a7d-474c-898e-32762397564c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.793464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50bdda-2fcc-4365-932c-ffaea4c9b8b1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.812352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.813939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.814390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.814819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.815880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:09.816379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.818689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.833670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:09.834490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:09.834881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:09.835801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:09.836610 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 382/754] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:09.836839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:09.837521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:09.838177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.843317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:09.875489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 373/755] 10.222.0.98 () {56 vars in 1149 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:09.876696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:09.979573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e35d6-fda2-458a-b3a1-2d3e0bd734c3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:09.987086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd83f-77f6-46b9-b2e0-abc20aa32d1d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:10.003600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:10.014193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:10.025022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:10.026081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.026573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.027074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.028300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:10.028824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:10.030528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:10.033900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:10.034717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.035008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.035309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.044075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:10.045510 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 383/756] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:10.045625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:10.046671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:10.071254 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:10.072245 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:10.073157 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:10.077863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 374/757] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:10.078837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:10.172393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beaf1e-6733-458c-a7fd-7117f18964db None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:10.216291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:10.217477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.218936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.219683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.225158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a304ef3-5ed0-4c23-b128-bce49ef14b8e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:10.270741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:10.271719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.272232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.273281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.274415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=e4c56829e4af4b609ab6c986b745a4fd) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:10.275015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:10.276722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:10.283610 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 375/758] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:10 2022] GET /identity/v3/role_assignments?user.id=e4c56829e4af4b609ab6c986b745a4fd&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:10.284800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:10.305972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:10.357273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:10.360117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:10.382586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:10.490226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93463c3f-182f-432d-b399-5f6d1611fd3f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:10.530901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318a3af-bd13-41c9-af33-16cf5299312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:10.532020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318a3af-bd13-41c9-af33-16cf5299312f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.532518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318a3af-bd13-41c9-af33-16cf5299312f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.533001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318a3af-bd13-41c9-af33-16cf5299312f None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.534020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318a3af-bd13-41c9-af33-16cf5299312f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:10.534533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318a3af-bd13-41c9-af33-16cf5299312f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:10.536253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318a3af-bd13-41c9-af33-16cf5299312f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:10.575922 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 384/759] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:20:10.581732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:10.669853 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 376/760] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:10.677198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f753e-9e52-4847-b88a-5c0c789f1723 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.677695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f753e-9e52-4847-b88a-5c0c789f1723 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.678179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f753e-9e52-4847-b88a-5c0c789f1723 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.681162 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 377/761] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:10.683951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f753e-9e52-4847-b88a-5c0c789f1723 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:10.715681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:10.723998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b63ba-6761-4357-b95d-49e2dc07334d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:10.774284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dd1d2-b561-4305-991e-80fb7ef89614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:10.775839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dd1d2-b561-4305-991e-80fb7ef89614 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.776274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dd1d2-b561-4305-991e-80fb7ef89614 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.776565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dd1d2-b561-4305-991e-80fb7ef89614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.791579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dd1d2-b561-4305-991e-80fb7ef89614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:10.793360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dd1d2-b561-4305-991e-80fb7ef89614 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:10.803743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f753e-9e52-4847-b88a-5c0c789f1723 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:10.805629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0f9dd1d2-b561-4305-991e-80fb7ef89614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:10.815430 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:10.816401 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:10.817302 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:10.817302 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:10.817302 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:10.817302 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:10.817989 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 385/762] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:10.819516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb1aa0-253c-4c23-82f3-689c7422a34f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.819809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb1aa0-253c-4c23-82f3-689c7422a34f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.820093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb1aa0-253c-4c23-82f3-689c7422a34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.841013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ebdb1aa0-253c-4c23-82f3-689c7422a34f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:10.842802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ebdb1aa0-253c-4c23-82f3-689c7422a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:10.857500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:10.858466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:10.858754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:10.859034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/eecb3bcddba54aca9316af7a0ec3b923/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:10.861269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=eecb3bcddba54aca9316af7a0ec3b923, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:10.862640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:10.883530 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 378/763] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:20:10 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/eecb3bcddba54aca9316af7a0ec3b923/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:20:10.891595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:10.998968 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 386/764] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:11.046283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb1aa0-253c-4c23-82f3-689c7422a34f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.072078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4244a4-83cf-406d-98f7-2dbe5cc8b11c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.118851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.120511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.121041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.121526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.121838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:11.122906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:11.123762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.125738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.142498 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 379/765] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:11.147546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.174101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb1aa0-253c-4c23-82f3-689c7422a34f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.183221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:11.211458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f236a7-ae13-4059-a27e-b027aeb6176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.212540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f236a7-ae13-4059-a27e-b027aeb6176f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.212910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f236a7-ae13-4059-a27e-b027aeb6176f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.213096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f236a7-ae13-4059-a27e-b027aeb6176f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.213822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f236a7-ae13-4059-a27e-b027aeb6176f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.215253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f236a7-ae13-4059-a27e-b027aeb6176f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-98f236a7-ae13-4059-a27e-b027aeb6176f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:11.229572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:11.230749 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:11.231983 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 387/766] 10.222.0.98 () {56 vars in 1129 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:11.233021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52289a-af3d-46fc-bc65-cae7f06a6346 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.233021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52289a-af3d-46fc-bc65-cae7f06a6346 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.233021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52289a-af3d-46fc-bc65-cae7f06a6346 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.234427 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 388/767] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:11.247626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c07648-b8b9-41f5-9cc0-8a815c039d87 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.248014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c07648-b8b9-41f5-9cc0-8a815c039d87 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.248391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c07648-b8b9-41f5-9cc0-8a815c039d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.267637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c6c07648-b8b9-41f5-9cc0-8a815c039d87 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:11.269061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c6c07648-b8b9-41f5-9cc0-8a815c039d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:11.278307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b5884-df54-4da3-a83e-019a52f5b874 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.314654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.315498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.315794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.316071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.323580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.325051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:11.342177 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:11.343121 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 380/768] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:11.344071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.360277 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 389/769] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:11.361804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c07648-b8b9-41f5-9cc0-8a815c039d87 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.437000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:11.443180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:11.457799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d25aa3-08f4-48e7-87b2-9bf045c54851 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.496148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.497057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.497444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.497816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.498649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:11.499054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.500557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.505929 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 381/770] 10.222.0.98 () {56 vars in 1124 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:11.506973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.507245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c07648-b8b9-41f5-9cc0-8a815c039d87 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.560463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.562006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.562517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.562958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.564216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:11.564534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.566042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.585349 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 390/771] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:11.585349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.654177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8bc3-0d51-4d55-9d7f-0f7372901f03 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.699071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.700189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.700600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.700937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] PATH_INFO: `/v3/services/network` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.701933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.703170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.713212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d073e-0fdd-4ad7-b203-0487c96b9f9f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:11.719026 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:11.720281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:11.721314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:11.723592 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 382/772] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:11.724595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.737743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:11.739386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:11.762108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.763457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.763895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.764585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.765479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:11.765931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.768532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.774788 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 391/773] 10.222.0.98 () {56 vars in 1124 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:11.776164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.844023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9904039-b13e-49f2-9fe8-9e8656966900 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:11.882391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:11.883441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:11.883553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:11.883808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:11.884747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=4999d3dfc6394f83a0b264434e6a256f) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:11.884959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:11.886515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:11.899301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 383/774] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/role_assignments?user.id=4999d3dfc6394f83a0b264434e6a256f&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:11.899301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:11.929540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdc5d0-d185-4ef9-a341-c514ca62d8e3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:12.025029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:12.025863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.026161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.026437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.027154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] RBAC: Adding query filter params (name=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:12.027484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:12.029005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:12.046508 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 392/775] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:12.056358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:12.060721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:12.099903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d1d3-b6f4-4274-a741-b62a213f2f6f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:12.126802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:12.152326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:12.153008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.153294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.153576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.154374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] RBAC: Adding query filter params (interface=public, service_id=7584c1500cb24a4796e5355fc45f68d5, region_id=RegionOne) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:12.154689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:12.156100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:12.182948 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 384/776] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:20:11 2022] GET /identity/v3/endpoints?service_id=7584c1500cb24a4796e5355fc45f68d5&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:12.188644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:12.227956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b2842-b51d-4096-9f62-3c65aec7b868 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:12.270899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:12.273786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.274085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.274369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.276317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] RBAC: Adding query filter params (type=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:12.276437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:12.277829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:12.295038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 393/777] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:12.295799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:12.405692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae77528-6828-44a0-a603-bbc07b01e758 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:12.447152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:12.448350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.448838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.449313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.450199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:12.452705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:12.470716 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 385/778] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:12 2022] GET /identity/v3/services => generated 772 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:12.507703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de65653-6c89-44bc-b8e9-2fa9a15d62fc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:12.529733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:12.566914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7f746-9486-4a6b-a1c9-fbed263bb954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:12.567648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7f746-9486-4a6b-a1c9-fbed263bb954 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.567935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7f746-9486-4a6b-a1c9-fbed263bb954 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.568213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7f746-9486-4a6b-a1c9-fbed263bb954 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.569023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7f746-9486-4a6b-a1c9-fbed263bb954 None admin] RBAC: Adding query filter params (interface=public, service_id=b2212e649d77493e93944623557b90b7, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:12.569374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7f746-9486-4a6b-a1c9-fbed263bb954 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:12.570764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7f746-9486-4a6b-a1c9-fbed263bb954 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:12.586884 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 394/779] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:20:12 2022] GET /identity/v3/endpoints?service_id=b2212e649d77493e93944623557b90b7&interface=public®ion_id=RegionOne => generated 194 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:12.592768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:12.602686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:12.607076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9ba87-40aa-4a05-8147-136684318a4e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.607402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9ba87-40aa-4a05-8147-136684318a4e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.607690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9ba87-40aa-4a05-8147-136684318a4e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.609392 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 395/780] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:12.616110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938b4b2-01c4-4cc1-92fb-e90c2f877608 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.617058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938b4b2-01c4-4cc1-92fb-e90c2f877608 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.617345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938b4b2-01c4-4cc1-92fb-e90c2f877608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.651245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0938b4b2-01c4-4cc1-92fb-e90c2f877608 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:12.652510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0938b4b2-01c4-4cc1-92fb-e90c2f877608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:12.766850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7279-0bb3-4bd6-ac28-b0f00d8db962 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:12.778285 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 396/781] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:12.803192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938b4b2-01c4-4cc1-92fb-e90c2f877608 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:12.810090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:12.810825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.811115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.811432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:12.812123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:12.813537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:12.820024 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 386/782] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:12 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:12.933135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938b4b2-01c4-4cc1-92fb-e90c2f877608 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:12.937409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:12.996501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:12.997334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:12.997623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:12.997906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:13.020189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:13.028256 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:13.029487 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:13.030354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 397/783] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:13.035643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:13.112566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:13.155830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92b615-7362-4ed4-bb30-dfb3e2286dfe None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:13.195371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:13.196069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:13.196353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:13.196631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:13.197385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:13.197693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:13.199080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:13.216657 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 387/784] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:13.222307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:13.403550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e84859-8539-4e12-8fc9-17e2df9ffb88 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:13.452057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593afa9-d697-475c-9770-b802b2071345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:13.452872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593afa9-d697-475c-9770-b802b2071345 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:13.453163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593afa9-d697-475c-9770-b802b2071345 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:13.453444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593afa9-d697-475c-9770-b802b2071345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:13.473390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593afa9-d697-475c-9770-b802b2071345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:13.474877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593afa9-d697-475c-9770-b802b2071345 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e593afa9-d697-475c-9770-b802b2071345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:13.499359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:13.500351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:13.501255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:13.501255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:13.501255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:13.501255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:13.501255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 398/785] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:13.506258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:13.578676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad9352-9b4d-4518-bfff-a890e6da54a3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:13.579389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad9352-9b4d-4518-bfff-a890e6da54a3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:13.579869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad9352-9b4d-4518-bfff-a890e6da54a3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:13.581717 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 399/786] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:13.587880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa608d-1f33-45bd-98a1-57116182564a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:13.588925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa608d-1f33-45bd-98a1-57116182564a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:13.589476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa608d-1f33-45bd-98a1-57116182564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:13.619971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6efa608d-1f33-45bd-98a1-57116182564a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:13.622362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6efa608d-1f33-45bd-98a1-57116182564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:13.642358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:13.703083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417512-9d76-485a-8ce0-458495aea7bc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:13.753204 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 400/787] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:13.763616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:13.764291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:13.764579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:13.764857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:13.765586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:13.765896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:13.767297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:13.781467 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 388/788] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:13.781772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:13.784204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa608d-1f33-45bd-98a1-57116182564a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:13.788743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:13.915582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa608d-1f33-45bd-98a1-57116182564a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:13.953406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:13.954547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:13.955063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:13.955589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:13.975767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:13.980620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662150c-8c3e-4f01-b28a-dd907490b096 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:13.992361 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:13.993371 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:13.994205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 401/789] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:14.000390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.007219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:14.027747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.030129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.030930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.032204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.046577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.049476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:14.074605 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:14.075906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:14.076869 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:14.083670 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 389/790] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:14.086193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.185816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:14.200118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7335c71-e193-4d62-bb1c-18a71b6a6c35 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.248174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.249783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.250075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.250357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.251125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:14.251462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.252842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.268248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 402/791] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:14.274275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.319897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a044f-0332-435a-9ea5-f41e2bf0d8ed None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.367809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80b314-f001-4adc-960a-239b73912b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.368492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b314-f001-4adc-960a-239b73912b8e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.368785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b314-f001-4adc-960a-239b73912b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.369028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:14.369133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b314-f001-4adc-960a-239b73912b8e None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.369969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80b314-f001-4adc-960a-239b73912b8e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:14.370203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80b314-f001-4adc-960a-239b73912b8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.372850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80b314-f001-4adc-960a-239b73912b8e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.403296 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 390/792] 10.222.0.98 () {56 vars in 1135 bytes} [Thu Jul 14 14:20:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:14.403296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5268e-1e06-42fd-8b4b-a31be1d44bf9 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.403296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5268e-1e06-42fd-8b4b-a31be1d44bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.403296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5268e-1e06-42fd-8b4b-a31be1d44bf9 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.403296 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 391/793] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:14.403296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5268e-1e06-42fd-8b4b-a31be1d44bf9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.419996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19b5e7-fd8f-4ff0-8123-09b271756781 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.458314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a0aa-90e2-4a06-ae59-66718bfbde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.459564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a0aa-90e2-4a06-ae59-66718bfbde81 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.460173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a0aa-90e2-4a06-ae59-66718bfbde81 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.460671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a0aa-90e2-4a06-ae59-66718bfbde81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.472851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9a0aa-90e2-4a06-ae59-66718bfbde81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.474643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9a0aa-90e2-4a06-ae59-66718bfbde81 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8cc9a0aa-90e2-4a06-ae59-66718bfbde81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:14.500307 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:14.501223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:14.502115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:14.502115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:14.502115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:14.502115 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:14.506249 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 403/794] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:14.508420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534534-6a4c-4ddc-bd38-49cd64a834e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.508716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534534-6a4c-4ddc-bd38-49cd64a834e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.509001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534534-6a4c-4ddc-bd38-49cd64a834e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.527467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4d534534-6a4c-4ddc-bd38-49cd64a834e4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:14.528786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d534534-6a4c-4ddc-bd38-49cd64a834e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:14.531996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5268e-1e06-42fd-8b4b-a31be1d44bf9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.540187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:14.570673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.571510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.571796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.572820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.583057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.585328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:14.606586 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:14.607816 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:14.608928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:14.608928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:14.608928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:14.608928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:14.610143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 392/795] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:14.610509 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 404/796] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:14.611080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.619184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d534534-6a4c-4ddc-bd38-49cd64a834e4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.693934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:14.722481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45beb2-6911-4be6-9c7c-4fd9ef007998 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.759666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d534534-6a4c-4ddc-bd38-49cd64a834e4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.769629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.771186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.771644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.772413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.773686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:14.774146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.776278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.792693 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 393/797] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:14.794465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.799168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.799468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.799853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.800236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.801071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:14.801487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.802972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.818164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:14.822060 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 405/798] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:14.823403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:14.935777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a41b9a-b56d-44ca-b185-02f5d4c520ca None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.938414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8946a4-8a84-4813-a015-e35bb1cabe04 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:14.949201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:14.977551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.978502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.978891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.979177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.983630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665a6ca-d11c-49f0-8466-36165d61640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:14.984437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a6ca-d11c-49f0-8466-36165d61640d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:14.984775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a6ca-d11c-49f0-8466-36165d61640d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:14.985053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a6ca-d11c-49f0-8466-36165d61640d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:14.987224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:14.988696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:14.995719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665a6ca-d11c-49f0-8466-36165d61640d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:15.002829 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:15.003778 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:15.004967 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3665a6ca-d11c-49f0-8466-36165d61640d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:15.005522 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:15.007702 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:15.008539 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:15.014300 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 406/799] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:20:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:15.014457 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 394/800] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:20:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:15.014457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f0a32-a2c0-4bc3-83c5-eaddd964de92 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.014457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f0a32-a2c0-4bc3-83c5-eaddd964de92 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.014457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f0a32-a2c0-4bc3-83c5-eaddd964de92 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.014457 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 395/801] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:15.015716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.015810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f0a32-a2c0-4bc3-83c5-eaddd964de92 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.106498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.124442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4df50-c52e-4a52-8e45-ab682b6aea23 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.135162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f0a32-a2c0-4bc3-83c5-eaddd964de92 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.163311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb799a-8b07-4425-89f0-a2714f91e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.164486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb799a-8b07-4425-89f0-a2714f91e43b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.164893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb799a-8b07-4425-89f0-a2714f91e43b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.165247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb799a-8b07-4425-89f0-a2714f91e43b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.171575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.172340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.172634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.172838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.173323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb799a-8b07-4425-89f0-a2714f91e43b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.173640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:15.173958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.174908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb799a-8b07-4425-89f0-a2714f91e43b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.175359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.184773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 396/802] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:15.184773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8ffb799a-8b07-4425-89f0-a2714f91e43b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:15.190774 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:15.191683 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:15.192573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 407/803] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:15.193493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427099-fc0c-45b1-b2ec-b2f490214507 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.193493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427099-fc0c-45b1-b2ec-b2f490214507 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.198832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427099-fc0c-45b1-b2ec-b2f490214507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.214420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4427099-fc0c-45b1-b2ec-b2f490214507 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:15.215755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4427099-fc0c-45b1-b2ec-b2f490214507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:15.241840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.292385 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 408/804] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:15.293210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427099-fc0c-45b1-b2ec-b2f490214507 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.309918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf953f-efbd-4b3f-be81-660b0ca9d2e9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.345598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.346269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.346548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.346821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.347697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:15.348003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.349446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.358784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.369280 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 397/805] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:15.370090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.399690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427099-fc0c-45b1-b2ec-b2f490214507 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.435219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fa1fa-663a-4a5e-a54c-52dc92d93c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.436063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fa1fa-663a-4a5e-a54c-52dc92d93c70 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.436352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fa1fa-663a-4a5e-a54c-52dc92d93c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.436635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fa1fa-663a-4a5e-a54c-52dc92d93c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.446742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fa1fa-663a-4a5e-a54c-52dc92d93c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.448242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fa1fa-663a-4a5e-a54c-52dc92d93c70 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5c4fa1fa-663a-4a5e-a54c-52dc92d93c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:15.466659 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:15.467835 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:15.468932 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:15.468932 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:15.468932 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:15.468932 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:15.468932 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 409/806] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:15.469692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c803a0-cd1a-4fbd-8e76-0fe2d2497f88 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.469692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c803a0-cd1a-4fbd-8e76-0fe2d2497f88 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.469857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c803a0-cd1a-4fbd-8e76-0fe2d2497f88 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.471030 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 410/807] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:15.471752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c803a0-cd1a-4fbd-8e76-0fe2d2497f88 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.480589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c4dd5-1bee-404e-857f-0a71726f19f1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.484520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.516344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.516925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.517208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.517486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.518303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:15.518611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.520080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.532335 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 398/808] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:15.533165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.578997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c803a0-cd1a-4fbd-8e76-0fe2d2497f88 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.592852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.615954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.617301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.617585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.617877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.618521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.620005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:15.633944 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:15.635138 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:15.636102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 411/809] 10.222.0.98 () {56 vars in 1129 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:15.637417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.637487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ac060-b30e-4ad7-a877-b326dca7b4d2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.673125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.673869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.674165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.674475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.716702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.741375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a5621-0e77-4f66-8f0a-48fb088e8834 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.748621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.750084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.776661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c2101-4982-492f-976e-c5ffe5b6c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.777244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2101-4982-492f-976e-c5ffe5b6c5ea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.777528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2101-4982-492f-976e-c5ffe5b6c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.777806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2101-4982-492f-976e-c5ffe5b6c5ea None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.778529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c2101-4982-492f-976e-c5ffe5b6c5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:15.778835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c2101-4982-492f-976e-c5ffe5b6c5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.780232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c2101-4982-492f-976e-c5ffe5b6c5ea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:15.791831 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 412/810] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:15.793159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a0fb-b2fe-4347-a007-4ddac11ed869 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.793443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a0fb-b2fe-4347-a007-4ddac11ed869 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.793724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a0fb-b2fe-4347-a007-4ddac11ed869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.809792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.810379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7004a0fb-b2fe-4347-a007-4ddac11ed869 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:15.811681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7004a0fb-b2fe-4347-a007-4ddac11ed869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:15.853833 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 399/811] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:20:15.854654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.886394 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 413/812] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:15.887230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a0fb-b2fe-4347-a007-4ddac11ed869 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:15.953205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:15.955472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d5da-ce26-47dc-88b4-b515c582ceab None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.991259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:15.992014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a0fb-b2fe-4347-a007-4ddac11ed869 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:15.992178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:15.992462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:15.992737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/e4c56829e4af4b609ab6c986b745a4fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:15.994673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=e4c56829e4af4b609ab6c986b745a4fd, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:15.996158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.013423 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 400/813] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:20:15 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/e4c56829e4af4b609ab6c986b745a4fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:20:16.014503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.032202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.032815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.033106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.033383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.034156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:16.034466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.035946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.037659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:16.042559 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 414/814] 10.222.0.98 () {56 vars in 1124 bytes} [Thu Jul 14 14:20:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:16.043327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.151524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f43ce-c4c4-4034-a13a-dd6e13496b7b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.158566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4a6e-8493-4aa2-8d8a-3706b1e2303a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.192595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:16.193062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.194798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.195149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.195490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.202224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.203034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.203351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.203636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.204515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.206278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.216071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.217534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:16.224041 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:16.225087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:16.226158 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:16.227223 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 401/815] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:16.228074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:16.237406 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:16.238431 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:16.239356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:16.239356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:16.239356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:16.239356 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:16.239356 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 415/816] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:16.239659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.321985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:16.349523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd308a-b8dd-4781-b109-08e679c3d3ff None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.363869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac890f3c-571f-427d-8342-bfe0e6276492 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.387691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.388953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.389245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.389587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.390192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.391680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.403125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.403836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.404127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:16.404378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:16.405356 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:20:16.406201 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:16.406959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.406959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:16.406959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.406959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.410573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 402/817] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:16.411363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.417915 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 416/818] 10.222.0.98 () {56 vars in 1124 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:16.417915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.465816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:16.528311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26630476-142d-484f-bb47-fe4906923ed5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.531638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2005c-9657-4913-95f4-9ede71f1c1d7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.567211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.567493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.567914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.568079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.568254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.568350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.568495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.568586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.569816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:16.569953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:16.570189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.570295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.571529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.571714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.589816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 417/819] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:16.589816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.590056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:16.594527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 403/820] 10.222.0.98 () {56 vars in 1149 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:16.599046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.704463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5e4e7-1028-47e7-bd4d-405f5aaae4e7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.706939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:16.716257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206510fe-d2bb-4a1b-9728-01d7c029e8ea None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.748450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.749323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.749628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.750004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.750671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] RBAC: Adding query filter params (name=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:16.751185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.752410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.756428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.757662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.758008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.764248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.764411 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 418/821] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:16.764525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.764604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.764682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.795856 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 404/822] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:16.796486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:16.866637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:16.901679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24ccea-ccec-4b37-8277-3884fb9c03cf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.933232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030268c-9457-4bcd-a48f-3b846ae6d3db None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:16.945540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.946800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.947302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.947807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.957338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:16.959113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:16.976892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:16.977704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:16.977992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:16.978094 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:16.978907 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:16.980076 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:16.980505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:16.980576 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 419/823] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:16.980576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.000116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.000116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.020318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:17.029808 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:17.030886 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:17.032055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:17.032055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:17.032055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:17.032055 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:17.032055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 405/824] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:17.032055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.121812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef39f-bdcc-4025-a762-4589bb498cca None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:17.136959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0edf9c-e8a2-4398-84ba-8305e0e75e63 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:17.139924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:17.167181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:17.167997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:17.168286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:17.168568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:17.169282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] RBAC: Adding query filter params (type=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:17.169597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.171229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.175948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:17.176623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:17.176912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:17.177196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:17.177996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:17.178324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.179840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.182008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 420/825] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:17.183027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.193131 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 406/826] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:17.194508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.298693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:17.306468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8815b9-eee8-4fff-9f6b-298c4bbe08d2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:17.310099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965070-9f3e-480d-a511-0e6bd7e14287 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:17.344392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:17.345158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:17.345517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:17.345877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:17.346896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.348495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.349649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:17.350551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:17.351664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:17.352105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:17.353148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:17.353614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.355198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.369201 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 421/827] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:17.370466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.383444 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 407/828] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:17.383444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.402809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:17.530146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1b4b8-2ef5-4f72-a01a-14718ce51e64 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:17.600963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:17.602073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:17.602504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:17.603019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:17.611467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.613438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.616389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3f2d7-fd8b-4af8-b276-9b68a461c11b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:17.632442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:17.633514 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:17.634745 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 408/829] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:17.642853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.666114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:17.667128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:17.667609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:17.668130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:17.669275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=eecb3bcddba54aca9316af7a0ec3b923) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:17.669593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.671042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.681449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 422/830] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:17 2022] GET /identity/v3/role_assignments?user.id=eecb3bcddba54aca9316af7a0ec3b923&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:17.770351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:17.801768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b83ed-2878-42d1-b9b5-98186f34f63b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:17.866060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ee4f-d13e-4c3a-a6d9-fe429d155054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:17.867061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ee4f-d13e-4c3a-a6d9-fe429d155054 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:17.868117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ee4f-d13e-4c3a-a6d9-fe429d155054 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:17.868807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ee4f-d13e-4c3a-a6d9-fe429d155054 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:17.869950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ee4f-d13e-4c3a-a6d9-fe429d155054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:17.870642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ee4f-d13e-4c3a-a6d9-fe429d155054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:17.873012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ee4f-d13e-4c3a-a6d9-fe429d155054 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:17.892070 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 409/831] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:17.898081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:17.925380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:18.037375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91353-bf5d-4762-96c2-d8beb757f625 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:18.088264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73aa5d-0b59-4362-bffa-9830bcf62cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:18.089200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73aa5d-0b59-4362-bffa-9830bcf62cdb None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:18.089485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73aa5d-0b59-4362-bffa-9830bcf62cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:18.089762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73aa5d-0b59-4362-bffa-9830bcf62cdb None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/4999d3dfc6394f83a0b264434e6a256f/roles/f5ed3686a3a84f21964d92c84c9170b1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:18.109036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73aa5d-0b59-4362-bffa-9830bcf62cdb None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=4999d3dfc6394f83a0b264434e6a256f, role_id=f5ed3686a3a84f21964d92c84c9170b1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:18.110513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73aa5d-0b59-4362-bffa-9830bcf62cdb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:18.125936 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 423/832] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:20:17 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/4999d3dfc6394f83a0b264434e6a256f/roles/f5ed3686a3a84f21964d92c84c9170b1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:20:18.152922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6db4-4ed6-48e7-8a18-f423aeb62729 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:18.153528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6db4-4ed6-48e7-8a18-f423aeb62729 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:18.153994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6db4-4ed6-48e7-8a18-f423aeb62729 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:18.157097 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 410/833] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:18.162129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5b6cf-2a0e-4458-ab75-9c8218a2fa86 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:18.162432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5b6cf-2a0e-4458-ab75-9c8218a2fa86 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:18.162750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5b6cf-2a0e-4458-ab75-9c8218a2fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:18.184421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3cd5b6cf-2a0e-4458-ab75-9c8218a2fa86 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:18.185669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3cd5b6cf-2a0e-4458-ab75-9c8218a2fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:18.263693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:18.267916 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 424/834] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:18.294939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6db4-4ed6-48e7-8a18-f423aeb62729 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:18.417209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6db4-4ed6-48e7-8a18-f423aeb62729 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:18.453420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:18.454220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:18.454501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:18.454777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:18.457545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:18.468158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:18.475993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:18.476908 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:18.477757 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:18.482235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 411/835] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:18.483642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5b6cf-2a0e-4458-ab75-9c8218a2fa86 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:18.593333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5b6cf-2a0e-4458-ab75-9c8218a2fa86 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:18.630928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:18.632227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:18.632519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:18.632804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:18.633627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:18.633948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:18.635394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:18.645356 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 425/836] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:18.651530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:18.762878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982027-e721-4707-b122-21b10c98c5b7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:18.798266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:18.799072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:18.799386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:18.799666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:18.811299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:18.812825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:18.830242 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:18.832317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:18.834460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:18.834460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:18.834460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:18.834460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:18.835534 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 412/837] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:18.840370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:18.904106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:18.951159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fc5dc-394c-474d-8dc3-7bc2ba782182 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:18.988341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf885c-9f9e-4339-9416-c3c7166eb9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:18.989025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf885c-9f9e-4339-9416-c3c7166eb9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:18.989317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf885c-9f9e-4339-9416-c3c7166eb9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:18.989601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf885c-9f9e-4339-9416-c3c7166eb9c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:18.990342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf885c-9f9e-4339-9416-c3c7166eb9c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:18.990659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf885c-9f9e-4339-9416-c3c7166eb9c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:18.992419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf885c-9f9e-4339-9416-c3c7166eb9c4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:19.006628 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 426/838] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:19.012172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:19.068491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:19.123099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4312c7a-d639-4564-a713-0bc7c7f7cebe None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:19.136501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145d75-b3e0-4013-98ed-f58810824d83 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.137012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145d75-b3e0-4013-98ed-f58810824d83 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.137274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145d75-b3e0-4013-98ed-f58810824d83 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.138782 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 427/839] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:19.144872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92c0d-bd31-421b-b3df-7eb97c8c6d4e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.145163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92c0d-bd31-421b-b3df-7eb97c8c6d4e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.145439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92c0d-bd31-421b-b3df-7eb97c8c6d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.164106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0bf92c0d-bd31-421b-b3df-7eb97c8c6d4e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:19.165399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0bf92c0d-bd31-421b-b3df-7eb97c8c6d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:19.169183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:19.169996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.170280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.170557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.179403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:19.180865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:19.197485 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:19.198484 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:19.199932 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 413/840] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:19.204649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:19.271372 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 428/841] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:19.293483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf92c0d-bd31-421b-b3df-7eb97c8c6d4e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:19.346349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:19.359958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecf349-3a0f-443f-8222-caa4ca733660 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:19.378336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:19.407585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf92c0d-bd31-421b-b3df-7eb97c8c6d4e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:19.426312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:19.427799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.428971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.429705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.431375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:19.432070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:19.434965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:19.448690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:19.449727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.450221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.450684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.451549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:19.453228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:19.466903 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:19.468153 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:19.469099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:19.476339 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 414/843] 10.222.0.98 () {56 vars in 1135 bytes} [Thu Jul 14 14:20:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:19.476587 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 429/843] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:19.479332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:19.481564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:19.592988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6515896-eb40-41de-91ff-740a49523e15 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:19.608540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:19.616572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21aee0-2117-4154-9183-db7245a386a9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:19.633629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:19.634538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.634922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.635530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.653145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:19.654048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.654532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.654981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.655972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:19.656469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:19.658080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:19.664079 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 415/844] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:19.670360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:19.712615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:19.729891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:19.731557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:19.791775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bac43-6d2a-42ab-86a9-0954155eb1a2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:19.828250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08891b-337d-4f2d-88e8-9f49fe3cd1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:19.829271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08891b-337d-4f2d-88e8-9f49fe3cd1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.829782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08891b-337d-4f2d-88e8-9f49fe3cd1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.830256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08891b-337d-4f2d-88e8-9f49fe3cd1f7 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:19.831167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08891b-337d-4f2d-88e8-9f49fe3cd1f7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:19.831695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08891b-337d-4f2d-88e8-9f49fe3cd1f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:19.833267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08891b-337d-4f2d-88e8-9f49fe3cd1f7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:19.846496 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 430/846] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:20:19.846731 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 416/846] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:19.852516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:19.869873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:19.979388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075d88a-68de-44ce-a013-0bd02d29ea7a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:19.998197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b038-d00b-417b-aa50-07ad64562636 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:19.998536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b038-d00b-417b-aa50-07ad64562636 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:19.998740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b038-d00b-417b-aa50-07ad64562636 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.001607 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 417/847] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:20.007031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d2f41-950a-4f36-ba75-a59282069dcd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.007031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d2f41-950a-4f36-ba75-a59282069dcd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.007303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d2f41-950a-4f36-ba75-a59282069dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.026910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.027759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.028049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.028324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.032815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b37d2f41-950a-4f36-ba75-a59282069dcd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:20.034620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b37d2f41-950a-4f36-ba75-a59282069dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:20.041841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:20.043358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:20.064227 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:20.065203 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:20.066102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:20.066102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:20.066102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:20.066102 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:20.066102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 431/848] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:20.072595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.126519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 418/849] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:20.149897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d2f41-950a-4f36-ba75-a59282069dcd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.152981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:20.185240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:20.201894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44572423-57d9-47bc-b1df-66005a19cddf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.259036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.260459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.261376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.261870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.262800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:20.263326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:20.265647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:20.278656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d2f41-950a-4f36-ba75-a59282069dcd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.283322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 432/850] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:20.289012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.331782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.332605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.332892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.333170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.333845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:20.335799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:20.349070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:20.350066 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:20.351577 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:20.356478 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 419/851] 10.222.0.98 () {56 vars in 1132 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:20.357416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.426164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490ec4c-0afb-4ef2-9099-8a6a388957fc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.449525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:20.458135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:20.462336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfe1fe-6208-48fb-ba19-25f45617dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.463298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfe1fe-6208-48fb-ba19-25f45617dd80 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.463618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfe1fe-6208-48fb-ba19-25f45617dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.463870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfe1fe-6208-48fb-ba19-25f45617dd80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.471576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfe1fe-6208-48fb-ba19-25f45617dd80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:20.472659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545379a-857f-423f-87ff-3da11e86f8f9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.473028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfe1fe-6208-48fb-ba19-25f45617dd80 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d3bfe1fe-6208-48fb-ba19-25f45617dd80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:20.488370 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:20.489344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:20.490255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 433/852] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:20.491436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76633c4a-11d2-46c3-b69f-71161a546250 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.491436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76633c4a-11d2-46c3-b69f-71161a546250 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.491597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76633c4a-11d2-46c3-b69f-71161a546250 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.493043 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 434/853] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:20.495615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76633c4a-11d2-46c3-b69f-71161a546250 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.516294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b8c7-7972-4eff-be27-7be589d3ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.516971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b8c7-7972-4eff-be27-7be589d3ee51 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.517256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b8c7-7972-4eff-be27-7be589d3ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.517535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b8c7-7972-4eff-be27-7be589d3ee51 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.518271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b8c7-7972-4eff-be27-7be589d3ee51 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:20.518583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b8c7-7972-4eff-be27-7be589d3ee51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:20.520092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b8c7-7972-4eff-be27-7be589d3ee51 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:20.530401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 420/854] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:20.530401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fd2fe-6b62-4d8b-b2df-70533cc8e640 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.530401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fd2fe-6b62-4d8b-b2df-70533cc8e640 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.530401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fd2fe-6b62-4d8b-b2df-70533cc8e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.547975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-056fd2fe-6b62-4d8b-b2df-70533cc8e640 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:20.550120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-056fd2fe-6b62-4d8b-b2df-70533cc8e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:20.651700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76633c4a-11d2-46c3-b69f-71161a546250 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.655994 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 421/855] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:20.657524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fd2fe-6b62-4d8b-b2df-70533cc8e640 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.712139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.713109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.713570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.714047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.715124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:20.715638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:20.717355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:20.735559 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 435/856] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:20.736647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.757977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:20.778682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fd2fe-6b62-4d8b-b2df-70533cc8e640 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.789785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:20.815736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.816411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.816698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.816976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.817672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:20.818026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:20.819459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:20.835303 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 422/857] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:20.835303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:20.874429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5102-9642-485e-b919-57f4ddcf1437 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.915214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:20.916289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:20.916768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:20.917114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:20.932648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:20.944748 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:20.945799 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:20:20.946635 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:20.947857 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 436/858] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:20.954274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55e4e-3ba2-44e2-a25b-1ebb06554cc8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:20.956892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:21.003107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:21.003756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:21.004045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:21.004326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:21.006171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=e4c56829e4af4b609ab6c986b745a4fd) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:21.006171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:21.007556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:21.021172 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 423/859] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/role_assignments?user.id=e4c56829e4af4b609ab6c986b745a4fd&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:21.090242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fbe47-6962-48f6-9277-f0afd6e4e398 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:21.093076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:21.134008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:21.134704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:21.135038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:21.135343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:21.136195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:21.136506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:21.137928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:21.148849 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 437/860] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:20:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:21.154243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:21.169175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:21.270767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c267da-8d96-4732-a44b-50c44735d81b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:21.306384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:21.307188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:21.307504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:21.307784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:21.319003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:21.320552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:21.343216 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:21.344181 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:21.345519 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:21.345519 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:21.345519 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:21.345519 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:21.345519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 424/861] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:21.350951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:21.457604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f090-ee06-4b84-b5af-e22e106fffac None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:21.496495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:21.497172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:21.497459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:21.497735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:21.498462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:21.498765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:21.500304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:21.513949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 438/862] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:21.519615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:21.587690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:21.635074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67396940-fe97-4e4b-b0a1-311f801350e4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:21.671781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:21.672611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:21.672892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:21.673166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:21.682045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:21.683680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:21.699285 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:21.700314 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:21.701995 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 425/863] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:20:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:21.706527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:21.736228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:21.818445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8eaae-8f3b-4003-9592-90099c01d0e3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:21.855048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bffc56-3149-4199-80e0-c145b8f5d2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:21.855764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bffc56-3149-4199-80e0-c145b8f5d2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:21.856052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bffc56-3149-4199-80e0-c145b8f5d2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:21.856330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bffc56-3149-4199-80e0-c145b8f5d2f8 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:21.857178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bffc56-3149-4199-80e0-c145b8f5d2f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:21.857489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bffc56-3149-4199-80e0-c145b8f5d2f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:21.858932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bffc56-3149-4199-80e0-c145b8f5d2f8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:21.878387 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 439/864] 10.222.0.98 () {56 vars in 1149 bytes} [Thu Jul 14 14:20:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:21.884315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:21.994978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ad90-c5c1-4f63-892c-82d77e333c21 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:22.027670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:22.033944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:22.034615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.034894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.035171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.056738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b7146-edf1-4f70-8369-c8e6456210fc None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.057191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b7146-edf1-4f70-8369-c8e6456210fc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.057578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b7146-edf1-4f70-8369-c8e6456210fc None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.059364 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 440/865] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:22.067683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ffab-d0dc-4256-b7c1-a5679834f167 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.068118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ffab-d0dc-4256-b7c1-a5679834f167 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.069086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ffab-d0dc-4256-b7c1-a5679834f167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.091094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21e1ffab-d0dc-4256-b7c1-a5679834f167 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:22.093218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21e1ffab-d0dc-4256-b7c1-a5679834f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:22.131314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:22.134511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:22.181165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 441/866] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:22.202915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1ffab-d0dc-4256-b7c1-a5679834f167 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:22.222300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:22.269863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 426/867] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:20:22.281727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:22.312891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:22.331608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1ffab-d0dc-4256-b7c1-a5679834f167 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:22.370532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:22.371252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.371568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.371853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.372608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:22.374016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:22.395773 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 442/868] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:22 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:20:22.402867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f0eb1-313f-45b9-a7ea-a198de25b655 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:22.454048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:22.454892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.455179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.455504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.470042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:22.471698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:22.494521 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:22.495531 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:22.496560 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:22.496560 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:22.496560 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:22.496560 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:22.499097 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 427/869] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:22.504709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:22.595716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:22.626491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912deb44-4d9c-484f-a8b1-3765f07e3654 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:22.662275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:22.662984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.663291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.663566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.664312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:22.664621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:22.666132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:22.683663 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 443/870] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:22.685413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:22.758544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:22.791105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c300a-260d-444c-a6bb-af6b2ea88d0a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:22.826290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990a751-d255-4151-a6d9-34465cbe8142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:22.827103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990a751-d255-4151-a6d9-34465cbe8142 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.827415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990a751-d255-4151-a6d9-34465cbe8142 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.827693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990a751-d255-4151-a6d9-34465cbe8142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.835068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990a751-d255-4151-a6d9-34465cbe8142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:22.836554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990a751-d255-4151-a6d9-34465cbe8142 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4990a751-d255-4151-a6d9-34465cbe8142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:22.851903 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:22.852882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:22.853774 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 428/871] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:22.859124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:22.967589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f4773-9565-4e26-b4f1-6db6cd9905b4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:22.978823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65363-5d78-4da2-90a9-e3b8c2671d7d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.979145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65363-5d78-4da2-90a9-e3b8c2671d7d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.979423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65363-5d78-4da2-90a9-e3b8c2671d7d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:22.981062 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 429/872] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:22.986305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7912-a01d-403c-ae74-000cd4d348d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:22.986601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7912-a01d-403c-ae74-000cd4d348d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:22.986889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7912-a01d-403c-ae74-000cd4d348d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.004145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:23.004354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-130c7912-a01d-403c-ae74-000cd4d348d0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:23.004817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:23.005100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:23.005382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.005690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-130c7912-a01d-403c-ae74-000cd4d348d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:23.006177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:23.007024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:23.008504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:23.010936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:23.027322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 444/873] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:23.030085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:23.095069 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 430/874] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:23.117973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c7912-a01d-403c-ae74-000cd4d348d0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:23.156224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494f05-ce85-4679-9ff7-89cfd3917e2c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:23.191957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:23.201360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c408f-8e96-4b6a-ac29-dd0354367ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:23.202487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c408f-8e96-4b6a-ac29-dd0354367ccc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:23.202883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c408f-8e96-4b6a-ac29-dd0354367ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:23.203300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c408f-8e96-4b6a-ac29-dd0354367ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.204920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c408f-8e96-4b6a-ac29-dd0354367ccc None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=4999d3dfc6394f83a0b264434e6a256f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:23.205366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c408f-8e96-4b6a-ac29-dd0354367ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:23.207251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c408f-8e96-4b6a-ac29-dd0354367ccc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:23.223367 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 445/875] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:23 2022] GET /identity/v3/role_assignments?user.id=4999d3dfc6394f83a0b264434e6a256f&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:23.249654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c7912-a01d-403c-ae74-000cd4d348d0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:23.293451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebad0b9-9162-4d80-a459-806dca17183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:23.294211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad0b9-9162-4d80-a459-806dca17183b None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:23.294430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad0b9-9162-4d80-a459-806dca17183b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:23.294712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad0b9-9162-4d80-a459-806dca17183b None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.295521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebad0b9-9162-4d80-a459-806dca17183b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:23.296946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebad0b9-9162-4d80-a459-806dca17183b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:23.315801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 431/876] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:23 2022] POST /identity/v3/services => generated 269 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:20:23.351831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c7ba-dd08-40fb-b10a-c6e20dc4c9d1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:23.352143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c7ba-dd08-40fb-b10a-c6e20dc4c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:23.352498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c7ba-dd08-40fb-b10a-c6e20dc4c9d1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.354162 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 446/877] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:23.360525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a793-053d-4c18-8dee-f0f5575ef22a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:23.361206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a793-053d-4c18-8dee-f0f5575ef22a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:23.361673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a793-053d-4c18-8dee-f0f5575ef22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.382557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ff85a793-053d-4c18-8dee-f0f5575ef22a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:23.384288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff85a793-053d-4c18-8dee-f0f5575ef22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:23.477589 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 432/878] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:23.500010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c7ba-dd08-40fb-b10a-c6e20dc4c9d1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:23.573867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:23.623392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c7ba-dd08-40fb-b10a-c6e20dc4c9d1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:23.663785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:23.664609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:23.664897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:23.665181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.665844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:23.667256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:23.681416 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:23.682484 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:23.683358 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:23.687389 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 447/879] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:23.689421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a793-053d-4c18-8dee-f0f5575ef22a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:23.742448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:23.801004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a793-053d-4c18-8dee-f0f5575ef22a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:23.837861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def32e3e-d985-487f-8e5f-00d00599541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:23.838542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def32e3e-d985-487f-8e5f-00d00599541b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:23.838825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def32e3e-d985-487f-8e5f-00d00599541b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:23.839248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def32e3e-d985-487f-8e5f-00d00599541b None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:23.839996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def32e3e-d985-487f-8e5f-00d00599541b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:23.840335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def32e3e-d985-487f-8e5f-00d00599541b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:23.841808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def32e3e-d985-487f-8e5f-00d00599541b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:23.847609 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 433/880] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:23.854134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:23.967145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c877-2d41-422c-af1e-8e79c37524fb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:23.992085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:24.005144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1f286-df45-46e4-83ba-7899ea5a0a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:24.005827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1f286-df45-46e4-83ba-7899ea5a0a88 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:24.006113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1f286-df45-46e4-83ba-7899ea5a0a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:24.007031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1f286-df45-46e4-83ba-7899ea5a0a88 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:24.007773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1f286-df45-46e4-83ba-7899ea5a0a88 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:24.008085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1f286-df45-46e4-83ba-7899ea5a0a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:24.009472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1f286-df45-46e4-83ba-7899ea5a0a88 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:24.014611 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 448/881] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:24.589888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731ab90-e0c5-42f9-9845-b9cd19f0ee8b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:24.590440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731ab90-e0c5-42f9-9845-b9cd19f0ee8b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:24.590440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731ab90-e0c5-42f9-9845-b9cd19f0ee8b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:24.592086 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 434/882] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:24.597978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7609f-37c0-4a53-97e4-ee1257b3e8d0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:24.598516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7609f-37c0-4a53-97e4-ee1257b3e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:24.598516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7609f-37c0-4a53-97e4-ee1257b3e8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:24.617613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-23d7609f-37c0-4a53-97e4-ee1257b3e8d0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:24.618852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23d7609f-37c0-4a53-97e4-ee1257b3e8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:24.701968 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 449/883] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:24.720179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731ab90-e0c5-42f9-9845-b9cd19f0ee8b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:24.831724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731ab90-e0c5-42f9-9845-b9cd19f0ee8b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:24.843549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:24.868126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:24.868929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:24.869209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:24.869481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:24.870131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:24.871527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:24.884207 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:24.886610 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:24.888733 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 435/884] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:24.895350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7609f-37c0-4a53-97e4-ee1257b3e8d0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:25.003139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7609f-37c0-4a53-97e4-ee1257b3e8d0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:25.021370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:25.044298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:25.044985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.045275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.045559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.046279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:25.046591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:25.048012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:25.058069 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 450/885] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:25.059494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:25.177391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d325413-a141-451c-9ac2-3ff80a819d44 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:25.216686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:25.217446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.217731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.218106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.218823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:25.219130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:25.220579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:25.227291 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 436/886] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:25.232973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:25.350269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b6a0-ce24-46b4-a240-83cbf7a3e229 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:25.387335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a21a8-1d44-448d-8b36-a52db98e9090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:25.388072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a21a8-1d44-448d-8b36-a52db98e9090 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.388362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a21a8-1d44-448d-8b36-a52db98e9090 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.388654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a21a8-1d44-448d-8b36-a52db98e9090 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.389495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a21a8-1d44-448d-8b36-a52db98e9090 None admin] RBAC: Adding query filter params (interface=public, service_id=833cead9696d4b339e2f12400713851c, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:25.389815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a21a8-1d44-448d-8b36-a52db98e9090 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:25.391199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a21a8-1d44-448d-8b36-a52db98e9090 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:25.402050 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 451/887] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:20:25 2022] GET /identity/v3/endpoints?service_id=833cead9696d4b339e2f12400713851c&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:25.403523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:25.457946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:25.523003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ce69-5726-4d97-88d2-ad8da1eb5cd7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.523313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ce69-5726-4d97-88d2-ad8da1eb5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.523640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ce69-5726-4d97-88d2-ad8da1eb5cd7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.525340 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 452/888] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:25.531913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f1226-c63e-432f-a725-7bd1a6b593b6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.532555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f1226-c63e-432f-a725-7bd1a6b593b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.532939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f1226-c63e-432f-a725-7bd1a6b593b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.543006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322376c-46f0-4ba1-80a0-a424dd07a2ae None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:25.551440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f7f1226-c63e-432f-a725-7bd1a6b593b6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:25.552800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f7f1226-c63e-432f-a725-7bd1a6b593b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:25.593832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157f92-f993-4e47-acc7-07197f7a9279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:25.596796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157f92-f993-4e47-acc7-07197f7a9279 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.596796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157f92-f993-4e47-acc7-07197f7a9279 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.596796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157f92-f993-4e47-acc7-07197f7a9279 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.597544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b157f92-f993-4e47-acc7-07197f7a9279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:25.599585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b157f92-f993-4e47-acc7-07197f7a9279 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:25.606148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:25.613805 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 437/889] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:25 2022] GET /identity/v3/services => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:20:25.616903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77a88-6c98-40c1-aad6-2dbd628b522c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.617187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77a88-6c98-40c1-aad6-2dbd628b522c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.617921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77a88-6c98-40c1-aad6-2dbd628b522c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.619345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 438/890] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:25.625107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f2429-b969-4a81-9273-3bf1ae0a7405 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.625418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f2429-b969-4a81-9273-3bf1ae0a7405 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.625666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f2429-b969-4a81-9273-3bf1ae0a7405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.645162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fa6f2429-b969-4a81-9273-3bf1ae0a7405 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:25.646393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa6f2429-b969-4a81-9273-3bf1ae0a7405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:25.648914 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 453/891] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:25.676255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f1226-c63e-432f-a725-7bd1a6b593b6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:25.743487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 439/892] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:25.758881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f2429-b969-4a81-9273-3bf1ae0a7405 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:25.796892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:25.833804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f1226-c63e-432f-a725-7bd1a6b593b6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:25.878866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:25.880184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.880645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.881175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.884694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f2429-b969-4a81-9273-3bf1ae0a7405 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:25.893880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:25.903838 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:25.905122 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:25.906179 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:25.908738 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 454/893] 10.222.0.98 () {56 vars in 1120 bytes} [Thu Jul 14 14:20:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:25.915132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:25.931798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:25.932796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:25.933082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:25.933548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:25.934842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:25.936731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:25.954538 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:25.955809 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:25.956851 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:25.957785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:25.961032 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 440/894] 10.222.0.98 () {56 vars in 1132 bytes} [Thu Jul 14 14:20:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:25.967012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.064628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fd84c-adaa-4115-b674-dc299a839eef None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.107925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:26.116525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5dec-f60a-4465-aba8-acb60a46445e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.118762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.119487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.119779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.120095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.121837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:26.122161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.123713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.140236 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 455/895] 10.222.0.98 () {56 vars in 1115 bytes} [Thu Jul 14 14:20:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:26.142104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.172038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26504bd8-cb50-46eb-b427-bd40656bb0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.172725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26504bd8-cb50-46eb-b427-bd40656bb0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.173006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26504bd8-cb50-46eb-b427-bd40656bb0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.173288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26504bd8-cb50-46eb-b427-bd40656bb0f5 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.174146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26504bd8-cb50-46eb-b427-bd40656bb0f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:26.174761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26504bd8-cb50-46eb-b427-bd40656bb0f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.176279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26504bd8-cb50-46eb-b427-bd40656bb0f5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.187455 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 441/896] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:26.187455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c133695-f31b-41ba-aef8-405e41654f9b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.187455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c133695-f31b-41ba-aef8-405e41654f9b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.187455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c133695-f31b-41ba-aef8-405e41654f9b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.187946 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 442/897] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:26.189668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c133695-f31b-41ba-aef8-405e41654f9b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.257319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:26.267013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72201-98e2-4527-867f-5b75461f1041 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.302503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c133695-f31b-41ba-aef8-405e41654f9b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.304919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3bde-1569-4377-9301-d37c48dff983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.305731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3bde-1569-4377-9301-d37c48dff983 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.306012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3bde-1569-4377-9301-d37c48dff983 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.306290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3bde-1569-4377-9301-d37c48dff983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.318283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc3bde-1569-4377-9301-d37c48dff983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.319756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc3bde-1569-4377-9301-d37c48dff983 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-11bc3bde-1569-4377-9301-d37c48dff983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:26.338649 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:26.339817 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:26.340781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:26.340781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:26.340781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:26.340781 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:26.340781 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 456/898] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:26.341470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cc44-8cd1-425a-a38c-f357dcefab54 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.341768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cc44-8cd1-425a-a38c-f357dcefab54 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.342050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cc44-8cd1-425a-a38c-f357dcefab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.343552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.344651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.345084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.345367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.346089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:26.346397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.349022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.355828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 443/899] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:26.356653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.366797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb13cc44-8cd1-425a-a38c-f357dcefab54 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:26.369022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb13cc44-8cd1-425a-a38c-f357dcefab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:26.397089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:26.460797 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 457/900] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:26.462338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cc44-8cd1-425a-a38c-f357dcefab54 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.486682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f28ee-fe50-45a0-b177-9602be2de54e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.529743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.530716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.531162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.531622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.532501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:26.532959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.534481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.548041 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 444/901] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:26.549166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.575887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:26.607548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cc44-8cd1-425a-a38c-f357dcefab54 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.645149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.645831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.646123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.646409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.647779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] RBAC: Adding query filter params (interface=public, service_id=9359268f9f58404889e7efc9c36526d5, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:26.648126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.649531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.655193 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 458/902] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:20:26 2022] GET /identity/v3/endpoints?service_id=9359268f9f58404889e7efc9c36526d5&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:26.655408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:26.660886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.674971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098977-51a1-4af0-b69a-bd2d1978ab3d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.717463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.718156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.718492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.718713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.719483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.720883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.743394 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 445/903] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:26 2022] POST /identity/v3/services => generated 241 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:26.743394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.800016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99762ce0-e9fc-4ec0-a548-e78a1679534a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.868110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.869200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.869491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.869773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.881219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.883167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.886679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:26.895992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683336-4ce6-4537-9217-3d3d71f72459 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:26.908613 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:26.909653 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:26.910606 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 459/904] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:20:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:26.918210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:26.946759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:26.947556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:26.947846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:26.948128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:26.948815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:26.950206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:26.959318 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 446/905] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:26 2022] GET /identity/v3/services => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:20:27.045284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ebc88-dbd7-45f4-ac9d-9dec3b762b4e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:27.088294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:27.088992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:27.089283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:27.089569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:27.090440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:27.090758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:27.092294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:27.114177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 460/906] 10.222.0.98 () {56 vars in 1149 bytes} [Thu Jul 14 14:20:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:27.120288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:27.134388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:27.237133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1eda1-e8ae-490b-82b5-2d6a1717e7a4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:27.276611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:27.277277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:27.277569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:27.277850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:27.351742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:27.353460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:27.364342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:27.460784 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 447/907] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:20:27.466299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:27.531199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:27.585682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0075b-d8cd-4666-a41b-dc15dfa19649 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:27.624715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154acfd2-f6e4-4076-9bc2-ddd04cb6fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:27.625516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154acfd2-f6e4-4076-9bc2-ddd04cb6fc0a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:27.625806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154acfd2-f6e4-4076-9bc2-ddd04cb6fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:27.626091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154acfd2-f6e4-4076-9bc2-ddd04cb6fc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:27.637479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154acfd2-f6e4-4076-9bc2-ddd04cb6fc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:27.638961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154acfd2-f6e4-4076-9bc2-ddd04cb6fc0a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-154acfd2-f6e4-4076-9bc2-ddd04cb6fc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:27.657490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:27.659463 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:27.660601 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:27.660601 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:27.660601 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:27.660601 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:27.660601 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 461/908] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:27.665091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:27.773839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3a545-1262-4e82-b397-fa3d8f02bc9b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:27.784379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:27.816603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:27.817284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:27.817565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:27.817848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:27.818715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:27.819029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:27.820454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:27.826635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab82d-9b51-413f-a8ef-005161237b23 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:27.827232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab82d-9b51-413f-a8ef-005161237b23 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:27.827835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab82d-9b51-413f-a8ef-005161237b23 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:27.829729 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 462/909] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:27.834720 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 448/910] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:27.836293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdaf05-3f89-478a-abd1-d851c86a638d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:27.837061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdaf05-3f89-478a-abd1-d851c86a638d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:27.837570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdaf05-3f89-478a-abd1-d851c86a638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:27.840307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:27.856330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1dbdaf05-3f89-478a-abd1-d851c86a638d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:27.858153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1dbdaf05-3f89-478a-abd1-d851c86a638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:27.943421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 463/911] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:27.962847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdaf05-3f89-478a-abd1-d851c86a638d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:27.975571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670858-82fd-4257-b2d6-e6bde3a636cf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:28.016286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:28.025423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:28.027332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.027840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.028320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.038405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:28.040806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:28.060309 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:28.061439 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:28.063046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:28.069699 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 449/912] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:28.070434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:28.098654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdaf05-3f89-478a-abd1-d851c86a638d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:28.113800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:28.148334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:28.149725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.150252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.151435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.152498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:28.154237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:28.169037 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:28.170285 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:20:28.171336 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:28.177440 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 464/913] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:28.181105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:28.258589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f724d-5bf6-4333-8eed-65d1a40dc7a5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:28.303000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:28.304422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.304882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.305304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.306286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:28.306742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:28.308561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:28.321841 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 450/914] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:28.327891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:28.348521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb420ba-bc1a-4284-80d6-5f33cd09bd85 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:28.350886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:28.390236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:28.390912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.391196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.391503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.392338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:28.392614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:28.394094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:28.403809 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 465/915] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:28.406789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:28.426164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:28.440424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e91d-7857-4e7f-9b46-358c0b17d584 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:28.478225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:28.479311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.479861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.480351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.481458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] RBAC: Adding query filter params (role.id=fd27043fdadb4fa89a4e37a8f574ca70, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=4999d3dfc6394f83a0b264434e6a256f) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:28.482025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:28.483732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:28.495602 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 451/916] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:28 2022] GET /identity/v3/role_assignments?user.id=4999d3dfc6394f83a0b264434e6a256f&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=fd27043fdadb4fa89a4e37a8f574ca70 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:28.528331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3941da3-f5b3-4ea8-9325-5fc04c94c282 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:28.570651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3dcec-a127-467b-b17a-0761847c1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:28.571347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3dcec-a127-467b-b17a-0761847c1f44 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.571641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3dcec-a127-467b-b17a-0761847c1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.571924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3dcec-a127-467b-b17a-0761847c1f44 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.572695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3dcec-a127-467b-b17a-0761847c1f44 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:28.573015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3dcec-a127-467b-b17a-0761847c1f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:28.574664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3dcec-a127-467b-b17a-0761847c1f44 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:28.581049 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 466/917] 10.222.0.98 () {56 vars in 1114 bytes} [Thu Jul 14 14:20:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:28.587681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:28.707734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b75f1a-0507-4df4-b7ce-5d89d5902a99 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:28.746740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78650057-361f-49fb-8415-47bbb30a417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:28.747448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78650057-361f-49fb-8415-47bbb30a417a None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.747737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78650057-361f-49fb-8415-47bbb30a417a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.748016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78650057-361f-49fb-8415-47bbb30a417a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.748768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78650057-361f-49fb-8415-47bbb30a417a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:28.750159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78650057-361f-49fb-8415-47bbb30a417a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:28.774262 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 452/918] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:28.983068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e700-8ab6-4099-9ca5-3f6317f751ae None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.983641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e700-8ab6-4099-9ca5-3f6317f751ae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.983641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e700-8ab6-4099-9ca5-3f6317f751ae None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:28.985428 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 467/919] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:28.992069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7623c-614f-4d73-a07f-96473b3dba23 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:28.992411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7623c-614f-4d73-a07f-96473b3dba23 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:28.992727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7623c-614f-4d73-a07f-96473b3dba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.017256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cdd7623c-614f-4d73-a07f-96473b3dba23 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:29.018470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cdd7623c-614f-4d73-a07f-96473b3dba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:29.020952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:29.106841 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 453/920] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:29.126180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e700-8ab6-4099-9ca5-3f6317f751ae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:29.160821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:29.177700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255943e-dac5-4f1c-b61b-a963b2ddc4a2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.178692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255943e-dac5-4f1c-b61b-a963b2ddc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.178982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255943e-dac5-4f1c-b61b-a963b2ddc4a2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.180748 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 454/921] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:29.187185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cef35-5015-4ee1-90ce-b0424223264c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.187570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cef35-5015-4ee1-90ce-b0424223264c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.187806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cef35-5015-4ee1-90ce-b0424223264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.204867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-419cef35-5015-4ee1-90ce-b0424223264c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:29.206080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-419cef35-5015-4ee1-90ce-b0424223264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:29.258294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e700-8ab6-4099-9ca5-3f6317f751ae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:29.299310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 455/922] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:29.304128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:29.304960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.305250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.305530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.306202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:29.307611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:29.320616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cef35-5015-4ee1-90ce-b0424223264c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:29.324634 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:29.325632 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:29.326466 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:29.329617 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 468/923] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:29.337453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:29.400631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:29.468199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cef35-5015-4ee1-90ce-b0424223264c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:29.515637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:29.522924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:29.524518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.526920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299a16-7a76-4062-8739-cea05e451f4d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:29.527889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.528391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.529457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:29.531200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:29.552799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:29.553861 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:20:29.554721 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:29.563120 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 456/924] 10.222.0.98 () {56 vars in 1132 bytes} [Thu Jul 14 14:20:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:29.564400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:29.583549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:29.590918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.591635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.592065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.593726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:29.594769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:29.602630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:29.622142 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 469/925] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:29.623087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:29.728714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f4626-326e-48c9-aafb-2f9b8cf7109b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:29.754769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9f66a-c4cf-4b3c-be0d-50704a146aee None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:29.796424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:29.797250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.797429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.797667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.798390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:29.798707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:29.800321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:29.802468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:29.812991 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 470/926] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:29.814770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:29.825075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:29.827173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.828904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.829875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.830953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:29.831531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:29.835914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:29.847780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:29.851549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 457/927] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:29.853255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:29.944739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c2aac-96c5-481a-b786-ed868bb5db5d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:29.987776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:29.988450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:29.988976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:29.989440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:29.991073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] RBAC: Adding query filter params (interface=public, service_id=7e971ebe9f1944b1aba6112494605ef0, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:29.991636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:29.993212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:30.005591 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 471/928] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:20:29 2022] GET /identity/v3/endpoints?service_id=7e971ebe9f1944b1aba6112494605ef0&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:30.007550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:30.106232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fabb6-96d9-4e57-b9d2-1041f9f4c12c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:30.118323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:30.140055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd7ad9-7451-48cc-bac3-d05e16354184 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:30.158439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:30.159924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:30.160611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:30.161071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:30.162227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:30.163208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:30.165224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:30.177428 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 458/929] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:30.178782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:30.192741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fee41f-c208-4a5f-a605-bb9348420e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:30.193823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fee41f-c208-4a5f-a605-bb9348420e6f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:30.194323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fee41f-c208-4a5f-a605-bb9348420e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:30.195174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fee41f-c208-4a5f-a605-bb9348420e6f None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:30.196116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fee41f-c208-4a5f-a605-bb9348420e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:30.198480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fee41f-c208-4a5f-a605-bb9348420e6f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:30.215995 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 472/930] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:30 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:20:30.260078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:30.320964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d98ce9-e092-452e-8f37-ae11d9828899 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:30.361895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c98cf-c791-4e12-a3ff-f201e31c8504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:30.362494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c98cf-c791-4e12-a3ff-f201e31c8504 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:30.362779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c98cf-c791-4e12-a3ff-f201e31c8504 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:30.363059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c98cf-c791-4e12-a3ff-f201e31c8504 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:30.363849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c98cf-c791-4e12-a3ff-f201e31c8504 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:30.365854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c98cf-c791-4e12-a3ff-f201e31c8504 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:30.390660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 459/931] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:30.814816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aceef-caab-4868-a9f7-480f885ff71e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:30.814816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aceef-caab-4868-a9f7-480f885ff71e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:30.814816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aceef-caab-4868-a9f7-480f885ff71e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:30.815442 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 473/932] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:30.821109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb406-f81a-4ea4-b06a-c02439fe9b97 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:30.821989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb406-f81a-4ea4-b06a-c02439fe9b97 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:30.822471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb406-f81a-4ea4-b06a-c02439fe9b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:30.841124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9f9bb406-f81a-4ea4-b06a-c02439fe9b97 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:30.842726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9f9bb406-f81a-4ea4-b06a-c02439fe9b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:30.973059 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 460/933] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:31.013346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97aceef-caab-4868-a9f7-480f885ff71e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:31.035532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe955fd0-d35b-4141-b0cc-313467f43c2e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.036445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe955fd0-d35b-4141-b0cc-313467f43c2e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.037946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe955fd0-d35b-4141-b0cc-313467f43c2e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.041138 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 461/934] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:31.047739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc4be9-7d39-4eb6-8dd4-d9320f030e71 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.048097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc4be9-7d39-4eb6-8dd4-d9320f030e71 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.048626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc4be9-7d39-4eb6-8dd4-d9320f030e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.071234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84bc4be9-7d39-4eb6-8dd4-d9320f030e71 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:31.072991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84bc4be9-7d39-4eb6-8dd4-d9320f030e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:31.122160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:31.159896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97aceef-caab-4868-a9f7-480f885ff71e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:31.178864 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 462/935] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:31.200954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc4be9-7d39-4eb6-8dd4-d9320f030e71 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:31.219196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:31.221133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.221751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.222232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.235717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:31.255235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:31.257012 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:31.257850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:31.264226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 474/936] 10.222.0.98 () {56 vars in 1120 bytes} [Thu Jul 14 14:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:31.267645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:31.290235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:31.352740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc4be9-7d39-4eb6-8dd4-d9320f030e71 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:31.395169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:31.396230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.396742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.397235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.398156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:31.400029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:31.401605 n-d-768852-23 devstack@keystone.service[80582]: WARNING keystone.server.flask.common [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 14:20:31.421763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.sql.core [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 14:20:31.421763 n-d-768852-23 devstack@keystone.service[80582]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 14:20:31.421763 n-d-768852-23 devstack@keystone.service[80582]: [parameters: {'id': 'd1b4d452919e4b91a51847c1133500ac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 14:20:31.421763 n-d-768852-23 devstack@keystone.service[80582]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80582) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1b4d452919e4b91a51847c1133500ac.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1b4d452919e4b91a51847c1133500ac. Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:20:31.432476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 14:20:31.433366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application yield resource Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise self.value Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application session.commit() Jul 14 14:20:31.434371 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.flush() Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application compat.raise_( Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:20:31.435330 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 14:20:31.436471 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:20:31.437281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [parameters: {'id': 'd1b4d452919e4b91a51847c1133500ac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:31.438144 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:31.438947 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1b4d452919e4b91a51847c1133500ac. Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.446566 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 463/937] 10.222.0.98 () {60 vars in 1140 bytes} [Thu Jul 14 14:20:31 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:31.448927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:31.457926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ae011-db7f-41c7-b096-36364805d616 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:31.493447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:31.518650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:31.520452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.521230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.522063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.523979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:31.525016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:31.528179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:31.541300 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 475/938] 10.222.0.98 () {56 vars in 1115 bytes} [Thu Jul 14 14:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:31.546864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:31.596209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6640d-bfed-46f2-8820-c4743b24b930 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:31.637333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:31.641169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:31.642548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.643076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.644319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.653809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:31.656062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:31.671891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67f56-b9f6-4a6c-a8c5-fa2ddfe2adf7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:31.672566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:31.673436 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:31.674316 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:31.677047 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 464/939] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:31.682897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:31.722087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:31.724016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.724675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.725778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.740938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:31.743610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:31.768188 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:31.769310 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:31.770421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:31.770421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:31.770421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:31.770421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:31.777663 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 476/940] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:31.779725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:31.800362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:31.823576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb8dda-858e-4f40-8cad-c964dc7b9064 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:31.872724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:31.873403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.873694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.873973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.875010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:31.875347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:31.877764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:31.911485 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 465/941] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:31.919319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9405be-e5d4-4b04-a6c6-b9ebcc73d3ea None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:31.949342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:31.963682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:31.964378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:31.964666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:31.964949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:31.965703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:31.966013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:31.967519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:31.983491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 477/942] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:31.992516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:32.129433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633bb3-15de-43af-ba6a-f20e60084031 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:32.173643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:32.174912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.175485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.175983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.187061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:32.189026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:32.207566 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:32.208620 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:32.210143 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:32.213353 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 466/943] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:20:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:32.219550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:32.347232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494281a8-d4ea-4ae1-975a-7b5c9c107aed None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:32.386139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620298fa-3df0-4449-98df-bfad8ab1f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:32.387230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620298fa-3df0-4449-98df-bfad8ab1f7ca None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.387758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620298fa-3df0-4449-98df-bfad8ab1f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.388272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620298fa-3df0-4449-98df-bfad8ab1f7ca None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.389364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620298fa-3df0-4449-98df-bfad8ab1f7ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:32.389879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620298fa-3df0-4449-98df-bfad8ab1f7ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:32.391556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620298fa-3df0-4449-98df-bfad8ab1f7ca None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:32.410891 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 478/944] 10.222.0.98 () {56 vars in 1149 bytes} [Thu Jul 14 14:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:32.416570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:32.420932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:32.531217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae057-a780-4efb-9a88-711fc2d05bfd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:32.548293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb2608-f724-4c5a-8335-4e1c4add5b91 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.548602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb2608-f724-4c5a-8335-4e1c4add5b91 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.548864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb2608-f724-4c5a-8335-4e1c4add5b91 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.551573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 479/945] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:32.557185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd11e2e-508a-4e53-9cc2-6b251f5decd8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.557482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd11e2e-508a-4e53-9cc2-6b251f5decd8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.557760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd11e2e-508a-4e53-9cc2-6b251f5decd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.575425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1f872-dc32-48f8-b9c5-fb4fde336bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:32.576243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f872-dc32-48f8-b9c5-fb4fde336bcd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.576527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f872-dc32-48f8-b9c5-fb4fde336bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.576803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f872-dc32-48f8-b9c5-fb4fde336bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.578635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4dd11e2e-508a-4e53-9cc2-6b251f5decd8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:32.579900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4dd11e2e-508a-4e53-9cc2-6b251f5decd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:32.591201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1f872-dc32-48f8-b9c5-fb4fde336bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:32.593342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1f872-dc32-48f8-b9c5-fb4fde336bcd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5ea1f872-dc32-48f8-b9c5-fb4fde336bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:32.614130 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:32.615116 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:32.616695 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:32.616695 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:32.616695 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:32.616695 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:32.616695 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 467/946] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:32.617524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c108ab6-0a60-41ca-961b-f6b0361dee9d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.617705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c108ab6-0a60-41ca-961b-f6b0361dee9d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.617954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c108ab6-0a60-41ca-961b-f6b0361dee9d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.619427 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 468/947] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:32.624082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c108ab6-0a60-41ca-961b-f6b0361dee9d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:32.627247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:32.670574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 480/948] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:32.672680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073668-f15d-43cd-a23d-bf3027247b23 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.673278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073668-f15d-43cd-a23d-bf3027247b23 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.673781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073668-f15d-43cd-a23d-bf3027247b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.693017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8f073668-f15d-43cd-a23d-bf3027247b23 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:32.694777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f073668-f15d-43cd-a23d-bf3027247b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:32.695120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:32.749674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c108ab6-0a60-41ca-961b-f6b0361dee9d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:32.775930 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 481/949] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:32.776392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f073668-f15d-43cd-a23d-bf3027247b23 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:32.799689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:32.800284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.800571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.800847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.801568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:32.801875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:32.803844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:32.816240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 469/950] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:32.821105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:32.896337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f073668-f15d-43cd-a23d-bf3027247b23 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:32.898155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:32.939007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:32.939872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.939976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269418-d5c4-406e-8a15-0acdd2b62462 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:32.940447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.940447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.941098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:32.942530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:32.956177 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:32.957289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:32.958119 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 482/951] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:32.958920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:32.966566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:32.988340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:32.989198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:32.989489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:32.989767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:32.990576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:32.992157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:33.005662 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:33.007437 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:33.008323 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 470/952] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:33.009820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:33.081435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cf6b-4b3b-4db2-b97c-562b69fcd84e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.125897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.126861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.127153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.127682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.133892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd5ef7-366a-454e-aaa2-aa8a1547229e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.135524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.137115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:33.152108 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:33.153219 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 483/953] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:33.154201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:33.174633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.175366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.175659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.175939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.176691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:33.176978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.179053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.184578 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 471/954] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:33.185465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:33.199966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:33.241436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:33.295536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980427-2e2e-41f3-8cc8-81118dfd6319 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.311491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401529b-7689-471c-940b-a21b5d357301 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.338673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.339420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.339703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.340300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.341361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] RBAC: Adding query filter params (name=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:33.341602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.343736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.347563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.348234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.348519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.348796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.354819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:33.355007 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 484/955] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:33.355106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.355193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:33.355306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.369852 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 472/956] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:33.369852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:33.458101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:33.470640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613657-a26d-4b0e-80e5-6f661c250eaa None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.479098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efd05-f543-4820-8503-e83f1c02c641 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.482285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:33.516820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.518054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.518346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.518633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.519386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:33.519704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.521095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.526955 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 485/957] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:33.527857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:33.538871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.540119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.540119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.540119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.540867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:33.541130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.542520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.555367 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 473/958] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:33.555367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:33.656769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1a0a3-2478-4f16-b1b1-3362ba680736 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.700192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d555b4c-3f3c-411c-b99c-9cd9900d71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.701258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d555b4c-3f3c-411c-b99c-9cd9900d71f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.701551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d555b4c-3f3c-411c-b99c-9cd9900d71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.701854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d555b4c-3f3c-411c-b99c-9cd9900d71f8 None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/4999d3dfc6394f83a0b264434e6a256f/roles/fd27043fdadb4fa89a4e37a8f574ca70` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.703442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee476be-c4c7-4b44-9284-dbc22be9fd44 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:33.704475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d555b4c-3f3c-411c-b99c-9cd9900d71f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=4999d3dfc6394f83a0b264434e6a256f, role_id=fd27043fdadb4fa89a4e37a8f574ca70)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.706114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d555b4c-3f3c-411c-b99c-9cd9900d71f8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.731667 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 486/959] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:20:33 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/4999d3dfc6394f83a0b264434e6a256f/roles/fd27043fdadb4fa89a4e37a8f574ca70 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:20:33.755331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd05637-1e74-4348-9373-a3d9cda3d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:33.756376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05637-1e74-4348-9373-a3d9cda3d6a8 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:33.756678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05637-1e74-4348-9373-a3d9cda3d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:33.756945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05637-1e74-4348-9373-a3d9cda3d6a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:33.757718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd05637-1e74-4348-9373-a3d9cda3d6a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:33.759141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd05637-1e74-4348-9373-a3d9cda3d6a8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:33.788808 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 474/960] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:34.126868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426240-4199-4c03-9642-a39543573e8e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:34.127219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426240-4199-4c03-9642-a39543573e8e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:34.127372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426240-4199-4c03-9642-a39543573e8e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:34.129171 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 487/961] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:34.135330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0f54-b592-4d89-b403-bdea5b813878 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:34.136216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0f54-b592-4d89-b403-bdea5b813878 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:34.136695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0f54-b592-4d89-b403-bdea5b813878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:34.155047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-559f0f54-b592-4d89-b403-bdea5b813878 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:34.157067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-559f0f54-b592-4d89-b403-bdea5b813878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:34.177598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:34.244953 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 475/962] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:34.270476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12426240-4199-4c03-9642-a39543573e8e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:34.288369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:34.393516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12426240-4199-4c03-9642-a39543573e8e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:34.431920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:34.432604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:34.432888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:34.433169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:34.433886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:34.435347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:34.436676 n-d-768852-23 devstack@keystone.service[80581]: WARNING keystone.server.flask.common [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 14:20:34.452366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.sql.core [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 14:20:34.452366 n-d-768852-23 devstack@keystone.service[80581]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 14:20:34.452366 n-d-768852-23 devstack@keystone.service[80581]: [parameters: {'user_id': '2bffc150b5484be7aadb3d417a692863', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 14:20:34.452366 n-d-768852-23 devstack@keystone.service[80581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 14 14:20:34.470661 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:20:34.471640 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 14:20:34.472605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:20:34.474255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:20:34.476443 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:20:34.478503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [parameters: {'user_id': '2bffc150b5484be7aadb3d417a692863', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:34.480830 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 14:20:34.484002 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 14:20:34.486166 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 14:20:34.486166 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 14:20:34.486166 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 14:20:34.486166 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 14:20:34.486166 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 14:20:34.486166 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:34.486166 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 488/963] 10.222.0.98 () {60 vars in 1131 bytes} [Thu Jul 14 14:20:34 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:34.487708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f0f54-b592-4d89-b403-bdea5b813878 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:34.589984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f0f54-b592-4d89-b403-bdea5b813878 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:34.628405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b200-cc98-4402-8422-65009d8f1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:34.629604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b200-cc98-4402-8422-65009d8f1f65 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:34.630110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b200-cc98-4402-8422-65009d8f1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:34.630587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b200-cc98-4402-8422-65009d8f1f65 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:34.639062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b200-cc98-4402-8422-65009d8f1f65 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:34.640817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b200-cc98-4402-8422-65009d8f1f65 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-46d0b200-cc98-4402-8422-65009d8f1f65 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:34.656579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:34.657548 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:20:34.658588 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:34.661201 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 476/964] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:34.667615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:34.784903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:34.827129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed003d1-b321-493c-b9c8-6b88bcbeb52f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:34.889396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd111-04b6-4f76-af2a-c6d28db1eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:34.890519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd111-04b6-4f76-af2a-c6d28db1eab5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:34.891001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd111-04b6-4f76-af2a-c6d28db1eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:34.891518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd111-04b6-4f76-af2a-c6d28db1eab5 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:34.893003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd111-04b6-4f76-af2a-c6d28db1eab5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:34.893542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd111-04b6-4f76-af2a-c6d28db1eab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:34.897023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd111-04b6-4f76-af2a-c6d28db1eab5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:34.969461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 489/965] 10.222.0.98 () {56 vars in 1101 bytes} [Thu Jul 14 14:20:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:35.782718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadba875-a0da-4ec5-8652-4a1140aa3a9b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:35.783244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadba875-a0da-4ec5-8652-4a1140aa3a9b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:35.783358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadba875-a0da-4ec5-8652-4a1140aa3a9b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:35.785074 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 477/966] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:35.791212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c3df3-ce5d-4f3a-8488-07242330d53f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:35.791722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c3df3-ce5d-4f3a-8488-07242330d53f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:35.791931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c3df3-ce5d-4f3a-8488-07242330d53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:35.810398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f29c3df3-ce5d-4f3a-8488-07242330d53f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:35.811989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f29c3df3-ce5d-4f3a-8488-07242330d53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:35.873107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeee9f4-a2aa-46cc-a940-24a25efc3329 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:35.873395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeee9f4-a2aa-46cc-a940-24a25efc3329 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:35.873677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeee9f4-a2aa-46cc-a940-24a25efc3329 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:35.875193 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 478/967] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:35.879911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a253-213e-4866-b6e7-38932e6f6aaf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:35.880205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a253-213e-4866-b6e7-38932e6f6aaf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:35.880497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a253-213e-4866-b6e7-38932e6f6aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:35.887455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 490/968] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:35.897299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4139a253-213e-4866-b6e7-38932e6f6aaf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:35.898478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4139a253-213e-4866-b6e7-38932e6f6aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:35.902294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:35.910382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c3df3-ce5d-4f3a-8488-07242330d53f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:35.970798 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 479/969] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:35.987527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:35.995058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a253-213e-4866-b6e7-38932e6f6aaf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.032446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c3df3-ce5d-4f3a-8488-07242330d53f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.071658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b4d13-63d5-4ad2-94ef-83ab3e13e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.072267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b4d13-63d5-4ad2-94ef-83ab3e13e007 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.072550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b4d13-63d5-4ad2-94ef-83ab3e13e007 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.072824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b4d13-63d5-4ad2-94ef-83ab3e13e007 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.073610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b4d13-63d5-4ad2-94ef-83ab3e13e007 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.074931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b4d13-63d5-4ad2-94ef-83ab3e13e007 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.100219 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 491/970] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:35 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:20:36.104918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a253-213e-4866-b6e7-38932e6f6aaf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.156210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.157049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.157338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.157623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.160827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:36.172695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:36.175669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8756-4c5c-4c62-ba9a-1b234adc21c4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.175959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8756-4c5c-4c62-ba9a-1b234adc21c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.176238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8756-4c5c-4c62-ba9a-1b234adc21c4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.177816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 492/971] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:36.181468 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:36.182493 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:36.187932 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 480/972] 10.222.0.98 () {56 vars in 1120 bytes} [Thu Jul 14 14:20:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:36.188643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82825d02-fd67-405a-9686-78de9f4edace None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.188643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82825d02-fd67-405a-9686-78de9f4edace None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.188643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82825d02-fd67-405a-9686-78de9f4edace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.191439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.204301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-82825d02-fd67-405a-9686-78de9f4edace None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:36.205557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82825d02-fd67-405a-9686-78de9f4edace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:36.295666 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 493/973] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:36.322377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82825d02-fd67-405a-9686-78de9f4edace None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.325895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541229d-d7b4-494e-a9fd-dee5d51da41a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.364285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.364973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.365262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.365543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.366304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:36.366611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.368031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.378836 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 481/974] 10.222.0.98 () {56 vars in 1115 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:36.384265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.386230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:36.437514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82825d02-fd67-405a-9686-78de9f4edace None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.453165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:36.481987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.482811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.483101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.483421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.484087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.485472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:36.498556 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:36.499705 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:36.500587 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 494/975] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:36.504001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f8790-2522-48f3-8179-f26a30088b6f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.505816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.541478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.542291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.542579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.542857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.555309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.556809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:36.576367 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:36.577495 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:36.578579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:36.578579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:36.578579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:36.578579 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:36.580169 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 482/976] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:36.586237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.623572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83977-82d5-4adf-aa4c-4fe0e4aae69e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.641988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:36.660621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.661309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.661596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.661872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.663131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:36.663481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.664862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.675309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 495/977] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:36.676179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.705943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940ab41-a193-41dd-b24f-f5b298d46a18 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.717787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:36.748708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.749679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.750176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.750529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.751347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:36.751655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.753030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.771119 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 483/978] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:36.771974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.797856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686c86-a826-4470-93e5-e6b518904f9c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.834897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.835507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.835792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.836068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.837361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:36.837361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.838786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.844527 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 496/979] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:36.850971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.890223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1616f3-26e7-4cfc-a92f-199eb764e3bd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.902254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:36.927864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:36.929153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:36.929336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:36.929611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:36.937287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:36.938734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:36.953744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:36.954799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 14:20:36.956333 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:36.959565 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 484/980] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:36.960914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:36.965799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ada58-0200-48bf-b1ef-4a84cf5c86f4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:36.997436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:37.004489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:37.005468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:37.006537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:37.007024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:37.008081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] RBAC: Adding query filter params (interface=admin, service_id=7e971ebe9f1944b1aba6112494605ef0, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:37.008606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:37.010313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:37.016661 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 497/981] 10.222.0.98 () {56 vars in 1249 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/endpoints?service_id=7e971ebe9f1944b1aba6112494605ef0&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:37.022780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:37.075356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713042-3210-4a44-87aa-cee6733a7e4d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:37.113490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:37.114089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:37.114372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:37.114645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:37.116302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:37.116922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:37.118422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:37.132146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67de91-2aab-46e9-a6e6-68402ac37968 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:37.137741 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 485/982] 10.222.0.98 () {56 vars in 1149 bytes} [Thu Jul 14 14:20:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:37.143257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:37.145175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:37.177175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:37.177884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:37.178174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:37.178635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:37.179135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:37.180571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:37.187374 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 498/983] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:37 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:20:37.270470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:37.286254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e885c-91e8-49ee-8c6b-f48d49a83cee None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:37.326691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:37.327401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:37.327687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:37.327964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:37.401720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:37.403170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:37.492583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:37.512285 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 486/984] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:37 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 14:20:37.513662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:37.620539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86223-0165-4157-82b2-c58c1005837b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:37.655322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:37.656054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:37.656341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:37.656597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:37.668186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:37.669653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:37.687675 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:37.688647 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:37.689572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:37.689572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:37.689572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:37.689572 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:37.693907 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 499/985] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:37.695492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:37.800724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faefa0-313d-4ce1-88fa-65f0a9f1635f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:37.836079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:37.837087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:37.837372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:37.837649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:37.838367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:37.838676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:37.840087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:37.856378 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 487/986] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:37.857728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:37.888898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:37.967033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb75073-cc49-42ba-8c25-7c8b90a928a9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:38.000419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db53cb5-0b39-48be-bab1-d461058f0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:38.001237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53cb5-0b39-48be-bab1-d461058f0ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.001525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53cb5-0b39-48be-bab1-d461058f0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.001926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53cb5-0b39-48be-bab1-d461058f0ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.009901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db53cb5-0b39-48be-bab1-d461058f0ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:38.011438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db53cb5-0b39-48be-bab1-d461058f0ba3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9db53cb5-0b39-48be-bab1-d461058f0ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:38.027035 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:38.028175 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:38.029112 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:38.030239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 500/987] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:38.034082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:38.088114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:38.145359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79209764-d42b-4ba0-9b1d-f3da7bfad99e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:38.181819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:38.182817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.183135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.183540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.184475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:38.184900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:38.186619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:38.188148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad476e-35cb-4eb5-aad0-cd0fe7d379d2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.188442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad476e-35cb-4eb5-aad0-cd0fe7d379d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.188724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad476e-35cb-4eb5-aad0-cd0fe7d379d2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.191360 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 501/988] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:38.195681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347b58-592f-4a84-9381-7e20db934de1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.195974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347b58-592f-4a84-9381-7e20db934de1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.196261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347b58-592f-4a84-9381-7e20db934de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.201892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 488/989] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:38.207602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:38.217520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4b347b58-592f-4a84-9381-7e20db934de1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:38.218845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b347b58-592f-4a84-9381-7e20db934de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:38.306881 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 502/990] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:38.332268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9de738-a776-4fd9-b3ac-98f29b5a8c93 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:38.339569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b347b58-592f-4a84-9381-7e20db934de1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:38.343673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:38.359263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:38.372684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:38.373610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.373898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.374188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.375025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] RBAC: Adding query filter params (role.id=fd27043fdadb4fa89a4e37a8f574ca70, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=4999d3dfc6394f83a0b264434e6a256f) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:38.375371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:38.376823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:38.383739 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 489/991] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:38 2022] GET /identity/v3/role_assignments?user.id=4999d3dfc6394f83a0b264434e6a256f&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=fd27043fdadb4fa89a4e37a8f574ca70 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:38.462120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b347b58-592f-4a84-9381-7e20db934de1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:38.500559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:38.501302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.501594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.501875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.502614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:38.504028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:38.516915 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:38.518060 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:38.519405 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 503/992] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:38.524949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:38.639517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120034-8f4f-4958-8386-cb834d99d4f7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:38.676972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:38.678136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.678629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.679109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.680057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:38.680567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:38.682172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:38.688240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 490/993] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:38.694028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:38.784454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:38.807094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a5aa0-2d7e-4366-984e-aca137550bc0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:38.841910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:38.842586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:38.842869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:38.843146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:38.843883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:38.844190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:38.845552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:38.856050 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 504/994] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:38.857350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:38.898023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:38.966771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ded401-957b-447e-85ac-efd9b940d456 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:39.008134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25b9e5-3e01-4ed9-8c85-a7f7b21530e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:39.008840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25b9e5-3e01-4ed9-8c85-a7f7b21530e0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:39.009123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25b9e5-3e01-4ed9-8c85-a7f7b21530e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:39.009400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25b9e5-3e01-4ed9-8c85-a7f7b21530e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:39.010202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25b9e5-3e01-4ed9-8c85-a7f7b21530e0 None admin] RBAC: Adding query filter params (interface=public, service_id=2bc53a26e8a14ed99f66be748604c11f, region_id=RegionOne) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:39.010511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25b9e5-3e01-4ed9-8c85-a7f7b21530e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:39.011918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25b9e5-3e01-4ed9-8c85-a7f7b21530e0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:39.017707 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 491/995] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:20:38 2022] GET /identity/v3/endpoints?service_id=2bc53a26e8a14ed99f66be748604c11f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:39.023859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:39.132302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba851-c046-48bb-bc63-be499f27e527 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:39.169713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7bff5-a969-4789-9465-7883ee6e463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:39.170389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7bff5-a969-4789-9465-7883ee6e463e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:39.170670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7bff5-a969-4789-9465-7883ee6e463e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:39.170946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7bff5-a969-4789-9465-7883ee6e463e None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:39.171655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7bff5-a969-4789-9465-7883ee6e463e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:39.173018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7bff5-a969-4789-9465-7883ee6e463e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:39.179745 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 505/996] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:39 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:20:39.276950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e656753-9445-4264-85cc-abc2ab32d493 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:39.277521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e656753-9445-4264-85cc-abc2ab32d493 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:39.277521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e656753-9445-4264-85cc-abc2ab32d493 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:39.279391 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 492/997] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:39.285300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767fef-b801-4a77-acea-ecabf64bd30c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:39.285590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767fef-b801-4a77-acea-ecabf64bd30c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:39.285874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767fef-b801-4a77-acea-ecabf64bd30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:39.304699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a767fef-b801-4a77-acea-ecabf64bd30c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:39.305931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a767fef-b801-4a77-acea-ecabf64bd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:39.308317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:39.382978 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 506/998] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:39.406346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e656753-9445-4264-85cc-abc2ab32d493 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:39.520112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:39.525686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e656753-9445-4264-85cc-abc2ab32d493 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:39.567744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:39.568609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:39.568894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:39.569175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:39.569838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:39.571343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:39.584151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:39.585150 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:39.585993 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 493/999] 10.222.0.98 () {56 vars in 1126 bytes} [Thu Jul 14 14:20:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:39.595310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a767fef-b801-4a77-acea-ecabf64bd30c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:39.697821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a767fef-b801-4a77-acea-ecabf64bd30c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:39.732356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:39.733033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:39.733324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:39.733606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:39.734317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:39.734633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:39.736049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:39.741155 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 507/1000] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:39.746816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:39.850236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e8dc-e500-4109-8813-393627940d37 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:39.886418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acadf4-f04e-4162-b4ef-db2d47073725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:39.887095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acadf4-f04e-4162-b4ef-db2d47073725 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:39.887423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acadf4-f04e-4162-b4ef-db2d47073725 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:39.887707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acadf4-f04e-4162-b4ef-db2d47073725 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:39.888413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acadf4-f04e-4162-b4ef-db2d47073725 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:39.888723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acadf4-f04e-4162-b4ef-db2d47073725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:39.890108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acadf4-f04e-4162-b4ef-db2d47073725 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:39.895242 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 494/1001] 10.222.0.98 () {56 vars in 1122 bytes} [Thu Jul 14 14:20:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:39.901545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:39.904591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:40.008557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89518b16-f4c7-4872-9563-87dc3c1387fd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:40.044112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978facfe-b6a9-46f5-876f-4b56ee34f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:40.044773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978facfe-b6a9-46f5-876f-4b56ee34f8cc None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:40.045058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978facfe-b6a9-46f5-876f-4b56ee34f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:40.045340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978facfe-b6a9-46f5-876f-4b56ee34f8cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:40.046100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978facfe-b6a9-46f5-876f-4b56ee34f8cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:40.047494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978facfe-b6a9-46f5-876f-4b56ee34f8cc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:40.071306 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 508/1002] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:40.500769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126eca7-b04c-458c-b877-4c9d59d06bf7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:40.501312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126eca7-b04c-458c-b877-4c9d59d06bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:40.501312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126eca7-b04c-458c-b877-4c9d59d06bf7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:40.502699 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 495/1003] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:40.508345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b454a-eecc-458f-9a5c-e5f66afa68a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:40.508601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b454a-eecc-458f-9a5c-e5f66afa68a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:40.508799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b454a-eecc-458f-9a5c-e5f66afa68a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:40.525924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-426b454a-eecc-458f-9a5c-e5f66afa68a2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:40.527022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-426b454a-eecc-458f-9a5c-e5f66afa68a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:40.595903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:40.618785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 509/1004] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:40.640761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126eca7-b04c-458c-b877-4c9d59d06bf7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:40.676091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:40.756544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126eca7-b04c-458c-b877-4c9d59d06bf7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:40.795099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:40.795785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:40.796124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:40.796360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:40.796982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:40.798355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:40.810358 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:40.811476 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:40.817169 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 496/1005] 10.222.0.98 () {56 vars in 1105 bytes} [Thu Jul 14 14:20:40 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:40.818032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b454a-eecc-458f-9a5c-e5f66afa68a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:40.929096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b454a-eecc-458f-9a5c-e5f66afa68a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:40.966349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686fd3e-c9ef-4322-86eb-bea7e76324f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:40.967035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fd3e-c9ef-4322-86eb-bea7e76324f3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:40.967345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fd3e-c9ef-4322-86eb-bea7e76324f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:40.967628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fd3e-c9ef-4322-86eb-bea7e76324f3 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:40.968340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fd3e-c9ef-4322-86eb-bea7e76324f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:40.968647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fd3e-c9ef-4322-86eb-bea7e76324f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:40.970021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fd3e-c9ef-4322-86eb-bea7e76324f3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:40.979366 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 510/1006] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:40.981382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:41.082734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:41.093786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeffc01-f654-4406-82ed-da37055f8ab3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:41.127765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f56be-0c9d-414f-ac1b-163a29513fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:41.128435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f56be-0c9d-414f-ac1b-163a29513fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:41.128718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f56be-0c9d-414f-ac1b-163a29513fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:41.128994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f56be-0c9d-414f-ac1b-163a29513fd2 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:41.129695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f56be-0c9d-414f-ac1b-163a29513fd2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:41.130013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f56be-0c9d-414f-ac1b-163a29513fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:41.131954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f56be-0c9d-414f-ac1b-163a29513fd2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:41.136992 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 497/1007] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:41.272279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef485-2a00-4aa7-ae09-f515537c73ad None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:41.272899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef485-2a00-4aa7-ae09-f515537c73ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:41.272899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef485-2a00-4aa7-ae09-f515537c73ad None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:41.274535 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 511/1008] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:41.279929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fb9b-af23-4f01-a41d-2ffa111e2647 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:41.280225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fb9b-af23-4f01-a41d-2ffa111e2647 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:41.280513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fb9b-af23-4f01-a41d-2ffa111e2647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:41.298888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7640fb9b-af23-4f01-a41d-2ffa111e2647 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:41.300198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7640fb9b-af23-4f01-a41d-2ffa111e2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:41.374391 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 498/1009] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:41.397413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afef485-2a00-4aa7-ae09-f515537c73ad None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:41.456172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:41.510702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afef485-2a00-4aa7-ae09-f515537c73ad None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:41.546026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:41.546872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:41.547115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:41.547426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:41.548079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:41.549451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:41.562022 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:41.563099 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:20:41.564619 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:41.567629 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 512/1010] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:41.569737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fb9b-af23-4f01-a41d-2ffa111e2647 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:41.660491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:41.678000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fb9b-af23-4f01-a41d-2ffa111e2647 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:41.715399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:41.716075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:41.716357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:41.716632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:41.717336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:41.717641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:41.719016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:41.730562 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 499/1011] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:41.735165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:41.839537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe01d-da33-4c44-8ab8-258062272823 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:41.857551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:41.878373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28141f3f-4992-416b-bb70-3dd1d642129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:41.879044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141f3f-4992-416b-bb70-3dd1d642129f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:41.879362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141f3f-4992-416b-bb70-3dd1d642129f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:41.879638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141f3f-4992-416b-bb70-3dd1d642129f None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:41.880361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28141f3f-4992-416b-bb70-3dd1d642129f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:41.880703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28141f3f-4992-416b-bb70-3dd1d642129f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:41.882186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28141f3f-4992-416b-bb70-3dd1d642129f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:41.887685 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 513/1012] 10.222.0.98 () {56 vars in 1112 bytes} [Thu Jul 14 14:20:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:41.893170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:41.996432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15b6d8-e0e8-48f1-92c9-1b79982ba1c9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:42.032371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcd4ee-3a33-4e1b-88f3-9097df544b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:42.033041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcd4ee-3a33-4e1b-88f3-9097df544b19 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:42.033328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcd4ee-3a33-4e1b-88f3-9097df544b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:42.033607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcd4ee-3a33-4e1b-88f3-9097df544b19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:42.034345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcd4ee-3a33-4e1b-88f3-9097df544b19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:42.035754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcd4ee-3a33-4e1b-88f3-9097df544b19 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:42.055418 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 500/1013] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:20:42.173054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342ec8b-8d53-4f9e-b601-2397244cbc51 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:42.173401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342ec8b-8d53-4f9e-b601-2397244cbc51 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:42.173627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342ec8b-8d53-4f9e-b601-2397244cbc51 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:42.175605 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 514/1014] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:42.181053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abed567-11a0-49ae-9188-122b3e793535 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:42.181388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abed567-11a0-49ae-9188-122b3e793535 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:42.181627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abed567-11a0-49ae-9188-122b3e793535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:42.194696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:42.202428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2abed567-11a0-49ae-9188-122b3e793535 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:42.203666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2abed567-11a0-49ae-9188-122b3e793535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:42.292445 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 501/1015] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:42.315408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342ec8b-8d53-4f9e-b601-2397244cbc51 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:42.442697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342ec8b-8d53-4f9e-b601-2397244cbc51 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:42.480111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a67f47-41d2-4810-b030-29c2cbe08c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:42.480999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a67f47-41d2-4810-b030-29c2cbe08c3e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:42.481282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a67f47-41d2-4810-b030-29c2cbe08c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:42.481611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a67f47-41d2-4810-b030-29c2cbe08c3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:42.482861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a67f47-41d2-4810-b030-29c2cbe08c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:42.484365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a67f47-41d2-4810-b030-29c2cbe08c3e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:42.486071 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 515/1016] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:42.492560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abed567-11a0-49ae-9188-122b3e793535 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:42.599001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abed567-11a0-49ae-9188-122b3e793535 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:42.632151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:42.638635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076428b-8d22-4d00-9420-dd4d1aefc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:42.639369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076428b-8d22-4d00-9420-dd4d1aefc504 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:42.639652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076428b-8d22-4d00-9420-dd4d1aefc504 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:42.639903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076428b-8d22-4d00-9420-dd4d1aefc504 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:42.640614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076428b-8d22-4d00-9420-dd4d1aefc504 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:42.642053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076428b-8d22-4d00-9420-dd4d1aefc504 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:42.669556 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 502/1017] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:42 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:43.244321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71ce3-5da7-42db-ad74-74952377bb44 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:43.244669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71ce3-5da7-42db-ad74-74952377bb44 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:43.244891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71ce3-5da7-42db-ad74-74952377bb44 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:43.246458 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 516/1018] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:43.252088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207343c-4376-4eb4-8402-a69deabe9199 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:43.252423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207343c-4376-4eb4-8402-a69deabe9199 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:43.252712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207343c-4376-4eb4-8402-a69deabe9199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:43.271200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2207343c-4376-4eb4-8402-a69deabe9199 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:43.272444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2207343c-4376-4eb4-8402-a69deabe9199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:43.347635 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 503/1019] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:43 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:43.371355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b71ce3-5da7-42db-ad74-74952377bb44 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:43.425481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:43.481608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b71ce3-5da7-42db-ad74-74952377bb44 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:43.516779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acdb9-50a6-4de9-99b2-c7191c518fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:43.517363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdb9-50a6-4de9-99b2-c7191c518fa1 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:43.517697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdb9-50a6-4de9-99b2-c7191c518fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:43.517922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdb9-50a6-4de9-99b2-c7191c518fa1 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:43.518642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acdb9-50a6-4de9-99b2-c7191c518fa1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:43.520040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acdb9-50a6-4de9-99b2-c7191c518fa1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:43.539319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 517/1020] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:20:43 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:44.267113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9a17-e5d8-4cbe-b3f7-1bbe2b9add20 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:44.267113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9a17-e5d8-4cbe-b3f7-1bbe2b9add20 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:44.267113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9a17-e5d8-4cbe-b3f7-1bbe2b9add20 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:44.271317 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 504/1021] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:44.273630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adbce4-fa28-4174-ada3-29b16f55e69a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:44.273930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adbce4-fa28-4174-ada3-29b16f55e69a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:44.274218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adbce4-fa28-4174-ada3-29b16f55e69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:44.291909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-04adbce4-fa28-4174-ada3-29b16f55e69a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:44.293120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04adbce4-fa28-4174-ada3-29b16f55e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:44.373579 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 518/1022] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:44.397542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb9a17-e5d8-4cbe-b3f7-1bbe2b9add20 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:44.506834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb9a17-e5d8-4cbe-b3f7-1bbe2b9add20 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:44.522737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:44.545653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:44.546476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:44.546763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:44.547043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:44.558671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:44.566958 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:44.568023 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:44.568940 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:44.570371 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 505/1023] 10.222.0.98 () {56 vars in 1120 bytes} [Thu Jul 14 14:20:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:44.574200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adbce4-fa28-4174-ada3-29b16f55e69a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:44.611810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:44.695259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adbce4-fa28-4174-ada3-29b16f55e69a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:44.731548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42f69e-baf8-4356-aac6-363ba33f9937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:44.732244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f69e-baf8-4356-aac6-363ba33f9937 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:44.732532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f69e-baf8-4356-aac6-363ba33f9937 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:44.732808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f69e-baf8-4356-aac6-363ba33f9937 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:44.733922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42f69e-baf8-4356-aac6-363ba33f9937 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:44.733922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42f69e-baf8-4356-aac6-363ba33f9937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:44.735249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42f69e-baf8-4356-aac6-363ba33f9937 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:44.749402 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 519/1024] 10.222.0.98 () {56 vars in 1115 bytes} [Thu Jul 14 14:20:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:44.750991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:44.770151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06427a-c8c7-47ae-93b0-f7e708dd2e28 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:44.770473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06427a-c8c7-47ae-93b0-f7e708dd2e28 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:44.770885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06427a-c8c7-47ae-93b0-f7e708dd2e28 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:44.772502 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 520/1025] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:44.779773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ca5d6-83ba-4751-9126-a231a9e6a83f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:44.780052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ca5d6-83ba-4751-9126-a231a9e6a83f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:44.780446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ca5d6-83ba-4751-9126-a231a9e6a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:44.799735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b0ca5d6-83ba-4751-9126-a231a9e6a83f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:44.800936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b0ca5d6-83ba-4751-9126-a231a9e6a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:44.864505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b932c-9368-44c4-8eab-d1f70de79ee6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:44.872696 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 521/1026] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:44.896692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ca5d6-83ba-4751-9126-a231a9e6a83f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:44.901335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:44.902141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:44.902464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:44.902747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:44.914591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:44.916009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:44.926681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:44.934044 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:44.935089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:44.941016 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:44.941016 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:44.941016 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:44.941016 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:44.941016 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 506/1027] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:44.941307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:44.969846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:45.014919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ca5d6-83ba-4751-9126-a231a9e6a83f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:45.049316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8e55-2004-47c2-9533-30d596b42cea None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:45.056302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:45.057553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.057846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.058133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.059742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:45.061796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:45.064316 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 522/1028] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:45.069890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:45.088675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:45.089357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.089646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.089942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.090807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:45.091357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:45.092888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:45.106569 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 507/1029] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:45.112246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:45.174511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:45.183015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fb08b-7876-4b5b-b71d-d9631902b167 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:45.212607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:45.221245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:45.221901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.222186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.222454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.223170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:45.225297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:45.229797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf2e69-441f-4002-952e-b33795231674 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:45.256299 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 523/1030] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:20:45 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:20:45.284272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:45.285149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.285442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.286055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.296399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:45.297911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:45.314325 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:45.315380 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:45.321714 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 508/1031] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:20:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:45.322753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:45.434555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff58a-ae8f-4746-a6cc-c433662a8dc9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:45.475888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89687112-d064-48a7-8cd0-c34e906c85c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:45.476645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687112-d064-48a7-8cd0-c34e906c85c5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.476935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687112-d064-48a7-8cd0-c34e906c85c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.477308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687112-d064-48a7-8cd0-c34e906c85c5 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.478175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89687112-d064-48a7-8cd0-c34e906c85c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:45.478487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89687112-d064-48a7-8cd0-c34e906c85c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:45.479984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89687112-d064-48a7-8cd0-c34e906c85c5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:45.501729 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 524/1032] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:20:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:45.507404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:45.616908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7103-725a-49a6-96d2-3138955b7846 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.617207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7103-725a-49a6-96d2-3138955b7846 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.617395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7103-725a-49a6-96d2-3138955b7846 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.618862 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 525/1033] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:45.622114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769cd19-736a-4925-96a5-7dc03b1a3272 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:45.624157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a900-56e5-44eb-959d-a0d65aea7419 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.624442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a900-56e5-44eb-959d-a0d65aea7419 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.624732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a900-56e5-44eb-959d-a0d65aea7419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.642081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8c47a900-56e5-44eb-959d-a0d65aea7419 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:45.643305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8c47a900-56e5-44eb-959d-a0d65aea7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:45.645428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:45.665613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:45.666277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.666562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.666848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.685246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:45.718929 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 526/1034] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:45.742584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a900-56e5-44eb-959d-a0d65aea7419 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:45.744482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:45.746014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:45.861077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a900-56e5-44eb-959d-a0d65aea7419 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:45.861821 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 509/1035] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:20:45.867971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:45.903547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:45.904654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:45.905116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:45.905542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] PATH_INFO: `/v3/services/image` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:45.906350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:45.907897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:45.916028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:45.922220 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:45.923461 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:45.924535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:45.927807 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 527/1036] 10.222.0.98 () {56 vars in 1105 bytes} [Thu Jul 14 14:20:45 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:45.933492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:45.937160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:45.982377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffffcb7-2687-4023-bdfd-f3310f918b84 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.019228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.020655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.021958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.022410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.033745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.035526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.044841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e259-f9b8-4a49-8d4b-83767c515eea None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:46.054744 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:46.055844 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:46.056905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:46.056905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:46.056905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:46.056905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:46.058510 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 510/1037] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:46.064007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:46.086864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.087582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.087873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.088152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.088988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] RBAC: Adding query filter params (name=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:46.089309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.090824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.101513 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 528/1038] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:46.102524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:46.170978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:46.171321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:46.178031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae99e9a-553c-4371-9a5b-efd8640b14ca None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.207448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473505-f108-40f3-abe4-fd08d1003b99 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.216323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.217321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.217612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.217970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.218722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:46.219039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.220469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.233075 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 511/1039] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:46.238803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:46.249543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.250285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.250574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.250844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.251653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:46.251968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.253341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.258821 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 529/1040] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:46.265444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:46.371364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f2022-3668-4b9b-ba37-750e8e6c548b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.386445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590df6-1635-420b-9eb7-cdc3b52bdcc9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.409939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.410758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.411044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.411353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.419556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.421094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.425196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:46.433831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.434514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.434799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.435446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.435908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] RBAC: Adding query filter params (interface=public, service_id=66c7db1e10064cdc8c232e854d16e00a, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:46.436229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:46.437445 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:46.438291 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:46.444126 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:46.444605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.444685 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 512/1041] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:46.444754 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 530/1042] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:20:46 2022] GET /identity/v3/endpoints?service_id=66c7db1e10064cdc8c232e854d16e00a&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:46.447566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:46.451561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:46.473718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:46.564075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a016cb-63bf-44d2-aa76-f832d9fb4c77 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.568885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64147474-a24b-45d5-a3b5-0d921b99c08b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.603783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f37cb-75d5-4f03-86da-01f95e1517ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.604459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f37cb-75d5-4f03-86da-01f95e1517ae None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.604757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f37cb-75d5-4f03-86da-01f95e1517ae None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.605029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f37cb-75d5-4f03-86da-01f95e1517ae None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.605884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f37cb-75d5-4f03-86da-01f95e1517ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:46.606199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f37cb-75d5-4f03-86da-01f95e1517ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.607683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f37cb-75d5-4f03-86da-01f95e1517ae None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.610752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.611626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.612054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.612469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.613299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.615545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.631303 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 531/1043] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:20:46 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:20:46.631516 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 513/1044] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:46.631641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:46.700379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:46.749768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a9b3-54e1-49c0-ba69-f44519d3f32a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:46.797289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0142c-f9cf-4ce7-b5d8-e0f8f3a947d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:46.797966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0142c-f9cf-4ce7-b5d8-e0f8f3a947d7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:46.798902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0142c-f9cf-4ce7-b5d8-e0f8f3a947d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:46.798902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0142c-f9cf-4ce7-b5d8-e0f8f3a947d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:46.799466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0142c-f9cf-4ce7-b5d8-e0f8f3a947d7 None admin] RBAC: Adding query filter params (role.id=fd27043fdadb4fa89a4e37a8f574ca70, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=eecb3bcddba54aca9316af7a0ec3b923) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:46.799791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0142c-f9cf-4ce7-b5d8-e0f8f3a947d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:46.801302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0142c-f9cf-4ce7-b5d8-e0f8f3a947d7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:46.808774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 532/1045] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:46 2022] GET /identity/v3/role_assignments?user.id=eecb3bcddba54aca9316af7a0ec3b923&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=fd27043fdadb4fa89a4e37a8f574ca70 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:47.409894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8e60-6f7f-41d0-a88a-80ff0691e606 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:47.410448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8e60-6f7f-41d0-a88a-80ff0691e606 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:47.410448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8e60-6f7f-41d0-a88a-80ff0691e606 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:47.412209 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 514/1046] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:47.417154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e95b-f1b5-4846-8053-5c47b7155e6c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:47.417458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e95b-f1b5-4846-8053-5c47b7155e6c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:47.417744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e95b-f1b5-4846-8053-5c47b7155e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:47.434822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9d16e95b-f1b5-4846-8053-5c47b7155e6c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:47.436030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d16e95b-f1b5-4846-8053-5c47b7155e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:47.507544 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 533/1047] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:47.531123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8e60-6f7f-41d0-a88a-80ff0691e606 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:47.617308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:47.641206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8e60-6f7f-41d0-a88a-80ff0691e606 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:47.676353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:47.677183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:47.677464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:47.677869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:47.689634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:47.698087 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:47.699182 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:47.700099 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:47.703664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 515/1048] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:47.705264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16e95b-f1b5-4846-8053-5c47b7155e6c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:47.761523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:47.812012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16e95b-f1b5-4846-8053-5c47b7155e6c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:47.845878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:47.846554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:47.846837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:47.847114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:47.847895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:47.848203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:47.850084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:47.858566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 534/1049] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:47.864264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:47.971422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79de69-4c17-42f1-a829-1c43d9bdfd27 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:48.006330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:48.007203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.007513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.007793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] PATH_INFO: `/v3/users/69a4b495a35840188e4834c9c92b7516` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.016300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:48.023954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] RBAC: Authorizing `identity:get_user(user_id=69a4b495a35840188e4834c9c92b7516)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:48.025410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:48.027264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 516/1050] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:20:47 2022] GET /identity/v3/users/69a4b495a35840188e4834c9c92b7516 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:48.032817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:48.135628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9941da-c275-4810-ba4b-0243c387a173 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:48.149252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:48.169951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:48.170613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.170891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.171165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.247033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:48.248535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:48.371523 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 535/1051] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:48 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 14:20:48.373906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:48.490958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96931c-c9bc-4e00-bc8d-93d01ca9b851 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:48.528345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc8cf7-bd3f-44d0-bdf4-52ad59d56dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:48.529216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8cf7-bd3f-44d0-bdf4-52ad59d56dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.529499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8cf7-bd3f-44d0-bdf4-52ad59d56dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.529779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8cf7-bd3f-44d0-bdf4-52ad59d56dc8 None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.530965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc8cf7-bd3f-44d0-bdf4-52ad59d56dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=adccaad9264d433ea0ff5b064697d378)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:48.532523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc8cf7-bd3f-44d0-bdf4-52ad59d56dc8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:48.542700 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 517/1052] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:20:48 2022] GET /identity/v3/projects/adccaad9264d433ea0ff5b064697d378 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:48.542882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:48.557116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:48.656021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eab107-4655-4c4e-aa9d-5d0c45c4aecb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:48.695375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51f24-c07c-4d37-b6e1-6a2bcf85c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:48.696048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51f24-c07c-4d37-b6e1-6a2bcf85c1ac None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.696342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51f24-c07c-4d37-b6e1-6a2bcf85c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.696625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51f24-c07c-4d37-b6e1-6a2bcf85c1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.697467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51f24-c07c-4d37-b6e1-6a2bcf85c1ac None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=adccaad9264d433ea0ff5b064697d378, user.id=69a4b495a35840188e4834c9c92b7516) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:48.697785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51f24-c07c-4d37-b6e1-6a2bcf85c1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:48.699235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51f24-c07c-4d37-b6e1-6a2bcf85c1ac None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:48.705528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749a11-dd98-4c92-bcfe-87a7e14b8846 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.705798 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 536/1053] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:48 2022] GET /identity/v3/role_assignments?user.id=69a4b495a35840188e4834c9c92b7516&scope.project.id=adccaad9264d433ea0ff5b064697d378&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:48.705882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749a11-dd98-4c92-bcfe-87a7e14b8846 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.706255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749a11-dd98-4c92-bcfe-87a7e14b8846 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.707613 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 518/1054] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:48.717316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037558b9-3e0b-4294-b5c1-53c420d38dc4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.717639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037558b9-3e0b-4294-b5c1-53c420d38dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.717908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037558b9-3e0b-4294-b5c1-53c420d38dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.737468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-037558b9-3e0b-4294-b5c1-53c420d38dc4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:48.738693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-037558b9-3e0b-4294-b5c1-53c420d38dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:48.818064 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 537/1055] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:48.841650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57749a11-dd98-4c92-bcfe-87a7e14b8846 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:48.857834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f922-d62b-4a85-97a0-962122afde7e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.858136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f922-d62b-4a85-97a0-962122afde7e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.858422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f922-d62b-4a85-97a0-962122afde7e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.859878 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 538/1056] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:48.865867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c7404-5d6f-4fed-aceb-ebfe920b78a0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.866151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c7404-5d6f-4fed-aceb-ebfe920b78a0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.866435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c7404-5d6f-4fed-aceb-ebfe920b78a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.884725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5d9c7404-5d6f-4fed-aceb-ebfe920b78a0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:48.885955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d9c7404-5d6f-4fed-aceb-ebfe920b78a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:48.888176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:48.914014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:48.955375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57749a11-dd98-4c92-bcfe-87a7e14b8846 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:48.963094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 539/1057] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:48.986211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c7404-5d6f-4fed-aceb-ebfe920b78a0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:48.992873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:48.993706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:48.993986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:48.994308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] PATH_INFO: `/v3/services/image` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:48.994914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:48.996643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:49.011718 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:49.012842 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:49.014281 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 519/1058] 10.222.0.98 () {56 vars in 1105 bytes} [Thu Jul 14 14:20:48 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:49.018796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:49.100791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c7404-5d6f-4fed-aceb-ebfe920b78a0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.137016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.137848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.138109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cd7f7-a474-4f8d-8682-e733d90dd138 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.138234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.138422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.147449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:49.152819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:49.161424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:49.162978 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:49.163906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 540/1059] 10.222.0.98 () {56 vars in 1120 bytes} [Thu Jul 14 14:20:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:49.171545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:49.175609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:49.185226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.185905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.186192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.186470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.187176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] RBAC: Adding query filter params (name=image) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:49.187537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:49.188964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.195032 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 520/1060] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:49.201117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:49.304731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eef442-181f-4311-bd73-d6c13a6c018b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.335654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f4602-17db-4c90-b6eb-dce96ea2e46d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.341406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.342087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.342376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.342659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.343451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:49.343792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:49.345181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.354520 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 541/1061] 10.222.0.98 () {56 vars in 1115 bytes} [Thu Jul 14 14:20:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:49.359910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:49.378545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.379355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.379640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.379917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.381210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] RBAC: Adding query filter params (type=image) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:49.381514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:49.383059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.390061 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 521/1062] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:49.395822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:49.427818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:49.454360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:49.481759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255b40e-b20d-4a62-9b8e-96803dc59cd3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.504129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb15fd2-c658-418a-8617-cd05129eb705 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.518600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.519541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.519828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.520106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.531882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:49.533574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.545650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.546338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.546625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.546907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.547699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:49.549077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:49.552273 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:49.554167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:49.555503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:49.555503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:49.555503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:49.555503 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:49.555503 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 542/1063] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:49.559981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:49.573507 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 522/1064] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:20:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:20:49.681918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad540b6-be94-4ef8-a1e9-a51b3826f54a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.698033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:49.733968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.733968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.734270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.734515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.735694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:49.735694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:49.737028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.751234 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 543/1065] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:49.757810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:49.872768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28861a25-574a-4479-93b7-95010849abe8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:49.886989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:49.912731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:49.913557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:49.913840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:49.914115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:49.922041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:49.923717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:49.938089 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:49.939046 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:49.945608 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 523/1066] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:20:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:49.946226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:50.049001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f51d1-78bc-41e6-b2f2-94cd46c611bb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:50.086429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:50.087112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:50.087433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:50.087758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:50.088578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:50.088891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:50.090356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:50.115325 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 544/1067] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:20:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:50.118119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:50.234776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682281-2ede-47e2-b96d-68e9c3bcaa2a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:50.277525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:50.278703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:50.279200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:50.279743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:50.292536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:50.294300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:50.314743 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:50.315764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:50.316664 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:50.316664 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:50.316664 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:50.316664 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:50.319368 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 524/1068] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:50.323126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:50.353803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:50.436092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e87f9f-1a14-47cb-8d27-fb58740013f4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:50.482434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:50.483602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:50.484098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:50.484582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:50.485580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:50.486096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:50.487721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:50.501644 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 545/1069] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:50.507464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:50.540693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:50.639014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a96cca-b910-43be-9016-85fefed3f470 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:50.678544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36ea2-bce7-413a-bdd0-95a433647fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:50.679222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36ea2-bce7-413a-bdd0-95a433647fef None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:50.679544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36ea2-bce7-413a-bdd0-95a433647fef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:50.679824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36ea2-bce7-413a-bdd0-95a433647fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:50.688227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36ea2-bce7-413a-bdd0-95a433647fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:50.689915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36ea2-bce7-413a-bdd0-95a433647fef None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-25f36ea2-bce7-413a-bdd0-95a433647fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:50.713320 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:50.714296 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:50.715251 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 525/1070] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:50.720717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:50.761308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9052-4949-46f4-8e11-49c952807fe4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:50.761489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9052-4949-46f4-8e11-49c952807fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:50.761775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9052-4949-46f4-8e11-49c952807fe4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:50.763199 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 526/1071] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:50.768985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1327c-305f-4ddc-b356-8f605ce04ab6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:50.769325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1327c-305f-4ddc-b356-8f605ce04ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:50.769556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1327c-305f-4ddc-b356-8f605ce04ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:50.789003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-14d1327c-305f-4ddc-b356-8f605ce04ab6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:50.790309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-14d1327c-305f-4ddc-b356-8f605ce04ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:50.822558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:50.840351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be44d4d-bc3c-44f0-97d3-6c84b370aca9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:50.868803 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 527/1072] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:50.881962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:50.882660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:50.883143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:50.883460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:50.884283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:50.884597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:50.886088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:50.891067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1327c-305f-4ddc-b356-8f605ce04ab6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:50.901245 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 546/1073] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:50.906638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:50.907404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:51.004467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1327c-305f-4ddc-b356-8f605ce04ab6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:51.027425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef0bd8-b8db-487b-9e23-ff0a452c1266 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:51.045630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d226837-8918-40f6-b208-d77faded367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:51.046440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d226837-8918-40f6-b208-d77faded367d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.047008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d226837-8918-40f6-b208-d77faded367d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.047008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d226837-8918-40f6-b208-d77faded367d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.061407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d226837-8918-40f6-b208-d77faded367d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:51.065455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:51.066365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.066654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.066939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/eecb3bcddba54aca9316af7a0ec3b923/roles/fd27043fdadb4fa89a4e37a8f574ca70` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.069774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=eecb3bcddba54aca9316af7a0ec3b923, role_id=fd27043fdadb4fa89a4e37a8f574ca70)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3d226837-8918-40f6-b208-d77faded367d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:51.069883 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:51.070767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:51.071821 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 528/1074] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:51.075618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:51.077022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d226837-8918-40f6-b208-d77faded367d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:51.093172 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 547/1075] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:20:50 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/eecb3bcddba54aca9316af7a0ec3b923/roles/fd27043fdadb4fa89a4e37a8f574ca70 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:20:51.173427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:51.202863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d226837-8918-40f6-b208-d77faded367d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:51.248331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:51.248731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.249022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.249308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.250619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:51.250619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:51.252202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:51.264293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 529/1076] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:51.269409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:51.280879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:51.385395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38970e-aa6c-4d9a-97a2-a80c1c4996b2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:51.422060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:51.422955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.423242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.423609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] PATH_INFO: `/v3/users/69a4b495a35840188e4834c9c92b7516` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.424876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] RBAC: Authorizing `identity:get_user(user_id=69a4b495a35840188e4834c9c92b7516)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:51.426340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:51.433204 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 548/1077] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:20:51 2022] GET /identity/v3/users/69a4b495a35840188e4834c9c92b7516 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:51.434428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:51.544620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50484b-ca25-4a12-b84c-7294f04bc93b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:51.582468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb353a7-30b7-402a-84ab-40e67401f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:51.583413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb353a7-30b7-402a-84ab-40e67401f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.583704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb353a7-30b7-402a-84ab-40e67401f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.583988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb353a7-30b7-402a-84ab-40e67401f4b5 None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.585191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb353a7-30b7-402a-84ab-40e67401f4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=adccaad9264d433ea0ff5b064697d378)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:51.587092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb353a7-30b7-402a-84ab-40e67401f4b5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:51.594229 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 530/1078] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:20:51 2022] GET /identity/v3/projects/adccaad9264d433ea0ff5b064697d378 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:51.595491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:51.682427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:51.710688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797645cf-3959-497a-a6a2-8573471aad5d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:51.744821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c88a-1bce-4627-854d-3932603dd76b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.745197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c88a-1bce-4627-854d-3932603dd76b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.745466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c88a-1bce-4627-854d-3932603dd76b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.747012 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 531/1079] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:51.748132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:51.749046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.749325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.749602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378/users/69a4b495a35840188e4834c9c92b7516/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.751919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] RBAC: Authorizing `identity:create_grant(project_id=adccaad9264d433ea0ff5b064697d378, user_id=69a4b495a35840188e4834c9c92b7516, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:51.752166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2f74-6e83-4181-b99b-13bee2ae6c2e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:51.752451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2f74-6e83-4181-b99b-13bee2ae6c2e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:51.752735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2f74-6e83-4181-b99b-13bee2ae6c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:51.753371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:51.759162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:51.772963 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 549/1080] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:20:51 2022] PUT /identity/v3/projects/adccaad9264d433ea0ff5b064697d378/users/69a4b495a35840188e4834c9c92b7516/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:20:51.773163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f9ba2f74-6e83-4181-b99b-13bee2ae6c2e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:51.774232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f9ba2f74-6e83-4181-b99b-13bee2ae6c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:51.859023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 532/1081] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:51.881905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:52.003527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0d6c-d883-48df-b3e4-15925cc6ef77 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:52.040985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:52.041658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:52.041942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:52.042221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:52.045169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:52.118223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:52.119535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:52.230728 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 550/1082] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:20:52.236447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2f74-6e83-4181-b99b-13bee2ae6c2e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:52.356303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2f74-6e83-4181-b99b-13bee2ae6c2e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:52.393232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c6ddb-1c0f-4e76-a86c-c16621d1a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:52.393951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c6ddb-1c0f-4e76-a86c-c16621d1a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:52.394237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c6ddb-1c0f-4e76-a86c-c16621d1a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:52.394513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c6ddb-1c0f-4e76-a86c-c16621d1a1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:52.397111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:52.407702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c6ddb-1c0f-4e76-a86c-c16621d1a1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:52.409176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c6ddb-1c0f-4e76-a86c-c16621d1a1b0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-274c6ddb-1c0f-4e76-a86c-c16621d1a1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:52.428460 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:52.429456 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:52.430409 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:52.430409 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:52.430409 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:52.430409 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:52.430409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 533/1083] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:52.437812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:52.475976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:52.556615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3b6b-d523-482e-9584-e84fbd550e5e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:52.605602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf96825-3779-4f76-b78d-cc27af52bce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:52.606802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf96825-3779-4f76-b78d-cc27af52bce0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:52.606802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf96825-3779-4f76-b78d-cc27af52bce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:52.606802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf96825-3779-4f76-b78d-cc27af52bce0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:52.607550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf96825-3779-4f76-b78d-cc27af52bce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:52.607856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf96825-3779-4f76-b78d-cc27af52bce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:52.609222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf96825-3779-4f76-b78d-cc27af52bce0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:52.631304 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 551/1084] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:53.161118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0d42-7582-4b37-bb96-df8c7214ceca None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.161670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0d42-7582-4b37-bb96-df8c7214ceca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.162053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0d42-7582-4b37-bb96-df8c7214ceca None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.164829 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 534/1085] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:53.172878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb82e1-f46b-4d3f-9fbf-788e07dfe697 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.173324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb82e1-f46b-4d3f-9fbf-788e07dfe697 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.173450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb82e1-f46b-4d3f-9fbf-788e07dfe697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.190304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-38bb82e1-f46b-4d3f-9fbf-788e07dfe697 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:53.191556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38bb82e1-f46b-4d3f-9fbf-788e07dfe697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:53.265507 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 552/1086] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:53.289196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0d42-7582-4b37-bb96-df8c7214ceca None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:53.399102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0d42-7582-4b37-bb96-df8c7214ceca None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:53.434688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:53.435456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.435743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.436023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.447189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:53.455499 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:53.456594 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:53.458132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 535/1087] 10.222.0.98 () {56 vars in 1120 bytes} [Thu Jul 14 14:20:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:53.463617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb82e1-f46b-4d3f-9fbf-788e07dfe697 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:53.490555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:53.570931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb82e1-f46b-4d3f-9fbf-788e07dfe697 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:53.611883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:53.612634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.612845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.613176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.613875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:53.614184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:53.615628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:53.628995 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 553/1088] 10.222.0.98 () {56 vars in 1115 bytes} [Thu Jul 14 14:20:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:53.634877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:53.693686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:53.749774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba1e3f-c47b-4fd1-b619-33a8e60af66a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:53.785268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bf6b9-afa5-4090-9182-f6f5c17497a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:53.786064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bf6b9-afa5-4090-9182-f6f5c17497a0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.786379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bf6b9-afa5-4090-9182-f6f5c17497a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.786656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bf6b9-afa5-4090-9182-f6f5c17497a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.797553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bf6b9-afa5-4090-9182-f6f5c17497a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:53.799313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bf6b9-afa5-4090-9182-f6f5c17497a0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-be8bf6b9-afa5-4090-9182-f6f5c17497a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:53.820546 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:53.821572 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:53.823021 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:53.823021 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:53.823021 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:53.823021 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:53.823021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 536/1089] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:53.828445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:53.861163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946c583-24ce-438a-9fec-62539baef0fe None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.861460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946c583-24ce-438a-9fec-62539baef0fe None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.861745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946c583-24ce-438a-9fec-62539baef0fe None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.863126 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 537/1090] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:20:53.868686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef502b-acdd-4ff9-a547-3952dc230e7b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.868973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef502b-acdd-4ff9-a547-3952dc230e7b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.869258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef502b-acdd-4ff9-a547-3952dc230e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.886559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9aef502b-acdd-4ff9-a547-3952dc230e7b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:53.887801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9aef502b-acdd-4ff9-a547-3952dc230e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:53.922816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:53.938086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9804b07-7f90-401f-9e02-a20740cfe669 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:53.972197 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 538/1091] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:20:53.975893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:53.976571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:53.976861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:53.977147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:53.977881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:53.978197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:53.979610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:53.992247 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 554/1092] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:53.995173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef502b-acdd-4ff9-a547-3952dc230e7b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:53.998171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.025485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.105585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785e3e7-ac51-4437-ab65-b8759e392910 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.107646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef502b-acdd-4ff9-a547-3952dc230e7b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.142153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.142993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.143303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.143594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.145456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.146293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.146575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.146849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.151683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:54.153142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:54.157813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:20:54.165486 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:54.166865 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:20:54.167764 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 539/1093] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:20:54.168471 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:54.169324 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:54.170276 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 555/1094] 10.222.0.98 () {56 vars in 1093 bytes} [Thu Jul 14 14:20:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:54.173281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.174517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.183991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.275500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.285285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c042c-e435-4f49-b0da-611980f357ac None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.289177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fb63b-e8bc-4d28-b398-bf1428beeeab None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.323185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.323905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.324191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.324508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.325168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.325420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:54.325762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:54.325873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.326147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.326422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.327169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:54.327259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:54.327511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:54.328879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:54.338226 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 540/1095] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:54.343985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.347368 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 556/1096] 10.222.0.98 () {56 vars in 1133 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:54.355217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.427728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.463551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d689-52cf-4067-9a56-52699fb4156b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.470225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006f226-c9c7-442f-9253-6ef345ed74b7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.502115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.503183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.503631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.503921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] PATH_INFO: `/v3/users/69a4b495a35840188e4834c9c92b7516` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.505928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] RBAC: Authorizing `identity:get_user(user_id=69a4b495a35840188e4834c9c92b7516)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:54.507170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.507439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:54.507864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.508148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.508426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.509309 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 541/1097] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/users/69a4b495a35840188e4834c9c92b7516 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:54.514870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.535492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.582477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:54.584541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:54.626342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac09a01-bcbf-4338-896f-a52df4c12c3e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.650980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.661482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.662140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.662422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.662697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.691942 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 557/1098] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 14:20:54.698171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.740910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:54.742381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:54.762184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.808819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e692deb-c17a-4d94-85dc-f8ab4fa3c5ef None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.845009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:54.845679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:54.845963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:54.846354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:54.850328 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 542/1099] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 14:20:54.856164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.856953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:54.858407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:20:54.878143 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:54.879454 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:54.881151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:20:54.881151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:20:54.881151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:20:54.881151 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:54.881151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 558/1100] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:20:54.885545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:54.903667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.966376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8dbeb-c98b-4bd7-9239-b89f70b6c565 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:54.986302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:54.995107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096c1a-562c-4296-b9f1-de5d18a90050 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:55.007129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:55.008730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:55.009262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:55.009822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:55.011960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] RBAC: Authorizing `identity:get_project(project_id=adccaad9264d433ea0ff5b064697d378)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:55.014753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:55.018478 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 543/1101] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/projects/adccaad9264d433ea0ff5b064697d378 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:55.024596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:55.031623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:55.032293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:55.032576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:55.032849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:55.033572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:55.033877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:55.035327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:55.048471 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 559/1102] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:55.054459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:55.130505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cbe61-bc99-4a65-8909-e1efe51f5f22 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:55.142388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:55.168839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedadef1-517c-4ad7-85e1-9e3ca8c3dd62 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:55.175612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:55.176276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:55.176565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:55.176861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:55.177698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=adccaad9264d433ea0ff5b064697d378, user.id=69a4b495a35840188e4834c9c92b7516) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:55.178011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:55.179496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:55.186303 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 544/1103] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:55 2022] GET /identity/v3/role_assignments?user.id=69a4b495a35840188e4834c9c92b7516&scope.project.id=adccaad9264d433ea0ff5b064697d378&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:55.216621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:55.217453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:55.217739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:55.218156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:55.226751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:55.228304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:20:55.246481 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:20:55.247669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:20:55.248663 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 560/1104] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:20:55.254492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:55.315603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:55.371921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef32790-e529-469d-9db8-e4876a14db0b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:55.418704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebf20f-3e4a-4d1e-acd1-a7f596687f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:55.419593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebf20f-3e4a-4d1e-acd1-a7f596687f8a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:55.419971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebf20f-3e4a-4d1e-acd1-a7f596687f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:55.420338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebf20f-3e4a-4d1e-acd1-a7f596687f8a None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:55.421229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebf20f-3e4a-4d1e-acd1-a7f596687f8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:55.421637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebf20f-3e4a-4d1e-acd1-a7f596687f8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:55.423185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebf20f-3e4a-4d1e-acd1-a7f596687f8a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:55.436976 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 545/1105] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:20:55.443780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:55.553744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d69043-078b-4e0a-bf2f-c83f0bfa617b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:55.592175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc0022-3c13-4d5c-b8e5-fbf8157dcc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:55.592835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc0022-3c13-4d5c-b8e5-fbf8157dcc08 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:55.593115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc0022-3c13-4d5c-b8e5-fbf8157dcc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:55.593391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc0022-3c13-4d5c-b8e5-fbf8157dcc08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:55.594235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc0022-3c13-4d5c-b8e5-fbf8157dcc08 None admin] RBAC: Adding query filter params (role.id=fd27043fdadb4fa89a4e37a8f574ca70, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=eecb3bcddba54aca9316af7a0ec3b923) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:20:55.594549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc0022-3c13-4d5c-b8e5-fbf8157dcc08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:55.596070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc0022-3c13-4d5c-b8e5-fbf8157dcc08 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:55.599320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:55.603767 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 561/1106] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:20:55 2022] GET /identity/v3/role_assignments?user.id=eecb3bcddba54aca9316af7a0ec3b923&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=fd27043fdadb4fa89a4e37a8f574ca70 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:57.288255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b036c-bb8c-46ad-a8be-0b6bc34cfb15 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:57.288846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b036c-bb8c-46ad-a8be-0b6bc34cfb15 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:57.288846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b036c-bb8c-46ad-a8be-0b6bc34cfb15 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:57.290208 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 546/1107] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:57.295361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb240-bd46-4f87-b16d-4ba14bca2288 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:57.295789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb240-bd46-4f87-b16d-4ba14bca2288 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:57.295908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb240-bd46-4f87-b16d-4ba14bca2288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:57.312897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3b1bb240-bd46-4f87-b16d-4ba14bca2288 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:57.314135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b1bb240-bd46-4f87-b16d-4ba14bca2288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:57.381837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 562/1108] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:57.406675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b036c-bb8c-46ad-a8be-0b6bc34cfb15 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:57.506368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b036c-bb8c-46ad-a8be-0b6bc34cfb15 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:57.516956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:57.540482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437082a9-d002-4432-ad94-f2f7f597862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:57.541270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437082a9-d002-4432-ad94-f2f7f597862a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:57.541550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437082a9-d002-4432-ad94-f2f7f597862a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:57.541821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437082a9-d002-4432-ad94-f2f7f597862a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:57.542972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437082a9-d002-4432-ad94-f2f7f597862a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:57.544444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437082a9-d002-4432-ad94-f2f7f597862a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:57.546055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 547/1109] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:20:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:20:57.551795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb240-bd46-4f87-b16d-4ba14bca2288 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:57.653350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb240-bd46-4f87-b16d-4ba14bca2288 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:20:57.682624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:20:57.690001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c221006-fac0-46c6-82e3-19816bf525ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:20:57.690752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221006-fac0-46c6-82e3-19816bf525ec None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:57.691062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221006-fac0-46c6-82e3-19816bf525ec None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:57.691395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221006-fac0-46c6-82e3-19816bf525ec None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:57.692144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c221006-fac0-46c6-82e3-19816bf525ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:20:57.693742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c221006-fac0-46c6-82e3-19816bf525ec None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:20:57.714119 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 563/1110] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:20:57 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:20:59.779544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b09a-0067-4735-92a6-c20880e9a6a8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:59.780111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b09a-0067-4735-92a6-c20880e9a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:59.780111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b09a-0067-4735-92a6-c20880e9a6a8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:59.781477 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 548/1111] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:20:59.787173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5ad6-625b-4536-a278-d96ba8f686b9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:20:59.787607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5ad6-625b-4536-a278-d96ba8f686b9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:20:59.787761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5ad6-625b-4536-a278-d96ba8f686b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:20:59.804543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e4ba5ad6-625b-4536-a278-d96ba8f686b9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:20:59.805709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4ba5ad6-625b-4536-a278-d96ba8f686b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:20:59.869491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 564/1112] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:20:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:20:59.892505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2b09a-0067-4735-92a6-c20880e9a6a8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:20:59.993110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2b09a-0067-4735-92a6-c20880e9a6a8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:00.026914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:00.027783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:00.028067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:00.028341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] PATH_INFO: `/v3/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:00.029870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] RBAC: Authorizing `identity:get_role(role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:00.031189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:00.032582 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 549/1113] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:20:59 2022] GET /identity/v3/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:00.038370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba5ad6-625b-4536-a278-d96ba8f686b9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:00.135320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba5ad6-625b-4536-a278-d96ba8f686b9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:00.151158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:00.169270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:00.170142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:00.170429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:00.170711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] PATH_INFO: `/v3/users/42d745bb8b634e898db1121c1b80f386` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:00.184191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] RBAC: Authorizing `identity:get_user(user_id=42d745bb8b634e898db1121c1b80f386)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:00.185670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:00.187379 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 565/1114] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:00 2022] GET /identity/v3/users/42d745bb8b634e898db1121c1b80f386 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:00.193669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:00.239042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:00.294850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e088-9eae-4045-94d8-99a5f2b9dcd7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:00.329211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:00.329860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:00.330149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:00.330433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:00.396004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:00.397450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:00.441357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:00.495352 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 550/1115] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:21:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:21:00.501301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:00.605749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c886-0833-44f6-bc61-b7eb13a16597 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:00.639386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704d89-481e-4305-9e55-58e6f513088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:00.640249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704d89-481e-4305-9e55-58e6f513088c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:00.640533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704d89-481e-4305-9e55-58e6f513088c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:00.640817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704d89-481e-4305-9e55-58e6f513088c None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:00.641999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704d89-481e-4305-9e55-58e6f513088c None admin] RBAC: Authorizing `identity:get_project(project_id=adccaad9264d433ea0ff5b064697d378)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:00.643466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704d89-481e-4305-9e55-58e6f513088c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:00.645171 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 566/1116] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:00 2022] GET /identity/v3/projects/adccaad9264d433ea0ff5b064697d378 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:00.651214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:00.753217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90205a35-edda-4ebf-a94f-dc1c546332c2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:00.785412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e94dd-e92a-470b-8390-b56ec8ea429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:00.786551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e94dd-e92a-470b-8390-b56ec8ea429b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:00.786833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e94dd-e92a-470b-8390-b56ec8ea429b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:00.787109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e94dd-e92a-470b-8390-b56ec8ea429b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:00.788163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e94dd-e92a-470b-8390-b56ec8ea429b None admin] RBAC: Adding query filter params (role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=adccaad9264d433ea0ff5b064697d378, user.id=42d745bb8b634e898db1121c1b80f386) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:00.788477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e94dd-e92a-470b-8390-b56ec8ea429b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:00.789902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e94dd-e92a-470b-8390-b56ec8ea429b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:00.795400 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 551/1117] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:21:00 2022] GET /identity/v3/role_assignments?user.id=42d745bb8b634e898db1121c1b80f386&scope.project.id=adccaad9264d433ea0ff5b064697d378&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:02.782758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638a766-3ec6-417c-9277-5a7cad0b1266 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:02.783343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638a766-3ec6-417c-9277-5a7cad0b1266 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:02.783343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638a766-3ec6-417c-9277-5a7cad0b1266 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:02.784716 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 567/1118] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:02.789924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f70a29-d8b9-4533-b463-00445526a962 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:02.790343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f70a29-d8b9-4533-b463-00445526a962 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:02.790484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f70a29-d8b9-4533-b463-00445526a962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:02.806852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-81f70a29-d8b9-4533-b463-00445526a962 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:02.808138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81f70a29-d8b9-4533-b463-00445526a962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:02.810858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:02.873522 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 552/1119] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:02.897071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638a766-3ec6-417c-9277-5a7cad0b1266 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:02.939212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:02.994689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638a766-3ec6-417c-9277-5a7cad0b1266 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:03.028921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:03.029773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:03.030061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:03.030342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] PATH_INFO: `/v3/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:03.031855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] RBAC: Authorizing `identity:get_role(role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:03.033280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:03.034604 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 568/1120] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:02 2022] GET /identity/v3/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:03.040425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f70a29-d8b9-4533-b463-00445526a962 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:03.148652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f70a29-d8b9-4533-b463-00445526a962 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:03.182934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:03.183829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:03.184117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:03.184395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] PATH_INFO: `/v3/users/42d745bb8b634e898db1121c1b80f386` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:03.185568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] RBAC: Authorizing `identity:get_user(user_id=42d745bb8b634e898db1121c1b80f386)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:03.186996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:03.188673 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 553/1121] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:03 2022] GET /identity/v3/users/42d745bb8b634e898db1121c1b80f386 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:03.195222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:03.296062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e58e-ce08-4d9f-bb63-2c86aaf399fb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:03.306756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:03.330570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8d4b5-9002-4c5c-97d2-e168a21791ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:03.331453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8d4b5-9002-4c5c-97d2-e168a21791ef None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:03.331737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8d4b5-9002-4c5c-97d2-e168a21791ef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:03.332010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8d4b5-9002-4c5c-97d2-e168a21791ef None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:03.333192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8d4b5-9002-4c5c-97d2-e168a21791ef None admin] RBAC: Authorizing `identity:get_project(project_id=adccaad9264d433ea0ff5b064697d378)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:03.334610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8d4b5-9002-4c5c-97d2-e168a21791ef None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:03.336574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 569/1122] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:03 2022] GET /identity/v3/projects/adccaad9264d433ea0ff5b064697d378 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:03.342658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:03.353280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:03.440079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de72bb-5ff6-4fa9-9471-8ed16ae06880 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:03.472509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91330d-0493-4eb3-afe0-773768c93cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:03.473895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91330d-0493-4eb3-afe0-773768c93cfc None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:03.474177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91330d-0493-4eb3-afe0-773768c93cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:03.474453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91330d-0493-4eb3-afe0-773768c93cfc None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378/users/42d745bb8b634e898db1121c1b80f386/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:03.476676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91330d-0493-4eb3-afe0-773768c93cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=adccaad9264d433ea0ff5b064697d378, user_id=42d745bb8b634e898db1121c1b80f386, role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:03.478099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91330d-0493-4eb3-afe0-773768c93cfc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:03.491326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 554/1123] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:21:03 2022] PUT /identity/v3/projects/adccaad9264d433ea0ff5b064697d378/users/42d745bb8b634e898db1121c1b80f386/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:21:05.516356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6186f8-600f-4c09-b81a-61850cc87fec None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:05.516854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6186f8-600f-4c09-b81a-61850cc87fec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:05.516854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6186f8-600f-4c09-b81a-61850cc87fec None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:05.518199 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 570/1124] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:05.523445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33874a-e467-4c25-a4bf-576b9b6168ed None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:05.523959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33874a-e467-4c25-a4bf-576b9b6168ed None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:05.524075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33874a-e467-4c25-a4bf-576b9b6168ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:05.540918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1f33874a-e467-4c25-a4bf-576b9b6168ed None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:05.542102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1f33874a-e467-4c25-a4bf-576b9b6168ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:05.604466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:05.611100 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 555/1125] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:05.637137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6186f8-600f-4c09-b81a-61850cc87fec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:05.737700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6186f8-600f-4c09-b81a-61850cc87fec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:05.771042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:05.771980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:05.772263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:05.772541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] PATH_INFO: `/v3/roles/d238afd4fe584fb0a5c86c10d1775cf0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:05.773989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] RBAC: Authorizing `identity:get_role(role_id=d238afd4fe584fb0a5c86c10d1775cf0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:05.775381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:05.776733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 571/1126] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:05 2022] GET /identity/v3/roles/d238afd4fe584fb0a5c86c10d1775cf0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:05.782570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33874a-e467-4c25-a4bf-576b9b6168ed None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:05.878408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33874a-e467-4c25-a4bf-576b9b6168ed None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:05.911446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:05.912305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:05.912583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:05.912854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] PATH_INFO: `/v3/users/42d745bb8b634e898db1121c1b80f386` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:05.914024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] RBAC: Authorizing `identity:get_user(user_id=42d745bb8b634e898db1121c1b80f386)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:05.915473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:05.917073 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 556/1127] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:05 2022] GET /identity/v3/users/42d745bb8b634e898db1121c1b80f386 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:05.922810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:05.968923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:06.019810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b515d9-f895-49ea-822b-d0361c1c583a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:06.053555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:06.054135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:06.054421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:06.054700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:06.119288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:06.120738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:06.163450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:06.216771 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 572/1128] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:21:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:21:06.222773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:06.288522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:06.323998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b0a4-5c3a-4653-a646-e6af102ab22e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:06.356538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8271-3e4f-4773-9b29-38cbf8930c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:06.357379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8271-3e4f-4773-9b29-38cbf8930c88 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:06.357666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8271-3e4f-4773-9b29-38cbf8930c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:06.357944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8271-3e4f-4773-9b29-38cbf8930c88 None admin] PATH_INFO: `/v3/projects/adccaad9264d433ea0ff5b064697d378` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:06.359110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8271-3e4f-4773-9b29-38cbf8930c88 None admin] RBAC: Authorizing `identity:get_project(project_id=adccaad9264d433ea0ff5b064697d378)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:06.360575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8271-3e4f-4773-9b29-38cbf8930c88 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:06.362265 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 557/1129] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:06 2022] GET /identity/v3/projects/adccaad9264d433ea0ff5b064697d378 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:06.368933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:06.464564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055004b-0a22-4ea1-8c67-0dedf04d66a7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:06.498335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c2946-c2dd-4a6d-b2ed-85c9415c135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:06.498999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c2946-c2dd-4a6d-b2ed-85c9415c135b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:06.499303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c2946-c2dd-4a6d-b2ed-85c9415c135b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:06.499591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c2946-c2dd-4a6d-b2ed-85c9415c135b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:06.500428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c2946-c2dd-4a6d-b2ed-85c9415c135b None admin] RBAC: Adding query filter params (role.id=d238afd4fe584fb0a5c86c10d1775cf0, scope.project.id=adccaad9264d433ea0ff5b064697d378, user.id=42d745bb8b634e898db1121c1b80f386) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:06.500745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c2946-c2dd-4a6d-b2ed-85c9415c135b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:06.502186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c2946-c2dd-4a6d-b2ed-85c9415c135b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:06.508119 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 573/1130] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:21:06 2022] GET /identity/v3/role_assignments?user.id=42d745bb8b634e898db1121c1b80f386&scope.project.id=adccaad9264d433ea0ff5b064697d378&role.id=d238afd4fe584fb0a5c86c10d1775cf0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:08.543747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826e92-c816-4418-a124-32896300eaa1 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:08.544282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826e92-c816-4418-a124-32896300eaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:08.544282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826e92-c816-4418-a124-32896300eaa1 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:08.545581 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 558/1131] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:08.550851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc80fe9-1a88-4464-8165-ebee303383c6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:08.551814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc80fe9-1a88-4464-8165-ebee303383c6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:08.552108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc80fe9-1a88-4464-8165-ebee303383c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:08.569074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6bc80fe9-1a88-4464-8165-ebee303383c6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:08.570239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bc80fe9-1a88-4464-8165-ebee303383c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:08.572938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:08.638275 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 574/1132] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:08.662908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89826e92-c816-4418-a124-32896300eaa1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:08.762892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89826e92-c816-4418-a124-32896300eaa1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:08.796643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d3f34-0ad2-45c0-9e2f-9191c7cb82f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:08.797362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3f34-0ad2-45c0-9e2f-9191c7cb82f7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:08.797647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3f34-0ad2-45c0-9e2f-9191c7cb82f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:08.797923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3f34-0ad2-45c0-9e2f-9191c7cb82f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:08.799086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d3f34-0ad2-45c0-9e2f-9191c7cb82f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:08.800553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d3f34-0ad2-45c0-9e2f-9191c7cb82f7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:08.802812 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 559/1133] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:21:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:08.808780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc80fe9-1a88-4464-8165-ebee303383c6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:08.905636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc80fe9-1a88-4464-8165-ebee303383c6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:08.939535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083dd7-a197-43f0-a5e7-3fe945636107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:08.940194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083dd7-a197-43f0-a5e7-3fe945636107 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:08.940486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083dd7-a197-43f0-a5e7-3fe945636107 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:08.940771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083dd7-a197-43f0-a5e7-3fe945636107 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:08.941469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083dd7-a197-43f0-a5e7-3fe945636107 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:08.942964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083dd7-a197-43f0-a5e7-3fe945636107 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:08.952471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:08.968634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 575/1134] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:21:08 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:21:11.012494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437ab4-247c-4a58-97b0-d9a5a5bd2068 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:11.013078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437ab4-247c-4a58-97b0-d9a5a5bd2068 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:11.013078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437ab4-247c-4a58-97b0-d9a5a5bd2068 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:11.014408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 560/1135] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:11.019572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b61d5-7549-4cb3-9cfa-34f9b543373f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:11.020033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b61d5-7549-4cb3-9cfa-34f9b543373f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:11.020240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b61d5-7549-4cb3-9cfa-34f9b543373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:11.037356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d75b61d5-7549-4cb3-9cfa-34f9b543373f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:11.038540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d75b61d5-7549-4cb3-9cfa-34f9b543373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:11.102808 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 576/1136] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:11.126719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15437ab4-247c-4a58-97b0-d9a5a5bd2068 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:11.130186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:11.227412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15437ab4-247c-4a58-97b0-d9a5a5bd2068 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:11.263151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000742f-ec30-448f-8f7d-80756636f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:11.263896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000742f-ec30-448f-8f7d-80756636f64d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:11.264178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000742f-ec30-448f-8f7d-80756636f64d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:11.264450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000742f-ec30-448f-8f7d-80756636f64d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:11.266039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000742f-ec30-448f-8f7d-80756636f64d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:11.267041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000742f-ec30-448f-8f7d-80756636f64d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:11.268839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 561/1137] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:21:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:11.275324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b61d5-7549-4cb3-9cfa-34f9b543373f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:11.372741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b61d5-7549-4cb3-9cfa-34f9b543373f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:11.394227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:11.406566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41918-5cf6-4103-b0b7-7478f6840d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:11.407230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41918-5cf6-4103-b0b7-7478f6840d6e None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:11.407547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41918-5cf6-4103-b0b7-7478f6840d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:11.407829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41918-5cf6-4103-b0b7-7478f6840d6e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:11.408529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b41918-5cf6-4103-b0b7-7478f6840d6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:11.409960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b41918-5cf6-4103-b0b7-7478f6840d6e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:11.429666 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 577/1138] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:21:11 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:21:13.500521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379affab-dfab-417c-bb6e-ff474d881412 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:13.501084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379affab-dfab-417c-bb6e-ff474d881412 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:13.501084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379affab-dfab-417c-bb6e-ff474d881412 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:13.502589 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 562/1139] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:13.508596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44479b-701b-4ea5-b451-1c019db39613 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:13.509030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44479b-701b-4ea5-b451-1c019db39613 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:13.509174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44479b-701b-4ea5-b451-1c019db39613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:13.526309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ea44479b-701b-4ea5-b451-1c019db39613 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:13.527459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ea44479b-701b-4ea5-b451-1c019db39613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:13.594581 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 578/1140] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:13.618182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379affab-dfab-417c-bb6e-ff474d881412 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:13.686604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:13.718646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379affab-dfab-417c-bb6e-ff474d881412 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:13.751744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:13.752533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:13.752818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:13.753097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:13.763633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:21:13.771213 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:21:13.772360 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:21:13.773249 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 563/1141] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:21:13.778800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44479b-701b-4ea5-b451-1c019db39613 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:13.880050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44479b-701b-4ea5-b451-1c019db39613 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:13.888928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:13.914238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:13.914904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:13.915192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:13.915512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:13.916260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:13.916569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:13.917956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:13.925936 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 579/1142] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:21:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:13.932252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:14.029277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36544c04-d365-4049-a6a5-917b680b8e17 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:14.056919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:14.062607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:14.063494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:14.063779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:14.064054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] PATH_INFO: `/v3/users/69bc1da301cc42c7a52aecad270b0283` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:14.076875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] RBAC: Authorizing `identity:get_user(user_id=69bc1da301cc42c7a52aecad270b0283)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:14.078341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:14.080003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 564/1143] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:13 2022] GET /identity/v3/users/69bc1da301cc42c7a52aecad270b0283 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:14.086136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:14.185440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0cbc2-79b7-4b99-be85-6b9a27513da8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:14.218976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:14.219824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:14.219934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:14.220427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:14.258909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:14.288743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:14.290127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:14.385349 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 580/1144] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:21:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:21:14.391207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:14.490982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f6d6-849a-49f4-ba7d-e6d3e2049e7f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:14.524745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5452-41b2-473b-a108-ac71948e1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:14.525606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5452-41b2-473b-a108-ac71948e1bef None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:14.525893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5452-41b2-473b-a108-ac71948e1bef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:14.526171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5452-41b2-473b-a108-ac71948e1bef None admin] PATH_INFO: `/v3/projects/7265d49c35c54b39a01b837b4ed20ab1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:14.527411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d5452-41b2-473b-a108-ac71948e1bef None admin] RBAC: Authorizing `identity:get_project(project_id=7265d49c35c54b39a01b837b4ed20ab1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:14.528795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d5452-41b2-473b-a108-ac71948e1bef None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:14.530492 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 565/1145] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:14 2022] GET /identity/v3/projects/7265d49c35c54b39a01b837b4ed20ab1 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:14.537276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:14.607699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:14.640238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03886-1f19-4184-a0fc-dfe0332ac710 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:14.687219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97cfef-d98c-4d3f-8b91-9c154bc59110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:14.687901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cfef-d98c-4d3f-8b91-9c154bc59110 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:14.688182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cfef-d98c-4d3f-8b91-9c154bc59110 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:14.688459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cfef-d98c-4d3f-8b91-9c154bc59110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:14.689284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97cfef-d98c-4d3f-8b91-9c154bc59110 None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=7265d49c35c54b39a01b837b4ed20ab1, user.id=69bc1da301cc42c7a52aecad270b0283) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:14.689595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97cfef-d98c-4d3f-8b91-9c154bc59110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:14.691061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97cfef-d98c-4d3f-8b91-9c154bc59110 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:14.696870 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 581/1146] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:21:14 2022] GET /identity/v3/role_assignments?user.id=69bc1da301cc42c7a52aecad270b0283&scope.project.id=7265d49c35c54b39a01b837b4ed20ab1&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:16.687392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d799a1-3b60-4bf3-b264-d8a3c3075bf3 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:16.687957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d799a1-3b60-4bf3-b264-d8a3c3075bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:16.687957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d799a1-3b60-4bf3-b264-d8a3c3075bf3 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:16.689353 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 566/1147] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:16.694590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc3cd9-8f1f-47b2-96f6-b2b07e98e82b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:16.694999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc3cd9-8f1f-47b2-96f6-b2b07e98e82b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:16.695149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc3cd9-8f1f-47b2-96f6-b2b07e98e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:16.712188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-25cc3cd9-8f1f-47b2-96f6-b2b07e98e82b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:16.713375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25cc3cd9-8f1f-47b2-96f6-b2b07e98e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:16.779958 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 582/1148] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:16.802637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d799a1-3b60-4bf3-b264-d8a3c3075bf3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:16.858818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:16.902926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d799a1-3b60-4bf3-b264-d8a3c3075bf3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:16.936259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:16.937053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:16.937336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:16.937663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:16.948064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:21:16.955633 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:21:16.956730 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:21:16.958606 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 567/1149] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:21:16.963710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc3cd9-8f1f-47b2-96f6-b2b07e98e82b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:17.024955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:17.062215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc3cd9-8f1f-47b2-96f6-b2b07e98e82b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:17.095705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:17.096364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:17.096646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:17.096922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:17.097657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:17.098006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:17.099391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:17.107248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 583/1150] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:17.112937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:17.211114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807ae70-f6b4-45aa-8a28-5a38206b0906 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:17.226642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:17.244567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:17.245438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:17.245718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:17.245992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] PATH_INFO: `/v3/users/69bc1da301cc42c7a52aecad270b0283` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:17.247183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] RBAC: Authorizing `identity:get_user(user_id=69bc1da301cc42c7a52aecad270b0283)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:17.248640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:17.250251 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 568/1151] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:17 2022] GET /identity/v3/users/69bc1da301cc42c7a52aecad270b0283 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:17.256448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:17.353514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bc78-6f3d-43b3-b943-c2b0d40c2331 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:17.377750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:17.387106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ec396-69c8-4a3f-ab82-3a415ceaab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:17.387995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec396-69c8-4a3f-ab82-3a415ceaab05 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:17.388278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec396-69c8-4a3f-ab82-3a415ceaab05 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:17.388554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec396-69c8-4a3f-ab82-3a415ceaab05 None admin] PATH_INFO: `/v3/projects/7265d49c35c54b39a01b837b4ed20ab1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:17.389710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ec396-69c8-4a3f-ab82-3a415ceaab05 None admin] RBAC: Authorizing `identity:get_project(project_id=7265d49c35c54b39a01b837b4ed20ab1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:17.391139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ec396-69c8-4a3f-ab82-3a415ceaab05 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:17.392837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 584/1152] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:17 2022] GET /identity/v3/projects/7265d49c35c54b39a01b837b4ed20ab1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:17.398838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:17.496021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df902fc-531e-40be-bd1b-7f9084a2bfe1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:17.528441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c104d-4993-4f12-8911-d59b1d829a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:17.529320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c104d-4993-4f12-8911-d59b1d829a05 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:17.529603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c104d-4993-4f12-8911-d59b1d829a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:17.529875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c104d-4993-4f12-8911-d59b1d829a05 None admin] PATH_INFO: `/v3/projects/7265d49c35c54b39a01b837b4ed20ab1/users/69bc1da301cc42c7a52aecad270b0283/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:17.531824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c104d-4993-4f12-8911-d59b1d829a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=7265d49c35c54b39a01b837b4ed20ab1, user_id=69bc1da301cc42c7a52aecad270b0283, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:17.533249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c104d-4993-4f12-8911-d59b1d829a05 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:17.545857 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 569/1153] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:21:17 2022] PUT /identity/v3/projects/7265d49c35c54b39a01b837b4ed20ab1/users/69bc1da301cc42c7a52aecad270b0283/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:21:19.545384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c670d91-aa61-44de-b6aa-c8854ef26171 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:19.545883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c670d91-aa61-44de-b6aa-c8854ef26171 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:19.545883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c670d91-aa61-44de-b6aa-c8854ef26171 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:19.547227 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 585/1154] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:19.552935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad8c9-d6ba-4537-95f0-f497ed93d6d2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:19.553320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad8c9-d6ba-4537-95f0-f497ed93d6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:19.553500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad8c9-d6ba-4537-95f0-f497ed93d6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:19.569923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f21ad8c9-d6ba-4537-95f0-f497ed93d6d2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:19.571100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f21ad8c9-d6ba-4537-95f0-f497ed93d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:19.611814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:19.639072 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 570/1155] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:19.663437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c670d91-aa61-44de-b6aa-c8854ef26171 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:19.762204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c670d91-aa61-44de-b6aa-c8854ef26171 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:19.795594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:19.796318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:19.796603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:19.796883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:19.806706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:21:19.814347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:21:19.815458 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:21:19.816549 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 586/1156] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:21:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:21:19.821516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad8c9-d6ba-4537-95f0-f497ed93d6d2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:19.916880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad8c9-d6ba-4537-95f0-f497ed93d6d2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:19.949656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:19.950314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:19.950600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:19.950878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:19.951648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:19.951957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:19.953322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:19.962017 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 571/1157] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:19.967673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:20.022186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:20.065407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ba58-deae-4d59-b79b-f6bf641d2616 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:20.098206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:20.099064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:20.099371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:20.099648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] PATH_INFO: `/v3/users/69bc1da301cc42c7a52aecad270b0283` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:20.100820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] RBAC: Authorizing `identity:get_user(user_id=69bc1da301cc42c7a52aecad270b0283)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:20.102240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:20.103872 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 587/1158] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:19 2022] GET /identity/v3/users/69bc1da301cc42c7a52aecad270b0283 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:20.109581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:20.144220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:20.208162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848a880-c9dd-408d-875c-abdd90374350 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:20.240737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:20.241397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:20.241682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:20.241965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:20.322174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:20.323590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:20.355230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:20.418855 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 572/1159] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:21:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:21:20.424806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:20.523594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e572fc3-8a8e-438d-85a5-478421d77ccf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:20.545473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:20.557985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792ac9f-e855-4a19-98e9-de0be4a613f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:20.558851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792ac9f-e855-4a19-98e9-de0be4a613f2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:20.559130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792ac9f-e855-4a19-98e9-de0be4a613f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:20.559455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792ac9f-e855-4a19-98e9-de0be4a613f2 None admin] PATH_INFO: `/v3/projects/7265d49c35c54b39a01b837b4ed20ab1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:20.560618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792ac9f-e855-4a19-98e9-de0be4a613f2 None admin] RBAC: Authorizing `identity:get_project(project_id=7265d49c35c54b39a01b837b4ed20ab1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:20.562065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792ac9f-e855-4a19-98e9-de0be4a613f2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:20.563789 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 588/1160] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:20 2022] GET /identity/v3/projects/7265d49c35c54b39a01b837b4ed20ab1 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:20.570416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:20.670393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940bb10-326f-4c89-ba24-7ed788c70a3c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:20.705146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d863a91-1a4d-4dae-a0c7-98767df8eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:20.705803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d863a91-1a4d-4dae-a0c7-98767df8eba9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:20.706092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d863a91-1a4d-4dae-a0c7-98767df8eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:20.706376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d863a91-1a4d-4dae-a0c7-98767df8eba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:20.707425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d863a91-1a4d-4dae-a0c7-98767df8eba9 None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=7265d49c35c54b39a01b837b4ed20ab1, user.id=69bc1da301cc42c7a52aecad270b0283) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:20.707604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d863a91-1a4d-4dae-a0c7-98767df8eba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:20.709059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d863a91-1a4d-4dae-a0c7-98767df8eba9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:20.712433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:20.716398 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 573/1161] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:21:20 2022] GET /identity/v3/role_assignments?user.id=69bc1da301cc42c7a52aecad270b0283&scope.project.id=7265d49c35c54b39a01b837b4ed20ab1&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:22.764178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883273e-2e31-40f7-ace1-97178d623b80 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:22.764737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883273e-2e31-40f7-ace1-97178d623b80 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:22.764737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883273e-2e31-40f7-ace1-97178d623b80 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:22.766094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 589/1162] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:22.771410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859cc5-b9a1-494e-99df-e967843fa3de None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:22.771832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859cc5-b9a1-494e-99df-e967843fa3de None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:22.771923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859cc5-b9a1-494e-99df-e967843fa3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:22.788524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8c859cc5-b9a1-494e-99df-e967843fa3de None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:22.789704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c859cc5-b9a1-494e-99df-e967843fa3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:22.854764 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 574/1163] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:22.877106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883273e-2e31-40f7-ace1-97178d623b80 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:22.975986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883273e-2e31-40f7-ace1-97178d623b80 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:23.008219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:23.008855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:23.009137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:23.009412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:23.063933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:23.074961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:23.076458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:23.171366 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 590/1164] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:21:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:21:23.177929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859cc5-b9a1-494e-99df-e967843fa3de None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:23.277490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859cc5-b9a1-494e-99df-e967843fa3de None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:23.305876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:23.311761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c59fec-07cd-4de8-a238-1322d42c7dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:23.312567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c59fec-07cd-4de8-a238-1322d42c7dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:23.312852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c59fec-07cd-4de8-a238-1322d42c7dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:23.313133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c59fec-07cd-4de8-a238-1322d42c7dc0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:23.319799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c59fec-07cd-4de8-a238-1322d42c7dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:23.321187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c59fec-07cd-4de8-a238-1322d42c7dc0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-42c59fec-07cd-4de8-a238-1322d42c7dc0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:21:23.335725 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:21:23.336905 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:21:23.338101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 575/1165] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:21:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:21:23.342858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:23.429081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:23.438808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20892fb-d27e-431f-9cd6-cb27b323e927 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:23.472781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07bba6-b2f5-41e4-90c3-1d03bf7e22c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:23.473429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07bba6-b2f5-41e4-90c3-1d03bf7e22c9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:23.474333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07bba6-b2f5-41e4-90c3-1d03bf7e22c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:23.474611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07bba6-b2f5-41e4-90c3-1d03bf7e22c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:23.475350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07bba6-b2f5-41e4-90c3-1d03bf7e22c9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:23.475657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07bba6-b2f5-41e4-90c3-1d03bf7e22c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:23.477013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07bba6-b2f5-41e4-90c3-1d03bf7e22c9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:23.484068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 591/1166] 10.222.0.98 () {56 vars in 1115 bytes} [Thu Jul 14 14:21:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:25.474491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee59de-e564-4352-95fc-2a88da14948c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:25.475036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee59de-e564-4352-95fc-2a88da14948c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:25.475036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee59de-e564-4352-95fc-2a88da14948c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:25.476457 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 576/1167] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:25.481670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955edc-0620-4c1f-af9a-6bd7f884716e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:25.482067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955edc-0620-4c1f-af9a-6bd7f884716e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:25.482236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955edc-0620-4c1f-af9a-6bd7f884716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:25.499333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9d955edc-0620-4c1f-af9a-6bd7f884716e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:25.500581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d955edc-0620-4c1f-af9a-6bd7f884716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:25.566771 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 592/1168] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:25.590005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee59de-e564-4352-95fc-2a88da14948c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:25.690635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee59de-e564-4352-95fc-2a88da14948c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:25.733968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4addb5-311b-45ea-8d4f-bf736375d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:25.734629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4addb5-311b-45ea-8d4f-bf736375d562 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:25.734917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4addb5-311b-45ea-8d4f-bf736375d562 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:25.735198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4addb5-311b-45ea-8d4f-bf736375d562 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:25.735971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4addb5-311b-45ea-8d4f-bf736375d562 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:25.737341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4addb5-311b-45ea-8d4f-bf736375d562 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:25.752106 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 577/1169] 10.222.0.98 () {60 vars in 1138 bytes} [Thu Jul 14 14:21:25 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:21:27.787165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abd7ba-14aa-492e-a2fd-1cb4dd6da87a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:27.787819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abd7ba-14aa-492e-a2fd-1cb4dd6da87a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:27.787934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abd7ba-14aa-492e-a2fd-1cb4dd6da87a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:27.789269 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 593/1170] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:27.794283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e9ee-00ab-4e49-aeca-33efbaa9db9c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:27.794681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e9ee-00ab-4e49-aeca-33efbaa9db9c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:27.794840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e9ee-00ab-4e49-aeca-33efbaa9db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:27.811223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7ca3e9ee-00ab-4e49-aeca-33efbaa9db9c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:27.812425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ca3e9ee-00ab-4e49-aeca-33efbaa9db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:27.858558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:27.879259 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 578/1171] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:21:27.903041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abd7ba-14aa-492e-a2fd-1cb4dd6da87a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:27.985774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:28.002535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abd7ba-14aa-492e-a2fd-1cb4dd6da87a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:28.035230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213c9ba-4685-4533-a4e5-9314f8681893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:28.036748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213c9ba-4685-4533-a4e5-9314f8681893 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:28.037025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213c9ba-4685-4533-a4e5-9314f8681893 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:28.037352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213c9ba-4685-4533-a4e5-9314f8681893 None admin] PATH_INFO: `/v3/domains/4e79b0849350404cb24aa49316f27c9a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:28.047362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213c9ba-4685-4533-a4e5-9314f8681893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e79b0849350404cb24aa49316f27c9a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:28.048816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213c9ba-4685-4533-a4e5-9314f8681893 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:28.050432 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 594/1172] 10.222.0.98 () {56 vars in 1183 bytes} [Thu Jul 14 14:21:27 2022] GET /identity/v3/domains/4e79b0849350404cb24aa49316f27c9a => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:28.056540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3e9ee-00ab-4e49-aeca-33efbaa9db9c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:28.152157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3e9ee-00ab-4e49-aeca-33efbaa9db9c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:28.184272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d508e-c0cc-40ea-bfdf-a8ccb5763db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:28.184920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d508e-c0cc-40ea-bfdf-a8ccb5763db7 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:28.185201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d508e-c0cc-40ea-bfdf-a8ccb5763db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:28.185475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d508e-c0cc-40ea-bfdf-a8ccb5763db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:28.186166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d508e-c0cc-40ea-bfdf-a8ccb5763db7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:28.187656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d508e-c0cc-40ea-bfdf-a8ccb5763db7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:28.215588 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 579/1173] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:21:28 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:21:30.281928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a67c-44f4-4a0e-9134-87510370641c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:30.282534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a67c-44f4-4a0e-9134-87510370641c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:30.282534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a67c-44f4-4a0e-9134-87510370641c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:30.284623 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 595/1174] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:30.292518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7c79-7995-43a7-8f38-48c8007c84a7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:30.293021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7c79-7995-43a7-8f38-48c8007c84a7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:30.293141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7c79-7995-43a7-8f38-48c8007c84a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:30.310812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a4c7c79-7995-43a7-8f38-48c8007c84a7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:30.312019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a4c7c79-7995-43a7-8f38-48c8007c84a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:30.338621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:30.380901 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 580/1175] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:30.405670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a67c-44f4-4a0e-9134-87510370641c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:30.505996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a67c-44f4-4a0e-9134-87510370641c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:30.539124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31aa75-d292-4811-b166-a961262e0907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:30.539933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31aa75-d292-4811-b166-a961262e0907 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:30.540214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31aa75-d292-4811-b166-a961262e0907 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:30.540491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31aa75-d292-4811-b166-a961262e0907 None admin] PATH_INFO: `/v3/domains/4e79b0849350404cb24aa49316f27c9a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:30.541669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31aa75-d292-4811-b166-a961262e0907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e79b0849350404cb24aa49316f27c9a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:30.543116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31aa75-d292-4811-b166-a961262e0907 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:30.544756 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 596/1176] 10.222.0.98 () {56 vars in 1183 bytes} [Thu Jul 14 14:21:30 2022] GET /identity/v3/domains/4e79b0849350404cb24aa49316f27c9a => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:30.550495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7c79-7995-43a7-8f38-48c8007c84a7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:30.651225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7c79-7995-43a7-8f38-48c8007c84a7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:30.684092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f0574-c089-44eb-a413-00ec95fd6d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:30.684757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0574-c089-44eb-a413-00ec95fd6d8d None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:30.685042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0574-c089-44eb-a413-00ec95fd6d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:30.685324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0574-c089-44eb-a413-00ec95fd6d8d None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:30.686032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f0574-c089-44eb-a413-00ec95fd6d8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:30.687517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f0574-c089-44eb-a413-00ec95fd6d8d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:30.708623 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 581/1177] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:21:30 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:21:32.766612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6303c7-b11d-47ff-b685-78ce0a291fe8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:32.767179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6303c7-b11d-47ff-b685-78ce0a291fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:32.767179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6303c7-b11d-47ff-b685-78ce0a291fe8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:32.768567 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 597/1178] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:32.774256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd278153-8527-439b-ac2f-660a97b86c82 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:32.774636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd278153-8527-439b-ac2f-660a97b86c82 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:32.774823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd278153-8527-439b-ac2f-660a97b86c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:32.792108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dd278153-8527-439b-ac2f-660a97b86c82 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:32.793295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd278153-8527-439b-ac2f-660a97b86c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:32.806342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:32.862637 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 582/1179] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:32.886079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6303c7-b11d-47ff-b685-78ce0a291fe8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:32.901265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:32.987114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6303c7-b11d-47ff-b685-78ce0a291fe8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:33.021116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:33.021843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:33.022129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:33.022409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:33.032244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:21:33.039809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:21:33.040992 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:21:33.042091 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 598/1180] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:21:33.047483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd278153-8527-439b-ac2f-660a97b86c82 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:33.143158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd278153-8527-439b-ac2f-660a97b86c82 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:33.175939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:33.177113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:33.177394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:33.177670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:33.178405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:33.178710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:33.180108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:33.188038 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 583/1181] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:33.194555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:33.265257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:33.295470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86d20-1192-4e0b-a139-5df65b34a456 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:33.329736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:33.330603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:33.330886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:33.331164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] PATH_INFO: `/v3/users/8660ec115b8148459b24e6750ff0bc93` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:33.344323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] RBAC: Authorizing `identity:get_user(user_id=8660ec115b8148459b24e6750ff0bc93)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:33.345775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:33.347488 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 599/1182] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:33 2022] GET /identity/v3/users/8660ec115b8148459b24e6750ff0bc93 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:33.353437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:33.366500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:33.451889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4087e2-83a0-4b11-930e-ef234ce56618 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:33.484795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:33.485430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:33.485712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:33.485989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:33.554524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:33.555928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:33.566672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:33.653685 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 584/1183] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:21:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:21:33.659584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:33.758633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192ca7-176e-47d6-a420-223799c843af None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:33.786876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:33.794577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901795c-3570-4021-8579-f95eb71ae66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:33.795476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901795c-3570-4021-8579-f95eb71ae66a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:33.795760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901795c-3570-4021-8579-f95eb71ae66a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:33.796035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901795c-3570-4021-8579-f95eb71ae66a None admin] PATH_INFO: `/v3/projects/81a1dc2458bc41b080b679223fdd6cd2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:33.797189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901795c-3570-4021-8579-f95eb71ae66a None admin] RBAC: Authorizing `identity:get_project(project_id=81a1dc2458bc41b080b679223fdd6cd2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:33.798618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901795c-3570-4021-8579-f95eb71ae66a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:33.800338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 600/1184] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:33 2022] GET /identity/v3/projects/81a1dc2458bc41b080b679223fdd6cd2 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:33.806506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:33.902735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b8fea-0679-41ed-9821-240df8148066 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:33.913746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:33.936961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee141e-72bd-47aa-9547-3eb1ebb3e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:33.937615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee141e-72bd-47aa-9547-3eb1ebb3e726 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:33.937900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee141e-72bd-47aa-9547-3eb1ebb3e726 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:33.938177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee141e-72bd-47aa-9547-3eb1ebb3e726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:33.938998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee141e-72bd-47aa-9547-3eb1ebb3e726 None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=81a1dc2458bc41b080b679223fdd6cd2, user.id=8660ec115b8148459b24e6750ff0bc93) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:33.939392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee141e-72bd-47aa-9547-3eb1ebb3e726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:33.940821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee141e-72bd-47aa-9547-3eb1ebb3e726 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:33.946726 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 585/1185] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:21:33 2022] GET /identity/v3/role_assignments?user.id=8660ec115b8148459b24e6750ff0bc93&scope.project.id=81a1dc2458bc41b080b679223fdd6cd2&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:35.926663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e784-7307-4c95-ad13-f8ed5543101b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:35.927862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e784-7307-4c95-ad13-f8ed5543101b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:35.927862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e784-7307-4c95-ad13-f8ed5543101b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:35.929251 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 601/1186] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:35.934380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6d804-0ef4-456a-85be-6ee466005f71 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:35.934796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6d804-0ef4-456a-85be-6ee466005f71 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:35.934935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6d804-0ef4-456a-85be-6ee466005f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:35.951883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ace6d804-0ef4-456a-85be-6ee466005f71 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:35.953056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ace6d804-0ef4-456a-85be-6ee466005f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:36.018471 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 586/1187] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:36.040742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e784-7307-4c95-ad13-f8ed5543101b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:36.140039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e784-7307-4c95-ad13-f8ed5543101b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:36.172549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:36.173338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:36.173625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:36.173904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:36.185183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:21:36.195223 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:21:36.196375 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:21:36.197438 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 602/1188] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:21:36.202936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6d804-0ef4-456a-85be-6ee466005f71 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:36.302629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6d804-0ef4-456a-85be-6ee466005f71 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:36.304964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:36.337263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:36.337922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:36.338200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:36.338478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:36.339216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:36.339624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:36.340992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:36.348874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 587/1189] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:36.354811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:36.413257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:36.455570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598fe41-e9ca-4346-b166-e460d327d00a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:36.488252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:36.489735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:36.490019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:36.490300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] PATH_INFO: `/v3/users/8660ec115b8148459b24e6750ff0bc93` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:36.491513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] RBAC: Authorizing `identity:get_user(user_id=8660ec115b8148459b24e6750ff0bc93)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:36.492951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:36.494569 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 603/1190] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:36 2022] GET /identity/v3/users/8660ec115b8148459b24e6750ff0bc93 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:36.500790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:36.598629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e3fd5-f337-4c4d-a9b5-27964edcb1ca None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:36.631794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3cb22-b910-433f-abab-56f2f03c69ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:36.632725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3cb22-b910-433f-abab-56f2f03c69ef None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:36.633009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3cb22-b910-433f-abab-56f2f03c69ef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:36.633286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3cb22-b910-433f-abab-56f2f03c69ef None admin] PATH_INFO: `/v3/projects/81a1dc2458bc41b080b679223fdd6cd2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:36.634440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3cb22-b910-433f-abab-56f2f03c69ef None admin] RBAC: Authorizing `identity:get_project(project_id=81a1dc2458bc41b080b679223fdd6cd2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:36.635958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3cb22-b910-433f-abab-56f2f03c69ef None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:36.637653 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 588/1191] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:36 2022] GET /identity/v3/projects/81a1dc2458bc41b080b679223fdd6cd2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:36.643695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:36.741591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82716f7e-7301-4c5e-ac88-fc4e2b1f82cd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:36.765679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:36.775367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a862-86b3-456a-ac12-6abda950f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:36.776263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a862-86b3-456a-ac12-6abda950f126 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:36.776548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a862-86b3-456a-ac12-6abda950f126 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:36.776828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a862-86b3-456a-ac12-6abda950f126 None admin] PATH_INFO: `/v3/projects/81a1dc2458bc41b080b679223fdd6cd2/users/8660ec115b8148459b24e6750ff0bc93/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:36.778767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a862-86b3-456a-ac12-6abda950f126 None admin] RBAC: Authorizing `identity:create_grant(project_id=81a1dc2458bc41b080b679223fdd6cd2, user_id=8660ec115b8148459b24e6750ff0bc93, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:36.780387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a862-86b3-456a-ac12-6abda950f126 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:36.793839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 604/1192] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:21:36 2022] PUT /identity/v3/projects/81a1dc2458bc41b080b679223fdd6cd2/users/8660ec115b8148459b24e6750ff0bc93/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:21:38.781050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a33b1-532e-480a-b925-e3353056cb5b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:38.781611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a33b1-532e-480a-b925-e3353056cb5b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:38.781611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a33b1-532e-480a-b925-e3353056cb5b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:38.782963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 589/1193] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:21:38.788702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec62b8-e917-440c-a3bb-4cc49aa3aa8d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:38.789133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec62b8-e917-440c-a3bb-4cc49aa3aa8d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:38.789240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec62b8-e917-440c-a3bb-4cc49aa3aa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:38.806129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e6ec62b8-e917-440c-a3bb-4cc49aa3aa8d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:21:38.807347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e6ec62b8-e917-440c-a3bb-4cc49aa3aa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:21:38.872859 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 605/1194] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:21:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:21:38.896212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a33b1-532e-480a-b925-e3353056cb5b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:38.931840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:39.020388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a33b1-532e-480a-b925-e3353056cb5b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:39.056694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:39.057417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:39.057702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:39.057981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:39.068610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:21:39.076193 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:21:39.078073 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:21:39.080054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 590/1195] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:21:39.084998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec62b8-e917-440c-a3bb-4cc49aa3aa8d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:39.181026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec62b8-e917-440c-a3bb-4cc49aa3aa8d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:39.197505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:39.215798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:39.216466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:39.216753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:39.217031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:39.217785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:39.218098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:39.219497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:39.229195 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 606/1196] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:39.235014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:39.328665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:39.335855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc53ef-94ae-4ec2-9b08-4b72884ba243 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:39.368422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:39.369283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:39.369571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:39.369852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] PATH_INFO: `/v3/users/8660ec115b8148459b24e6750ff0bc93` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:39.371020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] RBAC: Authorizing `identity:get_user(user_id=8660ec115b8148459b24e6750ff0bc93)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:39.372487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:39.374109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 591/1197] 10.222.0.98 () {56 vars in 1177 bytes} [Thu Jul 14 14:21:39 2022] GET /identity/v3/users/8660ec115b8148459b24e6750ff0bc93 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:39.380671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:39.478497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b136-2b61-41cf-841a-7932d1a6c07c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:39.512081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:39.512726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:39.513027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:39.513287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:39.557789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:39.578632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:39.580155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:39.675134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 607/1198] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:21:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:21:39.681633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:39.778694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3cdd-1683-4c98-af94-31d00432a07c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:39.811342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52d58e-ad42-4c15-9720-6deb677620eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:39.812195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d58e-ad42-4c15-9720-6deb677620eb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:39.812481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d58e-ad42-4c15-9720-6deb677620eb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:39.812759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d58e-ad42-4c15-9720-6deb677620eb None admin] PATH_INFO: `/v3/projects/81a1dc2458bc41b080b679223fdd6cd2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:39.813918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52d58e-ad42-4c15-9720-6deb677620eb None admin] RBAC: Authorizing `identity:get_project(project_id=81a1dc2458bc41b080b679223fdd6cd2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:39.815394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52d58e-ad42-4c15-9720-6deb677620eb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:39.817093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 592/1199] 10.222.0.98 () {56 vars in 1186 bytes} [Thu Jul 14 14:21:39 2022] GET /identity/v3/projects/81a1dc2458bc41b080b679223fdd6cd2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:39.823156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:21:39.901081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:39.923709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61e760-c7d6-444f-922a-b58785bea697 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:21:39.957913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c811-3091-45c1-b0f7-4e2060d8575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:21:39.958629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c811-3091-45c1-b0f7-4e2060d8575c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:21:39.958931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c811-3091-45c1-b0f7-4e2060d8575c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:21:39.959229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c811-3091-45c1-b0f7-4e2060d8575c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:21:39.960359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c811-3091-45c1-b0f7-4e2060d8575c None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=81a1dc2458bc41b080b679223fdd6cd2, user.id=8660ec115b8148459b24e6750ff0bc93) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:21:39.960678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c811-3091-45c1-b0f7-4e2060d8575c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:21:39.962125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c811-3091-45c1-b0f7-4e2060d8575c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:21:39.968350 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 608/1200] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:21:39 2022] GET /identity/v3/role_assignments?user.id=8660ec115b8148459b24e6750ff0bc93&scope.project.id=81a1dc2458bc41b080b679223fdd6cd2&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:21:49.807299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:21:49.965319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=29 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:35.907210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518390a-adea-41e3-97e6-b6a7929147b6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:35.907842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518390a-adea-41e3-97e6-b6a7929147b6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:35.907842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518390a-adea-41e3-97e6-b6a7929147b6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:35.909472 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 593/1201] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:22:35.915950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864a99-f7ad-49cc-9e5e-53109b0e82ca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:35.916476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864a99-f7ad-49cc-9e5e-53109b0e82ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:35.916690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864a99-f7ad-49cc-9e5e-53109b0e82ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:35.938282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d3864a99-f7ad-49cc-9e5e-53109b0e82ca None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:22:35.939612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3864a99-f7ad-49cc-9e5e-53109b0e82ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:22:36.027192 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 609/1202] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:22:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:22:36.054435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518390a-adea-41e3-97e6-b6a7929147b6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:36.190340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518390a-adea-41e3-97e6-b6a7929147b6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:36.244526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:36.245350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:36.245637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:36.245952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:36.262361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:36.266477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:36.286678 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:36.288028 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:36.289442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:36.289442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:36.289442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:36.289442 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:36.289442 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 594/1203] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:36.297524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3864a99-f7ad-49cc-9e5e-53109b0e82ca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:36.414293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3864a99-f7ad-49cc-9e5e-53109b0e82ca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:36.459546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:36.466104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e647902-3cd1-4c35-a132-21bdc23bc998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:36.466877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647902-3cd1-4c35-a132-21bdc23bc998 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:36.467195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647902-3cd1-4c35-a132-21bdc23bc998 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:36.467504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647902-3cd1-4c35-a132-21bdc23bc998 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:36.468232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e647902-3cd1-4c35-a132-21bdc23bc998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:36.468566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e647902-3cd1-4c35-a132-21bdc23bc998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:36.470241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e647902-3cd1-4c35-a132-21bdc23bc998 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:36.491068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 610/1204] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:22:36.492928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:36.578980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:36.634684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de37e6-651b-4520-a91e-eafb32691404 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:36.686925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838963-5b9a-4167-89ab-10f75498c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:36.687792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838963-5b9a-4167-89ab-10f75498c794 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:36.688159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838963-5b9a-4167-89ab-10f75498c794 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:36.688491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838963-5b9a-4167-89ab-10f75498c794 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:36.689399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838963-5b9a-4167-89ab-10f75498c794 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:36.691319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838963-5b9a-4167-89ab-10f75498c794 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:36.720770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 595/1205] 10.222.0.98 () {60 vars in 1132 bytes} [Thu Jul 14 14:22:36 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:22:39.005534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900682e-623d-498f-b7be-ad580b669678 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:39.006065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900682e-623d-498f-b7be-ad580b669678 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:39.006160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900682e-623d-498f-b7be-ad580b669678 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:39.007837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 611/1206] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:22:39.021043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152c986-8897-4243-8bff-eaaa36ee4a1e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:39.021979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152c986-8897-4243-8bff-eaaa36ee4a1e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:39.021979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152c986-8897-4243-8bff-eaaa36ee4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:39.042166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1152c986-8897-4243-8bff-eaaa36ee4a1e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:22:39.043735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1152c986-8897-4243-8bff-eaaa36ee4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:22:39.147466 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 596/1207] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:22:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:22:39.169531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900682e-623d-498f-b7be-ad580b669678 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:39.327370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900682e-623d-498f-b7be-ad580b669678 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:39.415857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:39.416226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:39.416462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:39.416766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:39.431924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:22:39.440347 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:39.441381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:22:39.442249 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:39.447798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152c986-8897-4243-8bff-eaaa36ee4a1e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:39.450360 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 612/1208] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:22:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:39.496999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:39.576857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152c986-8897-4243-8bff-eaaa36ee4a1e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:39.630863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:39.631842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:39.632776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:39.632776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:39.633599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:39.634020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:39.636171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:39.648029 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 597/1209] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:39.653285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:39.749685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:39.832139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce787052-9b53-431f-8cad-36cbad582399 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:39.874624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:39.875499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:39.875755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:39.876057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:39.890972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:39.893149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:39.917381 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:39.918344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:39.920252 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:39.920252 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:39.920252 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:39.920252 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:39.920252 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 613/1210] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:39.924930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:40.059053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:40.062215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e9efd-767a-4cee-b68f-9fd1ea8d44ea None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:40.103929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:40.104527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:40.104814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:40.105090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:40.105895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:40.106286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:40.107720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:40.122962 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 598/1211] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:40.131045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:40.291669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84a6a-0edb-4276-a54b-3bccace28c05 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:40.293788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:40.336855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:40.337785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:40.338093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:40.338358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:40.346522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:40.348259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:22:40.369868 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:40.370955 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:40.372186 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:40.375857 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 614/1212] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:40.380970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:40.524388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a93f-8d4b-438f-8416-d17a2773d5c3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:40.565815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:40.566740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:40.567128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:40.567601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:40.568519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:40.568824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:40.570392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:40.596207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 599/1213] 10.222.0.98 () {56 vars in 1143 bytes} [Thu Jul 14 14:22:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:40.601958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:40.744678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77336bd9-2ca6-4db7-b3a6-2d54394bf203 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:40.792059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:40.794418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:40.794897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:40.795549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:40.839798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:40.887961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:40.889598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:41.010017 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 615/1214] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:22:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:22:41.015457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:41.038344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:41.131375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c327-3176-4554-9c67-c0bfe41330e6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:41.169421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:41.170412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:41.170677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:41.170965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:41.182193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:41.183784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:41.203503 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:41.204767 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:41.206022 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:41.206022 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:41.206022 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:41.206022 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:41.206022 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 600/1215] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:41.211416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:41.290077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:41.338836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94e4be-1dc5-4ae6-a954-4c80e701fc2c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:41.376518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:41.377296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:41.377588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:41.377871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:41.379174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:41.379600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:41.380913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:41.392943 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 616/1216] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:41.399196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:41.474907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:41.510841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0268-5ec5-49fa-864c-3233fbd0c55e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:41.554454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:41.555231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:41.555554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:41.555831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:41.563922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:41.565556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:22:41.580530 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:41.582425 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:41.583761 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 601/1217] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:22:41.588803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:41.700501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75f3f-592d-4d17-9cfb-ff8c0741266a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:41.727765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:41.755583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a69b1-3008-4a7a-ba8a-1c954ec5409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:41.756367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a69b1-3008-4a7a-ba8a-1c954ec5409b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:41.756652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a69b1-3008-4a7a-ba8a-1c954ec5409b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:41.757008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a69b1-3008-4a7a-ba8a-1c954ec5409b None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:41.757821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a69b1-3008-4a7a-ba8a-1c954ec5409b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:41.758139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a69b1-3008-4a7a-ba8a-1c954ec5409b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:41.759946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a69b1-3008-4a7a-ba8a-1c954ec5409b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:41.775998 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 617/1218] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:22:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:41.782230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:41.897037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a4952-8fe7-4d3b-b5ea-724b4501a5a1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:41.931486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:41.938683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c6ce6-89d6-43b8-be4c-ebc7e4f5ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:41.939512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c6ce6-89d6-43b8-be4c-ebc7e4f5ed53 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:41.940245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c6ce6-89d6-43b8-be4c-ebc7e4f5ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:41.940245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c6ce6-89d6-43b8-be4c-ebc7e4f5ed53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:41.941366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c6ce6-89d6-43b8-be4c-ebc7e4f5ed53 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=5d5da8901f9d44d884119c66f4b813ff) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:41.941651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c6ce6-89d6-43b8-be4c-ebc7e4f5ed53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:41.943171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c6ce6-89d6-43b8-be4c-ebc7e4f5ed53 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:41.949125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 602/1219] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:22:41 2022] GET /identity/v3/role_assignments?user.id=5d5da8901f9d44d884119c66f4b813ff&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:44.005699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0911f8e-9e0c-4b70-a40a-247f656f14d3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:44.006252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0911f8e-9e0c-4b70-a40a-247f656f14d3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:44.006252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0911f8e-9e0c-4b70-a40a-247f656f14d3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:44.007670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 618/1220] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:22:44.012942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a86ce-5d94-48f8-9f25-029b1570afc2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:44.013502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a86ce-5d94-48f8-9f25-029b1570afc2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:44.013502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a86ce-5d94-48f8-9f25-029b1570afc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:44.032700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-de2a86ce-5d94-48f8-9f25-029b1570afc2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:22:44.033926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de2a86ce-5d94-48f8-9f25-029b1570afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:22:44.109207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 603/1221] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:22:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:22:44.132611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0911f8e-9e0c-4b70-a40a-247f656f14d3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:44.249658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0911f8e-9e0c-4b70-a40a-247f656f14d3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:44.295020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:44.296091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:44.296525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:44.296933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:44.311058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:22:44.321988 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:44.324309 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:44.325301 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 619/1222] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:22:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:44.330389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a86ce-5d94-48f8-9f25-029b1570afc2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:44.440063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a86ce-5d94-48f8-9f25-029b1570afc2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:44.464945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:44.477054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:44.477810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:44.478096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:44.478406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:44.479162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:44.479502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:44.480870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:44.489931 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 604/1223] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:22:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:44.495745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:44.543931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:44.607407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c239019-d3ce-4c77-a13a-6f605ca1880d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:44.644583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:44.645388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:44.645671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:44.645951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:44.657623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:44.659148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:44.678669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:44.679843 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:44.680807 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:44.680807 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:44.680807 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:44.680807 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:44.680807 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 620/1224] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:44.686264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:44.806632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224b27-1a79-477d-b5e7-b26cc076f8d1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:44.841028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:44.841696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:44.841978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:44.842255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:44.843014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:44.843527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:44.845474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:44.860503 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 605/1225] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:44.870206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:44.968230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:44.975847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfdd37-b584-4ec1-81b3-c7c00dd69e24 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:45.012309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:45.013123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:45.013411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:45.013692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:45.022009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:45.023571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:22:45.039014 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:45.040079 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:45.041038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 621/1226] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:45.046743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:45.097993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:45.156235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318e90-4e7a-4b99-af00-df1d662ae83e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:45.192221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:45.192929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:45.193219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:45.193505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:45.194355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:45.194702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:45.196209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:45.220311 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 606/1227] 10.222.0.98 () {56 vars in 1143 bytes} [Thu Jul 14 14:22:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:45.221554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:45.334661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505e599-5f75-489c-8efb-c5491faa8b3b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:45.373316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:45.374176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:45.374463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:45.374742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:45.386946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:45.388724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:45.408019 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:45.409216 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:45.410392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:45.410392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:45.410392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:45.410392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:45.410392 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 622/1228] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:45.415246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:45.541006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c459f-3454-4932-93e5-351d428156b0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:45.544362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:45.579706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:45.580373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:45.580654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:45.580929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:45.581665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:45.581945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:45.583331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:45.595536 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 607/1229] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:45.601779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:45.612108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:45.714008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7aa38-87e2-4682-ae9a-b21c550d99bc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:45.754908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:45.755791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:45.756162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:45.756493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:45.764925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:45.766445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:22:45.782198 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:45.783386 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:45.790160 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 623/1230] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:22:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:45.790772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:45.913067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6eb7-6a04-4a89-af99-931e214648ff None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:45.952381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb3270-862a-4a9f-baf4-df8bb2292e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:45.953055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb3270-862a-4a9f-baf4-df8bb2292e5d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:45.953341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb3270-862a-4a9f-baf4-df8bb2292e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:45.953612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb3270-862a-4a9f-baf4-df8bb2292e5d None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:45.954402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb3270-862a-4a9f-baf4-df8bb2292e5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:45.954706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb3270-862a-4a9f-baf4-df8bb2292e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:45.956879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb3270-862a-4a9f-baf4-df8bb2292e5d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:45.975660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 608/1231] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:22:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:45.977189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:46.058372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:46.101774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc668c0-3119-4563-8d45-44743f191d9e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:46.142275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253161c-3828-4017-ba74-5270896679c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:46.143104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253161c-3828-4017-ba74-5270896679c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:46.143460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253161c-3828-4017-ba74-5270896679c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:46.143705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253161c-3828-4017-ba74-5270896679c3 None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/5d5da8901f9d44d884119c66f4b813ff/roles/f5ed3686a3a84f21964d92c84c9170b1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:46.161141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253161c-3828-4017-ba74-5270896679c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=5d5da8901f9d44d884119c66f4b813ff, role_id=f5ed3686a3a84f21964d92c84c9170b1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:46.162598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253161c-3828-4017-ba74-5270896679c3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:46.177475 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 624/1232] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:22:45 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/5d5da8901f9d44d884119c66f4b813ff/roles/f5ed3686a3a84f21964d92c84c9170b1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:22:48.215340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a96d3-bb93-4c23-92a1-f8d8d4e91bad None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:48.215907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a96d3-bb93-4c23-92a1-f8d8d4e91bad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:48.215907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a96d3-bb93-4c23-92a1-f8d8d4e91bad None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:48.217440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 609/1233] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:22:48.222444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62c617-7f32-4bd1-93ad-e61b95904a49 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:48.222933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62c617-7f32-4bd1-93ad-e61b95904a49 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:48.223085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62c617-7f32-4bd1-93ad-e61b95904a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:48.241021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da62c617-7f32-4bd1-93ad-e61b95904a49 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:22:48.242207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da62c617-7f32-4bd1-93ad-e61b95904a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:22:48.314538 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 625/1234] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:22:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:22:48.338530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a96d3-bb93-4c23-92a1-f8d8d4e91bad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:48.364675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:48.444978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a96d3-bb93-4c23-92a1-f8d8d4e91bad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:48.480986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:48.481722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:48.482033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:48.482293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:48.493014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:22:48.500775 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:48.501784 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:48.503711 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 610/1235] 10.222.0.98 () {56 vars in 1102 bytes} [Thu Jul 14 14:22:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:48.508638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62c617-7f32-4bd1-93ad-e61b95904a49 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:48.563700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:48.626274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62c617-7f32-4bd1-93ad-e61b95904a49 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:48.662388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:48.663167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:48.663530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:48.663808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:48.664557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:48.664864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:48.666243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:48.674576 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 626/1236] 10.222.0.98 () {56 vars in 1103 bytes} [Thu Jul 14 14:22:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:48.681188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:48.808614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:48.827024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0c809-9998-4be5-b477-2c183e5f2067 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:48.862796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:48.863623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:48.863910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:48.864188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:48.875392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:48.877034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:48.894983 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:48.896676 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:48.898052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:48.898052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:48.898052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:48.898052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:48.898052 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 611/1237] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:48.902661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:49.019409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcde2-8a28-41a0-a12e-952dae1cdbe7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:49.031371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:49.063118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:49.063810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:49.064129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:49.064424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:49.065244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:49.065575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:49.067061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:49.086495 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 627/1238] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:49.088331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:49.204333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce66aa-7787-48b6-9bd5-62ad724c7d8a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:49.242204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:49.243166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:49.243491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:49.243775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:49.246923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:49.252711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:49.255030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:22:49.271086 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:49.272491 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:49.278146 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 612/1239] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:22:49.278743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:49.385072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48023ab6-9dd7-4bae-b174-48cd555c6f98 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:49.421546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:49.422239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:49.422509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:49.422785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:49.423664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:49.423972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:49.425429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:49.443798 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 628/1240] 10.222.0.98 () {56 vars in 1143 bytes} [Thu Jul 14 14:22:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:49.449483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:49.570429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27904fe-8bb4-4b1c-bdea-bc8afa1cf144 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:49.620618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:49.621421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:49.621749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:49.622034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:49.693049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:49.700887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:49.702564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:49.828644 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 613/1241] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:22:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:22:49.835959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:49.866786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:49.954159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bed42-9190-42dd-a31b-0cfad6f7cc1c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:49.996282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:49.997088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:49.997370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:49.997648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:50.010984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:50.012492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:50.033366 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:50.034421 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:50.035821 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:50.035821 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:50.035821 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:50.035821 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:50.035821 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 629/1242] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:50.040643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:50.140616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:50.148661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199a168-bebe-4e06-a30c-a5c98c197edd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:50.186109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:50.186902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:50.187363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:50.187578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:50.188646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:50.188968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:50.191091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:50.204121 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 614/1243] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:50.210493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:50.306421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:50.332770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26482b5-e15a-41e0-b592-0491d5df46d7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:50.374882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:50.375913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:50.376302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:50.376762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:50.387979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:50.389796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:22:50.409472 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:50.410509 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:50.411760 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 630/1244] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:50.417100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:50.538772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6a249-12e4-46a3-be39-df449c3e19a3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:50.575470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fa9c5-11e6-46d6-9ac8-e1db4ac372e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:50.576136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa9c5-11e6-46d6-9ac8-e1db4ac372e3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:50.576422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa9c5-11e6-46d6-9ac8-e1db4ac372e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:50.576698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa9c5-11e6-46d6-9ac8-e1db4ac372e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:50.577478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa9c5-11e6-46d6-9ac8-e1db4ac372e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:50.577794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa9c5-11e6-46d6-9ac8-e1db4ac372e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:50.579364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa9c5-11e6-46d6-9ac8-e1db4ac372e3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:50.600655 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 615/1245] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:50.602337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:50.717030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec051-79c4-4d0b-9f29-b31dadaa47e3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:50.759818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b5cc4-6d24-48a7-ae87-743b1bdb3218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:50.760818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5cc4-6d24-48a7-ae87-743b1bdb3218 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:50.761732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5cc4-6d24-48a7-ae87-743b1bdb3218 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:50.762250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5cc4-6d24-48a7-ae87-743b1bdb3218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:50.763777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5cc4-6d24-48a7-ae87-743b1bdb3218 None admin] RBAC: Adding query filter params (role.id=f5ed3686a3a84f21964d92c84c9170b1, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=5d5da8901f9d44d884119c66f4b813ff) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:50.764408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5cc4-6d24-48a7-ae87-743b1bdb3218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:50.766511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5cc4-6d24-48a7-ae87-743b1bdb3218 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:50.775565 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 631/1246] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:22:50 2022] GET /identity/v3/role_assignments?user.id=5d5da8901f9d44d884119c66f4b813ff&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=f5ed3686a3a84f21964d92c84c9170b1 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:53.057979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d861b-bdb5-4373-993c-d59f5a4eb9d5 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:53.058573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d861b-bdb5-4373-993c-d59f5a4eb9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:53.058573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d861b-bdb5-4373-993c-d59f5a4eb9d5 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:53.059965 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 616/1247] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:22:53.066513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b051e0d-68ac-4a3a-8c12-d44235bf5e0f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:53.066999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b051e0d-68ac-4a3a-8c12-d44235bf5e0f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:53.067090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b051e0d-68ac-4a3a-8c12-d44235bf5e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:53.073422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:53.088562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b051e0d-68ac-4a3a-8c12-d44235bf5e0f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:22:53.089954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b051e0d-68ac-4a3a-8c12-d44235bf5e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:22:53.168327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 632/1248] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:22:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:22:53.196555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d861b-bdb5-4373-993c-d59f5a4eb9d5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:53.216614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:53.318306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d861b-bdb5-4373-993c-d59f5a4eb9d5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:53.356013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:53.356820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:53.357101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:53.357381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:53.368745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:22:53.376510 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:53.377927 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:53.379599 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 617/1249] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:53.384629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b051e0d-68ac-4a3a-8c12-d44235bf5e0f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:53.497191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b051e0d-68ac-4a3a-8c12-d44235bf5e0f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:53.531301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:53.537993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:53.538763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:53.539093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:53.539504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:53.540513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:53.540865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:53.542534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:53.552254 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 633/1250] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:22:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:22:53.558279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:53.642330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:53.671119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3d46-4878-4732-b994-5df25ee0043f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:53.712927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:53.713812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:53.714164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:53.714505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:53.726780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:53.728444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:53.748189 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:53.749426 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:53.750357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:53.750357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:53.750357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:53.750357 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:53.750357 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 618/1251] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:53.756155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:53.873414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be69c4-2e76-4fbb-bb41-45071de068a2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:53.912631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:53.913337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:53.913711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:53.913926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:53.914668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:53.914974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:53.916400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:53.929878 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 634/1252] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:53.936262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:54.053588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075ab4-b123-4c09-af3b-5cca7e5ad975 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:54.082452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:54.091449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:54.092276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:54.092570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:54.092859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:54.101563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:54.103158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:22:54.119043 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:54.120151 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:54.121101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 619/1253] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:54.126581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:54.195410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:54.263457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9c82f-b340-49cb-a110-4b815d45a253 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:54.307180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:54.308111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:54.308545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:54.308929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:54.309954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:54.310301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:54.312005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:54.332686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 635/1254] 10.222.0.98 () {56 vars in 1143 bytes} [Thu Jul 14 14:22:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:54.339148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:54.459661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b4355-2e6a-4383-b502-1d4e5d6b7b69 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:54.499626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:54.500591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:54.500891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:54.501108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:54.578860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:54.598490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:54.600099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:54.723379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 620/1255] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:22:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:22:54.725886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:54.861944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2833a-8a32-4e9c-a3e2-93825a7d95db None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:54.877711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:54.904164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:54.904975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:54.905260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:54.905546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:54.916928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:54.918596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:54.937696 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:54.938823 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:54.939937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:54.939937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:54.939937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:54.939937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:54.939937 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 636/1256] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:54.945233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:55.040189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:55.054385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63879fe-f0e6-4138-8b49-6441bf842a84 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:55.094050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:55.094725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:55.094980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:55.095289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:55.096022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:55.096327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:55.097735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:55.111037 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 621/1257] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:55.117212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:55.223202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341037a-d156-4785-a2c0-21bddfa0a035 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:55.265070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:55.265912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:55.267125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:55.267125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:55.275746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:55.277329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:22:55.292434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:55.293475 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:22:55.294390 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 637/1258] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:55.301973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:55.424189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83f2af-add3-4094-a16c-df34494e4a85 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:55.465238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be760b-3ef0-4e3e-adea-0481cb3f47f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:55.465909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be760b-3ef0-4e3e-adea-0481cb3f47f0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:55.466195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be760b-3ef0-4e3e-adea-0481cb3f47f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:55.466485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be760b-3ef0-4e3e-adea-0481cb3f47f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:55.467288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be760b-3ef0-4e3e-adea-0481cb3f47f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:55.467606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be760b-3ef0-4e3e-adea-0481cb3f47f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:55.469048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be760b-3ef0-4e3e-adea-0481cb3f47f0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:55.483093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 622/1259] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:55.489927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:55.516399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:55.605829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83f9b-2ff4-4a74-95a9-cd14a0cf4ab0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:55.642781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4ada-a4fd-4a03-bc2e-8fef8696d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:55.644221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4ada-a4fd-4a03-bc2e-8fef8696d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:55.644762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4ada-a4fd-4a03-bc2e-8fef8696d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:55.645115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4ada-a4fd-4a03-bc2e-8fef8696d2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:55.646253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4ada-a4fd-4a03-bc2e-8fef8696d2a5 None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=5d5da8901f9d44d884119c66f4b813ff) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:55.646576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4ada-a4fd-4a03-bc2e-8fef8696d2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:55.648418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4ada-a4fd-4a03-bc2e-8fef8696d2a5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:55.655243 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 638/1260] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:22:55 2022] GET /identity/v3/role_assignments?user.id=5d5da8901f9d44d884119c66f4b813ff&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:57.732723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05dfa-c7f0-42d9-bda3-83fd72230560 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:57.733357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05dfa-c7f0-42d9-bda3-83fd72230560 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:57.733357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05dfa-c7f0-42d9-bda3-83fd72230560 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:57.734927 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 623/1261] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:22:57.741240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b98bd-1318-4424-8671-c747287f8e1b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:57.741671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b98bd-1318-4424-8671-c747287f8e1b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:57.741906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b98bd-1318-4424-8671-c747287f8e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:57.760661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e84b98bd-1318-4424-8671-c747287f8e1b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:22:57.761846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e84b98bd-1318-4424-8671-c747287f8e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:22:57.827677 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 639/1262] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:22:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:22:57.852492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd05dfa-c7f0-42d9-bda3-83fd72230560 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:57.863385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:57.954290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd05dfa-c7f0-42d9-bda3-83fd72230560 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:57.989122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:57.989835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:57.990127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:57.990407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:58.000782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:22:58.008547 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:58.009750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:58.010850 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 624/1263] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:58.015932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b98bd-1318-4424-8671-c747287f8e1b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:58.035166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:58.114411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b98bd-1318-4424-8671-c747287f8e1b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:58.147766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:58.148431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:58.148720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:58.149002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:58.149740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:58.150049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:58.151451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:58.159461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 640/1264] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:22:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:58.165107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:58.229736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:58.263144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3009e34-129d-45e6-a45a-2fbbb07b8177 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:58.296617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:58.297406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:58.297694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:58.297974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:58.308439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:58.309906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:58.326974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:58.328078 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:58.329070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:58.329070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:58.329070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:58.329070 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:58.329070 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 625/1265] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:58.334844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:58.413985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:58.433550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d104-6704-48bd-a45b-b091536750c5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:58.467483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:58.468146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:58.468433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:58.468715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:58.469433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:58.469743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:58.471127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:58.483286 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 641/1266] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:58.489615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:58.588682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944ff53-a12f-4f51-b407-0eb6c39939a0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:58.608341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:58.623063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:58.623894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:58.624173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:58.624445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:58.632683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:58.634159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:22:58.648243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:58.649394 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:58.650562 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 626/1267] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:58.657723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:58.765938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8a8f0-c8b9-4ed6-b463-8874a367b1ab None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:58.801209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:58.801875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:58.802162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:58.802443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:58.803299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:58.803617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:58.805071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:58.813530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:58.823126 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 642/1268] 10.222.0.98 () {56 vars in 1143 bytes} [Thu Jul 14 14:22:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:58.828772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:58.927317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be124d6-be5f-40f4-a8c6-a24a75f593ea None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:58.960374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:58.961155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:58.961439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:58.961715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:58.971940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:58.973902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:22:58.991222 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:58.992278 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:58.993383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:22:58.993383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:22:58.993383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:22:58.993383 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:58.993383 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 627/1269] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:58.998119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:59.098528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d37ea5-7f8f-400f-9701-003fab25d11d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:59.131924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:59.132599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:59.132867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:59.133143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:59.133858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:59.134166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:59.135547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:59.147414 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 643/1270] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:59.153025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:59.183672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:59.251653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f5965-8236-4ac9-afe3-0039013221d6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:59.286780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:59.287600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:59.287882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:59.288156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:59.294593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:59.296058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:22:59.310154 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:22:59.311187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:22:59.312269 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 628/1271] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:22:59.317072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:59.375931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:59.418121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474dd72-9534-4d89-ac9f-2a8fdd0bb479 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:59.450453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135acd-0ffc-4914-ac7f-ed80276d4243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:59.451035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135acd-0ffc-4914-ac7f-ed80276d4243 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:59.451343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135acd-0ffc-4914-ac7f-ed80276d4243 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:59.451622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135acd-0ffc-4914-ac7f-ed80276d4243 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:59.452399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135acd-0ffc-4914-ac7f-ed80276d4243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:22:59.452710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135acd-0ffc-4914-ac7f-ed80276d4243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:59.454137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135acd-0ffc-4914-ac7f-ed80276d4243 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:59.466484 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 644/1272] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:22:59.472390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:22:59.563130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:22:59.572805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d0e4-36d1-4d87-b6cf-b4bb943aa28e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:22:59.610579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f30ae-607a-469c-83fb-c1e95af4fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:22:59.611510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f30ae-607a-469c-83fb-c1e95af4fb4d None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:22:59.611791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f30ae-607a-469c-83fb-c1e95af4fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:22:59.612064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f30ae-607a-469c-83fb-c1e95af4fb4d None admin] PATH_INFO: `/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/5d5da8901f9d44d884119c66f4b813ff/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:22:59.614051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f30ae-607a-469c-83fb-c1e95af4fb4d None admin] RBAC: Authorizing `identity:create_grant(project_id=3d7042d8cdce4651a115e79a914930c3, user_id=5d5da8901f9d44d884119c66f4b813ff, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:22:59.616826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f30ae-607a-469c-83fb-c1e95af4fb4d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:22:59.628982 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 629/1273] 10.222.0.98 () {58 vars in 1439 bytes} [Thu Jul 14 14:22:59 2022] PUT /identity/v3/projects/3d7042d8cdce4651a115e79a914930c3/users/5d5da8901f9d44d884119c66f4b813ff/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:23:01.618150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9bb5-d481-4f60-a6bd-c1a566bad8e8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:01.618647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9bb5-d481-4f60-a6bd-c1a566bad8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:01.618647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9bb5-d481-4f60-a6bd-c1a566bad8e8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:01.620102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 645/1274] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:01.625137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741083a-4e39-4b64-af18-e9a357d7c143 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:01.625506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741083a-4e39-4b64-af18-e9a357d7c143 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:01.625694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741083a-4e39-4b64-af18-e9a357d7c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:01.643884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7741083a-4e39-4b64-af18-e9a357d7c143 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:01.645097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7741083a-4e39-4b64-af18-e9a357d7c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:01.715581 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 630/1275] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:23:01.741749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f9bb5-d481-4f60-a6bd-c1a566bad8e8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:01.848877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f9bb5-d481-4f60-a6bd-c1a566bad8e8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:01.866002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:01.884837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:01.885576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:01.885864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:01.886143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:01.896054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:01.903629 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:01.904727 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:01.905753 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 646/1276] 10.222.0.98 () {56 vars in 1096 bytes} [Thu Jul 14 14:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:01.911299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741083a-4e39-4b64-af18-e9a357d7c143 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:01.993203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:02.013078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741083a-4e39-4b64-af18-e9a357d7c143 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:02.058408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:02.059887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:02.060172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:02.060443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:02.061178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:02.061481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:02.062855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:02.070976 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 631/1277] 10.222.0.98 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:02.076706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:02.174564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621c687-0ba7-4022-bf58-898ec84276e5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:02.207869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:02.208655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:02.209201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:02.209473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:02.219144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:02.220628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:23:02.238110 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:02.239088 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:02.240034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:23:02.240034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:23:02.240034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:02.240034 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:02.240034 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 647/1278] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:23:02.246503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:02.345321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393d4ea-adf3-46fe-b6b1-de605b005bcb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:02.377933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:02.378591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:02.378872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:02.379187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:02.380316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:02.380622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:02.382089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:02.393341 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 632/1279] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:02.399511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:02.429898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:02.498562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abb74a-ba80-4eff-a23a-4006b95c4495 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:02.531897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:02.532691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:02.533031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:02.533251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:02.540969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:02.542410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:23:02.557313 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:02.558492 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:02.559578 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 648/1280] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:02.564227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:02.568498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:02.664736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfbbd3-ac7f-4cc6-a624-0293ab124a34 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:02.698849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:02.699474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:02.699762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:02.700042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:02.700874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:02.701184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:02.702618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:02.721123 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 633/1281] 10.222.0.98 () {56 vars in 1143 bytes} [Thu Jul 14 14:23:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:02.728956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:02.818301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:02.828361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd0396-3a00-4068-94d5-ea1a8f0dbfe8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:02.861690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:02.862338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:02.862624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:02.862906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:02.928260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:02.929712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:03.018362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:03.029043 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 649/1282] 10.222.0.98 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:03.034751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:03.095136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:03.133413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583d2a5-70eb-4898-8adc-6fc689d03dda None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:03.165974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:03.166760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:03.167042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:03.167349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:03.177877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:03.179354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:23:03.196922 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:03.197987 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:03.199187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:23:03.199187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:23:03.199187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:03.199187 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:23:03.199187 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 634/1283] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:03.203763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:03.303377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d6d6c-16fd-405e-abda-22d0806bd994 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:03.338960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:03.339648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:03.339937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:03.340219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:03.340940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:03.341250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:03.342624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:03.353554 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 650/1284] 10.222.0.98 () {56 vars in 1109 bytes} [Thu Jul 14 14:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:03.359293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:03.455552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376dadb-e510-4a10-9379-680546bdebc8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:03.470964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:03.490518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:03.491345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:03.491636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:03.491914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:03.498432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:03.499925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:23:03.513866 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:03.514962 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:23:03.516230 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 635/1285] 10.222.0.98 () {56 vars in 1111 bytes} [Thu Jul 14 14:23:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:03.522157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:03.571979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:03.622165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3072b6-6257-4aaf-98f4-221c93b3cc9b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:03.656054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbbf4d-a273-4de7-b106-2acaf597abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:03.656709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbf4d-a273-4de7-b106-2acaf597abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:03.656993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbf4d-a273-4de7-b106-2acaf597abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:03.657271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbf4d-a273-4de7-b106-2acaf597abc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:03.658049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbbf4d-a273-4de7-b106-2acaf597abc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:03.658357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbbf4d-a273-4de7-b106-2acaf597abc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:03.659965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbbf4d-a273-4de7-b106-2acaf597abc5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:03.672393 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 651/1286] 10.222.0.98 () {56 vars in 1148 bytes} [Thu Jul 14 14:23:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:03.678511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:03.780233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9623-ef05-4abf-826c-bcb71fbe8738 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:03.813136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed842-045b-492a-9382-6e08a7fbbcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:03.813783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed842-045b-492a-9382-6e08a7fbbcee None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:03.814132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed842-045b-492a-9382-6e08a7fbbcee None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:03.814410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed842-045b-492a-9382-6e08a7fbbcee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:03.815232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed842-045b-492a-9382-6e08a7fbbcee None admin] RBAC: Adding query filter params (role.id=ba3e21bde1be4808aa89ff8df9bbb9be, scope.project.id=3d7042d8cdce4651a115e79a914930c3, user.id=5d5da8901f9d44d884119c66f4b813ff) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:03.815719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed842-045b-492a-9382-6e08a7fbbcee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:03.817863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed842-045b-492a-9382-6e08a7fbbcee None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:03.823652 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 636/1287] 10.222.0.98 () {56 vars in 1374 bytes} [Thu Jul 14 14:23:03 2022] GET /identity/v3/role_assignments?user.id=5d5da8901f9d44d884119c66f4b813ff&scope.project.id=3d7042d8cdce4651a115e79a914930c3&role.id=ba3e21bde1be4808aa89ff8df9bbb9be => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:05.877602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f6f4-5dd0-4812-bb65-f2a62172cb93 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:05.878197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f6f4-5dd0-4812-bb65-f2a62172cb93 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:05.878197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f6f4-5dd0-4812-bb65-f2a62172cb93 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:05.879552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 652/1288] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:05.884679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097381f-e34c-4834-8954-5176f95490e6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:05.885118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097381f-e34c-4834-8954-5176f95490e6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:05.885226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097381f-e34c-4834-8954-5176f95490e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:05.901670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1097381f-e34c-4834-8954-5176f95490e6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:05.902848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1097381f-e34c-4834-8954-5176f95490e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:05.933874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:05.971487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 637/1289] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:23:05.994478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f6f4-5dd0-4812-bb65-f2a62172cb93 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:06.094977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f6f4-5dd0-4812-bb65-f2a62172cb93 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:06.106052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:06.129211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:06.129930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:06.130218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:06.130496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:06.131148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:06.132559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:06.144235 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:06.146140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:06.147832 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 653/1290] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:23:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:06.152062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097381f-e34c-4834-8954-5176f95490e6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:06.248374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097381f-e34c-4834-8954-5176f95490e6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:06.282616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8b8c-1b62-4e9c-9ded-0c4da133b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:06.283319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8b8c-1b62-4e9c-9ded-0c4da133b403 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:06.283604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8b8c-1b62-4e9c-9ded-0c4da133b403 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:06.283882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8b8c-1b62-4e9c-9ded-0c4da133b403 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:06.284583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8b8c-1b62-4e9c-9ded-0c4da133b403 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:06.284892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8b8c-1b62-4e9c-9ded-0c4da133b403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:06.286287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8b8c-1b62-4e9c-9ded-0c4da133b403 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:06.291064 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 638/1291] 10.222.0.98 () {56 vars in 1116 bytes} [Thu Jul 14 14:23:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:06.296759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:06.396293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c11d-e6b1-4091-9241-9d09b2266252 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:06.429390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265515f-6347-47da-ba28-116c2a3b4a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:06.430041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265515f-6347-47da-ba28-116c2a3b4a55 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:06.430326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265515f-6347-47da-ba28-116c2a3b4a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:06.430603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265515f-6347-47da-ba28-116c2a3b4a55 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:06.431315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265515f-6347-47da-ba28-116c2a3b4a55 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:06.431624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265515f-6347-47da-ba28-116c2a3b4a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:06.432983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265515f-6347-47da-ba28-116c2a3b4a55 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:06.437329 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 654/1292] 10.222.0.98 () {56 vars in 1116 bytes} [Thu Jul 14 14:23:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:08.446283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd339d4-1c06-4e56-990f-ab9e37cec742 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:08.446807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd339d4-1c06-4e56-990f-ab9e37cec742 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:08.446931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd339d4-1c06-4e56-990f-ab9e37cec742 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:08.448262 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 639/1293] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:08.453219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fa2fd-70b2-4113-8154-f67b02bacaa3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:08.453659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fa2fd-70b2-4113-8154-f67b02bacaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:08.453778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fa2fd-70b2-4113-8154-f67b02bacaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:08.470954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-813fa2fd-70b2-4113-8154-f67b02bacaa3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:08.472179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-813fa2fd-70b2-4113-8154-f67b02bacaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:08.501651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:08.539631 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 655/1294] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:23:08.561992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd339d4-1c06-4e56-990f-ab9e37cec742 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:08.593960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:08.664196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd339d4-1c06-4e56-990f-ab9e37cec742 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:08.697478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87324081-9de6-4aa4-850b-4f2d1c54ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:08.698139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324081-9de6-4aa4-850b-4f2d1c54ead3 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:08.698424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324081-9de6-4aa4-850b-4f2d1c54ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:08.698703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324081-9de6-4aa4-850b-4f2d1c54ead3 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:08.699461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87324081-9de6-4aa4-850b-4f2d1c54ead3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:08.700826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87324081-9de6-4aa4-850b-4f2d1c54ead3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:08.716814 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 640/1295] 10.222.0.98 () {60 vars in 1141 bytes} [Thu Jul 14 14:23:08 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:10.746737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a67f8-99d5-4f1f-a53e-e17c8e6f473e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:10.747300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a67f8-99d5-4f1f-a53e-e17c8e6f473e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:10.747300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a67f8-99d5-4f1f-a53e-e17c8e6f473e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:10.748725 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 656/1296] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:10.754416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645b92-6e77-42c3-933b-db4b873f0a04 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:10.754864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645b92-6e77-42c3-933b-db4b873f0a04 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:10.754976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645b92-6e77-42c3-933b-db4b873f0a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:10.771681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3f645b92-6e77-42c3-933b-db4b873f0a04 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:10.772929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f645b92-6e77-42c3-933b-db4b873f0a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:10.843831 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 641/1297] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:23:10.867363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a67f8-99d5-4f1f-a53e-e17c8e6f473e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:10.967546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a67f8-99d5-4f1f-a53e-e17c8e6f473e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:11.001549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:11.002273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:11.002559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:11.002837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:11.003514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:11.004941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:11.016490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:11.017652 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:11.018697 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 657/1298] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:23:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:11.023905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645b92-6e77-42c3-933b-db4b873f0a04 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:11.043479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:11.123538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645b92-6e77-42c3-933b-db4b873f0a04 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:11.156684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:11.157338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:11.157620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:11.157895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:11.158588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:11.158892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:11.160916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:11.166044 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 642/1299] 10.222.0.98 () {56 vars in 1116 bytes} [Thu Jul 14 14:23:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:11.172422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:11.204743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:11.274227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141df1f-2b06-4b4d-9175-ca774f8c0771 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:11.307039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab918d3-50d9-4527-ac75-164a7fbda863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:11.307726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab918d3-50d9-4527-ac75-164a7fbda863 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:11.308014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab918d3-50d9-4527-ac75-164a7fbda863 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:11.308295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab918d3-50d9-4527-ac75-164a7fbda863 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:11.309088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab918d3-50d9-4527-ac75-164a7fbda863 None admin] RBAC: Adding query filter params (interface=public, service_id=35e7f0e0d3ca48399c5a33e8f87d981c, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:11.309398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab918d3-50d9-4527-ac75-164a7fbda863 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:11.310767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab918d3-50d9-4527-ac75-164a7fbda863 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:11.315717 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 658/1300] 10.222.0.98 () {56 vars in 1251 bytes} [Thu Jul 14 14:23:11 2022] GET /identity/v3/endpoints?service_id=35e7f0e0d3ca48399c5a33e8f87d981c&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:11.321420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:11.401532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:11.420050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f603a0b-0a29-4935-945a-7dfa60f66af1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:11.452377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587cd28-9603-436b-9b3a-81936de41224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:11.453033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cd28-9603-436b-9b3a-81936de41224 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:11.453321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cd28-9603-436b-9b3a-81936de41224 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:11.453601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cd28-9603-436b-9b3a-81936de41224 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:11.454273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587cd28-9603-436b-9b3a-81936de41224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:11.455676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587cd28-9603-436b-9b3a-81936de41224 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:11.463132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 643/1301] 10.222.0.98 () {56 vars in 1087 bytes} [Thu Jul 14 14:23:11 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:23:13.465009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1d36-2386-4a18-8ecd-640582831d40 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:13.465525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1d36-2386-4a18-8ecd-640582831d40 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:13.465612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1d36-2386-4a18-8ecd-640582831d40 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:13.466948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 659/1302] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:13.471978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb29e3-303d-43ae-a1a5-c9bbedb915ce None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:13.473049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb29e3-303d-43ae-a1a5-c9bbedb915ce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:13.473159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb29e3-303d-43ae-a1a5-c9bbedb915ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:13.489534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9bcb29e3-303d-43ae-a1a5-c9bbedb915ce None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:13.490707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9bcb29e3-303d-43ae-a1a5-c9bbedb915ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:13.555938 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 644/1303] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:23:13.578481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1d36-2386-4a18-8ecd-640582831d40 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:13.673902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:13.681568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1d36-2386-4a18-8ecd-640582831d40 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:13.715514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:13.716312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:13.716602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:13.716884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:13.717534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:13.718906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:13.730840 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:13.731928 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:23:13.732780 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 660/1304] 10.222.0.98 () {56 vars in 1117 bytes} [Thu Jul 14 14:23:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:13.738980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb29e3-303d-43ae-a1a5-c9bbedb915ce None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:13.813342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:13.837023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb29e3-303d-43ae-a1a5-c9bbedb915ce None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:13.870526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2ab7-2869-4db2-ad29-be66bdfe0ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:13.871173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2ab7-2869-4db2-ad29-be66bdfe0ced None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:13.871478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2ab7-2869-4db2-ad29-be66bdfe0ced None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:13.871756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2ab7-2869-4db2-ad29-be66bdfe0ced None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:13.872449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2ab7-2869-4db2-ad29-be66bdfe0ced None admin] RBAC: Adding query filter params (name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:13.872752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2ab7-2869-4db2-ad29-be66bdfe0ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:13.874118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2ab7-2869-4db2-ad29-be66bdfe0ced None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:13.879217 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 645/1305] 10.222.0.98 () {56 vars in 1116 bytes} [Thu Jul 14 14:23:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:13.884940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:13.984333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251abad-f5a1-4fa1-8cd9-28e7ff4fb1b9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:14.017745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3427f-3aa8-4bf5-b954-15c1f3dd2b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:14.018412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3427f-3aa8-4bf5-b954-15c1f3dd2b91 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:14.018701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3427f-3aa8-4bf5-b954-15c1f3dd2b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:14.018986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3427f-3aa8-4bf5-b954-15c1f3dd2b91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:14.019812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3427f-3aa8-4bf5-b954-15c1f3dd2b91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:14.021184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3427f-3aa8-4bf5-b954-15c1f3dd2b91 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:14.040244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 661/1306] 10.222.0.98 () {60 vars in 1144 bytes} [Thu Jul 14 14:23:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:23.876175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=30 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:24.035191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:17.610576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156931-53d3-4321-a816-f39209ee7db4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.611149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156931-53d3-4321-a816-f39209ee7db4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.611149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156931-53d3-4321-a816-f39209ee7db4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.616442 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 646/1307] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:17.618059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d229-2bc1-4617-aad9-2c5accdf99ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.619024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d229-2bc1-4617-aad9-2c5accdf99ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.619513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d229-2bc1-4617-aad9-2c5accdf99ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.702242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3a00d229-2bc1-4617-aad9-2c5accdf99ad None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:17.703653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a00d229-2bc1-4617-aad9-2c5accdf99ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:17.904454 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 662/1308] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:17.959580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337bdbd-e343-4acb-90e9-1148cac0bd03 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.962238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337bdbd-e343-4acb-90e9-1148cac0bd03 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.963043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337bdbd-e343-4acb-90e9-1148cac0bd03 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.966532 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 647/1309] 10.222.0.98 () {54 vars in 964 bytes} [Thu Jul 14 14:24:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:17.973274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8b47-17f6-47df-955c-44029bc2df16 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.973997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8b47-17f6-47df-955c-44029bc2df16 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.974520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8b47-17f6-47df-955c-44029bc2df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.061649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-76bc8b47-17f6-47df-955c-44029bc2df16 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:18.063230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76bc8b47-17f6-47df-955c-44029bc2df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:18.094121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:18.165257 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 663/1310] 10.222.0.98 () {58 vars in 1061 bytes} [Thu Jul 14 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:18.170567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337bdbd-e343-4acb-90e9-1148cac0bd03 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:18.172337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c337bdbd-e343-4acb-90e9-1148cac0bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:18.299198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337bdbd-e343-4acb-90e9-1148cac0bd03 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:18.383587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc79cf-a3c0-4050-a40c-f95ee179ed1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:18.384255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc79cf-a3c0-4050-a40c-f95ee179ed1f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.384540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc79cf-a3c0-4050-a40c-f95ee179ed1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.384817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc79cf-a3c0-4050-a40c-f95ee179ed1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.386569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15dc79cf-a3c0-4050-a40c-f95ee179ed1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:18.452337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:18.522087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc79cf-a3c0-4050-a40c-f95ee179ed1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:18.523654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc79cf-a3c0-4050-a40c-f95ee179ed1f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:18.545530 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 648/1311] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:20.891441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb563c9-f570-4c2a-aa87-30a4fb0a3f46 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.891441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb563c9-f570-4c2a-aa87-30a4fb0a3f46 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.892141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb563c9-f570-4c2a-aa87-30a4fb0a3f46 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.895244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 664/1312] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:20.899579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a0745-25df-4f09-8526-4860ee824c65 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.900236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a0745-25df-4f09-8526-4860ee824c65 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.900236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a0745-25df-4f09-8526-4860ee824c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:21.001035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b84a0745-25df-4f09-8526-4860ee824c65 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:21.002281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b84a0745-25df-4f09-8526-4860ee824c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:21.108996 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 649/1313] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:21.147811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb563c9-f570-4c2a-aa87-30a4fb0a3f46 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:21.149526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bb563c9-f570-4c2a-aa87-30a4fb0a3f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:21.272960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb563c9-f570-4c2a-aa87-30a4fb0a3f46 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:21.349730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:21.352359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f49c80-06ca-4e3d-aea4-ca7569c51930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:21.353063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f49c80-06ca-4e3d-aea4-ca7569c51930 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:21.353600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f49c80-06ca-4e3d-aea4-ca7569c51930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:21.354031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f49c80-06ca-4e3d-aea4-ca7569c51930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:21.355960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84f49c80-06ca-4e3d-aea4-ca7569c51930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:21.466126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f49c80-06ca-4e3d-aea4-ca7569c51930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:21.467615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f49c80-06ca-4e3d-aea4-ca7569c51930 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:21.486145 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 665/1314] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:23.821702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d059a6-7939-4c11-adf4-b712b7c130f6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:23.822268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d059a6-7939-4c11-adf4-b712b7c130f6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:23.822268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d059a6-7939-4c11-adf4-b712b7c130f6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:23.823671 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 650/1315] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:23.828726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ddf51-1941-4076-9af1-41b6bab78122 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:23.829213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ddf51-1941-4076-9af1-41b6bab78122 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:23.829309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ddf51-1941-4076-9af1-41b6bab78122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:23.894258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-228ddf51-1941-4076-9af1-41b6bab78122 None None] MFA Rules not processed for user `c5e7b7279bcd44ffae1520de252f481d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:23.895508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-228ddf51-1941-4076-9af1-41b6bab78122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:23.947446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:23.993100 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 666/1316] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:24.031842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d059a6-7939-4c11-adf4-b712b7c130f6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:24.033996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c7d059a6-7939-4c11-adf4-b712b7c130f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:24.043768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:24.136782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d059a6-7939-4c11-adf4-b712b7c130f6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:24.210361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee5e09-adf0-44dc-9f65-6d520412aed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:24.211010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee5e09-adf0-44dc-9f65-6d520412aed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.211313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee5e09-adf0-44dc-9f65-6d520412aed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.211615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee5e09-adf0-44dc-9f65-6d520412aed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:24.213266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7cee5e09-adf0-44dc-9f65-6d520412aed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:24.275685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:24.322949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee5e09-adf0-44dc-9f65-6d520412aed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:24.324437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee5e09-adf0-44dc-9f65-6d520412aed9 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:24.342903 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 651/1317] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:26.925108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e918-63ce-47dd-9927-ff10dd1ab2f2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.925679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e918-63ce-47dd-9927-ff10dd1ab2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.925679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e918-63ce-47dd-9927-ff10dd1ab2f2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.927028 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 667/1318] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:26.932213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61592c26-5602-467b-9400-8992b8a0e343 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.932671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61592c26-5602-467b-9400-8992b8a0e343 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.932782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61592c26-5602-467b-9400-8992b8a0e343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.012765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-61592c26-5602-467b-9400-8992b8a0e343 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:27.013986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61592c26-5602-467b-9400-8992b8a0e343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:27.112064 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 652/1319] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:27.166219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3eab-369d-4ddb-9dd6-0fc5f776089f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:27.166508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3eab-369d-4ddb-9dd6-0fc5f776089f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:27.166794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3eab-369d-4ddb-9dd6-0fc5f776089f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.168225 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 668/1320] 10.222.0.98 () {54 vars in 964 bytes} [Thu Jul 14 14:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:27.174655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1930f-2759-419c-b030-f528953183eb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:27.174949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1930f-2759-419c-b030-f528953183eb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:27.175313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1930f-2759-419c-b030-f528953183eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.196362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:27.255957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7ae1930f-2759-419c-b030-f528953183eb None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:27.257189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ae1930f-2759-419c-b030-f528953183eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:27.345093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 653/1321] 10.222.0.98 () {58 vars in 1061 bytes} [Thu Jul 14 14:24:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:24:27.354171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3eab-369d-4ddb-9dd6-0fc5f776089f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:27.355770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64cc3eab-369d-4ddb-9dd6-0fc5f776089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:27.460400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3eab-369d-4ddb-9dd6-0fc5f776089f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:27.533699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d3cc3-19ab-4046-a46a-6f1185baf8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:27.534428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3cc3-19ab-4046-a46a-6f1185baf8fc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:27.534718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3cc3-19ab-4046-a46a-6f1185baf8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:27.534996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3cc3-19ab-4046-a46a-6f1185baf8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.536719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b01d3cc3-19ab-4046-a46a-6f1185baf8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:27.544525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:27.648843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d3cc3-19ab-4046-a46a-6f1185baf8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:27.650295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d3cc3-19ab-4046-a46a-6f1185baf8fc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:27.668881 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 669/1322] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:30.831516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356e3c8-64f9-4411-b74a-d7703c9b9dc7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:30.832125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356e3c8-64f9-4411-b74a-d7703c9b9dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:30.832125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356e3c8-64f9-4411-b74a-d7703c9b9dc7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:30.833726 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 654/1323] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:30.839000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d16c4-16f5-4f17-87e7-cace049fcb3f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:30.839438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d16c4-16f5-4f17-87e7-cace049fcb3f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:30.839598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d16c4-16f5-4f17-87e7-cace049fcb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:30.934464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d78d16c4-16f5-4f17-87e7-cace049fcb3f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:30.935847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d78d16c4-16f5-4f17-87e7-cace049fcb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:31.012043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:31.073731 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 670/1324] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:31.110069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356e3c8-64f9-4411-b74a-d7703c9b9dc7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:31.111755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b356e3c8-64f9-4411-b74a-d7703c9b9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:31.235731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356e3c8-64f9-4411-b74a-d7703c9b9dc7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:31.249966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:31.316126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bbbc1-9a76-4b8b-9170-9f67feed9036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:31.316783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbbc1-9a76-4b8b-9170-9f67feed9036 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:31.317066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbbc1-9a76-4b8b-9170-9f67feed9036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:31.317341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bbbc1-9a76-4b8b-9170-9f67feed9036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:31.319009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-663bbbc1-9a76-4b8b-9170-9f67feed9036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:31.429963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bbbc1-9a76-4b8b-9170-9f67feed9036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:31.431389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bbbc1-9a76-4b8b-9170-9f67feed9036 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:31.463552 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 655/1325] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:33.563944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6de1-d23c-4bd1-b727-1ca008750be0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:33.564480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6de1-d23c-4bd1-b727-1ca008750be0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:33.564480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6de1-d23c-4bd1-b727-1ca008750be0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:33.565877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 671/1326] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:33.571213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24253d0c-276c-4f88-b93e-60e0ee22e834 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:33.571658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24253d0c-276c-4f88-b93e-60e0ee22e834 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:33.572444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24253d0c-276c-4f88-b93e-60e0ee22e834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:33.621708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:33.640547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-24253d0c-276c-4f88-b93e-60e0ee22e834 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:33.641755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-24253d0c-276c-4f88-b93e-60e0ee22e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:33.742582 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 656/1327] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:33.778133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6de1-d23c-4bd1-b727-1ca008750be0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:33.779772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f63d6de1-d23c-4bd1-b727-1ca008750be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:33.884895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6de1-d23c-4bd1-b727-1ca008750be0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:33.962489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae088e35-faba-4d18-bf10-a745636d959f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:33.963458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088e35-faba-4d18-bf10-a745636d959f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:33.963740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088e35-faba-4d18-bf10-a745636d959f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:33.964011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088e35-faba-4d18-bf10-a745636d959f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:33.965632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae088e35-faba-4d18-bf10-a745636d959f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:33.983583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:34.076195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae088e35-faba-4d18-bf10-a745636d959f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:34.077648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae088e35-faba-4d18-bf10-a745636d959f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:34.097459 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 672/1328] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:36.200302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e5922-cbfb-48d5-b3f0-a9b95d5f73be None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.200859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e5922-cbfb-48d5-b3f0-a9b95d5f73be None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.200859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e5922-cbfb-48d5-b3f0-a9b95d5f73be None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.202254 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 657/1329] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:36.208283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b141-815f-4528-bf6a-af50a787f670 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.208709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b141-815f-4528-bf6a-af50a787f670 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.208851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b141-815f-4528-bf6a-af50a787f670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.279651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1573b141-815f-4528-bf6a-af50a787f670 None None] MFA Rules not processed for user `c5e7b7279bcd44ffae1520de252f481d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:36.280862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1573b141-815f-4528-bf6a-af50a787f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:36.381731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:36.414806 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 673/1330] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:36.451453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e5922-cbfb-48d5-b3f0-a9b95d5f73be None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:36.453078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-155e5922-cbfb-48d5-b3f0-a9b95d5f73be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:36.562679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e5922-cbfb-48d5-b3f0-a9b95d5f73be None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:36.589642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:36.640612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b15ad-c020-4d31-97a9-5d68bac8be41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:36.641271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b15ad-c020-4d31-97a9-5d68bac8be41 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.641562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b15ad-c020-4d31-97a9-5d68bac8be41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.641881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b15ad-c020-4d31-97a9-5d68bac8be41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.644211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-286b15ad-c020-4d31-97a9-5d68bac8be41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:36.770376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b15ad-c020-4d31-97a9-5d68bac8be41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:36.772458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b15ad-c020-4d31-97a9-5d68bac8be41 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:36.793012 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 658/1331] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:39.083988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dd75-91d6-42a4-83e8-2c0db41ad75d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.084528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dd75-91d6-42a4-83e8-2c0db41ad75d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.084528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611dd75-91d6-42a4-83e8-2c0db41ad75d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.085935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 674/1332] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:39.091484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede74f-ac3d-42c4-971a-2bb645b714bc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.091944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede74f-ac3d-42c4-971a-2bb645b714bc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.092036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede74f-ac3d-42c4-971a-2bb645b714bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.156326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:39.159929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a5ede74f-ac3d-42c4-971a-2bb645b714bc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:39.161555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a5ede74f-ac3d-42c4-971a-2bb645b714bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:39.267139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 659/1333] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:39.303895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dd75-91d6-42a4-83e8-2c0db41ad75d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:39.304759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0611dd75-91d6-42a4-83e8-2c0db41ad75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:39.411982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611dd75-91d6-42a4-83e8-2c0db41ad75d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:39.487030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925dbf-ab75-4df8-9e7a-036aa8aebe39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:39.487722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925dbf-ab75-4df8-9e7a-036aa8aebe39 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.488006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925dbf-ab75-4df8-9e7a-036aa8aebe39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.488287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925dbf-ab75-4df8-9e7a-036aa8aebe39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.489944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51925dbf-ab75-4df8-9e7a-036aa8aebe39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:39.516919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:39.599931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925dbf-ab75-4df8-9e7a-036aa8aebe39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:39.601387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925dbf-ab75-4df8-9e7a-036aa8aebe39 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:39.620330 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 675/1334] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:41.691460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd72b8-b939-429d-bba0-daa5b3f3127e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:41.691987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd72b8-b939-429d-bba0-daa5b3f3127e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:41.692103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd72b8-b939-429d-bba0-daa5b3f3127e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:41.693402 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 660/1335] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:41.698746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe472ed-313f-4ff9-a9aa-1550d4e03987 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:41.699196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe472ed-313f-4ff9-a9aa-1550d4e03987 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:41.699341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe472ed-313f-4ff9-a9aa-1550d4e03987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:41.763770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2fe472ed-313f-4ff9-a9aa-1550d4e03987 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:41.764984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fe472ed-313f-4ff9-a9aa-1550d4e03987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:41.838739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:41.861749 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 676/1336] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:41.902328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd72b8-b939-429d-bba0-daa5b3f3127e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:41.903910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46dd72b8-b939-429d-bba0-daa5b3f3127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:42.006394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd72b8-b939-429d-bba0-daa5b3f3127e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:42.034080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:42.079459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908f620-bb69-44e4-9cca-95190108ccbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:42.080113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908f620-bb69-44e4-9cca-95190108ccbf service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:42.080398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908f620-bb69-44e4-9cca-95190108ccbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:42.080673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908f620-bb69-44e4-9cca-95190108ccbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:42.082614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f908f620-bb69-44e4-9cca-95190108ccbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:42.190903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908f620-bb69-44e4-9cca-95190108ccbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:42.192377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908f620-bb69-44e4-9cca-95190108ccbf service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:42.210655 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 661/1337] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:24:44.619126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb83c-3ba2-4b25-982d-38aa2b4448ec None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.619671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb83c-3ba2-4b25-982d-38aa2b4448ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.619671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb83c-3ba2-4b25-982d-38aa2b4448ec None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.621019 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 677/1338] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:44.626253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34890e2-a609-417e-9fe2-86543d590b87 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.626702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34890e2-a609-417e-9fe2-86543d590b87 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.626808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34890e2-a609-417e-9fe2-86543d590b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.690876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f34890e2-a609-417e-9fe2-86543d590b87 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:44.692243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f34890e2-a609-417e-9fe2-86543d590b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:44.700869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:44.799043 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 662/1339] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:44.833999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb83c-3ba2-4b25-982d-38aa2b4448ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:44.835535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-641bb83c-3ba2-4b25-982d-38aa2b4448ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:44.936602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb83c-3ba2-4b25-982d-38aa2b4448ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:45.009594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1de5d2-040a-4cf4-a4e5-3ab25ea29ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:45.010244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1de5d2-040a-4cf4-a4e5-3ab25ea29ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:45.010525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1de5d2-040a-4cf4-a4e5-3ab25ea29ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:45.010803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1de5d2-040a-4cf4-a4e5-3ab25ea29ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:45.012464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e1de5d2-040a-4cf4-a4e5-3ab25ea29ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:45.048203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:45.121822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1de5d2-040a-4cf4-a4e5-3ab25ea29ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:45.123297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1de5d2-040a-4cf4-a4e5-3ab25ea29ac4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:45.141169 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 678/1340] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:49.130922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840d685-d8f5-42e6-b568-699e0bf5fcc4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.131470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840d685-d8f5-42e6-b568-699e0bf5fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.131590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840d685-d8f5-42e6-b568-699e0bf5fcc4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.132898 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 663/1341] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:49.138135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e857c3c-0fa0-4fb9-b792-5b91a98b4aa2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.138559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e857c3c-0fa0-4fb9-b792-5b91a98b4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.138815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e857c3c-0fa0-4fb9-b792-5b91a98b4aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.206222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e857c3c-0fa0-4fb9-b792-5b91a98b4aa2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:49.207635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e857c3c-0fa0-4fb9-b792-5b91a98b4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:49.301338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:49.313200 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 679/1342] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:49.352261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840d685-d8f5-42e6-b568-699e0bf5fcc4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:49.353877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c840d685-d8f5-42e6-b568-699e0bf5fcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:49.465961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840d685-d8f5-42e6-b568-699e0bf5fcc4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:49.508368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:49.546305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c28db-8cfa-4d38-8b15-806f8445af35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:49.547082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c28db-8cfa-4d38-8b15-806f8445af35 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.547525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c28db-8cfa-4d38-8b15-806f8445af35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.548323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c28db-8cfa-4d38-8b15-806f8445af35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.550024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fc7c28db-8cfa-4d38-8b15-806f8445af35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:49.675082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c28db-8cfa-4d38-8b15-806f8445af35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:49.676561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c28db-8cfa-4d38-8b15-806f8445af35 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:49.695119 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 664/1343] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:52.337001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff93cb4-12c7-4fe6-a857-dd860849ff2f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.337574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff93cb4-12c7-4fe6-a857-dd860849ff2f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.337681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff93cb4-12c7-4fe6-a857-dd860849ff2f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.339218 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 680/1344] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:52.345081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5d99-8519-4253-a6e7-c50826d6b1f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.345622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5d99-8519-4253-a6e7-c50826d6b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.345788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5d99-8519-4253-a6e7-c50826d6b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.417373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-345f5d99-8519-4253-a6e7-c50826d6b1f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:52.418646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-345f5d99-8519-4253-a6e7-c50826d6b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:52.437048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:52.523226 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 665/1345] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:52.560202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff93cb4-12c7-4fe6-a857-dd860849ff2f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:52.561879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eff93cb4-12c7-4fe6-a857-dd860849ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:52.669413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff93cb4-12c7-4fe6-a857-dd860849ff2f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:52.748542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab427d-9252-4f65-8465-e7dbb229378f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:52.749214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab427d-9252-4f65-8465-e7dbb229378f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.749498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab427d-9252-4f65-8465-e7dbb229378f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.749777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab427d-9252-4f65-8465-e7dbb229378f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.752085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8bab427d-9252-4f65-8465-e7dbb229378f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:52.804073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:52.873029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab427d-9252-4f65-8465-e7dbb229378f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:52.874474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab427d-9252-4f65-8465-e7dbb229378f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:52.893003 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 681/1346] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:56.989907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c63d5-7c3c-4a77-8c7e-f9bb2558900a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.990473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c63d5-7c3c-4a77-8c7e-f9bb2558900a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.990473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c63d5-7c3c-4a77-8c7e-f9bb2558900a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.992039 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 666/1347] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:56.997177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fdf31-cea5-40d3-85fd-1c8fb5085974 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.997626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fdf31-cea5-40d3-85fd-1c8fb5085974 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.997718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fdf31-cea5-40d3-85fd-1c8fb5085974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:57.062182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c9fdf31-cea5-40d3-85fd-1c8fb5085974 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:57.064077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c9fdf31-cea5-40d3-85fd-1c8fb5085974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:57.177079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:57.180430 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 682/1348] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:24:57.217850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c63d5-7c3c-4a77-8c7e-f9bb2558900a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:57.219454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-223c63d5-7c3c-4a77-8c7e-f9bb2558900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:57.363995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c63d5-7c3c-4a77-8c7e-f9bb2558900a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:57.426520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:57.456918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374bbfa-e2d6-4694-a955-8e24df715c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:57.457849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374bbfa-e2d6-4694-a955-8e24df715c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:57.458142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374bbfa-e2d6-4694-a955-8e24df715c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:57.458427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374bbfa-e2d6-4694-a955-8e24df715c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:57.460192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f374bbfa-e2d6-4694-a955-8e24df715c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:57.592118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374bbfa-e2d6-4694-a955-8e24df715c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:57.593591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374bbfa-e2d6-4694-a955-8e24df715c72 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:57.615154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 667/1349] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:02.791339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656804-67cb-4cbd-b9a3-cc57846fe5d9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.798055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656804-67cb-4cbd-b9a3-cc57846fe5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.798055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656804-67cb-4cbd-b9a3-cc57846fe5d9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.798055 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 683/1350] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:25:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:02.811645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851fa7-0c05-426b-ba22-8f6e0a8ba5a0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.812516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851fa7-0c05-426b-ba22-8f6e0a8ba5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.813498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851fa7-0c05-426b-ba22-8f6e0a8ba5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.971111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-35851fa7-0c05-426b-ba22-8f6e0a8ba5a0 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:02.972395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-35851fa7-0c05-426b-ba22-8f6e0a8ba5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:02.995984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:03.092083 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 668/1351] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:25:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:07.285865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aa8d9-2e79-4435-b108-d752ae0aeb21 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:07.286397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aa8d9-2e79-4435-b108-d752ae0aeb21 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:07.286832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aa8d9-2e79-4435-b108-d752ae0aeb21 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:07.288580 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 684/1352] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:07.294407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ae4e-384f-4aa3-b81d-bf4deac7e7d6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:07.294869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ae4e-384f-4aa3-b81d-bf4deac7e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:07.294953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ae4e-384f-4aa3-b81d-bf4deac7e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:07.378899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bf66ae4e-384f-4aa3-b81d-bf4deac7e7d6 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:07.380265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bf66ae4e-384f-4aa3-b81d-bf4deac7e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:07.459698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:07.505082 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 669/1353] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:25:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:08.863156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59bf30-858a-45f6-ba81-3a4b063a311f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:08.863739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59bf30-858a-45f6-ba81-3a4b063a311f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:08.863739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59bf30-858a-45f6-ba81-3a4b063a311f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:08.866134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 685/1354] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:08.874899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66944-2caf-4bb3-a1ee-93a238e0d276 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:08.875960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66944-2caf-4bb3-a1ee-93a238e0d276 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:08.876153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66944-2caf-4bb3-a1ee-93a238e0d276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:08.956048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-61c66944-2caf-4bb3-a1ee-93a238e0d276 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:08.957525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61c66944-2caf-4bb3-a1ee-93a238e0d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:09.086455 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 670/1355] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:25:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:12.491745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355add32-851f-4d39-aad9-321e3b9b43d0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.492567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355add32-851f-4d39-aad9-321e3b9b43d0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.493022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355add32-851f-4d39-aad9-321e3b9b43d0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.495040 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 686/1356] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:12.501107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f646-1061-4567-bd8a-4ffeb300f54e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.501676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f646-1061-4567-bd8a-4ffeb300f54e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.501676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f646-1061-4567-bd8a-4ffeb300f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.546263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.586696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0369f646-1061-4567-bd8a-4ffeb300f54e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:12.587950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0369f646-1061-4567-bd8a-4ffeb300f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:12.696566 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 671/1357] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:12.751999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb646b-7b6a-481e-8086-c31abcafabbd None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.752486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb646b-7b6a-481e-8086-c31abcafabbd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.753042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb646b-7b6a-481e-8086-c31abcafabbd None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.754758 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 687/1358] 10.222.0.98 () {54 vars in 961 bytes} [Thu Jul 14 14:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:12.762985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8a9a-bc2d-467c-ab0b-38ac7a95dee9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.763697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8a9a-bc2d-467c-ab0b-38ac7a95dee9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.764472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8a9a-bc2d-467c-ab0b-38ac7a95dee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.862670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2dab8a9a-bc2d-467c-ab0b-38ac7a95dee9 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:12.864132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2dab8a9a-bc2d-467c-ab0b-38ac7a95dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:12.919145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.994050 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 672/1359] 10.222.0.98 () {58 vars in 1058 bytes} [Thu Jul 14 14:25:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:13.002219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb646b-7b6a-481e-8086-c31abcafabbd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:13.003926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ebbb646b-7b6a-481e-8086-c31abcafabbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:13.160074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb646b-7b6a-481e-8086-c31abcafabbd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.238283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:13.296783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0837bd4-26ff-46df-b068-4e788ba54bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.297461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0837bd4-26ff-46df-b068-4e788ba54bcc service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.297742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0837bd4-26ff-46df-b068-4e788ba54bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.298021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0837bd4-26ff-46df-b068-4e788ba54bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.299868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0837bd4-26ff-46df-b068-4e788ba54bcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:13.401914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0837bd4-26ff-46df-b068-4e788ba54bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.403569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0837bd4-26ff-46df-b068-4e788ba54bcc service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.424721 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 688/1360] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:15.691386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bf668-02be-45d6-b5a7-0bc7a5222fb4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:15.691983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bf668-02be-45d6-b5a7-0bc7a5222fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:15.691983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bf668-02be-45d6-b5a7-0bc7a5222fb4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:15.693654 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 673/1361] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:15.699041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91b68-1b76-49fe-8276-9348f2964b27 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:15.699538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91b68-1b76-49fe-8276-9348f2964b27 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:15.699618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91b68-1b76-49fe-8276-9348f2964b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:15.769266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-17f91b68-1b76-49fe-8276-9348f2964b27 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:15.770404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17f91b68-1b76-49fe-8276-9348f2964b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:15.810056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:15.879409 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 689/1362] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:15.920346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bf668-02be-45d6-b5a7-0bc7a5222fb4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:15.922083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c3bf668-02be-45d6-b5a7-0bc7a5222fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:16.108638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bf668-02be-45d6-b5a7-0bc7a5222fb4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:16.119444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.276429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b440f7-b6e5-400e-956e-8899ebdbc848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:16.277093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b440f7-b6e5-400e-956e-8899ebdbc848 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:16.277380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b440f7-b6e5-400e-956e-8899ebdbc848 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:16.277783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b440f7-b6e5-400e-956e-8899ebdbc848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:16.279513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74b440f7-b6e5-400e-956e-8899ebdbc848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:16.377306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b440f7-b6e5-400e-956e-8899ebdbc848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:16.379080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b440f7-b6e5-400e-956e-8899ebdbc848 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:16.400313 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 674/1363] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:18.795814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4a4c-62f9-4521-91cb-a0797aabdb36 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.796361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4a4c-62f9-4521-91cb-a0797aabdb36 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.796361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4a4c-62f9-4521-91cb-a0797aabdb36 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.798294 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 690/1364] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:18.803872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f54c72-a944-4e91-a56d-4af60d204b5e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.804317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f54c72-a944-4e91-a56d-4af60d204b5e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.804553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f54c72-a944-4e91-a56d-4af60d204b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.820086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.888080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c5f54c72-a944-4e91-a56d-4af60d204b5e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:18.890278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5f54c72-a944-4e91-a56d-4af60d204b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:19.037844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 675/1365] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:19.087983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632513dc-0689-40d8-a625-d4467c2a7bc8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.088580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632513dc-0689-40d8-a625-d4467c2a7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.088865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632513dc-0689-40d8-a625-d4467c2a7bc8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.090592 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 691/1366] 10.222.0.98 () {54 vars in 961 bytes} [Thu Jul 14 14:25:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:19.096594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5a69-dd87-4d93-ae60-741bd604e3c6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.096889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5a69-dd87-4d93-ae60-741bd604e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.097178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5a69-dd87-4d93-ae60-741bd604e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.188734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-95fe5a69-dd87-4d93-ae60-741bd604e3c6 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:19.189979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-95fe5a69-dd87-4d93-ae60-741bd604e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:19.229111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.380175 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 676/1367] 10.222.0.98 () {58 vars in 1058 bytes} [Thu Jul 14 14:25:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:19.388189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632513dc-0689-40d8-a625-d4467c2a7bc8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.389911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-632513dc-0689-40d8-a625-d4467c2a7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:19.605190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632513dc-0689-40d8-a625-d4467c2a7bc8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.628083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.792448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ecac-3b2d-4a27-af01-4c639af62bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.793042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ecac-3b2d-4a27-af01-4c639af62bd8 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.793327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ecac-3b2d-4a27-af01-4c639af62bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.793608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ecac-3b2d-4a27-af01-4c639af62bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.795489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0db6ecac-3b2d-4a27-af01-4c639af62bd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:19.888906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ecac-3b2d-4a27-af01-4c639af62bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.890545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ecac-3b2d-4a27-af01-4c639af62bd8 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:19.912184 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 692/1368] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:22.164793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98426b96-578a-47aa-b440-4f96b9e8586e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.165242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98426b96-578a-47aa-b440-4f96b9e8586e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.165367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98426b96-578a-47aa-b440-4f96b9e8586e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.166774 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 677/1369] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:22.174894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6a6f-0893-49fb-8c20-8211af9479d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.175421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6a6f-0893-49fb-8c20-8211af9479d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.176206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6a6f-0893-49fb-8c20-8211af9479d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.235712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:22.302714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eedf6a6f-0893-49fb-8c20-8211af9479d9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:22.303985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eedf6a6f-0893-49fb-8c20-8211af9479d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:22.435309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 693/1370] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:22.482931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98426b96-578a-47aa-b440-4f96b9e8586e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:22.484884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-98426b96-578a-47aa-b440-4f96b9e8586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:22.700179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:22.710957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98426b96-578a-47aa-b440-4f96b9e8586e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:22.849169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642882b1-6c2f-4349-845a-f44713e36cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:22.850075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642882b1-6c2f-4349-845a-f44713e36cb3 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.850541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642882b1-6c2f-4349-845a-f44713e36cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.850970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642882b1-6c2f-4349-845a-f44713e36cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.852815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-642882b1-6c2f-4349-845a-f44713e36cb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:22.955756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642882b1-6c2f-4349-845a-f44713e36cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:22.957897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642882b1-6c2f-4349-845a-f44713e36cb3 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:22.975239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:22.990907 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 678/1371] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:24.261194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8284d-8c0e-4ea6-935f-60aecf4923b3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.261680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8284d-8c0e-4ea6-935f-60aecf4923b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.261766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8284d-8c0e-4ea6-935f-60aecf4923b3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.263128 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 694/1372] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:24.270878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9896d0-44b6-4ade-bf09-7f39f921c716 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.271385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9896d0-44b6-4ade-bf09-7f39f921c716 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.271486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9896d0-44b6-4ade-bf09-7f39f921c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.368967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fb9896d0-44b6-4ade-bf09-7f39f921c716 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:24.370325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb9896d0-44b6-4ade-bf09-7f39f921c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:24.486419 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 679/1373] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:24.833120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98e7e-f4a7-47cb-a16c-f5c180d891b6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.833409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98e7e-f4a7-47cb-a16c-f5c180d891b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.833691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98e7e-f4a7-47cb-a16c-f5c180d891b6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.835059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 695/1374] 10.222.0.98 () {54 vars in 963 bytes} [Thu Jul 14 14:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:24.840314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f02b32-465c-4823-a6ff-7c022adac017 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.840694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f02b32-465c-4823-a6ff-7c022adac017 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.841052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f02b32-465c-4823-a6ff-7c022adac017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.930739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-25f02b32-465c-4823-a6ff-7c022adac017 None None] MFA Rules not processed for user `3db64ff447674dd2a2f15b005696075b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:24.932050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-25f02b32-465c-4823-a6ff-7c022adac017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:24.956099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.018540 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 680/1375] 10.222.0.98 () {58 vars in 1060 bytes} [Thu Jul 14 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:25.026112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98e7e-f4a7-47cb-a16c-f5c180d891b6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:25.027654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0db98e7e-f4a7-47cb-a16c-f5c180d891b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:25.142454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98e7e-f4a7-47cb-a16c-f5c180d891b6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:25.146470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.230418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e69fff-7347-4319-9588-bc44146f0de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:25.231084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e69fff-7347-4319-9588-bc44146f0de3 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.231402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e69fff-7347-4319-9588-bc44146f0de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.231686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e69fff-7347-4319-9588-bc44146f0de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.233405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-91e69fff-7347-4319-9588-bc44146f0de3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:25.356534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e69fff-7347-4319-9588-bc44146f0de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:25.358139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e69fff-7347-4319-9588-bc44146f0de3 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:25.377593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5f9c-3b8e-4224-9095-ee96be6abcd9 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.378137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5f9c-3b8e-4224-9095-ee96be6abcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.378137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5f9c-3b8e-4224-9095-ee96be6abcd9 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.378971 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 696/1376] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:25.383478 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 681/1377] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:25.387119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8272-cd0e-4fd0-b7af-43e2ae3f447f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.387459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8272-cd0e-4fd0-b7af-43e2ae3f447f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.387746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8272-cd0e-4fd0-b7af-43e2ae3f447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.431880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.454978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f08b8272-cd0e-4fd0-b7af-43e2ae3f447f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:25.456242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f08b8272-cd0e-4fd0-b7af-43e2ae3f447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:25.565151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 697/1378] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:25.611639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5f9c-3b8e-4224-9095-ee96be6abcd9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:25.613200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb3e5f9c-3b8e-4224-9095-ee96be6abcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:25.776074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5f9c-3b8e-4224-9095-ee96be6abcd9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:25.806765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.906770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a289c54-b2c5-4aeb-bad6-0f532987200a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:25.907468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289c54-b2c5-4aeb-bad6-0f532987200a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.907759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289c54-b2c5-4aeb-bad6-0f532987200a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.908041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289c54-b2c5-4aeb-bad6-0f532987200a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.909991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4a289c54-b2c5-4aeb-bad6-0f532987200a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:26.035421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a289c54-b2c5-4aeb-bad6-0f532987200a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:26.037348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a289c54-b2c5-4aeb-bad6-0f532987200a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:26.064004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 682/1379] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:28.199216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d373239-d766-45e4-a771-598b39484011 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:28.200218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d373239-d766-45e4-a771-598b39484011 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:28.200713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d373239-d766-45e4-a771-598b39484011 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:28.203983 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 698/1380] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:28.209028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8ffdf-1076-47c5-8897-519fe0e02c09 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:28.209519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8ffdf-1076-47c5-8897-519fe0e02c09 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:28.209621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8ffdf-1076-47c5-8897-519fe0e02c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:28.254493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:28.288568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fbc8ffdf-1076-47c5-8897-519fe0e02c09 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:28.289717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fbc8ffdf-1076-47c5-8897-519fe0e02c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:28.396700 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 683/1381] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:28.446815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d373239-d766-45e4-a771-598b39484011 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:28.448427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d373239-d766-45e4-a771-598b39484011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:28.567805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:28.619938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d373239-d766-45e4-a771-598b39484011 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:28.776148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989d973-9e76-4fff-aaf1-3a0df2ac2afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:28.777053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d973-9e76-4fff-aaf1-3a0df2ac2afb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:28.777396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d973-9e76-4fff-aaf1-3a0df2ac2afb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:28.777785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989d973-9e76-4fff-aaf1-3a0df2ac2afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:28.779567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3989d973-9e76-4fff-aaf1-3a0df2ac2afb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:28.859094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:28.877013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989d973-9e76-4fff-aaf1-3a0df2ac2afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:28.878766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989d973-9e76-4fff-aaf1-3a0df2ac2afb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:28.898401 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 699/1382] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:31.050876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcd44e-f4a1-4ad6-a68f-af6432806e2c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.051379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcd44e-f4a1-4ad6-a68f-af6432806e2c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.051485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcd44e-f4a1-4ad6-a68f-af6432806e2c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.056754 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 684/1383] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:31.058216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e251-5f22-49a8-a94e-2624db9c1eca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.058661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e251-5f22-49a8-a94e-2624db9c1eca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.058758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e251-5f22-49a8-a94e-2624db9c1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.133516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e498e251-5f22-49a8-a94e-2624db9c1eca None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:31.134627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e498e251-5f22-49a8-a94e-2624db9c1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:31.280521 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 700/1384] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:25:31.311756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcd44e-f4a1-4ad6-a68f-af6432806e2c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:31.314073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-40fcd44e-f4a1-4ad6-a68f-af6432806e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:31.482821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:31.554470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcd44e-f4a1-4ad6-a68f-af6432806e2c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:31.724511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67945e-b81e-4981-9dfb-72c5d3c1f289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:31.726099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67945e-b81e-4981-9dfb-72c5d3c1f289 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.726099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67945e-b81e-4981-9dfb-72c5d3c1f289 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.726099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67945e-b81e-4981-9dfb-72c5d3c1f289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.728086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a67945e-b81e-4981-9dfb-72c5d3c1f289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:31.866508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:31.887518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67945e-b81e-4981-9dfb-72c5d3c1f289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:31.889525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67945e-b81e-4981-9dfb-72c5d3c1f289 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:31.925611 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 685/1385] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:34.005195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218128-07e0-452d-b412-4390311593a1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.005753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218128-07e0-452d-b412-4390311593a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.005753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218128-07e0-452d-b412-4390311593a1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.007177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 701/1386] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:34.012403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39d53-78ae-45b4-b29f-b0ec74a52e4f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.012828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39d53-78ae-45b4-b29f-b0ec74a52e4f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.012959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39d53-78ae-45b4-b29f-b0ec74a52e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.080046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c8f39d53-78ae-45b4-b29f-b0ec74a52e4f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:34.081195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8f39d53-78ae-45b4-b29f-b0ec74a52e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:34.179545 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 686/1387] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:34.226209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218128-07e0-452d-b412-4390311593a1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.227801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85218128-07e0-452d-b412-4390311593a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:34.290669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:34.387185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218128-07e0-452d-b412-4390311593a1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.511851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c221-06bd-4dc5-a8d0-3d09ab62934c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.513166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c221-06bd-4dc5-a8d0-3d09ab62934c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.513648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c221-06bd-4dc5-a8d0-3d09ab62934c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.514029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c221-06bd-4dc5-a8d0-3d09ab62934c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.516826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22a2c221-06bd-4dc5-a8d0-3d09ab62934c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:34.536631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:34.626791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c221-06bd-4dc5-a8d0-3d09ab62934c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.628455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c221-06bd-4dc5-a8d0-3d09ab62934c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.647054 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 702/1388] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:36.787961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9dd0-808d-4f9f-838e-89071241151a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:36.788504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9dd0-808d-4f9f-838e-89071241151a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:36.788598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9dd0-808d-4f9f-838e-89071241151a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:36.789990 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 687/1389] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:36.795569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7581-ee19-4f00-8853-9ab1d1993cda None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:36.796077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7581-ee19-4f00-8853-9ab1d1993cda None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:36.796077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7581-ee19-4f00-8853-9ab1d1993cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:36.866850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7b2e7581-ee19-4f00-8853-9ab1d1993cda None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:36.868479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b2e7581-ee19-4f00-8853-9ab1d1993cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:36.974501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:36.988057 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 703/1390] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:25:37.033385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa9dd0-808d-4f9f-838e-89071241151a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:37.034976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c3aa9dd0-808d-4f9f-838e-89071241151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:37.090928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:37.194068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa9dd0-808d-4f9f-838e-89071241151a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:37.317574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73072bf-46a1-49bf-8290-4a3ffa3f5648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:37.318243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73072bf-46a1-49bf-8290-4a3ffa3f5648 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:37.318533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73072bf-46a1-49bf-8290-4a3ffa3f5648 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:37.318811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73072bf-46a1-49bf-8290-4a3ffa3f5648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:37.320521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b73072bf-46a1-49bf-8290-4a3ffa3f5648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:37.333111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:37.428631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73072bf-46a1-49bf-8290-4a3ffa3f5648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:37.431463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73072bf-46a1-49bf-8290-4a3ffa3f5648 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:37.454764 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 688/1391] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:39.566534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b868d5d-a355-43b0-b526-7b41dce55e96 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.567111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b868d5d-a355-43b0-b526-7b41dce55e96 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.567441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b868d5d-a355-43b0-b526-7b41dce55e96 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.569072 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 704/1392] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:39.576429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc5ad-a8f0-4105-8b6e-b9a69e6e3485 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.577057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc5ad-a8f0-4105-8b6e-b9a69e6e3485 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.577284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc5ad-a8f0-4105-8b6e-b9a69e6e3485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.659245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-400bc5ad-a8f0-4105-8b6e-b9a69e6e3485 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:39.660647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-400bc5ad-a8f0-4105-8b6e-b9a69e6e3485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:39.765995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:39.782193 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 689/1393] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:25:39.826247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b868d5d-a355-43b0-b526-7b41dce55e96 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.827857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b868d5d-a355-43b0-b526-7b41dce55e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:39.983369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b868d5d-a355-43b0-b526-7b41dce55e96 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:40.048834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:40.099689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f377c-f46c-4dd1-b1be-28cfb83dfdc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:40.100264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f377c-f46c-4dd1-b1be-28cfb83dfdc0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:40.100554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f377c-f46c-4dd1-b1be-28cfb83dfdc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:40.100833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f377c-f46c-4dd1-b1be-28cfb83dfdc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:40.102480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e0f377c-f46c-4dd1-b1be-28cfb83dfdc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:40.193391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f377c-f46c-4dd1-b1be-28cfb83dfdc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:40.195010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f377c-f46c-4dd1-b1be-28cfb83dfdc0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:40.213797 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 705/1394] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:41.450774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b38a3b-74f5-47ff-9536-4bcd0dc1b68b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.451331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b38a3b-74f5-47ff-9536-4bcd0dc1b68b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.451331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b38a3b-74f5-47ff-9536-4bcd0dc1b68b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.453470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 690/1395] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:41.459263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046095c-c800-4e9b-bc32-a72f5788f452 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.459728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046095c-c800-4e9b-bc32-a72f5788f452 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.459835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046095c-c800-4e9b-bc32-a72f5788f452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.524893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3046095c-c800-4e9b-bc32-a72f5788f452 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:41.526097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3046095c-c800-4e9b-bc32-a72f5788f452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:41.553990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:41.625645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 706/1396] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:41.680938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc755-3449-41a9-8143-48551f140db2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.681220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc755-3449-41a9-8143-48551f140db2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.681496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc755-3449-41a9-8143-48551f140db2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.682869 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 691/1397] 10.222.0.98 () {54 vars in 962 bytes} [Thu Jul 14 14:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:41.688656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166d665-2c11-40fc-9709-6b6c7b892225 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.688951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166d665-2c11-40fc-9709-6b6c7b892225 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.689234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166d665-2c11-40fc-9709-6b6c7b892225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.766501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a166d665-2c11-40fc-9709-6b6c7b892225 None None] MFA Rules not processed for user `0ded1996761b4d7d8ec89534d2103dea`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:41.767988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a166d665-2c11-40fc-9709-6b6c7b892225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:41.846096 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 707/1398] 10.222.0.98 () {58 vars in 1059 bytes} [Thu Jul 14 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:41.853670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc755-3449-41a9-8143-48551f140db2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:41.855163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-680cc755-3449-41a9-8143-48551f140db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:41.964758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc755-3449-41a9-8143-48551f140db2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:42.042701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d3cde-bd1b-4db0-8ccb-f5aab4ef1c02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:42.043385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d3cde-bd1b-4db0-8ccb-f5aab4ef1c02 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:42.043669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d3cde-bd1b-4db0-8ccb-f5aab4ef1c02 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:42.043946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d3cde-bd1b-4db0-8ccb-f5aab4ef1c02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:42.045614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c37d3cde-bd1b-4db0-8ccb-f5aab4ef1c02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:42.091351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:42.162607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d3cde-bd1b-4db0-8ccb-f5aab4ef1c02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:42.164090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d3cde-bd1b-4db0-8ccb-f5aab4ef1c02 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:42.183101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 692/1399] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:42.294194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f36ae4-cd50-4105-9693-3dab7baa03b4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:42.294498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f36ae4-cd50-4105-9693-3dab7baa03b4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:42.294781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f36ae4-cd50-4105-9693-3dab7baa03b4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:42.296194 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 708/1400] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:42.302026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da3ab-5e52-4483-bbd0-1807cc7830d8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:42.302323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da3ab-5e52-4483-bbd0-1807cc7830d8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:42.302608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da3ab-5e52-4483-bbd0-1807cc7830d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:42.369970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7f9da3ab-5e52-4483-bbd0-1807cc7830d8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:42.371394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7f9da3ab-5e52-4483-bbd0-1807cc7830d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:42.480876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:42.485482 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 693/1401] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:42.532241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f36ae4-cd50-4105-9693-3dab7baa03b4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:42.534068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0f36ae4-cd50-4105-9693-3dab7baa03b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:42.563891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:42.695578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f36ae4-cd50-4105-9693-3dab7baa03b4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:42.809690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:42.832968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0812b-db01-421d-acfa-06a3b2112bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:42.833630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0812b-db01-421d-acfa-06a3b2112bf5 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:42.833920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0812b-db01-421d-acfa-06a3b2112bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:42.834210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0812b-db01-421d-acfa-06a3b2112bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:42.835890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-efb0812b-db01-421d-acfa-06a3b2112bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:42.917030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76ee4a-e3e1-4c5e-996e-f7a958f8e176 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:42.917326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76ee4a-e3e1-4c5e-996e-f7a958f8e176 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:42.917611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76ee4a-e3e1-4c5e-996e-f7a958f8e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:42.944239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0812b-db01-421d-acfa-06a3b2112bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:42.947017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0812b-db01-421d-acfa-06a3b2112bf5 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:42.966410 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 709/1402] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:42.994975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fd76ee4a-e3e1-4c5e-996e-f7a958f8e176 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:42.996437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd76ee4a-e3e1-4c5e-996e-f7a958f8e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:43.111966 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 694/1403] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:25:43.159728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191324-d5cc-4ff3-b782-e63bbf2b3a94 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.160028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191324-d5cc-4ff3-b782-e63bbf2b3a94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.160315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191324-d5cc-4ff3-b782-e63bbf2b3a94 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.161761 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 710/1404] 10.222.0.98 () {54 vars in 942 bytes} [Thu Jul 14 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:43.169097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9869bc-46cf-47e3-89ee-428dad12e2f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.169393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9869bc-46cf-47e3-89ee-428dad12e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.169676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9869bc-46cf-47e3-89ee-428dad12e2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.254192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e9869bc-46cf-47e3-89ee-428dad12e2f4 None None] MFA Rules not processed for user `e4c56829e4af4b609ab6c986b745a4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:43.255475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e9869bc-46cf-47e3-89ee-428dad12e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:43.290914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:43.377336 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 695/1405] 10.222.0.98 () {58 vars in 1039 bytes} [Thu Jul 14 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:43.386802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191324-d5cc-4ff3-b782-e63bbf2b3a94 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:43.388437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e191324-d5cc-4ff3-b782-e63bbf2b3a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:43.501820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:43.535210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191324-d5cc-4ff3-b782-e63bbf2b3a94 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:43.641667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b933f4-f347-4892-bded-72e828ef7651 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:43.642243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b933f4-f347-4892-bded-72e828ef7651 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.642526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b933f4-f347-4892-bded-72e828ef7651 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.642801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b933f4-f347-4892-bded-72e828ef7651 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.644491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35b933f4-f347-4892-bded-72e828ef7651 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:43.733864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b933f4-f347-4892-bded-72e828ef7651 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:43.735615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b933f4-f347-4892-bded-72e828ef7651 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:43.744651 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 711/1406] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:25:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:25:45.145024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1611d0d-99cc-4ba2-a0e0-e14793146c58 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:45.145591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1611d0d-99cc-4ba2-a0e0-e14793146c58 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:45.145591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1611d0d-99cc-4ba2-a0e0-e14793146c58 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:45.147127 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 696/1407] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:45.152351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea318-7489-44a7-a254-d05119a2784e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:45.152780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea318-7489-44a7-a254-d05119a2784e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:45.152958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea318-7489-44a7-a254-d05119a2784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:45.161945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:45.229158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fb9ea318-7489-44a7-a254-d05119a2784e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:45.230443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb9ea318-7489-44a7-a254-d05119a2784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:45.365117 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 712/1408] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:25:45.410176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1611d0d-99cc-4ba2-a0e0-e14793146c58 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:45.411467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f1611d0d-99cc-4ba2-a0e0-e14793146c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:45.586901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1611d0d-99cc-4ba2-a0e0-e14793146c58 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:45.590074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:45.713429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbad842-9772-49af-9082-8bcb4ba77d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:45.714094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad842-9772-49af-9082-8bcb4ba77d22 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:45.714378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad842-9772-49af-9082-8bcb4ba77d22 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:45.714658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad842-9772-49af-9082-8bcb4ba77d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:45.716380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3fbad842-9772-49af-9082-8bcb4ba77d22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:45.820492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbad842-9772-49af-9082-8bcb4ba77d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:45.822150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbad842-9772-49af-9082-8bcb4ba77d22 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:45.843850 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 697/1409] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:25:55.362636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=62 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:55.841467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:07.484356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b0e7-40fc-4e13-bac1-94f0078ec360 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:07.485019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b0e7-40fc-4e13-bac1-94f0078ec360 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:07.485019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b0e7-40fc-4e13-bac1-94f0078ec360 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:07.486371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 713/1410] 10.222.0.98 () {54 vars in 918 bytes} [Thu Jul 14 14:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:07.491712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af78e-0dc9-4f6c-aac4-614fb7825bdc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:07.492229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af78e-0dc9-4f6c-aac4-614fb7825bdc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:07.492387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af78e-0dc9-4f6c-aac4-614fb7825bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:07.567417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a2af78e-0dc9-4f6c-aac4-614fb7825bdc None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:07.568545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a2af78e-0dc9-4f6c-aac4-614fb7825bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:07.682695 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 698/1411] 10.222.0.98 () {58 vars in 1015 bytes} [Thu Jul 14 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:07.698035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575d1b-0537-41c1-a42c-e53e2c779ae6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:07.698324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575d1b-0537-41c1-a42c-e53e2c779ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:07.698605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575d1b-0537-41c1-a42c-e53e2c779ae6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:07.700070 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 714/1412] 10.222.0.98 () {54 vars in 918 bytes} [Thu Jul 14 14:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:07.705855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89767850-981e-4e92-a94d-f03dc84442ea None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:07.706152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89767850-981e-4e92-a94d-f03dc84442ea None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:07.706464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89767850-981e-4e92-a94d-f03dc84442ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:07.785579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:07.788604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-89767850-981e-4e92-a94d-f03dc84442ea None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:07.790497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-89767850-981e-4e92-a94d-f03dc84442ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:07.909585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 699/1413] 10.222.0.98 () {58 vars in 1015 bytes} [Thu Jul 14 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:10.438389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ffde-1b4b-49b5-8a75-4cd62e2abf61 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:10.438924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ffde-1b4b-49b5-8a75-4cd62e2abf61 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:10.438924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ffde-1b4b-49b5-8a75-4cd62e2abf61 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:10.440337 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:10.445576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223532-f5fd-425d-bd6c-77a56dd0b3e6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:10.445968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223532-f5fd-425d-bd6c-77a56dd0b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:10.446138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223532-f5fd-425d-bd6c-77a56dd0b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:10.512173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-76223532-f5fd-425d-bd6c-77a56dd0b3e6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:10.513376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-76223532-f5fd-425d-bd6c-77a56dd0b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:10.568828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:10.612220 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:10.655252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ffde-1b4b-49b5-8a75-4cd62e2abf61 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:10.656869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2047ffde-1b4b-49b5-8a75-4cd62e2abf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:10.803117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ffde-1b4b-49b5-8a75-4cd62e2abf61 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:10.878845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:10.921588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef747f7-23be-44e0-80a3-3d73618eedf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:10.922813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef747f7-23be-44e0-80a3-3d73618eedf0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:10.923098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef747f7-23be-44e0-80a3-3d73618eedf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:10.923416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef747f7-23be-44e0-80a3-3d73618eedf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:10.925073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ef747f7-23be-44e0-80a3-3d73618eedf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:11.015058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef747f7-23be-44e0-80a3-3d73618eedf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:11.016749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef747f7-23be-44e0-80a3-3d73618eedf0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:11.035892 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 716/1416] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:11.940976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f5b03-511a-42db-acb9-271c54fe224e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:11.941555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f5b03-511a-42db-acb9-271c54fe224e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:11.941555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f5b03-511a-42db-acb9-271c54fe224e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:11.942899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:11.947911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac220-0ce1-4af8-80c5-1f38ea524665 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:11.948371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac220-0ce1-4af8-80c5-1f38ea524665 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:11.948483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac220-0ce1-4af8-80c5-1f38ea524665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:12.025782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7acac220-0ce1-4af8-80c5-1f38ea524665 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:12.026901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7acac220-0ce1-4af8-80c5-1f38ea524665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:12.054135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:12.124698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:12.300950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f5b03-511a-42db-acb9-271c54fe224e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:12.302471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-526f5b03-511a-42db-acb9-271c54fe224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:12.454592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f5b03-511a-42db-acb9-271c54fe224e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:12.496305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:12.571086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a43b7c-f0fb-4e68-9acc-869a1c5da3f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:12.571696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43b7c-f0fb-4e68-9acc-869a1c5da3f4 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:12.571984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43b7c-f0fb-4e68-9acc-869a1c5da3f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:12.572266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43b7c-f0fb-4e68-9acc-869a1c5da3f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:12.573931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-40a43b7c-f0fb-4e68-9acc-869a1c5da3f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:12.666149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43b7c-f0fb-4e68-9acc-869a1c5da3f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:12.667857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43b7c-f0fb-4e68-9acc-869a1c5da3f4 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:12.686642 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 702/1419] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:13.570616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc37c76-56ff-4b92-a10c-60409a7bfce2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:13.571178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc37c76-56ff-4b92-a10c-60409a7bfce2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:13.571178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc37c76-56ff-4b92-a10c-60409a7bfce2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:13.572522 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:13.577654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457acb-c658-4762-9403-40edd2619837 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:13.578620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457acb-c658-4762-9403-40edd2619837 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:13.578718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457acb-c658-4762-9403-40edd2619837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:13.633112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:13.655400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3f457acb-c658-4762-9403-40edd2619837 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:13.657233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f457acb-c658-4762-9403-40edd2619837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:13.753783 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:26:13.904677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc37c76-56ff-4b92-a10c-60409a7bfce2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:13.906218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cdc37c76-56ff-4b92-a10c-60409a7bfce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:14.053835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc37c76-56ff-4b92-a10c-60409a7bfce2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:14.066656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:14.168985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837375-140d-49b5-83ba-bb65a2af298e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:14.169557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837375-140d-49b5-83ba-bb65a2af298e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:14.169849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837375-140d-49b5-83ba-bb65a2af298e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:14.170133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837375-140d-49b5-83ba-bb65a2af298e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:14.171817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9837375-140d-49b5-83ba-bb65a2af298e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:14.264805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9837375-140d-49b5-83ba-bb65a2af298e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:14.266509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9837375-140d-49b5-83ba-bb65a2af298e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:14.285247 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 719/1422] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:15.159424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b198-b625-4339-8896-c5d0f5fdcf8c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:15.159988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b198-b625-4339-8896-c5d0f5fdcf8c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:15.159988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b198-b625-4339-8896-c5d0f5fdcf8c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:15.161377 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:15.166459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d840-de7c-4341-ab4f-20de58510d84 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:15.166895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d840-de7c-4341-ab4f-20de58510d84 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:15.167053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d840-de7c-4341-ab4f-20de58510d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:15.185222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:15.244560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4ca4d840-de7c-4341-ab4f-20de58510d84 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:15.245787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ca4d840-de7c-4341-ab4f-20de58510d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:15.346080 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:15.495562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b198-b625-4339-8896-c5d0f5fdcf8c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:15.497014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fda5b198-b625-4339-8896-c5d0f5fdcf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:15.732509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:15.770580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b198-b625-4339-8896-c5d0f5fdcf8c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:15.888436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb472b5-3033-432a-bdd9-19ca5944661b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:15.889095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb472b5-3033-432a-bdd9-19ca5944661b service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:15.889382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb472b5-3033-432a-bdd9-19ca5944661b service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:15.889661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb472b5-3033-432a-bdd9-19ca5944661b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:15.891964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-edb472b5-3033-432a-bdd9-19ca5944661b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:15.968686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:15.983444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb472b5-3033-432a-bdd9-19ca5944661b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:15.985065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb472b5-3033-432a-bdd9-19ca5944661b service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:16.003082 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 705/1425] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:16.868037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf216a-d0df-412f-9a91-e5087bd53ad9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:16.868594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf216a-d0df-412f-9a91-e5087bd53ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:16.868594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf216a-d0df-412f-9a91-e5087bd53ad9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:16.869984 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:16.874962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84b855-e60d-4a78-aa56-a1c0fb44140c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:16.875439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84b855-e60d-4a78-aa56-a1c0fb44140c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:16.875562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84b855-e60d-4a78-aa56-a1c0fb44140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:16.950774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0d84b855-e60d-4a78-aa56-a1c0fb44140c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:16.952017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0d84b855-e60d-4a78-aa56-a1c0fb44140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:17.049863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:17.200217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf216a-d0df-412f-9a91-e5087bd53ad9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:17.201942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3cf216a-d0df-412f-9a91-e5087bd53ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:17.290827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:17.353117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf216a-d0df-412f-9a91-e5087bd53ad9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:17.465729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b08c3-93d2-4b83-bbd7-01b0615768ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:17.466301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b08c3-93d2-4b83-bbd7-01b0615768ea service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:17.466581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b08c3-93d2-4b83-bbd7-01b0615768ea service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:17.466857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b08c3-93d2-4b83-bbd7-01b0615768ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:17.468540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-515b08c3-93d2-4b83-bbd7-01b0615768ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:17.517340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:17.559405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b08c3-93d2-4b83-bbd7-01b0615768ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:17.561039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b08c3-93d2-4b83-bbd7-01b0615768ea service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:17.580207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 722/1428] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:18.387484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc072b-b64b-46c1-8991-c25ac20f1273 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:18.388004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc072b-b64b-46c1-8991-c25ac20f1273 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:18.388004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc072b-b64b-46c1-8991-c25ac20f1273 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:18.389345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:18.394340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd19b-68a9-4e36-99d4-37cffc946743 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:18.394800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd19b-68a9-4e36-99d4-37cffc946743 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:18.394907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd19b-68a9-4e36-99d4-37cffc946743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:18.472891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8dbfd19b-68a9-4e36-99d4-37cffc946743 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:18.474120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8dbfd19b-68a9-4e36-99d4-37cffc946743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:18.693231 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:18.843794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc072b-b64b-46c1-8991-c25ac20f1273 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:18.845811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5dfc072b-b64b-46c1-8991-c25ac20f1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:18.895530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:18.992661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc072b-b64b-46c1-8991-c25ac20f1273 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:19.106349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d771744-31bb-4bf6-82e3-62a97af42606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:19.107001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d771744-31bb-4bf6-82e3-62a97af42606 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:19.107307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d771744-31bb-4bf6-82e3-62a97af42606 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:19.107591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d771744-31bb-4bf6-82e3-62a97af42606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:19.109242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d771744-31bb-4bf6-82e3-62a97af42606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:19.116289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:19.208909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d771744-31bb-4bf6-82e3-62a97af42606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:19.210571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d771744-31bb-4bf6-82e3-62a97af42606 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:19.229615 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 708/1431] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:26:20.056414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943f42-7b80-405d-bd72-fc2ddaccf038 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:20.056987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943f42-7b80-405d-bd72-fc2ddaccf038 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:20.056987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943f42-7b80-405d-bd72-fc2ddaccf038 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:20.058336 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:20.063503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0f4c-0640-40bd-9e19-a648fd0c696a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:20.063974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0f4c-0640-40bd-9e19-a648fd0c696a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:20.064074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0f4c-0640-40bd-9e19-a648fd0c696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:20.137775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-473e0f4c-0640-40bd-9e19-a648fd0c696a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:20.139049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-473e0f4c-0640-40bd-9e19-a648fd0c696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:20.207302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:20.236702 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:20.388278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943f42-7b80-405d-bd72-fc2ddaccf038 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:20.389656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e943f42-7b80-405d-bd72-fc2ddaccf038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:20.408589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:20.548283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943f42-7b80-405d-bd72-fc2ddaccf038 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:20.644964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:20.670586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1c4de-904d-4381-973e-91449686842c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:20.671235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1c4de-904d-4381-973e-91449686842c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:20.671551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1c4de-904d-4381-973e-91449686842c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:20.671826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1c4de-904d-4381-973e-91449686842c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:20.673451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93e1c4de-904d-4381-973e-91449686842c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:20.763647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1c4de-904d-4381-973e-91449686842c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:20.765235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1c4de-904d-4381-973e-91449686842c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:20.783688 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 725/1434] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:21.591320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2481707-fb4b-4132-81bc-bf287fc868c8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:21.592177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2481707-fb4b-4132-81bc-bf287fc868c8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:21.592177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2481707-fb4b-4132-81bc-bf287fc868c8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:21.593354 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:21.599365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003d11-2dfe-40b9-b901-442247fa396f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:21.600186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003d11-2dfe-40b9-b901-442247fa396f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:21.600362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003d11-2dfe-40b9-b901-442247fa396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:21.676240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3003d11-2dfe-40b9-b901-442247fa396f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:21.677441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3003d11-2dfe-40b9-b901-442247fa396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:21.718192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:21.774902 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:21.922225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2481707-fb4b-4132-81bc-bf287fc868c8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:21.923789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2481707-fb4b-4132-81bc-bf287fc868c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:22.071260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2481707-fb4b-4132-81bc-bf287fc868c8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:22.125549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:22.185459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc659f-5583-4e45-99a1-7702a23874cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:22.186027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc659f-5583-4e45-99a1-7702a23874cc service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:22.186311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc659f-5583-4e45-99a1-7702a23874cc service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:22.186589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc659f-5583-4e45-99a1-7702a23874cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:22.189076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f0fc659f-5583-4e45-99a1-7702a23874cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:22.285976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc659f-5583-4e45-99a1-7702a23874cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:22.287653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc659f-5583-4e45-99a1-7702a23874cc service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:22.305755 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 711/1437] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:23.121523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4eb3-6ba8-4a0b-accc-0c1860105df8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:23.122099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4eb3-6ba8-4a0b-accc-0c1860105df8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:23.122099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4eb3-6ba8-4a0b-accc-0c1860105df8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:23.123556 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:26:23.128626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174e76-2045-4e4b-b526-354b82e769d6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:23.129059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174e76-2045-4e4b-b526-354b82e769d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:23.129182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174e76-2045-4e4b-b526-354b82e769d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:23.202986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e174e76-2045-4e4b-b526-354b82e769d6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:23.204761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e174e76-2045-4e4b-b526-354b82e769d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:23.206788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:23.306135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:23.455813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4eb3-6ba8-4a0b-accc-0c1860105df8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:23.457306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c23a4eb3-6ba8-4a0b-accc-0c1860105df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:23.602954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4eb3-6ba8-4a0b-accc-0c1860105df8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:23.629976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:23.716110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fa791-4e29-423f-ad78-fcba70474e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:23.716763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa791-4e29-423f-ad78-fcba70474e33 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:23.717043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa791-4e29-423f-ad78-fcba70474e33 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:23.717317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa791-4e29-423f-ad78-fcba70474e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:23.719033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-333fa791-4e29-423f-ad78-fcba70474e33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:23.815577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fa791-4e29-423f-ad78-fcba70474e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:23.817186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fa791-4e29-423f-ad78-fcba70474e33 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:23.837364 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 728/1440] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:25.790999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06b8ff-e3ef-4c79-b030-db9e4ac20e7e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:25.791617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06b8ff-e3ef-4c79-b030-db9e4ac20e7e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:25.791617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06b8ff-e3ef-4c79-b030-db9e4ac20e7e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:25.793052 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:25.799254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308b87-8c65-4875-8b8e-0dfc564ff63b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:25.799751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308b87-8c65-4875-8b8e-0dfc564ff63b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:25.799874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308b87-8c65-4875-8b8e-0dfc564ff63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:25.840097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:25.867460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6c308b87-8c65-4875-8b8e-0dfc564ff63b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:25.868671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c308b87-8c65-4875-8b8e-0dfc564ff63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:25.971857 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:26.010465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06b8ff-e3ef-4c79-b030-db9e4ac20e7e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:26.012076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa06b8ff-e3ef-4c79-b030-db9e4ac20e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:26.117908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06b8ff-e3ef-4c79-b030-db9e4ac20e7e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:26.149172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:26.191598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee436-c4fc-437b-a650-c673a36c0853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:26.192268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee436-c4fc-437b-a650-c673a36c0853 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:26.192531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee436-c4fc-437b-a650-c673a36c0853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:26.192804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee436-c4fc-437b-a650-c673a36c0853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:26.194460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0fbee436-c4fc-437b-a650-c673a36c0853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:26.305983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbee436-c4fc-437b-a650-c673a36c0853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:26.307522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbee436-c4fc-437b-a650-c673a36c0853 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:26.326535 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 714/1443] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:28.528362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fcf2-4908-47a9-a58f-91d9a8e9e0f2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:28.528925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fcf2-4908-47a9-a58f-91d9a8e9e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:28.528925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fcf2-4908-47a9-a58f-91d9a8e9e0f2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:28.530230 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:28.535985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613735-65be-4d74-bc34-d2ab7e65fc06 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:28.536469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613735-65be-4d74-bc34-d2ab7e65fc06 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:28.536579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613735-65be-4d74-bc34-d2ab7e65fc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:28.606168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-85613735-65be-4d74-bc34-d2ab7e65fc06 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:28.607431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-85613735-65be-4d74-bc34-d2ab7e65fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:28.621312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:28.716183 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:28.754383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4fcf2-4908-47a9-a58f-91d9a8e9e0f2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:28.755993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17e4fcf2-4908-47a9-a58f-91d9a8e9e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:28.859981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4fcf2-4908-47a9-a58f-91d9a8e9e0f2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:28.872135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:28.937710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbeeaa-087a-430b-9745-04205086c60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:28.938373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbeeaa-087a-430b-9745-04205086c60f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:28.938658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbeeaa-087a-430b-9745-04205086c60f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:28.938933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbeeaa-087a-430b-9745-04205086c60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:28.940726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0cbeeaa-087a-430b-9745-04205086c60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:29.063641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbeeaa-087a-430b-9745-04205086c60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:29.065248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbeeaa-087a-430b-9745-04205086c60f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:29.084925 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 731/1446] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:31.455649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddf24f-f4a8-463e-ad2f-4864c088d5f8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:31.456226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddf24f-f4a8-463e-ad2f-4864c088d5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:31.456226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddf24f-f4a8-463e-ad2f-4864c088d5f8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:31.457607 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:26:31.463733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30023-aace-489d-9353-8f1adeb68d9a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:31.464260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30023-aace-489d-9353-8f1adeb68d9a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:31.464378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30023-aace-489d-9353-8f1adeb68d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:31.514594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:31.534530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bfa30023-aace-489d-9353-8f1adeb68d9a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:31.535720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bfa30023-aace-489d-9353-8f1adeb68d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:31.645935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:31.684644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddf24f-f4a8-463e-ad2f-4864c088d5f8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:31.686214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1bddf24f-f4a8-463e-ad2f-4864c088d5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:31.814870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddf24f-f4a8-463e-ad2f-4864c088d5f8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:31.860209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:31.898028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff0111-1229-477b-95bb-1f230e8653c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:31.898785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0111-1229-477b-95bb-1f230e8653c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:31.899094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0111-1229-477b-95bb-1f230e8653c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:31.899408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0111-1229-477b-95bb-1f230e8653c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:31.901170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b3ff0111-1229-477b-95bb-1f230e8653c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:32.022199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff0111-1229-477b-95bb-1f230e8653c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:32.023683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff0111-1229-477b-95bb-1f230e8653c2 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:32.044967 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 717/1449] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:34.208438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab13bef-6779-4524-9ae3-a51721f12715 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:34.209017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab13bef-6779-4524-9ae3-a51721f12715 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:34.209017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab13bef-6779-4524-9ae3-a51721f12715 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:34.210364 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:34.215729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd390369-f0ca-4551-9996-21e415463d9d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:34.216149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd390369-f0ca-4551-9996-21e415463d9d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:34.216284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd390369-f0ca-4551-9996-21e415463d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:34.282892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dd390369-f0ca-4551-9996-21e415463d9d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:34.284142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd390369-f0ca-4551-9996-21e415463d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:34.304643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:34.382555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:34.420876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab13bef-6779-4524-9ae3-a51721f12715 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:34.422392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ab13bef-6779-4524-9ae3-a51721f12715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:34.531075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab13bef-6779-4524-9ae3-a51721f12715 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:34.552299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:34.611674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a7494-dfb2-4e18-b6fb-7e4ddbd221dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:34.612341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a7494-dfb2-4e18-b6fb-7e4ddbd221dc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:34.612623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a7494-dfb2-4e18-b6fb-7e4ddbd221dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:34.612902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a7494-dfb2-4e18-b6fb-7e4ddbd221dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:34.614569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d1a7494-dfb2-4e18-b6fb-7e4ddbd221dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:34.733896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a7494-dfb2-4e18-b6fb-7e4ddbd221dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:34.735888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a7494-dfb2-4e18-b6fb-7e4ddbd221dc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:34.755640 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 734/1452] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:36.939744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61305eb-5e83-435f-9f20-c434faa39279 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:36.940333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61305eb-5e83-435f-9f20-c434faa39279 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:36.940493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61305eb-5e83-435f-9f20-c434faa39279 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:36.942005 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:26:36.949073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405f55-d701-4662-9a5b-396e57fe195b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:36.949589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405f55-d701-4662-9a5b-396e57fe195b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:36.950038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405f55-d701-4662-9a5b-396e57fe195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:37.047393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:37.052199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df405f55-d701-4662-9a5b-396e57fe195b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:37.052609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df405f55-d701-4662-9a5b-396e57fe195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:37.201137 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:26:37.240354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61305eb-5e83-435f-9f20-c434faa39279 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:37.242028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e61305eb-5e83-435f-9f20-c434faa39279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:37.407975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61305eb-5e83-435f-9f20-c434faa39279 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:37.478235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:37.524887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2785877-e556-4f19-abad-6d678c4297cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:37.525990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2785877-e556-4f19-abad-6d678c4297cc service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:37.526472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2785877-e556-4f19-abad-6d678c4297cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:37.526988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2785877-e556-4f19-abad-6d678c4297cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:37.530187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2785877-e556-4f19-abad-6d678c4297cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:37.729347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2785877-e556-4f19-abad-6d678c4297cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:37.730796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2785877-e556-4f19-abad-6d678c4297cc service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:37.752820 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 720/1455] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:40.168639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7470-e70b-42d6-9cd3-b0665ce7a45e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:40.169455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7470-e70b-42d6-9cd3-b0665ce7a45e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:40.169455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7470-e70b-42d6-9cd3-b0665ce7a45e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:40.170452 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:40.176904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b0eb-20e1-4187-81ee-bb2378759bb6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:40.177465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b0eb-20e1-4187-81ee-bb2378759bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:40.177465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b0eb-20e1-4187-81ee-bb2378759bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:40.250591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-15e8b0eb-20e1-4187-81ee-bb2378759bb6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:40.251875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15e8b0eb-20e1-4187-81ee-bb2378759bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:40.286092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:40.376502 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:40.415439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da7470-e70b-42d6-9cd3-b0665ce7a45e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:40.417005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-36da7470-e70b-42d6-9cd3-b0665ce7a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:40.528685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da7470-e70b-42d6-9cd3-b0665ce7a45e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:40.559586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:40.610531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a8b96-6284-40e2-9078-87c4d5254729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:40.611192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a8b96-6284-40e2-9078-87c4d5254729 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:40.611504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a8b96-6284-40e2-9078-87c4d5254729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:40.611783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a8b96-6284-40e2-9078-87c4d5254729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:40.613464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-448a8b96-6284-40e2-9078-87c4d5254729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:40.733024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a8b96-6284-40e2-9078-87c4d5254729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:40.734607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a8b96-6284-40e2-9078-87c4d5254729 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:40.754035 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 737/1458] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:42.932262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11595-a5bc-4722-9c9e-ad8931f26c1d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:42.932947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11595-a5bc-4722-9c9e-ad8931f26c1d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:42.933120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11595-a5bc-4722-9c9e-ad8931f26c1d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:42.935515 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:42.942259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507ea2-7532-4898-b5a1-bbf872f016fc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:42.942854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507ea2-7532-4898-b5a1-bbf872f016fc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:42.942962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507ea2-7532-4898-b5a1-bbf872f016fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:43.042937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f3507ea2-7532-4898-b5a1-bbf872f016fc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:43.044995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3507ea2-7532-4898-b5a1-bbf872f016fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:43.060492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:43.215446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:43.255929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11595-a5bc-4722-9c9e-ad8931f26c1d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:43.257615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dff11595-a5bc-4722-9c9e-ad8931f26c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:43.463182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11595-a5bc-4722-9c9e-ad8931f26c1d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:43.534142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:43.571563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695a666-3d87-4dbc-a2d1-a82da9a4a98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:43.572714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695a666-3d87-4dbc-a2d1-a82da9a4a98c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:43.573230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695a666-3d87-4dbc-a2d1-a82da9a4a98c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:43.573740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695a666-3d87-4dbc-a2d1-a82da9a4a98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:43.577134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d695a666-3d87-4dbc-a2d1-a82da9a4a98c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:43.736655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695a666-3d87-4dbc-a2d1-a82da9a4a98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:43.738226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695a666-3d87-4dbc-a2d1-a82da9a4a98c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:43.760704 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 723/1461] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:46.051694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280e8c2-000d-4fa6-ae2c-e943e1bbc1bd None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:46.052518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280e8c2-000d-4fa6-ae2c-e943e1bbc1bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:46.052518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280e8c2-000d-4fa6-ae2c-e943e1bbc1bd None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:46.053631 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:46.059628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5744-15fb-4ada-abf6-5eecd1551b8c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:46.060491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5744-15fb-4ada-abf6-5eecd1551b8c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:46.060491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5744-15fb-4ada-abf6-5eecd1551b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:46.141297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-656e5744-15fb-4ada-abf6-5eecd1551b8c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:46.142771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-656e5744-15fb-4ada-abf6-5eecd1551b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:46.191575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:46.265944 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:46.306161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280e8c2-000d-4fa6-ae2c-e943e1bbc1bd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:46.307795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1280e8c2-000d-4fa6-ae2c-e943e1bbc1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:46.439039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280e8c2-000d-4fa6-ae2c-e943e1bbc1bd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:46.492999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:46.566207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b81e5-fdb8-40e3-8e6c-011e76aa0a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:46.567346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b81e5-fdb8-40e3-8e6c-011e76aa0a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:46.567850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b81e5-fdb8-40e3-8e6c-011e76aa0a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:46.568352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b81e5-fdb8-40e3-8e6c-011e76aa0a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:46.571914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-521b81e5-fdb8-40e3-8e6c-011e76aa0a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:46.721740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b81e5-fdb8-40e3-8e6c-011e76aa0a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:46.723787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b81e5-fdb8-40e3-8e6c-011e76aa0a4c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:46.756707 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 740/1464] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:48.919806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcc65-f526-4d44-bd38-c13de26f1ae2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:48.920689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcc65-f526-4d44-bd38-c13de26f1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:48.920853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcc65-f526-4d44-bd38-c13de26f1ae2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:48.922289 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:26:48.928924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c503f-fe93-44b8-a53e-487dbfa0b717 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:48.929610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c503f-fe93-44b8-a53e-487dbfa0b717 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:48.929948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c503f-fe93-44b8-a53e-487dbfa0b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:49.019081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3b2c503f-fe93-44b8-a53e-487dbfa0b717 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:49.020396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b2c503f-fe93-44b8-a53e-487dbfa0b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:49.050170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:49.155959 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:26:49.193700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fcc65-f526-4d44-bd38-c13de26f1ae2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:49.195329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c74fcc65-f526-4d44-bd38-c13de26f1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:49.324645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fcc65-f526-4d44-bd38-c13de26f1ae2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:49.407062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:49.415543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bda0-562b-49f6-bd7e-010951aa18af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:49.416433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bda0-562b-49f6-bd7e-010951aa18af service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:49.416721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bda0-562b-49f6-bd7e-010951aa18af service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:49.417007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bda0-562b-49f6-bd7e-010951aa18af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:49.418797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8639bda0-562b-49f6-bd7e-010951aa18af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:49.585424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bda0-562b-49f6-bd7e-010951aa18af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:49.586892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bda0-562b-49f6-bd7e-010951aa18af service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:49.608827 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 726/1467] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:51.822546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd09e-009b-4d1c-bc49-8bcc7bf08efe None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:51.823311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd09e-009b-4d1c-bc49-8bcc7bf08efe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:51.823491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd09e-009b-4d1c-bc49-8bcc7bf08efe None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:51.825098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:51.832036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9d2f-a391-402f-8754-784166adf20a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:51.832901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9d2f-a391-402f-8754-784166adf20a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:51.833072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9d2f-a391-402f-8754-784166adf20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:51.915357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c48d9d2f-a391-402f-8754-784166adf20a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:51.916670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c48d9d2f-a391-402f-8754-784166adf20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:51.982070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:52.053713 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:26:52.093541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd09e-009b-4d1c-bc49-8bcc7bf08efe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:52.095304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69dcd09e-009b-4d1c-bc49-8bcc7bf08efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:52.226275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd09e-009b-4d1c-bc49-8bcc7bf08efe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:52.290982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:52.324891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52965d8d-ae62-48f1-bfbc-ae3230ea6679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:52.325567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52965d8d-ae62-48f1-bfbc-ae3230ea6679 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:52.325845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52965d8d-ae62-48f1-bfbc-ae3230ea6679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:52.326124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52965d8d-ae62-48f1-bfbc-ae3230ea6679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:52.328025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52965d8d-ae62-48f1-bfbc-ae3230ea6679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:52.476496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52965d8d-ae62-48f1-bfbc-ae3230ea6679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:52.479400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52965d8d-ae62-48f1-bfbc-ae3230ea6679 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:52.518088 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 743/1470] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:02.050997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=22 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:02.513441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=66 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:13.979361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386c59d-8bcc-44d1-b126-00d90631771f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:13.979945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386c59d-8bcc-44d1-b126-00d90631771f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:13.980269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386c59d-8bcc-44d1-b126-00d90631771f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:13.982467 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 728/1471] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:27:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:13.989965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e389d4-f1a8-4480-81ba-1c371c3aa4b2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:13.990627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e389d4-f1a8-4480-81ba-1c371c3aa4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:13.990627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e389d4-f1a8-4480-81ba-1c371c3aa4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:14.067959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b9e389d4-f1a8-4480-81ba-1c371c3aa4b2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:14.069236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9e389d4-f1a8-4480-81ba-1c371c3aa4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:14.186636 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 744/1472] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:27:14.284473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab39526-18c5-4f11-b74f-abe9d2b88e18 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:14.284770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab39526-18c5-4f11-b74f-abe9d2b88e18 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:14.285252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab39526-18c5-4f11-b74f-abe9d2b88e18 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:14.286860 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 729/1473] 10.222.0.98 () {54 vars in 962 bytes} [Thu Jul 14 14:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:14.293017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409f627-15cf-4b1c-ae43-46d4966f347a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:14.293361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409f627-15cf-4b1c-ae43-46d4966f347a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:14.293687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409f627-15cf-4b1c-ae43-46d4966f347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:14.390162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4409f627-15cf-4b1c-ae43-46d4966f347a None None] MFA Rules not processed for user `0ded1996761b4d7d8ec89534d2103dea`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:14.392178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4409f627-15cf-4b1c-ae43-46d4966f347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:14.418480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:14.493419 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 745/1474] 10.222.0.98 () {58 vars in 1059 bytes} [Thu Jul 14 14:27:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:27:14.502387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab39526-18c5-4f11-b74f-abe9d2b88e18 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:14.505522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aab39526-18c5-4f11-b74f-abe9d2b88e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:14.688916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab39526-18c5-4f11-b74f-abe9d2b88e18 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:14.777691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43f63-b915-404c-971b-8867a2773323 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:14.778368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43f63-b915-404c-971b-8867a2773323 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:14.778657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43f63-b915-404c-971b-8867a2773323 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:14.778942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43f63-b915-404c-971b-8867a2773323 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:14.780730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-29e43f63-b915-404c-971b-8867a2773323 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:14.845369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:14.906848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43f63-b915-404c-971b-8867a2773323 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:14.908361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43f63-b915-404c-971b-8867a2773323 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:14.929573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 730/1475] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:17.160902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8834-a529-4768-aa0a-f8897c1717bb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:17.161463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8834-a529-4768-aa0a-f8897c1717bb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:17.161463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8834-a529-4768-aa0a-f8897c1717bb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:17.162884 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 746/1476] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:17.168942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220af34-e5af-4ec4-8a2b-4a9de7a3b3f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:17.169782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220af34-e5af-4ec4-8a2b-4a9de7a3b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:17.169956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220af34-e5af-4ec4-8a2b-4a9de7a3b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:17.246436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e220af34-e5af-4ec4-8a2b-4a9de7a3b3f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:17.247712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e220af34-e5af-4ec4-8a2b-4a9de7a3b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:17.364666 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 731/1477] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:27:17.392010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8834-a529-4768-aa0a-f8897c1717bb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:17.394173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-333d8834-a529-4768-aa0a-f8897c1717bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:17.536568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8834-a529-4768-aa0a-f8897c1717bb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:17.605684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:17.661921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954bfa9-a888-4daa-837c-c0b206431873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:17.663135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954bfa9-a888-4daa-837c-c0b206431873 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:17.663681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954bfa9-a888-4daa-837c-c0b206431873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:17.664187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954bfa9-a888-4daa-837c-c0b206431873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:17.665605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954bfa9-a888-4daa-837c-c0b206431873 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:17.668861 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-3954bfa9-a888-4daa-837c-c0b206431873 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:17.668861 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:27:17.668861 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:27:17.671171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954bfa9-a888-4daa-837c-c0b206431873 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:17.709622 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 747/1478] 10.222.0.98 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:17 2022] GET /identity/v3/projects => generated 2553 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:27:19.835615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0723f63-a9a5-4632-ac70-9dce1db4fb92 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:19.836442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0723f63-a9a5-4632-ac70-9dce1db4fb92 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:19.836442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0723f63-a9a5-4632-ac70-9dce1db4fb92 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:19.837495 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 732/1479] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:27:19.843497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3548-e5f3-421a-94d6-33173a858972 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:19.844747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3548-e5f3-421a-94d6-33173a858972 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:19.844747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3548-e5f3-421a-94d6-33173a858972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:19.919713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1cec3548-e5f3-421a-94d6-33173a858972 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:19.920983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1cec3548-e5f3-421a-94d6-33173a858972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:20.039661 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 748/1480] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:27:20.089016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0723f63-a9a5-4632-ac70-9dce1db4fb92 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:20.090700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a0723f63-a9a5-4632-ac70-9dce1db4fb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:20.102973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:20.269506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0723f63-a9a5-4632-ac70-9dce1db4fb92 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:20.362435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:20.399342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f174dc-bc6d-43d0-8e28-5debfe78cbc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:20.400023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f174dc-bc6d-43d0-8e28-5debfe78cbc3 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:20.400317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f174dc-bc6d-43d0-8e28-5debfe78cbc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:20.400600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f174dc-bc6d-43d0-8e28-5debfe78cbc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:20.402376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f8f174dc-bc6d-43d0-8e28-5debfe78cbc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:20.509446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f174dc-bc6d-43d0-8e28-5debfe78cbc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:20.511130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f174dc-bc6d-43d0-8e28-5debfe78cbc3 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:20.532436 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 733/1481] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:22.886103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b289-afcc-49e6-a806-71870c38c34b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:22.886712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b289-afcc-49e6-a806-71870c38c34b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:22.886712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b289-afcc-49e6-a806-71870c38c34b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:22.888251 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 749/1482] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:22.894837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46a315-cfd3-4d93-8cca-8cc30f5f4b5d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:22.895432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46a315-cfd3-4d93-8cca-8cc30f5f4b5d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:22.895659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46a315-cfd3-4d93-8cca-8cc30f5f4b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:22.972237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a46a315-cfd3-4d93-8cca-8cc30f5f4b5d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:22.973477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a46a315-cfd3-4d93-8cca-8cc30f5f4b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:23.026413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:23.086398 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 734/1483] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:27:23.128262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9b289-afcc-49e6-a806-71870c38c34b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:23.129966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06f9b289-afcc-49e6-a806-71870c38c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:23.156932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:23.252939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9b289-afcc-49e6-a806-71870c38c34b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:23.356207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c906d-abbe-4c53-98d5-b882bc3b2314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:23.356876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c906d-abbe-4c53-98d5-b882bc3b2314 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:23.357163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c906d-abbe-4c53-98d5-b882bc3b2314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:23.357439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c906d-abbe-4c53-98d5-b882bc3b2314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:23.359351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a69c906d-abbe-4c53-98d5-b882bc3b2314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:23.467576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:23.522974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c906d-abbe-4c53-98d5-b882bc3b2314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:23.525866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c906d-abbe-4c53-98d5-b882bc3b2314 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:23.549106 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 750/1484] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:25.759074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87bde-12e5-468a-9027-5095cd130f57 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:25.759703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87bde-12e5-468a-9027-5095cd130f57 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:25.759826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87bde-12e5-468a-9027-5095cd130f57 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:25.761295 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 735/1485] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:27:25.767860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c3fd-1ac2-491e-b6e7-89eef277ab67 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:25.768471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c3fd-1ac2-491e-b6e7-89eef277ab67 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:25.768471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c3fd-1ac2-491e-b6e7-89eef277ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:25.846894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5d57c3fd-1ac2-491e-b6e7-89eef277ab67 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:25.848156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d57c3fd-1ac2-491e-b6e7-89eef277ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:26.002357 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 751/1486] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:27:26.041914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87bde-12e5-468a-9027-5095cd130f57 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:26.043553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4ab87bde-12e5-468a-9027-5095cd130f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:26.191758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87bde-12e5-468a-9027-5095cd130f57 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:26.296744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:26.299502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf82c-f466-4f06-95cb-5c90bbe33e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:26.300212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf82c-f466-4f06-95cb-5c90bbe33e86 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:26.300562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf82c-f466-4f06-95cb-5c90bbe33e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:26.301039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf82c-f466-4f06-95cb-5c90bbe33e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:26.304080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a98bf82c-f466-4f06-95cb-5c90bbe33e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:26.460223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf82c-f466-4f06-95cb-5c90bbe33e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:26.461699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf82c-f466-4f06-95cb-5c90bbe33e86 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:26.483891 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 736/1487] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:28.824489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ced30-a625-4969-ae02-70ee8fad0ddb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:28.825125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ced30-a625-4969-ae02-70ee8fad0ddb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:28.825125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ced30-a625-4969-ae02-70ee8fad0ddb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:28.826526 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 752/1488] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:28.833518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cd26-7326-4acc-9b4b-9827ef407dac None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:28.834338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cd26-7326-4acc-9b4b-9827ef407dac None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:28.834676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cd26-7326-4acc-9b4b-9827ef407dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:28.955173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2394cd26-7326-4acc-9b4b-9827ef407dac None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:28.957375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2394cd26-7326-4acc-9b4b-9827ef407dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:29.038094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:29.091464 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 737/1489] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:27:29.132774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ced30-a625-4969-ae02-70ee8fad0ddb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:29.134379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-361ced30-a625-4969-ae02-70ee8fad0ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:29.179299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:29.257601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ced30-a625-4969-ae02-70ee8fad0ddb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:29.347892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2271846-d2b8-4d33-b555-59cc62e658cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:29.348921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2271846-d2b8-4d33-b555-59cc62e658cd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:29.349439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2271846-d2b8-4d33-b555-59cc62e658cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:29.349949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2271846-d2b8-4d33-b555-59cc62e658cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:29.353324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2271846-d2b8-4d33-b555-59cc62e658cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:29.465874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:29.501555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2271846-d2b8-4d33-b555-59cc62e658cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:29.503056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2271846-d2b8-4d33-b555-59cc62e658cd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:29.524310 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 753/1490] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:31.986042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6ac32-3257-4968-8b32-49c46304a0c2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:31.986669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6ac32-3257-4968-8b32-49c46304a0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:31.986669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6ac32-3257-4968-8b32-49c46304a0c2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:31.988268 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 738/1491] 10.222.0.98 () {54 vars in 926 bytes} [Thu Jul 14 14:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:31.995808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99081bf-c3a7-4114-a652-b24aa33dc952 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:31.996657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99081bf-c3a7-4114-a652-b24aa33dc952 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:31.996834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99081bf-c3a7-4114-a652-b24aa33dc952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:32.087411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a99081bf-c3a7-4114-a652-b24aa33dc952 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:32.089879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a99081bf-c3a7-4114-a652-b24aa33dc952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:32.275951 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 754/1492] 10.222.0.98 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:27:32.340179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6ac32-3257-4968-8b32-49c46304a0c2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:32.342155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8dd6ac32-3257-4968-8b32-49c46304a0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:32.477601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6ac32-3257-4968-8b32-49c46304a0c2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:32.569537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a34485-9744-4925-bab3-9b6c715e57c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:32.570107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34485-9744-4925-bab3-9b6c715e57c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:32.570391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34485-9744-4925-bab3-9b6c715e57c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:32.570666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34485-9744-4925-bab3-9b6c715e57c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:32.572495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a7a34485-9744-4925-bab3-9b6c715e57c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:32.584465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:32.709539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a34485-9744-4925-bab3-9b6c715e57c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:32.711011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a34485-9744-4925-bab3-9b6c715e57c8 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:32.734579 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 739/1493] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:42.271345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:42.730196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=50 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:14.438804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:14.439561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:14.439867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:14.560177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:14.562255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:14.689071 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 755/1494] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:29:14.697808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79b0e-8ee8-48cc-baae-4505b2913b8f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:14.698405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79b0e-8ee8-48cc-baae-4505b2913b8f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:14.698405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79b0e-8ee8-48cc-baae-4505b2913b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:14.787166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3af79b0e-8ee8-48cc-baae-4505b2913b8f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:14.788380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3af79b0e-8ee8-48cc-baae-4505b2913b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:14.923679 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 740/1495] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:29:14.928564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:14.929955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:14.942291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2bbfc-686b-4f96-8426-264b64016940 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:15.015845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:15.057362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:15.058061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:15.058398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:15.058717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:15.059571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:29:15.059915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:15.061008 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:15.061008 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:29:15.061008 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:29:15.062336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:15.076492 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 756/1496] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:29:15.086637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af79b0e-8ee8-48cc-baae-4505b2913b8f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:15.097891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af79b0e-8ee8-48cc-baae-4505b2913b8f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:15.178415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:15.247951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:15.249708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:15.250188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:15.250662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:15.253260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:15.256897 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:15.256897 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:29:15.256897 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:29:15.259858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:15.341379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 741/1497] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:29:15 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:29:15.346423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:15.348376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:15.389294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba86fa-d5ef-4b36-993e-a518681fe103 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:15.506153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:15.507214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:15.507618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:15.507996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:15.508811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:15.509963 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:15.509963 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:29:15.509963 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:29:15.511502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:15.561253 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 757/1498] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:29:15 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:29:15.565826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:15.567421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:15.644319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7be75-7524-40d8-b04f-a5c9b8c30938 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:15.745408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:15.760062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:15.760861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:15.761189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:15.761508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:15.762304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:15.763561 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:15.763561 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:29:15.763561 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:29:15.765384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:15.783032 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 742/1499] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:29:15.789478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:15.793454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:15.812746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f3b05-a631-44a3-87f2-1a6f979706ae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:15.844973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:15.930037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147f110-59a8-43fd-bcd3-9920c5a67022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:15.930780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147f110-59a8-43fd-bcd3-9920c5a67022 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:15.931176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147f110-59a8-43fd-bcd3-9920c5a67022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:15.931530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147f110-59a8-43fd-bcd3-9920c5a67022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:15.932324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147f110-59a8-43fd-bcd3-9920c5a67022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:15.933406 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-8147f110-59a8-43fd-bcd3-9920c5a67022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:15.933406 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:29:15.933406 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:29:15.934440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147f110-59a8-43fd-bcd3-9920c5a67022 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:15.950462 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 758/1500] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:29:15.956002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:15.957740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:15.997096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af113cf-b1b8-4cfc-9fb8-646a93f1bcc8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:16.110637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29f836-6f7f-415e-97a2-6b0d324d0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:16.111702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f836-6f7f-415e-97a2-6b0d324d0e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:16.112096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f836-6f7f-415e-97a2-6b0d324d0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:16.112473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f836-6f7f-415e-97a2-6b0d324d0e6a admin admin] PATH_INFO: `/v3/projects/0f1c5c52e1c844ada59dde7d0d7259f4/users/2ae00ffb071241718bc7e489e79c4dbf/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:16.140249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29f836-6f7f-415e-97a2-6b0d324d0e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1c5c52e1c844ada59dde7d0d7259f4, user_id=2ae00ffb071241718bc7e489e79c4dbf, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:16.141313 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-0e29f836-6f7f-415e-97a2-6b0d324d0e6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:16.141313 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:29:16.141313 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:29:16.143369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29f836-6f7f-415e-97a2-6b0d324d0e6a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:16.173171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 743/1501] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:29:15 2022] PUT /identity/v3/projects/0f1c5c52e1c844ada59dde7d0d7259f4/users/2ae00ffb071241718bc7e489e79c4dbf/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:29:16.187186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b646-b61d-4409-aff1-e01ec365bc2a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:16.187577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b646-b61d-4409-aff1-e01ec365bc2a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:16.187962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b646-b61d-4409-aff1-e01ec365bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:16.259510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0342b646-b61d-4409-aff1-e01ec365bc2a None None] MFA Rules not processed for user `2ae00ffb071241718bc7e489e79c4dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:16.260797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0342b646-b61d-4409-aff1-e01ec365bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:16.354258 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 759/1502] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:16.369058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7f675-dcf4-4ba0-b00a-e0575cb98178 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:16.369342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7f675-dcf4-4ba0-b00a-e0575cb98178 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:16.369626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7f675-dcf4-4ba0-b00a-e0575cb98178 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:16.371079 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 744/1503] 10.222.0.98 () {54 vars in 963 bytes} [Thu Jul 14 14:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:29:16.377295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f5735-93d0-40b1-9fff-486148519904 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:16.377714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f5735-93d0-40b1-9fff-486148519904 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:16.378475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f5735-93d0-40b1-9fff-486148519904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:16.428681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:16.496126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-136f5735-93d0-40b1-9fff-486148519904 None None] MFA Rules not processed for user `3db64ff447674dd2a2f15b005696075b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:16.497280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-136f5735-93d0-40b1-9fff-486148519904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:16.596442 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 760/1504] 10.222.0.98 () {58 vars in 1060 bytes} [Thu Jul 14 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:16.604872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7f675-dcf4-4ba0-b00a-e0575cb98178 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:16.606537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3eb7f675-dcf4-4ba0-b00a-e0575cb98178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:16.675575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:16.745418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7f675-dcf4-4ba0-b00a-e0575cb98178 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:16.833004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:16.833582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:16.833867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:16.834147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:16.836173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:16.954021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:16.955512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:16.959261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:16.977094 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 745/1505] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:17.024736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18cf73-7229-49f7-bf35-4bfe8a49ddb5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:17.025083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18cf73-7229-49f7-bf35-4bfe8a49ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:17.025425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18cf73-7229-49f7-bf35-4bfe8a49ddb5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:17.026996 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 761/1506] 10.222.0.98 () {52 vars in 829 bytes} [Thu Jul 14 14:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:29:17.032014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:17.033381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:17.156480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05038a46-2191-4742-bea2-3815164abe9e service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:17.270412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:17.271463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:17.271745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:17.276961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] PATH_INFO: `/v3/users/2ae00ffb071241718bc7e489e79c4dbf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:17.288782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae00ffb071241718bc7e489e79c4dbf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:17.289907 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:17.289907 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:29:17.289907 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:29:17.291499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:17.303792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:17.368053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae00ffb071241718bc7e489e79c4dbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:17.388691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae00ffb071241718bc7e489e79c4dbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:17.389295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae00ffb071241718bc7e489e79c4dbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:17.403601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae00ffb071241718bc7e489e79c4dbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:17.404091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae00ffb071241718bc7e489e79c4dbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:17.426130 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 746/1507] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:29:17 2022] DELETE /identity/v3/users/2ae00ffb071241718bc7e489e79c4dbf => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:29:17.430932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:17.431429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:17.431760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:17.503514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:17.504822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:17.595796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:17.611650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 762/1508] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:29:17.625036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:17.626291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:17.750740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c1fd-a9e2-4843-a0a8-be1229435e60 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:17.816324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:17.852430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449578b-d617-4d93-a581-0016a05e7288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:17.853564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449578b-d617-4d93-a581-0016a05e7288 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:17.854089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449578b-d617-4d93-a581-0016a05e7288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:17.854614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449578b-d617-4d93-a581-0016a05e7288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:17.858045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a449578b-d617-4d93-a581-0016a05e7288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:18.039639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449578b-d617-4d93-a581-0016a05e7288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:18.041228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449578b-d617-4d93-a581-0016a05e7288 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:18.071520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 747/1509] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:18.519241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:18.521806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:18.539154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b346fd-27c0-4b9c-b000-b58af12f6680 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:18.686361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:18.687248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:18.687565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:18.687848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] PATH_INFO: `/v3/projects/0f1c5c52e1c844ada59dde7d0d7259f4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:18.700194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1c5c52e1c844ada59dde7d0d7259f4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:18.701265 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:18.701265 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:29:18.701265 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:29:18.703055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:18.781925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1c5c52e1c844ada59dde7d0d7259f4', 'request_id': 'req-354c9628-f267-4163-af87-4e126ee09aac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:18.788227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1c5c52e1c844ada59dde7d0d7259f4', 'request_id': 'req-354c9628-f267-4163-af87-4e126ee09aac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:18.801990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1c5c52e1c844ada59dde7d0d7259f4', 'request_id': 'req-354c9628-f267-4163-af87-4e126ee09aac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:18.834784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] The token cache is being invalidate because project 0f1c5c52e1c844ada59dde7d0d7259f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:29:18.835423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:18.836101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-354c9628-f267-4163-af87-4e126ee09aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:29:18.837826 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 763/1510] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:18 2022] DELETE /identity/v3/projects/0f1c5c52e1c844ada59dde7d0d7259f4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:29:28.065819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=62 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:28.832406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:45.446760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f7b0-b1bd-4662-b0ac-9367f9918283 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:45.447470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f7b0-b1bd-4662-b0ac-9367f9918283 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:45.447470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f7b0-b1bd-4662-b0ac-9367f9918283 None None] PATH_INFO: `/v3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:45.448981 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 748/1511] 10.222.0.110 () {54 vars in 926 bytes} [Thu Jul 14 14:32:45 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:32:45.456885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6a04-c267-43c7-89d6-ac4c947e8218 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:45.457496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6a04-c267-43c7-89d6-ac4c947e8218 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:45.457496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6a04-c267-43c7-89d6-ac4c947e8218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:45.553300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-890e6a04-c267-43c7-89d6-ac4c947e8218 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:45.554552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-890e6a04-c267-43c7-89d6-ac4c947e8218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:45.665142 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 764/1512] 10.222.0.110 () {58 vars in 1016 bytes} [Thu Jul 14 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:49.220682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf8f7-770f-4878-a4a1-7faf8abf6cc6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:49.221241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf8f7-770f-4878-a4a1-7faf8abf6cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:49.221241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf8f7-770f-4878-a4a1-7faf8abf6cc6 None None] PATH_INFO: `/v3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:49.223300 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 749/1513] 10.222.0.104 () {54 vars in 926 bytes} [Thu Jul 14 14:32:49 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:32:49.230084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ef06b-2f6e-49a1-a3fb-da692654d95f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:49.231133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ef06b-2f6e-49a1-a3fb-da692654d95f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:49.231427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ef06b-2f6e-49a1-a3fb-da692654d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:49.254022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d89ef06b-2f6e-49a1-a3fb-da692654d95f None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:49.255173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d89ef06b-2f6e-49a1-a3fb-da692654d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:49.265390 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 765/1514] 10.222.0.104 () {58 vars in 1016 bytes} [Thu Jul 14 14:32:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:54.993987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7ce9-0d5c-45d2-be6a-92abf40e0e25 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:54.994600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7ce9-0d5c-45d2-be6a-92abf40e0e25 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:54.994600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7ce9-0d5c-45d2-be6a-92abf40e0e25 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:54.996725 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 750/1515] 10.222.0.98 () {54 vars in 960 bytes} [Thu Jul 14 14:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:32:55.002774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a11d4-75ae-466b-b6bb-d58d0cead1f3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:55.003357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a11d4-75ae-466b-b6bb-d58d0cead1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:55.003524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a11d4-75ae-466b-b6bb-d58d0cead1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:55.023073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4f7a11d4-75ae-466b-b6bb-d58d0cead1f3 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:55.024389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f7a11d4-75ae-466b-b6bb-d58d0cead1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:55.034014 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 766/1516] 10.222.0.98 () {58 vars in 1057 bytes} [Thu Jul 14 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:55.041827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e7ce9-0d5c-45d2-be6a-92abf40e0e25 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:55.057871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e7ce9-0d5c-45d2-be6a-92abf40e0e25 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:55.064842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4033c97-382d-48e6-b248-4385aacc6b65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:55.065887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033c97-382d-48e6-b248-4385aacc6b65 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:55.066174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033c97-382d-48e6-b248-4385aacc6b65 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:55.066456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033c97-382d-48e6-b248-4385aacc6b65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:55.076178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4033c97-382d-48e6-b248-4385aacc6b65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:55.077812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4033c97-382d-48e6-b248-4385aacc6b65 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:55.089070 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 751/1517] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:58.453254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4755c-6b94-4e52-a122-e2b55a3db33a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:58.453827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4755c-6b94-4e52-a122-e2b55a3db33a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:58.453827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4755c-6b94-4e52-a122-e2b55a3db33a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:58.455217 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 767/1518] 10.222.0.98 () {54 vars in 960 bytes} [Thu Jul 14 14:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:32:58.461387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b936e6-250f-4a3b-afe9-4715bc12d0cc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:58.462415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b936e6-250f-4a3b-afe9-4715bc12d0cc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:58.462415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b936e6-250f-4a3b-afe9-4715bc12d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:58.481609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-03b936e6-250f-4a3b-afe9-4715bc12d0cc None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:58.482849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-03b936e6-250f-4a3b-afe9-4715bc12d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:58.492135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 752/1519] 10.222.0.98 () {58 vars in 1057 bytes} [Thu Jul 14 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:32:58.501544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4755c-6b94-4e52-a122-e2b55a3db33a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:58.517478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4755c-6b94-4e52-a122-e2b55a3db33a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:58.522877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7dd20-0331-4171-9ed6-cf5160ba1b57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:58.523596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7dd20-0331-4171-9ed6-cf5160ba1b57 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:58.523887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7dd20-0331-4171-9ed6-cf5160ba1b57 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:58.524172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7dd20-0331-4171-9ed6-cf5160ba1b57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:58.536527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7dd20-0331-4171-9ed6-cf5160ba1b57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:58.538865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7dd20-0331-4171-9ed6-cf5160ba1b57 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:58.550685 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 768/1520] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:33:08.475933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:08.546088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=75 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:19.269600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728330-fddd-4451-958f-10adb4e41ad0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:19.270047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728330-fddd-4451-958f-10adb4e41ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:19.270187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728330-fddd-4451-958f-10adb4e41ad0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:19.271835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 753/1521] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:33:19.277686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618658f-f004-4fd7-b54d-c411e64f1635 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:19.278299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618658f-f004-4fd7-b54d-c411e64f1635 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:19.278432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618658f-f004-4fd7-b54d-c411e64f1635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:19.333577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c618658f-f004-4fd7-b54d-c411e64f1635 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:33:19.334805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c618658f-f004-4fd7-b54d-c411e64f1635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:33:19.398369 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 769/1522] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:33:19.647096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728330-fddd-4451-958f-10adb4e41ad0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:33:19.649294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-64728330-fddd-4451-958f-10adb4e41ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:33:19.792637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728330-fddd-4451-958f-10adb4e41ad0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:33:19.801392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a014c80-48e6-4eef-a788-c1e74fab3bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:33:19.802435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014c80-48e6-4eef-a788-c1e74fab3bf4 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:19.802865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014c80-48e6-4eef-a788-c1e74fab3bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:19.803263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014c80-48e6-4eef-a788-c1e74fab3bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:19.819048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a014c80-48e6-4eef-a788-c1e74fab3bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:33:19.821950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a014c80-48e6-4eef-a788-c1e74fab3bf4 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:33:19.841185 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 754/1523] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:33:20.720702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea17b31-8062-46e5-9303-5411da9171e7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:20.721317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea17b31-8062-46e5-9303-5411da9171e7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:20.721317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea17b31-8062-46e5-9303-5411da9171e7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:20.722687 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 770/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:33:20.728485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7da1-f7a7-4c2d-a5fb-faf228d1ffd4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:20.729140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7da1-f7a7-4c2d-a5fb-faf228d1ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:20.729268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7da1-f7a7-4c2d-a5fb-faf228d1ffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:20.749967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-242c7da1-f7a7-4c2d-a5fb-faf228d1ffd4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:33:20.751188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-242c7da1-f7a7-4c2d-a5fb-faf228d1ffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:33:20.759337 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 755/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:33:20.916043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea17b31-8062-46e5-9303-5411da9171e7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:33:20.937964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea17b31-8062-46e5-9303-5411da9171e7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:33:20.943827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3556522-6a08-4e14-bf93-5fc4d6a28a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:33:20.944497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3556522-6a08-4e14-bf93-5fc4d6a28a4a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:20.944785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3556522-6a08-4e14-bf93-5fc4d6a28a4a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:20.945071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3556522-6a08-4e14-bf93-5fc4d6a28a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:20.954896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3556522-6a08-4e14-bf93-5fc4d6a28a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:33:20.956602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3556522-6a08-4e14-bf93-5fc4d6a28a4a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:33:20.968443 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 771/1526] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:33:24.892169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc935fc-a4c2-4656-8407-e750cec80731 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:24.892760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc935fc-a4c2-4656-8407-e750cec80731 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:24.892760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc935fc-a4c2-4656-8407-e750cec80731 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:24.894050 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 756/1527] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:33:24.903837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9b3d7-ecb5-4e24-afec-57f5634fc3a5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:24.904414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9b3d7-ecb5-4e24-afec-57f5634fc3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:24.904807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9b3d7-ecb5-4e24-afec-57f5634fc3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:24.932902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e6d9b3d7-ecb5-4e24-afec-57f5634fc3a5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:33:24.934949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e6d9b3d7-ecb5-4e24-afec-57f5634fc3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:33:24.947949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 772/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:33:25.030901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc935fc-a4c2-4656-8407-e750cec80731 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:33:25.033338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2bc935fc-a4c2-4656-8407-e750cec80731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:33:25.161336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc935fc-a4c2-4656-8407-e750cec80731 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:33:25.167774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74975eb5-6d35-493c-97a5-5d6c94d49969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:33:25.169000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975eb5-6d35-493c-97a5-5d6c94d49969 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:25.169515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975eb5-6d35-493c-97a5-5d6c94d49969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:25.170011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975eb5-6d35-493c-97a5-5d6c94d49969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:25.187784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74975eb5-6d35-493c-97a5-5d6c94d49969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:33:25.190535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74975eb5-6d35-493c-97a5-5d6c94d49969 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:33:25.207470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 757/1529] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:33:27.384564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46f5c-e4e3-48cd-afa0-f24a845fb9a2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:27.385144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46f5c-e4e3-48cd-afa0-f24a845fb9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:27.385144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46f5c-e4e3-48cd-afa0-f24a845fb9a2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:27.386788 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 773/1530] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:33:27.396370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacdd21-108e-4db3-be57-53ef24c42d9c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:27.396950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacdd21-108e-4db3-be57-53ef24c42d9c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:27.397405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacdd21-108e-4db3-be57-53ef24c42d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:27.430189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-deacdd21-108e-4db3-be57-53ef24c42d9c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:33:27.432413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-deacdd21-108e-4db3-be57-53ef24c42d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:33:27.446983 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 758/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:33:27.485422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc46f5c-e4e3-48cd-afa0-f24a845fb9a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:33:27.497888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc46f5c-e4e3-48cd-afa0-f24a845fb9a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:33:27.502163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66cdcf-f837-4e2b-b000-8a928dfba9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:33:27.502951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66cdcf-f837-4e2b-b000-8a928dfba9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:33:27.503297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66cdcf-f837-4e2b-b000-8a928dfba9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:33:27.503846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66cdcf-f837-4e2b-b000-8a928dfba9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:33:27.514682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66cdcf-f837-4e2b-b000-8a928dfba9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:33:27.516355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66cdcf-f837-4e2b-b000-8a928dfba9a8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:33:27.528640 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 774/1532] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:33:37.421634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:37.522673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=52 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:19.759416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80ec0f-0d09-4f0d-af55-aa10f85be74b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:19.760724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80ec0f-0d09-4f0d-af55-aa10f85be74b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:19.760724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80ec0f-0d09-4f0d-af55-aa10f85be74b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:19.762021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 759/1533] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:34:19.768301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa94a3-e34d-4020-b3a0-5569709cbc54 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:19.768845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa94a3-e34d-4020-b3a0-5569709cbc54 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:19.768845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa94a3-e34d-4020-b3a0-5569709cbc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:19.790844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-40aa94a3-e34d-4020-b3a0-5569709cbc54 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:34:19.792404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-40aa94a3-e34d-4020-b3a0-5569709cbc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:19.802802 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 775/1534] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:34:29.784236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:00.405350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad65e5-b5de-4544-81ce-a82ca329e59e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:00.405931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad65e5-b5de-4544-81ce-a82ca329e59e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:00.406393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad65e5-b5de-4544-81ce-a82ca329e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:00.453323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8bad65e5-b5de-4544-81ce-a82ca329e59e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:00.455831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8bad65e5-b5de-4544-81ce-a82ca329e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:00.480503 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 760/1535] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:00.491941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82181-a811-41ec-a1b7-1272dd9b9701 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:00.492870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82181-a811-41ec-a1b7-1272dd9b9701 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:00.492950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82181-a811-41ec-a1b7-1272dd9b9701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:00.541731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a9a82181-a811-41ec-a1b7-1272dd9b9701 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:00.543919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9a82181-a811-41ec-a1b7-1272dd9b9701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:00.563968 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 776/1536] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:00.570561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad65e5-b5de-4544-81ce-a82ca329e59e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:00.603224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad65e5-b5de-4544-81ce-a82ca329e59e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:00.619109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:00.620348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:00.620832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:00.621351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:00.623400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:00.623960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:00.626364 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:00.626364 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:35:00.626364 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:35:00.628202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:00.663085 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 761/1537] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:00.685687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82181-a811-41ec-a1b7-1272dd9b9701 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:00.715416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82181-a811-41ec-a1b7-1272dd9b9701 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:00.730220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:00.732042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:00.732556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:00.733066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:00.734376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:00.736390 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:00.736390 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:35:00.736390 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:35:00.738780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:00.841546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 777/1538] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:00 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:00.849213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:00.877607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01c344-8f3e-4961-b611-a614272e8488 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:01.035952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:01.037735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.038184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.038666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.040639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:01.047310 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:01.047310 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:35:01.047310 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:35:01.048550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:01.103639 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 762/1539] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:00 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:01.111767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:01.146501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f57ca-5c35-4d25-b2a1-eabb1dd6da65 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:01.160627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:01.160627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.160627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.161310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.163292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:01.166449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:01.200826 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 778/1540] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:01.229981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:01.262889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ae019-c54e-4d71-b27e-905aa13acea7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:01.280704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4910d9-213e-4361-a262-1a1944b4392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:01.281900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4910d9-213e-4361-a262-1a1944b4392b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.282407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4910d9-213e-4361-a262-1a1944b4392b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.282912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4910d9-213e-4361-a262-1a1944b4392b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.284829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4910d9-213e-4361-a262-1a1944b4392b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:01.288067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4910d9-213e-4361-a262-1a1944b4392b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:01.318094 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 763/1541] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:01.325874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:01.350208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7098-fe68-43cc-9056-fb4d8890b5d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:01.369797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24c3c9-5f7c-4af8-8ec8-fa820aca7a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:01.371446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c3c9-5f7c-4af8-8ec8-fa820aca7a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.371928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c3c9-5f7c-4af8-8ec8-fa820aca7a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.372422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c3c9-5f7c-4af8-8ec8-fa820aca7a85 admin admin] PATH_INFO: `/v3/projects/19329650123c4a2f8d0ac7a73f1c1397/users/c93780ebefe44646af7284316c6b40a9/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.407714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24c3c9-5f7c-4af8-8ec8-fa820aca7a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19329650123c4a2f8d0ac7a73f1c1397, user_id=c93780ebefe44646af7284316c6b40a9, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:01.409757 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-5f24c3c9-5f7c-4af8-8ec8-fa820aca7a85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:01.409757 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:35:01.409757 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:35:01.414275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24c3c9-5f7c-4af8-8ec8-fa820aca7a85 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:01.428846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3cfb-77a3-4627-9b2c-49cf6e70ecc9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.429975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3cfb-77a3-4627-9b2c-49cf6e70ecc9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.430491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3cfb-77a3-4627-9b2c-49cf6e70ecc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.450779 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 779/1542] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:01 2022] PUT /identity/v3/projects/19329650123c4a2f8d0ac7a73f1c1397/users/c93780ebefe44646af7284316c6b40a9/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:01.494882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bb8c3cfb-77a3-4627-9b2c-49cf6e70ecc9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.497207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb8c3cfb-77a3-4627-9b2c-49cf6e70ecc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.497583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8d77-b037-40f3-9be8-25ce95107d42 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.498284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8d77-b037-40f3-9be8-25ce95107d42 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.498839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8d77-b037-40f3-9be8-25ce95107d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.553924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e6d8d77-b037-40f3-9be8-25ce95107d42 None None] MFA Rules not processed for user `c93780ebefe44646af7284316c6b40a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.556443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e6d8d77-b037-40f3-9be8-25ce95107d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.630362 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 764/1543] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:01.635309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0766e-a730-48ec-88bd-eb1613b76a3e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.635309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0766e-a730-48ec-88bd-eb1613b76a3e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.635681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0766e-a730-48ec-88bd-eb1613b76a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.665774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e3c0766e-a730-48ec-88bd-eb1613b76a3e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.667178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e3c0766e-a730-48ec-88bd-eb1613b76a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.691580 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 765/1544] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:01.691580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee8db-1a1e-4108-9460-2cd58c8dc742 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.691580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee8db-1a1e-4108-9460-2cd58c8dc742 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.691580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee8db-1a1e-4108-9460-2cd58c8dc742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.726561 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 780/1545] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:35:01.728733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbf15-76f2-449f-b4d2-53d603910e53 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.729030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbf15-76f2-449f-b4d2-53d603910e53 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.729317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbf15-76f2-449f-b4d2-53d603910e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.734904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-adbee8db-1a1e-4108-9460-2cd58c8dc742 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.736400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-adbee8db-1a1e-4108-9460-2cd58c8dc742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.757217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5aadbf15-76f2-449f-b4d2-53d603910e53 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.758767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5aadbf15-76f2-449f-b4d2-53d603910e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.766111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 766/1546] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:01.771302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d76cc-7f3b-4f7f-ac55-835cfac6893a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.771302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d76cc-7f3b-4f7f-ac55-835cfac6893a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.771302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d76cc-7f3b-4f7f-ac55-835cfac6893a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.777563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 781/1547] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:01.783610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbf15-76f2-449f-b4d2-53d603910e53 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:01.807927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbf15-76f2-449f-b4d2-53d603910e53 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:01.809021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3e6d76cc-7f3b-4f7f-ac55-835cfac6893a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.810316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e6d76cc-7f3b-4f7f-ac55-835cfac6893a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.822971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:01.823705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.823991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.824273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.825000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:01.827019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:01.835312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 767/1548] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:01.835312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d967a35-6411-49f7-8d99-95d18d7f56e4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.835312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d967a35-6411-49f7-8d99-95d18d7f56e4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.835312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d967a35-6411-49f7-8d99-95d18d7f56e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.868195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0d967a35-6411-49f7-8d99-95d18d7f56e4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.870348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0d967a35-6411-49f7-8d99-95d18d7f56e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.884424 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 768/1549] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:01.886154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d967a35-6411-49f7-8d99-95d18d7f56e4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:01.900191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d967a35-6411-49f7-8d99-95d18d7f56e4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:01.906886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54083-a9e2-460c-b8b5-a8c69204bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:01.908238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54083-a9e2-460c-b8b5-a8c69204bb08 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.908795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54083-a9e2-460c-b8b5-a8c69204bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.909295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54083-a9e2-460c-b8b5-a8c69204bb08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.910301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54083-a9e2-460c-b8b5-a8c69204bb08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:01.910821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54083-a9e2-460c-b8b5-a8c69204bb08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:01.911471 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 782/1550] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:01.912488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:01.915719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54083-a9e2-460c-b8b5-a8c69204bb08 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:01.936839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 769/1551] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:01.938866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669fc4-68d5-4b29-8e4e-a258ad4b4277 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:01.939581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669fc4-68d5-4b29-8e4e-a258ad4b4277 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:01.940143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669fc4-68d5-4b29-8e4e-a258ad4b4277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:01.964290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1b669fc4-68d5-4b29-8e4e-a258ad4b4277 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:01.966019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1b669fc4-68d5-4b29-8e4e-a258ad4b4277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:01.997406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:02.038938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:02.068023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68226af-0917-4732-9a03-175666e018bb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.078155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.079354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.079880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.080382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.081842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:02.082596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.086164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.107682 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 770/1552] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.107682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03583-a3bf-48c3-8703-f23d7e105ae7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.108143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03583-a3bf-48c3-8703-f23d7e105ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.108586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03583-a3bf-48c3-8703-f23d7e105ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.111229 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 783/1553] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:02.113233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.133296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844efd2-c2bc-4294-82f9-84f9438537df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.140776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-93b03583-a3bf-48c3-8703-f23d7e105ae7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:02.142965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-93b03583-a3bf-48c3-8703-f23d7e105ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:02.150931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381391cf-52fb-450d-85b5-36216cae7bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.151943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381391cf-52fb-450d-85b5-36216cae7bec admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.152421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381391cf-52fb-450d-85b5-36216cae7bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.152920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381391cf-52fb-450d-85b5-36216cae7bec admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.153757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381391cf-52fb-450d-85b5-36216cae7bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.158371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381391cf-52fb-450d-85b5-36216cae7bec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.158943 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 771/1554] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.160056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03583-a3bf-48c3-8703-f23d7e105ae7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.176191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03583-a3bf-48c3-8703-f23d7e105ae7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.186747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.188352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.188845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.189377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.190967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.194670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.200077 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 784/1555] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:02.201994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b643513-25bd-4af5-9bd7-840346a5fd09 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.202286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b643513-25bd-4af5-9bd7-840346a5fd09 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.202568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b643513-25bd-4af5-9bd7-840346a5fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.236184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1b643513-25bd-4af5-9bd7-840346a5fd09 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:02.237858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b643513-25bd-4af5-9bd7-840346a5fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:02.248701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 785/1556] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.250585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 772/1557] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:02.250920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16ff7-11da-4034-8d2d-2e6eac2a2351 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.251456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16ff7-11da-4034-8d2d-2e6eac2a2351 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.252568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.252852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16ff7-11da-4034-8d2d-2e6eac2a2351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.274125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4e16ff7-11da-4034-8d2d-2e6eac2a2351 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:02.276085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4e16ff7-11da-4034-8d2d-2e6eac2a2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:02.345923 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 786/1558] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.346784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16ff7-11da-4034-8d2d-2e6eac2a2351 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.358295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16ff7-11da-4034-8d2d-2e6eac2a2351 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.363457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3605e-4312-409f-be5e-c38388a997e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.363748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b6e1a-98da-4053-a2e6-d95d5de23570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.364420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6e1a-98da-4053-a2e6-d95d5de23570 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.364702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6e1a-98da-4053-a2e6-d95d5de23570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.364982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6e1a-98da-4053-a2e6-d95d5de23570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.365692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b6e1a-98da-4053-a2e6-d95d5de23570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.367880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b6e1a-98da-4053-a2e6-d95d5de23570 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.371748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.372869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.373324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.373782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.375082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:02.375759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.379229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.399769 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 787/1559] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:02.401695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973c41-04e0-46a1-a8a0-2cf8f37c873c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.402098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973c41-04e0-46a1-a8a0-2cf8f37c873c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.402388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973c41-04e0-46a1-a8a0-2cf8f37c873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.411852 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 773/1560] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:02.411852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.428081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd973c41-04e0-46a1-a8a0-2cf8f37c873c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:02.429337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700acd-53c1-46c0-ac65-4730b3733d57 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.430219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd973c41-04e0-46a1-a8a0-2cf8f37c873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:02.526074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.527084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.527602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.528079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.529387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:02.529902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.532799 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 788/1561] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.533560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.534166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd973c41-04e0-46a1-a8a0-2cf8f37c873c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.550073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd973c41-04e0-46a1-a8a0-2cf8f37c873c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.551807 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 774/1562] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:02.553330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.560095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c7dab-b9bc-4d96-9634-ecaef863b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.561269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7dab-b9bc-4d96-9634-ecaef863b6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.561771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7dab-b9bc-4d96-9634-ecaef863b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.562297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7dab-b9bc-4d96-9634-ecaef863b6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.563694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c7dab-b9bc-4d96-9634-ecaef863b6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.566073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c7dab-b9bc-4d96-9634-ecaef863b6d4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.572123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a81bdd-04fd-4610-adb1-0ca58c34aef4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.579246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99eefb-2c98-4465-8ab9-b84c0fd14e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.580117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99eefb-2c98-4465-8ab9-b84c0fd14e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.580472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99eefb-2c98-4465-8ab9-b84c0fd14e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.580813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99eefb-2c98-4465-8ab9-b84c0fd14e4d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.581292 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 789/1563] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:02.581859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99eefb-2c98-4465-8ab9-b84c0fd14e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.582952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f43621-a107-4bb1-8dab-6221973beaca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.583364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f43621-a107-4bb1-8dab-6221973beaca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.583736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f43621-a107-4bb1-8dab-6221973beaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.585905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99eefb-2c98-4465-8ab9-b84c0fd14e4d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.609606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b6f43621-a107-4bb1-8dab-6221973beaca None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:02.611611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6f43621-a107-4bb1-8dab-6221973beaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:02.616399 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 775/1564] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/users => generated 300 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:02.620329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38e37-16fd-475a-9f00-861f1115d297 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.620600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38e37-16fd-475a-9f00-861f1115d297 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.621044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38e37-16fd-475a-9f00-861f1115d297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.629094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 790/1565] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.630491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f43621-a107-4bb1-8dab-6221973beaca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.634228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:02.644862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f43621-a107-4bb1-8dab-6221973beaca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.651376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4fd0-bc63-4392-ad7c-39142355088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.652099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4fd0-bc63-4392-ad7c-39142355088c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.652563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4fd0-bc63-4392-ad7c-39142355088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.653013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4fd0-bc63-4392-ad7c-39142355088c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.654203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4fd0-bc63-4392-ad7c-39142355088c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.657445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c5b38e37-16fd-475a-9f00-861f1115d297 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:02.657964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4fd0-bc63-4392-ad7c-39142355088c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.658899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5b38e37-16fd-475a-9f00-861f1115d297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:02.667454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 776/1566] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.668305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38e37-16fd-475a-9f00-861f1115d297 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.682019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38e37-16fd-475a-9f00-861f1115d297 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.687413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.688098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 791/1567] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:02.688270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.688410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.688702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.689510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.690043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f75a-1121-4089-97e0-0c97d42d3655 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.690538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f75a-1121-4089-97e0-0c97d42d3655 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.691004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f75a-1121-4089-97e0-0c97d42d3655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.691666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.700429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:02.719585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d149f75a-1121-4089-97e0-0c97d42d3655 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:02.721967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d149f75a-1121-4089-97e0-0c97d42d3655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:02.732639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 792/1568] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:02.733721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f75a-1121-4089-97e0-0c97d42d3655 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.735493 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 777/1569] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:02.737553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.751048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f75a-1121-4089-97e0-0c97d42d3655 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.839736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.840526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.840875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.840995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2608-c5af-4985-8a5d-14397d5f9202 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:02.841267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.842080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.844558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.849559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:02.852356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:02.852895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:02.853406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] PATH_INFO: `/v3/projects/fc288ce4bcef4d6a9871f458dc7e44f9/users/a0c417bc3b3345f8a0f7ae40d951a3e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:02.878415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 793/1570] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:02 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:02.880773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.887369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc288ce4bcef4d6a9871f458dc7e44f9, user_id=a0c417bc3b3345f8a0f7ae40d951a3e4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:02.892969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:02.916290 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 778/1571] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:02 2022] PUT /identity/v3/projects/fc288ce4bcef4d6a9871f458dc7e44f9/users/a0c417bc3b3345f8a0f7ae40d951a3e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:02.918020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:02.967372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910302-a3e4-4c13-9566-f1e616e98b40 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.037209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.038273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.038564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.038849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.039790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.041258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e6e6-8109-4a90-9580-36b56273fbbc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.042051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.049539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.050721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.051229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.051757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.053161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:03.053738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.054473 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 794/1572] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.055391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.057604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.066663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb776-6ffe-4843-9d5a-90fdbab089c6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.073029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.073851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.074227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.074552 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 779/1573] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:03.075015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.075730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.076652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:03.077043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.079297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.093402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b6eb-56cd-4c99-a76a-46c23d4b7ddf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.104585 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 795/1574] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:03.104585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.104878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.104878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.104878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.104878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.105161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.105161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.119175 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 780/1575] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.120012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.124075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bf7a5-f7a3-41ee-8132-43ce5ccaaed2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.131678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777feb5-48fb-44d8-9b84-2e12740bbc80 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.132198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.133374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.133950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.134459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.135941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:03.136522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.136850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.137549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.137849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.138126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.138834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.139757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.140888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.160548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:03.167918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 781/1576] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.168694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.179155 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 796/1577] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:03.182270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.189895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa365d1-4a06-45ae-8d55-3be46eb90fc1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.198917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.200142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.200656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.200861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f5c37-3d40-4997-8002-83ee622c0e19 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.201153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.202386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.205888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.206635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.206902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.207676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.207986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.208916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.210994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.227039 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 797/1578] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.229864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.246357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66742-33a0-4b21-bbaa-3832871dfae5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.247530 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 782/1579] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/users => generated 288 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.248542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.256263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.257052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.257419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.257794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:03.257968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.259170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.261814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.264448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb2550-db2b-49a5-883d-4fff70620920 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.273450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.274827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.275465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.275889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.276725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.277787 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 798/1580] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.278766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.280050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.297001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6284aa-deab-4989-b675-70b2baecfd68 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.303947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.304965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.305418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.306620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.307638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.310380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.317582 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 783/1581] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/projects => generated 411 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.319754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.356266 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 799/1582] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.358463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.421590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4d43-c49c-476d-ac68-c9add5ad4601 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.462987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c169d-c736-43aa-b0cc-40466a56f506 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.470221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.471299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.471732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.472354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.473282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.475880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.490449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 800/1583] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.491580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.509958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa165e-0e73-4ff3-98cf-34bf2b853800 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.513891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.514705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.515111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.515499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.516344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.516922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.517760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.518189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.518339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.518703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.519841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.522709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.541030 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 784/1584] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.541030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.550278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1387dbc-ab0f-4596-88dc-3bf8d225edf8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.556929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.558118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.558498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.558830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] PATH_INFO: `/v3/projects/fc288ce4bcef4d6a9871f458dc7e44f9/users/a0c417bc3b3345f8a0f7ae40d951a3e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.561676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc288ce4bcef4d6a9871f458dc7e44f9, user_id=a0c417bc3b3345f8a0f7ae40d951a3e4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.565363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 801/1585] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.566535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.569307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.587590 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 785/1586] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:03 2022] PUT /identity/v3/projects/fc288ce4bcef4d6a9871f458dc7e44f9/users/a0c417bc3b3345f8a0f7ae40d951a3e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:03.588885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.674019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb3d34-714b-48f6-9d3d-36fc1d18a4cc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.688448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ececc6-cc2c-4f41-a833-2c0e87e3d26f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.693599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.694522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.694802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.695082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] PATH_INFO: `/v3/projects/95e6cb6b271e40129098cf47adfb06e2/users/514824382c1f44c3a4cb77582c04c14e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.714180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e6cb6b271e40129098cf47adfb06e2, user_id=514824382c1f44c3a4cb77582c04c14e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.717469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.721457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:03.739942 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 786/1587] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:03 2022] PUT /identity/v3/projects/95e6cb6b271e40129098cf47adfb06e2/users/514824382c1f44c3a4cb77582c04c14e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:03.741313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.741486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:03.800809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.802062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.802561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.803061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.804504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.807803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.817619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9043b6-d184-4149-b728-51993fd76c36 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.825001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.825688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.825980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.826274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.826979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.829070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.830031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 802/1588] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.831309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.853720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989cb6c-ff90-4624-b38e-64ffcbaf4512 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.857307 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 787/1589] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/users => generated 306 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.858264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.861825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.862620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.862989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.863380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.864252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.866332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.873529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941aa76-188f-4865-8b3a-8eb986b214fd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.881683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.882727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.883098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.883514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.884916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.886966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.896001 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 803/1590] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/users => generated 291 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.897412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.902565 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 788/1591] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:03.903901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:03.916687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593c85c-9cde-4830-8e6c-1e73965f3578 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.917029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423c27-d647-484e-a729-bc8851c2c1ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:03.922334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167ef4-fc9e-4179-978a-7e4b04a1306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.923035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167ef4-fc9e-4179-978a-7e4b04a1306c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.923367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167ef4-fc9e-4179-978a-7e4b04a1306c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.923663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167ef4-fc9e-4179-978a-7e4b04a1306c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.924425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167ef4-fc9e-4179-978a-7e4b04a1306c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.925668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d800cd9-fc5a-4acb-be3b-e958353337b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:03.926367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167ef4-fc9e-4179-978a-7e4b04a1306c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.927229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d800cd9-fc5a-4acb-be3b-e958353337b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.927784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d800cd9-fc5a-4acb-be3b-e958353337b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.928287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d800cd9-fc5a-4acb-be3b-e958353337b4 admin admin] PATH_INFO: `/v3/projects/4e1e3e2e4d114865804976a40c6cac55/users/a876582ed4d94e9da876592597aa1c06/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.951486 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 789/1592] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:03.952868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14d74-9afc-402c-8a73-342b84cb51ae None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.953157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14d74-9afc-402c-8a73-342b84cb51ae None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.953443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14d74-9afc-402c-8a73-342b84cb51ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.957216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d800cd9-fc5a-4acb-be3b-e958353337b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1e3e2e4d114865804976a40c6cac55, user_id=a876582ed4d94e9da876592597aa1c06, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:03.961257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d800cd9-fc5a-4acb-be3b-e958353337b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:03.982464 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 804/1593] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:03 2022] PUT /identity/v3/projects/4e1e3e2e4d114865804976a40c6cac55/users/a876582ed4d94e9da876592597aa1c06/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:03.984487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e49c81-4b5e-47d5-8272-59b108bee693 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:03.984961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e49c81-4b5e-47d5-8272-59b108bee693 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:03.985386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e49c81-4b5e-47d5-8272-59b108bee693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:03.987087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2ba14d74-9afc-402c-8a73-342b84cb51ae None None] MFA Rules not processed for user `a0c417bc3b3345f8a0f7ae40d951a3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:03.988597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ba14d74-9afc-402c-8a73-342b84cb51ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:04.026290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c3e49c81-4b5e-47d5-8272-59b108bee693 None None] MFA Rules not processed for user `514824382c1f44c3a4cb77582c04c14e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:04.027603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3e49c81-4b5e-47d5-8272-59b108bee693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:04.108408 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 805/1594] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:04.109298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e49c81-4b5e-47d5-8272-59b108bee693 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.116268 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 790/1595] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:04.117805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14d74-9afc-402c-8a73-342b84cb51ae None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.201526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:04.208971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e49c81-4b5e-47d5-8272-59b108bee693 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.216272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.217394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.217867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.218421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.220018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.223468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.224979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14d74-9afc-402c-8a73-342b84cb51ae None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.230361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.231058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.231382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.231665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.232405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.234068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.248534 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 806/1596] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:04.248534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.255536 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 791/1597] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:04.256830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.266607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b6cd9-621d-4ed6-b1d1-1b2a5377f33c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.271101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e43233-c9cd-4713-aa6a-c95a9f059129 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.276203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391e3e4-a67a-4da7-9b4d-1b9d8b238159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.276987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.277208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e3e4-a67a-4da7-9b4d-1b9d8b238159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.277488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e3e4-a67a-4da7-9b4d-1b9d8b238159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.277672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e3e4-a67a-4da7-9b4d-1b9d8b238159 admin admin] PATH_INFO: `/v3/projects/7d5b1ad669de4499b8ff71b9dd2cc780/users/65b23c692f4e40dd80218b649202dcc5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.278250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.278738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.279235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.280575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.283570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.296618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391e3e4-a67a-4da7-9b4d-1b9d8b238159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5b1ad669de4499b8ff71b9dd2cc780, user_id=65b23c692f4e40dd80218b649202dcc5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.299501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391e3e4-a67a-4da7-9b4d-1b9d8b238159 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.306724 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 807/1598] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:04.306724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.317516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:04.319820 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 792/1599] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:04 2022] PUT /identity/v3/projects/7d5b1ad669de4499b8ff71b9dd2cc780/users/65b23c692f4e40dd80218b649202dcc5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:04.321997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843894-b20b-46f8-b246-6b60c38429f3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.322290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843894-b20b-46f8-b246-6b60c38429f3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.322610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843894-b20b-46f8-b246-6b60c38429f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.336766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673d6b9-7ea0-48bb-8502-2dee1097f5e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.367482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2d843894-b20b-46f8-b246-6b60c38429f3 None None] MFA Rules not processed for user `a876582ed4d94e9da876592597aa1c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:04.370021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2d843894-b20b-46f8-b246-6b60c38429f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:04.423135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.424245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.424718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.425169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.426036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.428992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.445588 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 808/1600] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:04.447535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.461565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a5ed-b33d-476e-ac57-2f6c15b818b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.469788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.470908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.471411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.471906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.473132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.476679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.488530 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 793/1601] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:04.490815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fad03-ecfc-493b-8700-003fb17d4c33 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.491334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fad03-ecfc-493b-8700-003fb17d4c33 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.491821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fad03-ecfc-493b-8700-003fb17d4c33 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.494958 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 794/1602] 10.222.0.98 () {54 vars in 961 bytes} [Thu Jul 14 14:35:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:04.496327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fad03-ecfc-493b-8700-003fb17d4c33 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.514730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fad03-ecfc-493b-8700-003fb17d4c33 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.525645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 809/1603] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:04 2022] POST /identity/v3/projects => generated 397 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:04.525645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.526068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.526068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.526068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.526068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] PATH_INFO: `/v3/projects/c7a730920325430ca28aa04a9434aea6/users/63af4fced46f4febbf930e90380338d2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.554232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a730920325430ca28aa04a9434aea6, user_id=63af4fced46f4febbf930e90380338d2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.558034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.576791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 795/1604] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:04 2022] PUT /identity/v3/projects/c7a730920325430ca28aa04a9434aea6/users/63af4fced46f4febbf930e90380338d2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:04.577951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.626087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21318199-afc6-4d58-b6db-2dfeb9231db6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.680303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac03f16-0fda-415e-b2b2-131bf35d8e9c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.687641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762af88-038c-4ac2-a41a-86894e5d735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.688521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762af88-038c-4ac2-a41a-86894e5d735e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.688813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762af88-038c-4ac2-a41a-86894e5d735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.689122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762af88-038c-4ac2-a41a-86894e5d735e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.689889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762af88-038c-4ac2-a41a-86894e5d735e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.691592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762af88-038c-4ac2-a41a-86894e5d735e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.700366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.701263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.701673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.702230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.703677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.705375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.711976 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 796/1605] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:04.714368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fee94-07cb-48f2-8b95-57937aeb6510 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.714834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fee94-07cb-48f2-8b95-57937aeb6510 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.715389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fee94-07cb-48f2-8b95-57937aeb6510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.723134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 810/1606] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:04.723134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.732087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59d57b-7ce8-427f-ba25-3156dd8c195f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.737374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.738082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.738370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.738650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.739439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.741099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.758285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e21fee94-07cb-48f2-8b95-57937aeb6510 None None] MFA Rules not processed for user `65b23c692f4e40dd80218b649202dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:04.759684 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 811/1607] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:04.760958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e21fee94-07cb-48f2-8b95-57937aeb6510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:04.761341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.767009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:04.776315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d8d07-ccb9-4027-8d8d-47ec67b12102 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.783642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b3a4-c494-4282-963c-59286c85a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.784710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b3a4-c494-4282-963c-59286c85a9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.785075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b3a4-c494-4282-963c-59286c85a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.785496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b3a4-c494-4282-963c-59286c85a9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.786428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b3a4-c494-4282-963c-59286c85a9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.788975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b3a4-c494-4282-963c-59286c85a9cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.801375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:04.831363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 812/1608] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:04 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:04.834117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa0a6-8c66-4184-8233-95af5ff8d58d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.835137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa0a6-8c66-4184-8233-95af5ff8d58d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.835951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa0a6-8c66-4184-8233-95af5ff8d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.854838 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 797/1609] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:04.855489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fee94-07cb-48f2-8b95-57937aeb6510 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:04.872345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fee94-07cb-48f2-8b95-57937aeb6510 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:04.902046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-098fa0a6-8c66-4184-8233-95af5ff8d58d None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:04.904190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-098fa0a6-8c66-4184-8233-95af5ff8d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:04.940525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b714f77-18a5-486a-a0ae-3cff4dc23580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:04.941249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b714f77-18a5-486a-a0ae-3cff4dc23580 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.941527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b714f77-18a5-486a-a0ae-3cff4dc23580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.941809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b714f77-18a5-486a-a0ae-3cff4dc23580 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:04.942521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b714f77-18a5-486a-a0ae-3cff4dc23580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:04.944572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b714f77-18a5-486a-a0ae-3cff4dc23580 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:04.969297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 798/1610] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:04 2022] POST /identity/v3/users => generated 305 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:04.970767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4426da7-b443-4cf0-8e64-28197aa0e80c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:04.971067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4426da7-b443-4cf0-8e64-28197aa0e80c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:04.971383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4426da7-b443-4cf0-8e64-28197aa0e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.008336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c4426da7-b443-4cf0-8e64-28197aa0e80c None None] MFA Rules not processed for user `63af4fced46f4febbf930e90380338d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:05.010617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c4426da7-b443-4cf0-8e64-28197aa0e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:05.014127 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 813/1611] 10.222.0.98 () {58 vars in 1058 bytes} [Thu Jul 14 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:05.015560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa0a6-8c66-4184-8233-95af5ff8d58d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.032865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa0a6-8c66-4184-8233-95af5ff8d58d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.038212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.039150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.039479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.039763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] PATH_INFO: `/v3/projects/99599aa1aa6547758b1b2a8bcef85925/users/0192ef478d974448b4d76d2752640b76/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.060325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99599aa1aa6547758b1b2a8bcef85925, user_id=0192ef478d974448b4d76d2752640b76, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.064228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.088894 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 814/1612] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:05 2022] PUT /identity/v3/projects/99599aa1aa6547758b1b2a8bcef85925/users/0192ef478d974448b4d76d2752640b76/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:05.088894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.127838 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 799/1613] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:05.128996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4426da7-b443-4cf0-8e64-28197aa0e80c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.142062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4426da7-b443-4cf0-8e64-28197aa0e80c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.175242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:05.185030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305239de-87b0-4405-ba4c-137a27bf7ee8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.193546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.195176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.195616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.196059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] PATH_INFO: `/v3/projects/149c07a07cc04dc5acb9e626459b6222/users/921ab539d8be44f09b5277aa1abe4665/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.216825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149c07a07cc04dc5acb9e626459b6222, user_id=921ab539d8be44f09b5277aa1abe4665, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.219875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.242617 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 815/1614] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:05 2022] PUT /identity/v3/projects/149c07a07cc04dc5acb9e626459b6222/users/921ab539d8be44f09b5277aa1abe4665/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:05.244111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.252874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.254219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.254658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.255308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] PATH_INFO: `/v3/projects/e9b30f4bd8ef428f9e9821b2e314131f/users/c2ddd784bcb9474e9d4f23b14f663245/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.278198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b30f4bd8ef428f9e9821b2e314131f, user_id=c2ddd784bcb9474e9d4f23b14f663245, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.281325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.297272 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 800/1615] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:05 2022] PUT /identity/v3/projects/e9b30f4bd8ef428f9e9821b2e314131f/users/c2ddd784bcb9474e9d4f23b14f663245/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:05.298307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.315539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:05.374126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff74730-1df8-472c-a10f-2f278ad562b1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.389811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271840b8-747d-4e55-8740-ee5d7eea7207 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.395695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.396475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.396920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.397518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.398608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.401461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.434427 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 801/1616] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:05 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:05.435550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.478569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.479171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.479510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.479809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.480650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.482706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.511480 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 816/1617] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:05 2022] POST /identity/v3/users => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:05.511480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.546216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d83f-13f4-4be1-b3cd-e9348e354385 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.553967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9a6f8-4485-4f60-b42c-b462941f7c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.555048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9a6f8-4485-4f60-b42c-b462941f7c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.556097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9a6f8-4485-4f60-b42c-b462941f7c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.556565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9a6f8-4485-4f60-b42c-b462941f7c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.557601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9a6f8-4485-4f60-b42c-b462941f7c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.560590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9a6f8-4485-4f60-b42c-b462941f7c3b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.580010 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 802/1618] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:05.582360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209e3f-1578-4963-ab1d-f1773595dfe5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.582860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209e3f-1578-4963-ab1d-f1773595dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.583392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209e3f-1578-4963-ab1d-f1773595dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.615016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4f209e3f-1578-4963-ab1d-f1773595dfe5 None None] MFA Rules not processed for user `0192ef478d974448b4d76d2752640b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:05.616334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f209e3f-1578-4963-ab1d-f1773595dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:05.625870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db404-928a-4d78-821b-5827da79ef49 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.646942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:05.709264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:05.715491 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 803/1619] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:05.721453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f209e3f-1578-4963-ab1d-f1773595dfe5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.727296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f209e3f-1578-4963-ab1d-f1773595dfe5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:05.732221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a220d-d2b6-426e-96a4-82e16aa0d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.732785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a220d-d2b6-426e-96a4-82e16aa0d061 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.733068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a220d-d2b6-426e-96a4-82e16aa0d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.733351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a220d-d2b6-426e-96a4-82e16aa0d061 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.734066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a220d-d2b6-426e-96a4-82e16aa0d061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.734736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677242f-da4c-40cb-b515-10c26ec3bb75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:05.735939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677242f-da4c-40cb-b515-10c26ec3bb75 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.736134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a220d-d2b6-426e-96a4-82e16aa0d061 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.736579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677242f-da4c-40cb-b515-10c26ec3bb75 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.737081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677242f-da4c-40cb-b515-10c26ec3bb75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.768101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 804/1620] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:05 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:05.769431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3efa4-bd85-47fe-affa-f1a6019fa88a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.770547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3efa4-bd85-47fe-affa-f1a6019fa88a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.770547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3efa4-bd85-47fe-affa-f1a6019fa88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.800111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-53b3efa4-bd85-47fe-affa-f1a6019fa88a None None] MFA Rules not processed for user `921ab539d8be44f09b5277aa1abe4665`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:05.801395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53b3efa4-bd85-47fe-affa-f1a6019fa88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:05.840749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677242f-da4c-40cb-b515-10c26ec3bb75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:05.843329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677242f-da4c-40cb-b515-10c26ec3bb75 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:05.856534 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 817/1621] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:05.857898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedbba-66a6-40e8-8bd0-82cbdfc87ec6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:05.858189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedbba-66a6-40e8-8bd0-82cbdfc87ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:05.858470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedbba-66a6-40e8-8bd0-82cbdfc87ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:05.891441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9bdedbba-66a6-40e8-8bd0-82cbdfc87ec6 None None] MFA Rules not processed for user `c2ddd784bcb9474e9d4f23b14f663245`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:05.892732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9bdedbba-66a6-40e8-8bd0-82cbdfc87ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:05.900835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 805/1622] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:05.902443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3efa4-bd85-47fe-affa-f1a6019fa88a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:05.998533 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 818/1623] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:05.999962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdedbba-66a6-40e8-8bd0-82cbdfc87ec6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.008156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3efa4-bd85-47fe-affa-f1a6019fa88a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.015583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.016489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.016894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.017336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.018227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.019040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdedbba-66a6-40e8-8bd0-82cbdfc87ec6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.020857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.027201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.028330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.028797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.029594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.030978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.034030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.049226 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 806/1624] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:05 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.051022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.059606 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 819/1625] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:06.061738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.070672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598d436-8211-4833-9f8f-ac96f6efdb6c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.078331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.079525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.079938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.080343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] PATH_INFO: `/v3/projects/e17d7a3778d741e481f5a85e2e89f099/users/36043899ed164e7489b8d8d25b27c802/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.083748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ae9d-0c4e-4303-90e1-d152274a1147 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.093903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.095016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.095566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.096395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.098319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.099185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.103925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.104441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17d7a3778d741e481f5a85e2e89f099, user_id=36043899ed164e7489b8d8d25b27c802, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.111120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.145348 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 807/1626] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:06 2022] PUT /identity/v3/projects/e17d7a3778d741e481f5a85e2e89f099/users/36043899ed164e7489b8d8d25b27c802/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:06.146478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.164084 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 820/1627] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:06 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.170645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.268993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.274027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9bafa-e447-405b-b183-86c7c3901e76 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.289393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.291115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.291720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.292206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.293605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.297398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.298502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeefdd-20f8-4ee9-b1a1-b9d3bf6e9d57 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.309717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.311150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.312027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.312319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.313602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.318205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.331735 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 808/1628] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:06 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.332899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.351950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482db95a-ce4d-4fdb-b893-1140e5ee2a90 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.358520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.359221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.359592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.359812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.360525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.362489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.375209 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 821/1629] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:06 2022] POST /identity/v3/projects => generated 411 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.375209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.411426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 809/1630] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:06 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.413199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.466788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2a8c7-2529-4546-9af3-36269c6864da admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.493552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f800f6-16ff-44d0-86dc-4ff823afa735 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.499312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.500254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.500542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.500827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] PATH_INFO: `/v3/projects/5f0d3e417558482f8ad745ca722d94ff/users/b7e3c609731c4325ab021b29b7a5fce7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.517776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0d3e417558482f8ad745ca722d94ff, user_id=b7e3c609731c4325ab021b29b7a5fce7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.520639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.541902 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 810/1631] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:06 2022] PUT /identity/v3/projects/5f0d3e417558482f8ad745ca722d94ff/users/b7e3c609731c4325ab021b29b7a5fce7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:06.541902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.574944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.576026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.576449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.576919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.578601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.581846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.598259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.606281 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 822/1632] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:06.606281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.624270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987c2fc-11f4-41b0-9910-821eafcc02e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.630344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b563b5-8476-4d6f-83f9-f066b782a072 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.630623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.631509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.631888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.632648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.633715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.637092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.639366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.640278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.640720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.641002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.641737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.643647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.663072 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 811/1633] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:06.664212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.669361 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 823/1634] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:06 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.671219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.676399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3d6c-4fd4-4542-998d-c952c59baf92 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.681668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.682372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.682738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.683102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.683898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.684566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ef314-46ae-4bcb-a3e3-24d6595a159f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.685545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.690570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.691487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.691864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.692282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.693309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.696645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.698198 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 812/1635] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:06.699057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.710876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467c578-429e-464a-9267-193ce1e853ad admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.718458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.720170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.720894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.721590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.723717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.727806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.732541 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 824/1636] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:06 2022] POST /identity/v3/users => generated 312 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.733609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.744936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3a8d-6cef-4d7c-b612-80512846339b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.750786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.751533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.751866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.752089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.753086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.754840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.766095 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 813/1637] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:06 2022] POST /identity/v3/users => generated 298 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:06.767490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.768168 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 825/1638] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:06.768168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.781870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab63de-f0bd-4360-ae14-c233b70ac760 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.787750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.788666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.788768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d014cbf-82f7-4862-b563-5a67d62e3575 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.788969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.789219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] PATH_INFO: `/v3/users/c93780ebefe44646af7284316c6b40a9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.790594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93780ebefe44646af7284316c6b40a9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.791695 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:06.791695 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:35:06.791695 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:35:06.792936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.797872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:06.799512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:06.800011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:06.800506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] PATH_INFO: `/v3/projects/349293ed3c6e4b84a9a01b06dc818ee3/users/645f3914062b45aba748d8884e936524/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:06.825142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] RBAC: Authorizing `identity:create_grant(project_id=349293ed3c6e4b84a9a01b06dc818ee3, user_id=645f3914062b45aba748d8884e936524, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:06.828646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:06.846298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.849928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 814/1639] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:06 2022] PUT /identity/v3/projects/349293ed3c6e4b84a9a01b06dc818ee3/users/645f3914062b45aba748d8884e936524/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:06.851583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.881756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93780ebefe44646af7284316c6b40a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:06.912231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93780ebefe44646af7284316c6b40a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:06.924614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93780ebefe44646af7284316c6b40a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:06.925935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93780ebefe44646af7284316c6b40a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:06.939555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93780ebefe44646af7284316c6b40a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:06.948176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff4fdb-805e-402b-94a1-46eb2cf6376a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:06.949995 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 826/1640] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:06 2022] DELETE /identity/v3/users/c93780ebefe44646af7284316c6b40a9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:06.951573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:06.953829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.029748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.030883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.031379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.031969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] PATH_INFO: `/v3/projects/e17d7a3778d741e481f5a85e2e89f099/users/36043899ed164e7489b8d8d25b27c802/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.034282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17d7a3778d741e481f5a85e2e89f099, user_id=36043899ed164e7489b8d8d25b27c802, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.037961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.044584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0637b-5190-47e4-9c4b-8f52e4af6170 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.052359 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 815/1641] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:06 2022] PUT /identity/v3/projects/e17d7a3778d741e481f5a85e2e89f099/users/36043899ed164e7489b8d8d25b27c802/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:07.053707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.058027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.121079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:07.129264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.130398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.130853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.131341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.132708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.137023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.158645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 827/1642] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:07.158645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.159982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.170203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe226-885a-4a96-beed-578e4d853bfa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.175298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.176931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.177221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.177507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] PATH_INFO: `/v3/projects/14ac76afa05e4400ba2512b3fc2453f0/users/33fbeca1a697411c9aae72ba9f24c884/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.183472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15332b0-0486-438a-b629-829424a24c42 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.193614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.194852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.195189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ac76afa05e4400ba2512b3fc2453f0, user_id=33fbeca1a697411c9aae72ba9f24c884, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.195412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.195929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.197869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.198645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.201045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.216625 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 816/1643] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:07 2022] PUT /identity/v3/projects/14ac76afa05e4400ba2512b3fc2453f0/users/33fbeca1a697411c9aae72ba9f24c884/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:07.217573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.220859 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 828/1644] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:07.222373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.222630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.226136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.250561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a2c3-8e39-4e55-986f-6d233389080b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.294995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:07.328883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8b5a5-fe26-4e5c-99b4-f9917ef32127 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.331787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.332877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.333310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.333708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] PATH_INFO: `/v3/projects/5f0d3e417558482f8ad745ca722d94ff/users/b7e3c609731c4325ab021b29b7a5fce7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.336325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0d3e417558482f8ad745ca722d94ff, user_id=b7e3c609731c4325ab021b29b7a5fce7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.338004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb5e7-6a2c-4412-b447-3991e2e93057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.339218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb5e7-6a2c-4412-b447-3991e2e93057 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.339574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.339794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb5e7-6a2c-4412-b447-3991e2e93057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.340293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb5e7-6a2c-4412-b447-3991e2e93057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.341736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb5e7-6a2c-4412-b447-3991e2e93057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.345026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb5e7-6a2c-4412-b447-3991e2e93057 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.354923 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 829/1645] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:07 2022] PUT /identity/v3/projects/5f0d3e417558482f8ad745ca722d94ff/users/b7e3c609731c4325ab021b29b7a5fce7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:07.356147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.363292 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 817/1646] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:07.363533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.363704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72e9a9-a0c7-43ce-aaf6-3d4fbcd41aa5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.363704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72e9a9-a0c7-43ce-aaf6-3d4fbcd41aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.363704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72e9a9-a0c7-43ce-aaf6-3d4fbcd41aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.381679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ee72e9a9-a0c7-43ce-aaf6-3d4fbcd41aa5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:07.383210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ee72e9a9-a0c7-43ce-aaf6-3d4fbcd41aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.463171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 818/1647] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:07.464868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49e28-322b-4986-bfd4-4ff19a874245 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.465172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49e28-322b-4986-bfd4-4ff19a874245 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.465331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c893867-09b0-49f4-9fb6-4957062b4267 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.465455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49e28-322b-4986-bfd4-4ff19a874245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.472270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.473269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.473567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.473850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.475002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.477856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.501506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-14d49e28-322b-4986-bfd4-4ff19a874245 None None] MFA Rules not processed for user `36043899ed164e7489b8d8d25b27c802`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:07.501783 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 830/1648] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:07.501783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.502003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-14d49e28-322b-4986-bfd4-4ff19a874245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.514070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0007eb-341c-4ad3-a9ef-04da652816bb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.519508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.520600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.520895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.521178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] PATH_INFO: `/v3/projects/ff6b7040a2284f218a101dfd023aa5ec/users/d33a4a3d5a644fdebc14b71a3cca13ea/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.538829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:07.549631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6b7040a2284f218a101dfd023aa5ec, user_id=d33a4a3d5a644fdebc14b71a3cca13ea, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.554888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.577480 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 831/1649] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:07 2022] PUT /identity/v3/projects/ff6b7040a2284f218a101dfd023aa5ec/users/d33a4a3d5a644fdebc14b71a3cca13ea/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:07.579211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.587248 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 819/1650] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:07.588242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d49e28-322b-4986-bfd4-4ff19a874245 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.608023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d49e28-322b-4986-bfd4-4ff19a874245 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.685298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f517-6e2d-49de-97b6-a91e51f2876c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.691358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.692069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.692356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.692645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.693405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.693568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64306765-4979-496b-bc8c-6a3eae73f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.694358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64306765-4979-496b-bc8c-6a3eae73f234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.694647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64306765-4979-496b-bc8c-6a3eae73f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.694935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64306765-4979-496b-bc8c-6a3eae73f234 admin admin] PATH_INFO: `/v3/projects/814c67643349454aa591a40c1f35528f/users/ff66fbcd8f5341d69b92eb5b60e56cee/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.695091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.707190 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 832/1651] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:07.708322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.720452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a59e5-b5c9-425a-a75a-3238016f9bc9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.721605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64306765-4979-496b-bc8c-6a3eae73f234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814c67643349454aa591a40c1f35528f, user_id=ff66fbcd8f5341d69b92eb5b60e56cee, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.725039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64306765-4979-496b-bc8c-6a3eae73f234 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.726080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.727008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.727837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.728140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] PATH_INFO: `/v3/projects/a736eed6f369472fa1351d8bfb7968a2/users/bf4e61f0e37743e2907c715a41eb6303/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.744056 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 820/1652] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:07 2022] PUT /identity/v3/projects/814c67643349454aa591a40c1f35528f/users/ff66fbcd8f5341d69b92eb5b60e56cee/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:07.745809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeef8b-4fc6-4d72-a7c0-3791e5fedb80 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.746144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeef8b-4fc6-4d72-a7c0-3791e5fedb80 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.746520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeef8b-4fc6-4d72-a7c0-3791e5fedb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.749335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a736eed6f369472fa1351d8bfb7968a2, user_id=bf4e61f0e37743e2907c715a41eb6303, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.752187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.775846 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 833/1653] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:07 2022] PUT /identity/v3/projects/a736eed6f369472fa1351d8bfb7968a2/users/bf4e61f0e37743e2907c715a41eb6303/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:07.775846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.776756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.779137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6deeef8b-4fc6-4d72-a7c0-3791e5fedb80 None None] MFA Rules not processed for user `b7e3c609731c4325ab021b29b7a5fce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:07.780409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6deeef8b-4fc6-4d72-a7c0-3791e5fedb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:07.810712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:07.861511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1b27-ef6c-43e5-8bc3-93f420c715a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.865733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.866413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.866698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.867092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.893003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 821/1654] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:07.893990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deeef8b-4fc6-4d72-a7c0-3791e5fedb80 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.953707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:07.965539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.967046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.980889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deeef8b-4fc6-4d72-a7c0-3791e5fedb80 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:07.981784 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 834/1655] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:07.983068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:07.986137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:07.987075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:07.987386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:07.987665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] PATH_INFO: `/v3/projects/349293ed3c6e4b84a9a01b06dc818ee3/users/645f3914062b45aba748d8884e936524/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:07.989825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=349293ed3c6e4b84a9a01b06dc818ee3, user_id=645f3914062b45aba748d8884e936524, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:07.992813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:07.996520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8b08a-cd72-4bac-98c7-7041e7583618 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.001763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.002462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.002754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.003041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.003905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.005663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.009603 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 822/1656] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:07 2022] PUT /identity/v3/projects/349293ed3c6e4b84a9a01b06dc818ee3/users/645f3914062b45aba748d8884e936524/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:08.010522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.012300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:08.029264 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 835/1657] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:08.029264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.041003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e1c26-2935-4118-b377-a0369a24528c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.140375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec615a7-ee95-4b63-8b23-b562b0a2ce98 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.156290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.157479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.157993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.158167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.158651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.159285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.160560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.160560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] PATH_INFO: `/v3/projects/14ac76afa05e4400ba2512b3fc2453f0/users/33fbeca1a697411c9aae72ba9f24c884/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.163333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ac76afa05e4400ba2512b3fc2453f0, user_id=33fbeca1a697411c9aae72ba9f24c884, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.167686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.184158 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 836/1658] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:08 2022] PUT /identity/v3/projects/14ac76afa05e4400ba2512b3fc2453f0/users/33fbeca1a697411c9aae72ba9f24c884/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:08.185266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.303335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.305318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.316771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:08.326434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 823/1659] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:08.328115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.346666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73fa5-32be-4865-8f59-10af777d40e5 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.349834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c02f1-663e-4cbf-9bf1-256b31b9dcfe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.355128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31b4a5-9eb9-445b-8395-1c16854ab208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.356289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b4a5-9eb9-445b-8395-1c16854ab208 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.356772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b4a5-9eb9-445b-8395-1c16854ab208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.357280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b4a5-9eb9-445b-8395-1c16854ab208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.358573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31b4a5-9eb9-445b-8395-1c16854ab208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.360897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.361565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31b4a5-9eb9-445b-8395-1c16854ab208 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.362291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.363091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.363667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.365354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.372737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.382293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 824/1660] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:08.384605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12a16d-6d97-4623-bfa1-25235ac01090 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.385074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12a16d-6d97-4623-bfa1-25235ac01090 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.385789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12a16d-6d97-4623-bfa1-25235ac01090 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.388293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 825/1661] 10.222.0.98 () {54 vars in 961 bytes} [Thu Jul 14 14:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:08.390076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629737-39db-4bea-90b4-1b8ab16bd7c3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.390493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629737-39db-4bea-90b4-1b8ab16bd7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.390977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629737-39db-4bea-90b4-1b8ab16bd7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.419497 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 837/1662] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:08.422005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.443727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cf629737-39db-4bea-90b4-1b8ab16bd7c3 None None] MFA Rules not processed for user `645f3914062b45aba748d8884e936524`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:08.446120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24121-1ad4-4a58-aac7-4608561b9d35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.447963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf629737-39db-4bea-90b4-1b8ab16bd7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:08.460605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753b42-3cf0-4abe-be7a-3652b17869fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.461552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753b42-3cf0-4abe-be7a-3652b17869fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.461908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753b42-3cf0-4abe-be7a-3652b17869fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.466909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753b42-3cf0-4abe-be7a-3652b17869fb admin admin] PATH_INFO: `/v3/projects/ff6b7040a2284f218a101dfd023aa5ec/users/d33a4a3d5a644fdebc14b71a3cca13ea/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.475257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753b42-3cf0-4abe-be7a-3652b17869fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6b7040a2284f218a101dfd023aa5ec, user_id=d33a4a3d5a644fdebc14b71a3cca13ea, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.481983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753b42-3cf0-4abe-be7a-3652b17869fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.531322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 838/1663] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:08 2022] PUT /identity/v3/projects/ff6b7040a2284f218a101dfd023aa5ec/users/d33a4a3d5a644fdebc14b71a3cca13ea/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:08.532938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711841a-2489-4b61-8b89-b62512ee8703 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.533248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711841a-2489-4b61-8b89-b62512ee8703 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.533576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711841a-2489-4b61-8b89-b62512ee8703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.535204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:08.573168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f711841a-2489-4b61-8b89-b62512ee8703 None None] MFA Rules not processed for user `33fbeca1a697411c9aae72ba9f24c884`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:08.574757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f711841a-2489-4b61-8b89-b62512ee8703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:08.603441 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 826/1664] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:08.603441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf629737-39db-4bea-90b4-1b8ab16bd7c3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.621598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf629737-39db-4bea-90b4-1b8ab16bd7c3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.693259 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 839/1665] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:08.694909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.695307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.695601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.720004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:08.721269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:08.733934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.735771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.736254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.736732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] PATH_INFO: `/v3/projects/a736eed6f369472fa1351d8bfb7968a2/users/bf4e61f0e37743e2907c715a41eb6303/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.740282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a736eed6f369472fa1351d8bfb7968a2, user_id=bf4e61f0e37743e2907c715a41eb6303, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.745699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.765080 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 827/1666] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:08 2022] PUT /identity/v3/projects/a736eed6f369472fa1351d8bfb7968a2/users/bf4e61f0e37743e2907c715a41eb6303/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:08.766355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.847870 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 840/1667] 10.222.0.98 () {58 vars in 1058 bytes} [Thu Jul 14 14:35:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:08.848833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:08.850305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:08.865494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537d79-4981-4161-b58b-79ffbaa75be6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.871222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.872178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.872466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.872750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] PATH_INFO: `/v3/projects/19329650123c4a2f8d0ac7a73f1c1397` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.874115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19329650123c4a2f8d0ac7a73f1c1397)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.876182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.878011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094baaa-ce34-422b-8082-c69ecca9195b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:08.886602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a470e7e-9a4b-445e-ae78-4dad07c5a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:08.887877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a470e7e-9a4b-445e-ae78-4dad07c5a0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.888345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a470e7e-9a4b-445e-ae78-4dad07c5a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.888759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a470e7e-9a4b-445e-ae78-4dad07c5a0a8 admin admin] PATH_INFO: `/v3/projects/814c67643349454aa591a40c1f35528f/users/ff66fbcd8f5341d69b92eb5b60e56cee/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.891758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a470e7e-9a4b-445e-ae78-4dad07c5a0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814c67643349454aa591a40c1f35528f, user_id=ff66fbcd8f5341d69b92eb5b60e56cee, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:08.894868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a470e7e-9a4b-445e-ae78-4dad07c5a0a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:08.911392 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 828/1668] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:08 2022] PUT /identity/v3/projects/814c67643349454aa591a40c1f35528f/users/ff66fbcd8f5341d69b92eb5b60e56cee/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:08.913891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.914429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.915755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:08.940762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:08.949242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19329650123c4a2f8d0ac7a73f1c1397', 'request_id': 'req-cee5712b-3dab-43bf-b22d-33f606462351'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:08.960307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19329650123c4a2f8d0ac7a73f1c1397', 'request_id': 'req-cee5712b-3dab-43bf-b22d-33f606462351'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:08.962759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] MFA Rules not processed for user `d33a4a3d5a644fdebc14b71a3cca13ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:08.964856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:08.972929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19329650123c4a2f8d0ac7a73f1c1397', 'request_id': 'req-cee5712b-3dab-43bf-b22d-33f606462351'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:08.992198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] The token cache is being invalidate because project 19329650123c4a2f8d0ac7a73f1c1397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:08.992615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:08.994077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cee5712b-3dab-43bf-b22d-33f606462351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:08.996275 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 841/1669] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:08 2022] DELETE /identity/v3/projects/19329650123c4a2f8d0ac7a73f1c1397 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:08.999820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fcb40-8ff9-47fe-b5a9-c8f371ec6f10 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:08.999820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fcb40-8ff9-47fe-b5a9-c8f371ec6f10 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:08.999820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fcb40-8ff9-47fe-b5a9-c8f371ec6f10 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.001759 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 842/1670] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:09.004040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c295-2824-4764-be32-e63a269ead58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.004523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c295-2824-4764-be32-e63a269ead58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.004999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c295-2824-4764-be32-e63a269ead58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.047034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2294c295-2824-4764-be32-e63a269ead58 None None] MFA Rules not processed for user `bf4e61f0e37743e2907c715a41eb6303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:09.048521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2294c295-2824-4764-be32-e63a269ead58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.060272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:09.074939 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 829/1671] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:09.078930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:09.081458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.161509 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 843/1672] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:09.164182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a5d5b-3c84-4ccc-bd16-ffd34812abeb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.164696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a5d5b-3c84-4ccc-bd16-ffd34812abeb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.165253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a5d5b-3c84-4ccc-bd16-ffd34812abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.191584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785625-7a30-48ff-9453-ec9b881c1988 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:09.198806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:09.199982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.200389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.200761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.202869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.215298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-537a5d5b-3c84-4ccc-bd16-ffd34812abeb None None] MFA Rules not processed for user `ff66fbcd8f5341d69b92eb5b60e56cee`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:09.216760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-537a5d5b-3c84-4ccc-bd16-ffd34812abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.289022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:09.291176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:09.302498 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 830/1673] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:09.303418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:09.304931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.355176 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 844/1674] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:09.357724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118885a3-3a68-49f7-93c5-f18afbd59930 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.358226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118885a3-3a68-49f7-93c5-f18afbd59930 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.358721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118885a3-3a68-49f7-93c5-f18afbd59930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.392793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-118885a3-3a68-49f7-93c5-f18afbd59930 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:09.395326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-118885a3-3a68-49f7-93c5-f18afbd59930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.428901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768f95c-8ede-4f6b-bcf5-aa44684fec59 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:09.435701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:09.436633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.436923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.437214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] PATH_INFO: `/v3/users/a0c417bc3b3345f8a0f7ae40d951a3e4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.438663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c417bc3b3345f8a0f7ae40d951a3e4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:09.440764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:09.463486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:09.482500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:09.505420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c417bc3b3345f8a0f7ae40d951a3e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.506884 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 845/1675] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:09.508749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118885a3-3a68-49f7-93c5-f18afbd59930 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:09.524025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c417bc3b3345f8a0f7ae40d951a3e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.525655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c417bc3b3345f8a0f7ae40d951a3e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.532444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118885a3-3a68-49f7-93c5-f18afbd59930 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:09.535727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c417bc3b3345f8a0f7ae40d951a3e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.536475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c417bc3b3345f8a0f7ae40d951a3e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.543989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:09.545306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.545768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.546399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.549953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.555022 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 831/1676] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:09 2022] DELETE /identity/v3/users/a0c417bc3b3345f8a0f7ae40d951a3e4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:09.561637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:09.563956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.667336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:09.671366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:09.696570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153880-61f4-4a55-b17f-9b3478714c8f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:09.699369 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 846/1677] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:09.702773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:09.703628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.703942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.704224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.706472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.724951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:09.725551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:09.727460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.727813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:09.739853 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 832/1678] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:09.740838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:09.742699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.746611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b30a65-3bb9-4a50-88ca-b6d05adacda4 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:09.841639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:09.843486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.844048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.844589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] PATH_INFO: `/v3/users/65b23c692f4e40dd80218b649202dcc5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.846873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b23c692f4e40dd80218b649202dcc5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:09.849812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:09.865852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417bf5-b0d4-4b90-afe2-71d346f02850 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:09.877386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20cf8c-08ba-4b9b-b7a0-4acb24b64357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:09.878228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20cf8c-08ba-4b9b-b7a0-4acb24b64357 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:09.878528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20cf8c-08ba-4b9b-b7a0-4acb24b64357 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:09.878816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20cf8c-08ba-4b9b-b7a0-4acb24b64357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:09.881843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6b20cf8c-08ba-4b9b-b7a0-4acb24b64357 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:09.925928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b23c692f4e40dd80218b649202dcc5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.943560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b23c692f4e40dd80218b649202dcc5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.947601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:09.953973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b23c692f4e40dd80218b649202dcc5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.954739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b23c692f4e40dd80218b649202dcc5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.963866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:09.967620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b23c692f4e40dd80218b649202dcc5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:09.979564 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 847/1679] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:09 2022] DELETE /identity/v3/users/65b23c692f4e40dd80218b649202dcc5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:35:09.981678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:09.984424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.016701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20cf8c-08ba-4b9b-b7a0-4acb24b64357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.019846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20cf8c-08ba-4b9b-b7a0-4acb24b64357 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.039349 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 833/1680] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:10.043554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.044275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.044733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.073752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:10.075042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.154337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23005c00-8d19-46f8-a735-f6e1ec8d634f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:10.167130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:10.168520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.169050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.170072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.172303 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 834/1681] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:10.173388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:10.174316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.174949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.194889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdb0e9-6588-48d2-b7d9-862dbda47c4c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:10.206888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:10.206888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.206888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.206888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.210273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.291229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.292888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.304574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 848/1682] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:10.305962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:10.307660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.325690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.328345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.346524 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 835/1683] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:10.348516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:10.350700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.378157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d065f2-74b4-4c70-992e-f964eb385b1f service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:10.387539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:10.388594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e0a89-5d5a-4d9a-b4fd-f18abee99a50 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:10.395998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.396478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.396824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] PATH_INFO: `/v3/projects/fc288ce4bcef4d6a9871f458dc7e44f9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.398594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc288ce4bcef4d6a9871f458dc7e44f9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.399796 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.399796 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:35:10.399796 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:35:10.401254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.404130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:10.404843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.405129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.405406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.418244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.419867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.436092 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 849/1684] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:10.437118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:10.457587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614f5d-245f-4d5b-92eb-8522fff30594 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:10.467672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38dce6-82d4-40a0-8a39-1f63ee62a245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:10.467672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38dce6-82d4-40a0-8a39-1f63ee62a245 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.468094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38dce6-82d4-40a0-8a39-1f63ee62a245 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.468343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38dce6-82d4-40a0-8a39-1f63ee62a245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.470834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d38dce6-82d4-40a0-8a39-1f63ee62a245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.537469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:10.538643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc288ce4bcef4d6a9871f458dc7e44f9', 'request_id': 'req-5c6743ef-e849-44be-941a-45bc9ca6d950'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:10.559677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc288ce4bcef4d6a9871f458dc7e44f9', 'request_id': 'req-5c6743ef-e849-44be-941a-45bc9ca6d950'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:10.563122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:10.587417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38dce6-82d4-40a0-8a39-1f63ee62a245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.589108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38dce6-82d4-40a0-8a39-1f63ee62a245 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.598242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc288ce4bcef4d6a9871f458dc7e44f9', 'request_id': 'req-5c6743ef-e849-44be-941a-45bc9ca6d950'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:10.608401 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 850/1685] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:10 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:10.626870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] The token cache is being invalidate because project fc288ce4bcef4d6a9871f458dc7e44f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:10.627653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:10.629241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c6743ef-e849-44be-941a-45bc9ca6d950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:10.633387 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 836/1686] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:10 2022] DELETE /identity/v3/projects/fc288ce4bcef4d6a9871f458dc7e44f9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:10.652213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b7023-6e7d-4882-a78c-cc541601cf8e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.652748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b7023-6e7d-4882-a78c-cc541601cf8e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.653209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b7023-6e7d-4882-a78c-cc541601cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.687228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c88b7023-6e7d-4882-a78c-cc541601cf8e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:10.688693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c88b7023-6e7d-4882-a78c-cc541601cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.777532 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 851/1687] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:10.785401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06195e-51fa-4481-9e04-480d682ce069 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.785984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06195e-51fa-4481-9e04-480d682ce069 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.786178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06195e-51fa-4481-9e04-480d682ce069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.810316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-be06195e-51fa-4481-9e04-480d682ce069 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:10.812067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be06195e-51fa-4481-9e04-480d682ce069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.825479 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 837/1688] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:35:10.826736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b7023-6e7d-4882-a78c-cc541601cf8e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:10.839691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b7023-6e7d-4882-a78c-cc541601cf8e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:10.846014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:10.846765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.847061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.847368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.848105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7b42-e323-4f49-a834-81b006f8db63 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.848279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:10.848691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.848915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7b42-e323-4f49-a834-81b006f8db63 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.849268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7b42-e323-4f49-a834-81b006f8db63 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.850269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.851926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 838/1689] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:10.864514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0cf3a-649c-47b8-b7c4-b5960f2930ed None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.865470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0cf3a-649c-47b8-b7c4-b5960f2930ed None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.865470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0cf3a-649c-47b8-b7c4-b5960f2930ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.870458 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 852/1690] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:10.877291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:10.891453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc6817-d671-4056-a2b8-cfb07578c92a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:10.894219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cab0cf3a-649c-47b8-b7c4-b5960f2930ed None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:10.897229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cab0cf3a-649c-47b8-b7c4-b5960f2930ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:10.898398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:10.899934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:10.900456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:10.900985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:10.903166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:10.905910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:10.980650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 853/1691] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:10 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:10.982087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:10.985039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.003672 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 839/1692] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:35:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:35:11.004661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0cf3a-649c-47b8-b7c4-b5960f2930ed None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.019071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0cf3a-649c-47b8-b7c4-b5960f2930ed None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.082562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041072-3fc5-4206-b001-f613dae9ec6a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.089624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.091352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.091741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.092249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] PATH_INFO: `/v3/projects/7d5b1ad669de4499b8ff71b9dd2cc780` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.093763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5b1ad669de4499b8ff71b9dd2cc780)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.096169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.113663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.114357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.114645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.114915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.115679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.118356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.144478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:11.151133 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 840/1693] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:11 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:11.151133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.151922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.168014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5b1ad669de4499b8ff71b9dd2cc780', 'request_id': 'req-30148241-1a8f-4d3a-84af-1557e3c5384a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.183818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5b1ad669de4499b8ff71b9dd2cc780', 'request_id': 'req-30148241-1a8f-4d3a-84af-1557e3c5384a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.194538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5b1ad669de4499b8ff71b9dd2cc780', 'request_id': 'req-30148241-1a8f-4d3a-84af-1557e3c5384a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.214474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] The token cache is being invalidate because project 7d5b1ad669de4499b8ff71b9dd2cc780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:11.214783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.215680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.217389 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 854/1694] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:10 2022] DELETE /identity/v3/projects/7d5b1ad669de4499b8ff71b9dd2cc780 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:11.220964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.223546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.275923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:11.287103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd916c-c22e-47d9-ba2c-2488598d5f71 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.338112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148241-1a8f-4d3a-84af-1557e3c5384a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.346215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.347052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.347485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.347885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.350646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.366704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.369716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.380277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.380957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.381240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.381514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.383059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 855/1695] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:11.383801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.384542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.386243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.496148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.499226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.512076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51966-746b-47cf-97b7-731b7a0822b0 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.517146 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 841/1696] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:11.517378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.518062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.518414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.518631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.519425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.521350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.521671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.526374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.540698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 856/1697] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:11.542440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.559541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a25e2-cad9-4ccb-bbf8-be7c09b5a13d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.571314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a05d70-9908-4563-9734-a4c3fd0bd3ae service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.575365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.576390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.576693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.576970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.577779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.579201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.580612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.581218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.581825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] PATH_INFO: `/v3/users/645f3914062b45aba748d8884e936524` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.583389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.584089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=645f3914062b45aba748d8884e936524)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.589301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.610174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 857/1698] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:11.616836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.657009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b1bdc-51e4-4be7-86a7-94436454ef71 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.664584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.666239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.666530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.666816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] PATH_INFO: `/v3/projects/5bdc824cd62144b291d93b7d0046971c/users/6c57af83ce66493aa3788a87b7f26e95/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.681391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645f3914062b45aba748d8884e936524'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.689604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdc824cd62144b291d93b7d0046971c, user_id=6c57af83ce66493aa3788a87b7f26e95, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.701278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.729749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645f3914062b45aba748d8884e936524'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.731735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645f3914062b45aba748d8884e936524'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.743885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 858/1699] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:11 2022] PUT /identity/v3/projects/5bdc824cd62144b291d93b7d0046971c/users/6c57af83ce66493aa3788a87b7f26e95/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:35:11.743885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.743885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.761755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645f3914062b45aba748d8884e936524'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.763972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645f3914062b45aba748d8884e936524'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:11.784140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:11.805032 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 842/1700] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:11 2022] DELETE /identity/v3/users/645f3914062b45aba748d8884e936524 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:11.807428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:11.810571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:11.839104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:11.947422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756c347-e67b-4406-ab81-c8d3d4a5a81b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.957699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.959685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.960323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.960698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] PATH_INFO: `/v3/users/921ab539d8be44f09b5277aa1abe4665` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.970159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392373-3472-4907-a098-456a597f7a9d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:11.976586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=921ab539d8be44f09b5277aa1abe4665)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.979178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:11.984323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:11.986780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:11.987203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:11.987795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] PATH_INFO: `/v3/users/c2ddd784bcb9474e9d4f23b14f663245` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:11.992605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ddd784bcb9474e9d4f23b14f663245)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:11.995127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:12.102646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921ab539d8be44f09b5277aa1abe4665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.118096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ddd784bcb9474e9d4f23b14f663245'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.132029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921ab539d8be44f09b5277aa1abe4665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.160980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ddd784bcb9474e9d4f23b14f663245'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.161299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921ab539d8be44f09b5277aa1abe4665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.161776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ddd784bcb9474e9d4f23b14f663245'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.169521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921ab539d8be44f09b5277aa1abe4665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.177903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ddd784bcb9474e9d4f23b14f663245'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.180242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7dda22e-6b1b-43cd-b994-540d8dfb664f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ddd784bcb9474e9d4f23b14f663245'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.200096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921ab539d8be44f09b5277aa1abe4665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.209107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 843/1701] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:11 2022] DELETE /identity/v3/users/c2ddd784bcb9474e9d4f23b14f663245 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:12.210971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce621-6f81-4158-bd98-032141c06770 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:12.211447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce621-6f81-4158-bd98-032141c06770 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:12.212563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce621-6f81-4158-bd98-032141c06770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:12.221709 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 859/1702] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:11 2022] DELETE /identity/v3/users/921ab539d8be44f09b5277aa1abe4665 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:12.221709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:12.223754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.252804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ddcce621-6f81-4158-bd98-032141c06770 None None] MFA Rules not processed for user `6c57af83ce66493aa3788a87b7f26e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:12.254451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ddcce621-6f81-4158-bd98-032141c06770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.414719 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 844/1703] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:12.417361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9e19-0c01-49b3-bdc8-bb479c818f42 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:12.418185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9e19-0c01-49b3-bdc8-bb479c818f42 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:12.418682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9e19-0c01-49b3-bdc8-bb479c818f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:12.435634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682ce16-2145-4e12-8cf1-7735d8c497e8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:12.448322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:12.449281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:12.449753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:12.450348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:12.455097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.458617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-565f9e19-0c01-49b3-bdc8-bb479c818f42 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:12.460145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-565f9e19-0c01-49b3-bdc8-bb479c818f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.485039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:12.520238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:12.573098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 845/1704] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:12.573098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:12.573098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:12.573098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:12.592002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:12.594121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:12.607459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:12.607459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.612629 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 860/1705] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:12.615911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:12.623900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.625150 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 846/1706] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:12.626381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:12.629545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.657874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53587430-273a-4cab-a2f8-a4422695ebeb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:12.667657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:12.669095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:12.669586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:12.670096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] PATH_INFO: `/v3/projects/349293ed3c6e4b84a9a01b06dc818ee3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:12.672346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=349293ed3c6e4b84a9a01b06dc818ee3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:12.675907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:12.677787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f09e11-32e9-4536-a5a3-6599975a7684 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:12.694933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:12.698018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:12.698782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:12.699577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:12.701597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:12.705589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:12.789552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349293ed3c6e4b84a9a01b06dc818ee3', 'request_id': 'req-f20c88f0-ff73-45b6-b692-fd13376b2b74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.796636 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 861/1707] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:12 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:12.799069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:12.802262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.807107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349293ed3c6e4b84a9a01b06dc818ee3', 'request_id': 'req-f20c88f0-ff73-45b6-b692-fd13376b2b74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.822583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349293ed3c6e4b84a9a01b06dc818ee3', 'request_id': 'req-f20c88f0-ff73-45b6-b692-fd13376b2b74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.855477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] The token cache is being invalidate because project 349293ed3c6e4b84a9a01b06dc818ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:12.856247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.858337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:12.861929 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 847/1708] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:12 2022] DELETE /identity/v3/projects/349293ed3c6e4b84a9a01b06dc818ee3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:12.863957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:12.867629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:12.980496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569af69e-175d-44e7-9c61-893aa1d15eae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:12.996905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:12.997593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:12.997875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:12.998153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:13.007191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.012005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c88f0-ff73-45b6-b692-fd13376b2b74 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:13.020099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02adc2-8cf2-4c91-ace6-e9851fc56bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:13.021581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02adc2-8cf2-4c91-ace6-e9851fc56bcf service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:13.022424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02adc2-8cf2-4c91-ace6-e9851fc56bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:13.023022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02adc2-8cf2-4c91-ace6-e9851fc56bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:13.027117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe02adc2-8cf2-4c91-ace6-e9851fc56bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.220050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:13.222604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:13.251786 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 862/1709] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:13.252903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:13.254696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:13.254906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.280492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccc52b-2676-4a93-bf6d-7324d614ba13 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:13.296696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a3a38-6fac-43a9-8cb9-e4074fdd075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:13.300417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3a38-6fac-43a9-8cb9-e4074fdd075d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:13.301627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3a38-6fac-43a9-8cb9-e4074fdd075d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:13.303427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3a38-6fac-43a9-8cb9-e4074fdd075d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:13.307370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a3a38-6fac-43a9-8cb9-e4074fdd075d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:13.311295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02adc2-8cf2-4c91-ace6-e9851fc56bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:13.313026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02adc2-8cf2-4c91-ace6-e9851fc56bcf service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:13.317696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a3a38-6fac-43a9-8cb9-e4074fdd075d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:13.328273 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 848/1710] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:13.329905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:13.330636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:13.330981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:13.356740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:13.358115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.387408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 849/1711] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:13.388659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:13.396971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.424379 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 863/1712] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:13 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:13.424801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:13.425524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:13.427060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:13.427154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1b7a5-05c2-4f3c-a497-746e3251e140 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:13.436295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:13.437967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:13.438664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:13.439146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] PATH_INFO: `/v3/users/0192ef478d974448b4d76d2752640b76` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:13.441792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0192ef478d974448b4d76d2752640b76)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:13.446826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:13.473145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:13.477821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.496206 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 864/1713] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:13.501490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:13.506207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.559589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0192ef478d974448b4d76d2752640b76'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:13.586722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0192ef478d974448b4d76d2752640b76'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:13.588163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0192ef478d974448b4d76d2752640b76'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:13.627419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0192ef478d974448b4d76d2752640b76'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:13.628220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:13.628755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0192ef478d974448b4d76d2752640b76'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:13.679913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 850/1714] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:13 2022] DELETE /identity/v3/users/0192ef478d974448b4d76d2752640b76 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:13.685083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:13.690177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:13.802694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db41d0-f310-4591-a94b-6354551df148 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:13.898856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1789b-14a7-4a33-9497-eab8626909e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:13.935312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:13.936758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:13.939032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:13.942134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:13.946545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:13.954604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:14.010648 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 851/1715] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:14.012581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:14.017667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.019620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878f9c9-3a29-4906-9433-cd7208bd4314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:14.020431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878f9c9-3a29-4906-9433-cd7208bd4314 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.020972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878f9c9-3a29-4906-9433-cd7208bd4314 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.021266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878f9c9-3a29-4906-9433-cd7208bd4314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.028915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a878f9c9-3a29-4906-9433-cd7208bd4314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.047630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eab165-f60b-462a-b005-edce0e1d4123 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:14.065333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59be91-21c3-402b-9c19-34909ab7e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:14.067870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59be91-21c3-402b-9c19-34909ab7e549 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.071335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59be91-21c3-402b-9c19-34909ab7e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.071996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59be91-21c3-402b-9c19-34909ab7e549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.075326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59be91-21c3-402b-9c19-34909ab7e549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:14.079930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59be91-21c3-402b-9c19-34909ab7e549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:14.084302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59be91-21c3-402b-9c19-34909ab7e549 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:14.113446 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 852/1716] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:14.114963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98796a-5027-47e4-9426-ca77441b3245 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.115403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98796a-5027-47e4-9426-ca77441b3245 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.115708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98796a-5027-47e4-9426-ca77441b3245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.165995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7c98796a-5027-47e4-9426-ca77441b3245 None None] MFA Rules not processed for user `a876582ed4d94e9da876592597aa1c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:14.168271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c98796a-5027-47e4-9426-ca77441b3245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.209183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878f9c9-3a29-4906-9433-cd7208bd4314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:14.213464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878f9c9-3a29-4906-9433-cd7208bd4314 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:14.235582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:14.238345 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 865/1717] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:14.245728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.245992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.246278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.273523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:14.274865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.288553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 866/1718] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:14.288553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:14.288553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.310765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa444ab-e642-4a29-a997-13967c6cb0a0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:14.318924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:14.320517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.321731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.322247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] PATH_INFO: `/v3/projects/e9b30f4bd8ef428f9e9821b2e314131f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.324811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b30f4bd8ef428f9e9821b2e314131f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:14.327462 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 853/1719] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:14.328748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98796a-5027-47e4-9426-ca77441b3245 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:14.329426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:14.353192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98796a-5027-47e4-9426-ca77441b3245 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:14.359336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:14.360011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.360296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.360574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] PATH_INFO: `/v3/projects/79d73fce2da04827bff55cc94108244e/users/4bb66869992a481ea95facd573afc7c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.377821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d73fce2da04827bff55cc94108244e, user_id=4bb66869992a481ea95facd573afc7c1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:14.380661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:14.398534 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 854/1720] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:14 2022] PUT /identity/v3/projects/79d73fce2da04827bff55cc94108244e/users/4bb66869992a481ea95facd573afc7c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:14.400223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:14.418546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b30f4bd8ef428f9e9821b2e314131f', 'request_id': 'req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.425915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:14.428530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b30f4bd8ef428f9e9821b2e314131f', 'request_id': 'req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.439722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b30f4bd8ef428f9e9821b2e314131f', 'request_id': 'req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.478250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] The token cache is being invalidate because project e9b30f4bd8ef428f9e9821b2e314131f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:14.478597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.479674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.482041 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 867/1721] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:14 2022] DELETE /identity/v3/projects/e9b30f4bd8ef428f9e9821b2e314131f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:14.486750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:14.488016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.534226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8d2a3-964b-471a-894e-e277b07a4fd2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:14.615196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd4492-cb6f-42f1-a2ef-c6525e136afe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:14.627263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:14.629259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.629702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.630168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] PATH_INFO: `/v3/projects/149c07a07cc04dc5acb9e626459b6222` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.632484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149c07a07cc04dc5acb9e626459b6222)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:14.637556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:14.657287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:14.658310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.658789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.659255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.660364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:14.663978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:14.723937 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 855/1722] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:14 2022] POST /identity/v3/projects => generated 395 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:14.725494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:14.728242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.740032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149c07a07cc04dc5acb9e626459b6222', 'request_id': 'req-13013abe-e3f9-47f7-82b9-c0a9bdfec812'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.754050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149c07a07cc04dc5acb9e626459b6222', 'request_id': 'req-13013abe-e3f9-47f7-82b9-c0a9bdfec812'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.767573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149c07a07cc04dc5acb9e626459b6222', 'request_id': 'req-13013abe-e3f9-47f7-82b9-c0a9bdfec812'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.797295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] The token cache is being invalidate because project 149c07a07cc04dc5acb9e626459b6222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:14.797795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.799003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:14.801268 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 868/1723] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:14 2022] DELETE /identity/v3/projects/149c07a07cc04dc5acb9e626459b6222 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:14.802798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:14.807709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.846444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:14.854560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9885b-2e3e-4af4-a99d-0e9dcfe01c08 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:14.862890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:14.864105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:14.866341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:14.866341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:14.870308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:14.956724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013abe-e3f9-47f7-82b9-c0a9bdfec812 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:14.971681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:15.009379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:15.012156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:15.040481 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 856/1724] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:15.042441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:15.045086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:15.072600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f34f1-bf19-49a8-982a-63dcdd7e12fa service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:15.082691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:15.083791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:15.084202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:15.084606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:15.085974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:15.089411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:15.099893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:15.100867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:15.101295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:15.101771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:15.105834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:15.115524 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 857/1725] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:15.115524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:15.116054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:15.144388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ceca0-4d3c-4ef7-8d46-92506a9605b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:15.156274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:15.157799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:15.158277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:15.158744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] PATH_INFO: `/v3/users/bf4e61f0e37743e2907c715a41eb6303` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:15.161579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4e61f0e37743e2907c715a41eb6303)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:15.166036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:15.266378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:15.269102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:15.278953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4e61f0e37743e2907c715a41eb6303'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:15.305030 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 869/1726] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:15.314929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:15.320760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:15.329940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4e61f0e37743e2907c715a41eb6303'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:15.331473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4e61f0e37743e2907c715a41eb6303'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:15.388193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4e61f0e37743e2907c715a41eb6303'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:15.394610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4e61f0e37743e2907c715a41eb6303'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:15.404078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c48a-c0ad-46e0-a9e7-9619186f2378 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:15.413622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:15.415560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:15.416063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:15.416852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:15.418531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:15.424355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:15.446519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 858/1727] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:15 2022] DELETE /identity/v3/users/bf4e61f0e37743e2907c715a41eb6303 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:15.452702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:15.463253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:15.492896 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 870/1728] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:15 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:15.494488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:15.511313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:15.542685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561bfea-7829-423a-ab96-ea04e66f394c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:15.761651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448f9de-3b1b-434c-9838-64ad9aa67595 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:15.779435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:15.781355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:15.781776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:15.782244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] PATH_INFO: `/v3/projects/79d73fce2da04827bff55cc94108244e/users/4bb66869992a481ea95facd573afc7c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:15.784440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:15.785705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:15.786162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:15.786286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d73fce2da04827bff55cc94108244e, user_id=4bb66869992a481ea95facd573afc7c1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:15.786982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] PATH_INFO: `/v3/users/ff66fbcd8f5341d69b92eb5b60e56cee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:15.788658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff66fbcd8f5341d69b92eb5b60e56cee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:15.791882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:15.794344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:15.798310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:15.843301 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 871/1729] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:15 2022] PUT /identity/v3/projects/79d73fce2da04827bff55cc94108244e/users/4bb66869992a481ea95facd573afc7c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:15.845133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:15.856655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:15.931810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:15.946702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff66fbcd8f5341d69b92eb5b60e56cee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:15.984367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff66fbcd8f5341d69b92eb5b60e56cee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:15.987945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff66fbcd8f5341d69b92eb5b60e56cee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.002415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff66fbcd8f5341d69b92eb5b60e56cee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.004320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2717765a-9948-4552-a998-440b68d0cc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff66fbcd8f5341d69b92eb5b60e56cee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.031596 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 859/1730] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:15 2022] DELETE /identity/v3/users/ff66fbcd8f5341d69b92eb5b60e56cee => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:16.033303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686f51-9d39-4dae-83c5-cd5f05bb7312 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.033712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686f51-9d39-4dae-83c5-cd5f05bb7312 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.034015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686f51-9d39-4dae-83c5-cd5f05bb7312 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.036073 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 860/1731] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:16.036994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55686f51-9d39-4dae-83c5-cd5f05bb7312 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:16.039788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-55686f51-9d39-4dae-83c5-cd5f05bb7312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.065672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa28df4-4d88-4763-81ee-51d7d702684a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:16.155922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55686f51-9d39-4dae-83c5-cd5f05bb7312 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:16.162391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:16.164388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.165426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.165897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] PATH_INFO: `/v3/projects/99599aa1aa6547758b1b2a8bcef85925` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.167864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99599aa1aa6547758b1b2a8bcef85925)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:16.171795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:16.216831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ac51-2816-4134-bb25-361f688b6357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:16.218077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ac51-2816-4134-bb25-361f688b6357 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.218559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ac51-2816-4134-bb25-361f688b6357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.219055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ac51-2816-4134-bb25-361f688b6357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.220554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ac51-2816-4134-bb25-361f688b6357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:16.223427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ac51-2816-4134-bb25-361f688b6357 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:16.246220 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 872/1732] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:16.246220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.246220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.246220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.253958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99599aa1aa6547758b1b2a8bcef85925', 'request_id': 'req-60c1e887-b000-497d-a52f-247425cf65b2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.268017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99599aa1aa6547758b1b2a8bcef85925', 'request_id': 'req-60c1e887-b000-497d-a52f-247425cf65b2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.277157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99599aa1aa6547758b1b2a8bcef85925', 'request_id': 'req-60c1e887-b000-497d-a52f-247425cf65b2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.291043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] The token cache is being invalidate because project 99599aa1aa6547758b1b2a8bcef85925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:16.291382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.292127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-60c1e887-b000-497d-a52f-247425cf65b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.294088 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 861/1733] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:16 2022] DELETE /identity/v3/projects/99599aa1aa6547758b1b2a8bcef85925 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:16.295122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.295451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.295732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.309561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] MFA Rules not processed for user `4bb66869992a481ea95facd573afc7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:16.313885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.320980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:16.322994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.329981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:16.449275 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 862/1734] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:16.450544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:16.453793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.465544 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 873/1735] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:16.468268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:16.470175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.568564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:16.588802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09d957-df6a-4166-b1ca-5e27984d6f04 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:16.594647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:16.595589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.595875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.596155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] PATH_INFO: `/v3/users/63af4fced46f4febbf930e90380338d2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.597491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63af4fced46f4febbf930e90380338d2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:16.599533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:16.603137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685539f5-5812-403e-8a7f-157c73f62b93 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:16.611074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:16.613703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.613703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.613703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] PATH_INFO: `/v3/projects/a736eed6f369472fa1351d8bfb7968a2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.615809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a736eed6f369472fa1351d8bfb7968a2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:16.619066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:16.681505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63af4fced46f4febbf930e90380338d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.696509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a736eed6f369472fa1351d8bfb7968a2', 'request_id': 'req-20ae5bf3-05bb-4c51-b54d-93ddce536de8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.706905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63af4fced46f4febbf930e90380338d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.709122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a736eed6f369472fa1351d8bfb7968a2', 'request_id': 'req-20ae5bf3-05bb-4c51-b54d-93ddce536de8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.719554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63af4fced46f4febbf930e90380338d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.720404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63af4fced46f4febbf930e90380338d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.723577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a736eed6f369472fa1351d8bfb7968a2', 'request_id': 'req-20ae5bf3-05bb-4c51-b54d-93ddce536de8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.731799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63af4fced46f4febbf930e90380338d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.740127 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 874/1736] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:16 2022] DELETE /identity/v3/users/63af4fced46f4febbf930e90380338d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:16.741681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:16.745367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.747160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] The token cache is being invalidate because project a736eed6f369472fa1351d8bfb7968a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:16.747661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.748696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.750650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 863/1737] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:16 2022] DELETE /identity/v3/projects/a736eed6f369472fa1351d8bfb7968a2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:16.752100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:16.754798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.805139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:16.842935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad9031-42ba-4d75-bbf8-7e73df3e460d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:16.850964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:16.852265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.853256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.853721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.854648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:16.857598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:16.860740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae5bf3-05bb-4c51-b54d-93ddce536de8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:16.868243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:16.869669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:16.870144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:16.870604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] PATH_INFO: `/v3/users/d33a4a3d5a644fdebc14b71a3cca13ea` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:16.872662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33a4a3d5a644fdebc14b71a3cca13ea)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:16.876143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:16.880779 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 875/1738] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:16.880779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:16.881161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:16.951761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33a4a3d5a644fdebc14b71a3cca13ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.973083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33a4a3d5a644fdebc14b71a3cca13ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.973999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33a4a3d5a644fdebc14b71a3cca13ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.985259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33a4a3d5a644fdebc14b71a3cca13ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:16.986396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33a4a3d5a644fdebc14b71a3cca13ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:17.005149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:17.009018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 864/1739] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:16 2022] DELETE /identity/v3/users/d33a4a3d5a644fdebc14b71a3cca13ea => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:17.014847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee223c-05e9-470b-a36b-f250934a63bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:17.015082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:17.015082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.111418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:17.113693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.113693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.114356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.118284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.166953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f2318-5bf8-45e1-8e22-242181cd9598 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:17.176678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425044fb-3b29-4817-9496-75eb0b525afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:17.177864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425044fb-3b29-4817-9496-75eb0b525afd service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.178363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425044fb-3b29-4817-9496-75eb0b525afd service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.178853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425044fb-3b29-4817-9496-75eb0b525afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.182254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-425044fb-3b29-4817-9496-75eb0b525afd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.234314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:17.237853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:17.257382 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 876/1740] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:17.259183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:17.263403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.280900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:17.323354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425044fb-3b29-4817-9496-75eb0b525afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:17.324998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425044fb-3b29-4817-9496-75eb0b525afd service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:17.355905 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 865/1741] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:17.360241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777676a7-f48e-4881-a1d7-7df2551e06de None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.360598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777676a7-f48e-4881-a1d7-7df2551e06de None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.360905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777676a7-f48e-4881-a1d7-7df2551e06de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.386728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-777676a7-f48e-4881-a1d7-7df2551e06de None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:17.388028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-777676a7-f48e-4881-a1d7-7df2551e06de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.475952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320a3f7-3e48-4f65-88ec-7d35b9a780e3 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:17.484902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:17.488022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.488497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.489003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] PATH_INFO: `/v3/projects/814c67643349454aa591a40c1f35528f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.491487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814c67643349454aa591a40c1f35528f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:17.495623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:17.509759 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 866/1742] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:17.513074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.513716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.514198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.541910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:17.544863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.557798 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 867/1743] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:17.559126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:17.561665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.590130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b2c00-aa3c-47a2-9e37-2172aac7ce67 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:17.606191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:17.610675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814c67643349454aa591a40c1f35528f', 'request_id': 'req-a82439b4-b090-4e19-b199-de7e3c5f92f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:17.628977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814c67643349454aa591a40c1f35528f', 'request_id': 'req-a82439b4-b090-4e19-b199-de7e3c5f92f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:17.656001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814c67643349454aa591a40c1f35528f', 'request_id': 'req-a82439b4-b090-4e19-b199-de7e3c5f92f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:17.679698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] The token cache is being invalidate because project 814c67643349454aa591a40c1f35528f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:17.680990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:17.682288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a82439b4-b090-4e19-b199-de7e3c5f92f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:17.684348 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 877/1744] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:17 2022] DELETE /identity/v3/projects/814c67643349454aa591a40c1f35528f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:17.685962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b94f-7650-42e2-828a-a788f7591d6b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.686625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b94f-7650-42e2-828a-a788f7591d6b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.687092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b94f-7650-42e2-828a-a788f7591d6b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.696862 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 878/1745] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:17.697874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5b94f-7650-42e2-828a-a788f7591d6b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:17.700343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bae5b94f-7650-42e2-828a-a788f7591d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.714396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31fc9-68d0-4e7a-8619-c4941ba3a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:17.716272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31fc9-68d0-4e7a-8619-c4941ba3a132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.716925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31fc9-68d0-4e7a-8619-c4941ba3a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.717436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31fc9-68d0-4e7a-8619-c4941ba3a132 admin admin] PATH_INFO: `/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a/users/db565d2fc4e84662b84966271a080b52/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.750488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31fc9-68d0-4e7a-8619-c4941ba3a132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb7498cccd6f46fd8a445d9f7455e31a, user_id=db565d2fc4e84662b84966271a080b52, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:17.759543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31fc9-68d0-4e7a-8619-c4941ba3a132 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:17.786365 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 868/1746] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:17 2022] PUT /identity/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a/users/db565d2fc4e84662b84966271a080b52/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:17.788027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.788355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.788715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.801282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5b94f-7650-42e2-828a-a788f7591d6b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:17.819158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:17.821624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.892668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28946df-4d7c-41d8-907f-3d78f95f7a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:17.893343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28946df-4d7c-41d8-907f-3d78f95f7a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.893627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28946df-4d7c-41d8-907f-3d78f95f7a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.893908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28946df-4d7c-41d8-907f-3d78f95f7a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.896219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c28946df-4d7c-41d8-907f-3d78f95f7a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.911130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:17.921054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 869/1747] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:17.922352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:17.927399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:17.943093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc10fa-b740-4e3c-9aff-3b257a882e71 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:17.953129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:17.954678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:17.955153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:17.956136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] PATH_INFO: `/v3/projects/ff6b7040a2284f218a101dfd023aa5ec` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:17.959425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6b7040a2284f218a101dfd023aa5ec)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:17.962838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:18.008459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28946df-4d7c-41d8-907f-3d78f95f7a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:18.011286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28946df-4d7c-41d8-907f-3d78f95f7a66 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:18.040343 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 879/1748] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:18.044893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156196f-7d9b-4653-8115-b6b6ed80bfee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.045388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156196f-7d9b-4653-8115-b6b6ed80bfee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.046513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156196f-7d9b-4653-8115-b6b6ed80bfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.054191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6b7040a2284f218a101dfd023aa5ec', 'request_id': 'req-3d82eeca-f0fa-46d5-965c-84a23c91b363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:18.076150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6b7040a2284f218a101dfd023aa5ec', 'request_id': 'req-3d82eeca-f0fa-46d5-965c-84a23c91b363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:18.090770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6b7040a2284f218a101dfd023aa5ec', 'request_id': 'req-3d82eeca-f0fa-46d5-965c-84a23c91b363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:18.092681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8156196f-7d9b-4653-8115-b6b6ed80bfee None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:18.095243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8156196f-7d9b-4653-8115-b6b6ed80bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.144735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] The token cache is being invalidate because project ff6b7040a2284f218a101dfd023aa5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:18.144735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:18.145948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:18.156424 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 870/1749] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:17 2022] DELETE /identity/v3/projects/ff6b7040a2284f218a101dfd023aa5ec => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:18.156424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:18.163779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.224755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:18.319555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 880/1750] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:18.322354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.322870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.323551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.393311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] MFA Rules not processed for user `db565d2fc4e84662b84966271a080b52`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:18.396207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.433483 n-d-768852-23 devstack@keystone.service[80582]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 14 14:35:18.434324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:18.436419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.532212 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 881/1751] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:18.533901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:18.539148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.561058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9adee-54ab-4488-a3c2-57551ab1ae15 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:18.567524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7fe8-ec23-4776-8490-41883171b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:18.568378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7fe8-ec23-4776-8490-41883171b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.568794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7fe8-ec23-4776-8490-41883171b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.569725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7fe8-ec23-4776-8490-41883171b9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.570600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7fe8-ec23-4776-8490-41883171b9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:18.571050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7fe8-ec23-4776-8490-41883171b9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:18.571446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82eeca-f0fa-46d5-965c-84a23c91b363 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:18.573155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7fe8-ec23-4776-8490-41883171b9a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:18.580341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248d0ee-4793-4d3f-b00c-aae75164ee6f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb66869992a481ea95facd573afc7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79d73fce2da04827bff55cc94108244e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:18.582826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248d0ee-4793-4d3f-b00c-aae75164ee6f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.582826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248d0ee-4793-4d3f-b00c-aae75164ee6f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.583211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248d0ee-4793-4d3f-b00c-aae75164ee6f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] PATH_INFO: `/v3/projects/5bdc824cd62144b291d93b7d0046971c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.585456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248d0ee-4793-4d3f-b00c-aae75164ee6f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] RBAC: Authorizing `identity:get_project(project_id=5bdc824cd62144b291d93b7d0046971c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:18.589050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248d0ee-4793-4d3f-b00c-aae75164ee6f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:18.592285 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 871/1752] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:18 2022] GET /identity/v3/projects/5bdc824cd62144b291d93b7d0046971c => generated 377 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:18.594278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.594758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.595312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.598142 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 882/1753] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:18.600530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.601022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.601507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.629054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:18.631256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.641123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:18.643616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.655037 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 872/1754] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:18.656767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:18.659217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.674475 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 883/1755] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:18.676706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:18.679366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.702919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878cee-542f-4ce8-bf75-fe8aec012e62 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:18.707442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:18.712977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:18.714179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.714636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.715113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.716407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:18.720120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:18.777491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 884/1756] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:18 2022] POST /identity/v3/projects => generated 395 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:18.779456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:18.822212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca3e6-c06d-47d4-ba0d-fca4d1914d48 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:18.863240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77e67-8813-4cec-ba06-a4ef44d66f1a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:18.870961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdbbff-afe2-4294-8226-22655939b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:18.872137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdbbff-afe2-4294-8226-22655939b7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.872627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdbbff-afe2-4294-8226-22655939b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.873095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdbbff-afe2-4294-8226-22655939b7bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.874331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdbbff-afe2-4294-8226-22655939b7bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:18.878017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdbbff-afe2-4294-8226-22655939b7bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:18.903983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:18.905028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.905410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.905970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.909144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.922124 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 885/1757] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:18 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:18.924320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1abe8-22dc-41fd-8de9-7b8d97d56260 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:18.924810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1abe8-22dc-41fd-8de9-7b8d97d56260 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:18.925226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1abe8-22dc-41fd-8de9-7b8d97d56260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:18.925858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:18.927776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:18.940346 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 873/1758] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:18.941711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:18.943588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.954973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fcd1abe8-22dc-41fd-8de9-7b8d97d56260 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:18.957316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcd1abe8-22dc-41fd-8de9-7b8d97d56260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:18.976926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:19.079246 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 886/1759] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:19.080336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa4b11-129b-49bc-877b-8968b0b3653a service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.081011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1abe8-22dc-41fd-8de9-7b8d97d56260 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.094960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1abe8-22dc-41fd-8de9-7b8d97d56260 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.103264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.104072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.105028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.105318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.106105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:19.106426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.108250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.135334 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 887/1760] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:19.135334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.137208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.162256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87106b84-6fb4-4792-9cb3-f57c4d0afe73 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.170477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:19.171834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.173337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.173523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.173678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] PATH_INFO: `/v3/projects/c7a730920325430ca28aa04a9434aea6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.175919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a730920325430ca28aa04a9434aea6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.178643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.222271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.223689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.224192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.224687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.228647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.248625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a730920325430ca28aa04a9434aea6', 'request_id': 'req-1e9bd14c-0b26-4584-bd36-69fa4e73777c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.261091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a730920325430ca28aa04a9434aea6', 'request_id': 'req-1e9bd14c-0b26-4584-bd36-69fa4e73777c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.278073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a730920325430ca28aa04a9434aea6', 'request_id': 'req-1e9bd14c-0b26-4584-bd36-69fa4e73777c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.294919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] The token cache is being invalidate because project c7a730920325430ca28aa04a9434aea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:19.295362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.297247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.298893 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 888/1761] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:19 2022] DELETE /identity/v3/projects/c7a730920325430ca28aa04a9434aea6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:19.300268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.302305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.369321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.372433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.393813 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 874/1762] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:19.394967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.419998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b592589-644c-4d45-96d6-7cc56c08c55e service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.444508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.444508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.444508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.444508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.445384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.447666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bd14c-0b26-4584-bd36-69fa4e73777c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.449768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.463696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.465137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.465805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.466448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.468448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.473365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.492159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 875/1763] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:19 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:19.502268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.503957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.522487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525296-841a-466b-9b68-af39941dac50 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.525199 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 889/1764] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:19 2022] POST /identity/v3/users => generated 304 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:19.527367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.530678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.530937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.532118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.532442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.532930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.534338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:19.534885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.538114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.562476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b42cd-dc38-4a8b-afae-ae1ff310fab9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.568276 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 876/1765] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:19.569929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.576281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.581509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b199a5d-3044-4085-b569-a737e4007408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.582861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199a5d-3044-4085-b569-a737e4007408 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.583401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199a5d-3044-4085-b569-a737e4007408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.583921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199a5d-3044-4085-b569-a737e4007408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.585472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b199a5d-3044-4085-b569-a737e4007408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.590810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b199a5d-3044-4085-b569-a737e4007408 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.594101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c606e77-af6c-4255-aaf5-b43b08e9cd3a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.603451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.604821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.605352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.605709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] PATH_INFO: `/v3/users/33fbeca1a697411c9aae72ba9f24c884` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.607223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fbeca1a697411c9aae72ba9f24c884)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.609424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.622268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:19.662235 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 890/1766] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:19 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:19.666053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6092-a2af-492d-8334-da3a50d3fb47 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.667372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6092-a2af-492d-8334-da3a50d3fb47 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.668187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6092-a2af-492d-8334-da3a50d3fb47 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.671615 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 891/1767] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:19.672971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b6092-a2af-492d-8334-da3a50d3fb47 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.676801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d03b6092-a2af-492d-8334-da3a50d3fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.703788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fbeca1a697411c9aae72ba9f24c884'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.728585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fbeca1a697411c9aae72ba9f24c884'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.729757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fbeca1a697411c9aae72ba9f24c884'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.742437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fbeca1a697411c9aae72ba9f24c884'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.744098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-186e5b56-d35c-45d1-abe0-1234327d9e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fbeca1a697411c9aae72ba9f24c884'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:19.771120 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 877/1768] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:19 2022] DELETE /identity/v3/users/33fbeca1a697411c9aae72ba9f24c884 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:19.778621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cafd9-8d19-47e9-9343-fa475366811b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.780225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cafd9-8d19-47e9-9343-fa475366811b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.780225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cafd9-8d19-47e9-9343-fa475366811b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.782767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 878/1769] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:19.784547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cafd9-8d19-47e9-9343-fa475366811b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.788749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6e2cafd9-8d19-47e9-9343-fa475366811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:19.809368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b6092-a2af-492d-8334-da3a50d3fb47 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.851780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:19.960736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cafd9-8d19-47e9-9343-fa475366811b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:19.962900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.964212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.964665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.965482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.966582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.969754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.978075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:19.979288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:19.979714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:19.980154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:19.981954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:19.984418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:19.993305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 892/1770] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:19.994938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:19.998001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.000819 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 879/1771] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:20.004868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.006706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.023793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62163-abd2-414d-aa8c-3c0d0a6acf4c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.030920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e574e-242e-4851-93e6-21dbd78451b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.031632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.032657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.033108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.033533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.034646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.037907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.050547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccef20-ec22-4212-bcdb-df3a20de93bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.052655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccef20-ec22-4212-bcdb-df3a20de93bd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.053357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccef20-ec22-4212-bcdb-df3a20de93bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.053850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccef20-ec22-4212-bcdb-df3a20de93bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.055756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccef20-ec22-4212-bcdb-df3a20de93bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.060457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccef20-ec22-4212-bcdb-df3a20de93bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.066122 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 880/1772] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:19 2022] POST /identity/v3/users => generated 302 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:20.067014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:20.069223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.140976 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 893/1773] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:19 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:20.143202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.143867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.144481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.189425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:20.190867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.191831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.192930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.307463 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 894/1774] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:20.308996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.310888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.327159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:20.351195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a12a7b-c6f8-40f7-86d1-019740c69f35 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.411610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f0bed-eb2c-4b6b-a227-a330e2cab654 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.422198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.423810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.424297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.425000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.426397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.427743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:20.429442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.450350 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 895/1775] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:20.450350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.454295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb66869992a481ea95facd573afc7c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79d73fce2da04827bff55cc94108244e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.455876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.456330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.456820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] PATH_INFO: `/v3/projects/5bdc824cd62144b291d93b7d0046971c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.459076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] RBAC: Authorizing `identity:get_project(project_id=5bdc824cd62144b291d93b7d0046971c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.465064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.468580 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 881/1776] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:20 2022] GET /identity/v3/projects/5bdc824cd62144b291d93b7d0046971c => generated 377 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:20.468763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a999329-539f-4e3a-a407-9858efa77272 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.470032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.477165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.478864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.479742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.480176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] PATH_INFO: `/v3/projects/8b2be727a8f34a1d86c8c4a59cc48d90/users/439726d211b24daba1ce6d4aa2473493/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.492902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63aa79-4e7d-420d-968d-132749e7318c tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.503783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.504776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.505320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.505737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.506825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.514758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.519016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2be727a8f34a1d86c8c4a59cc48d90, user_id=439726d211b24daba1ce6d4aa2473493, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.525600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.537784 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 882/1777] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:20.539976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.571230 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 896/1778] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:20 2022] PUT /identity/v3/projects/8b2be727a8f34a1d86c8c4a59cc48d90/users/439726d211b24daba1ce6d4aa2473493/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:20.571705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.578218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82727-ab32-4505-a42a-87aff9bfea22 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.579333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.672606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798c1c-84ac-4743-b239-cf82be1e319e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.680710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.687398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.687769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.688178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] PATH_INFO: `/v3/projects/14ac76afa05e4400ba2512b3fc2453f0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.691902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ac76afa05e4400ba2512b3fc2453f0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.699349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.737616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.738870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.739386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.739861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.741054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:20.745231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:20.779189 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 883/1779] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:20 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:20.779189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.780335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.798976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ac76afa05e4400ba2512b3fc2453f0', 'request_id': 'req-7986c388-6fb9-455d-a93f-51828a0bb85a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:20.812365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ac76afa05e4400ba2512b3fc2453f0', 'request_id': 'req-7986c388-6fb9-455d-a93f-51828a0bb85a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:20.827724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ac76afa05e4400ba2512b3fc2453f0', 'request_id': 'req-7986c388-6fb9-455d-a93f-51828a0bb85a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:20.848322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] The token cache is being invalidate because project 14ac76afa05e4400ba2512b3fc2453f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:20.848702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:20.849792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:20.851963 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 897/1780] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:20 2022] DELETE /identity/v3/projects/14ac76afa05e4400ba2512b3fc2453f0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:20.853392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:20.858551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:20.875692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:20.881290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d98d6-00ff-4bb0-9a9d-b51deccfde44 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.966966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986c388-6fb9-455d-a93f-51828a0bb85a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:20.969329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.970471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.970980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.971561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.974619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:20.975913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:20.976295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:20.976654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] PATH_INFO: `/v3/projects/c9f14b1548c547608944442a8a351e56/users/cdac1d4106674c7ab0cfe39939de9d7b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:20.978975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.004919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f14b1548c547608944442a8a351e56, user_id=cdac1d4106674c7ab0cfe39939de9d7b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.008391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.026324 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 898/1781] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:20 2022] PUT /identity/v3/projects/c9f14b1548c547608944442a8a351e56/users/cdac1d4106674c7ab0cfe39939de9d7b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:21.027502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.029375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.048836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:21.121227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.122705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.135713 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 884/1782] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:21.136602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.138049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.142606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb204d-5791-4efc-a292-1d6ff8663e82 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.153742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538db3b-6171-48bc-a84c-c8fa5ef5c551 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.154363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856913ff-31e1-4d1c-933b-046384b98536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.156373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856913ff-31e1-4d1c-933b-046384b98536 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.157189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856913ff-31e1-4d1c-933b-046384b98536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.158052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856913ff-31e1-4d1c-933b-046384b98536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.159532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.159910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856913ff-31e1-4d1c-933b-046384b98536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.160299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.160594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.160880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.161736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.163992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.165352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856913ff-31e1-4d1c-933b-046384b98536 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.177477 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 885/1783] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:21.178531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.187163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.191567 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 899/1784] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:21.196787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.196787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.196787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.217999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:21.219422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.223565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb78db-f90c-448d-9e55-06244a6a2b7b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.230161 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 900/1785] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:21.231123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.232669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.249471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6314eec-8eee-496c-8c7f-f88ff6891014 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.255263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.256240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.256529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.256813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] PATH_INFO: `/v3/users/6c57af83ce66493aa3788a87b7f26e95` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.258204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c57af83ce66493aa3788a87b7f26e95)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.260438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.271915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27027ee7-46e6-46b9-8733-42d22fbef430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.273057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027ee7-46e6-46b9-8733-42d22fbef430 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.273537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027ee7-46e6-46b9-8733-42d22fbef430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.274095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027ee7-46e6-46b9-8733-42d22fbef430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.275639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27027ee7-46e6-46b9-8733-42d22fbef430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.279407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27027ee7-46e6-46b9-8733-42d22fbef430 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.307327 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 886/1786] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:21.310721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.311550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.312195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.358993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c57af83ce66493aa3788a87b7f26e95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:21.385510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] MFA Rules not processed for user `cdac1d4106674c7ab0cfe39939de9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:21.403613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.403803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c57af83ce66493aa3788a87b7f26e95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:21.403803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c57af83ce66493aa3788a87b7f26e95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:21.403803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c57af83ce66493aa3788a87b7f26e95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:21.414368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:21.421343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c57af83ce66493aa3788a87b7f26e95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:21.430917 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 901/1787] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:21 2022] DELETE /identity/v3/users/6c57af83ce66493aa3788a87b7f26e95 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:21.434403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.439026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.551469 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 887/1788] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:21.552521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.553995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.569271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1413e-962e-4ccb-a3b2-cf18bf3e92d1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.592858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ed518-ac28-473e-a6d9-7ffa8bd8e3a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.603553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ab023-b65d-4b32-a6d1-a94b5a8dd744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.605692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ab023-b65d-4b32-a6d1-a94b5a8dd744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.606480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ab023-b65d-4b32-a6d1-a94b5a8dd744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.607205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ab023-b65d-4b32-a6d1-a94b5a8dd744 admin admin] PATH_INFO: `/v3/projects/8b2be727a8f34a1d86c8c4a59cc48d90/users/439726d211b24daba1ce6d4aa2473493/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.612339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ab023-b65d-4b32-a6d1-a94b5a8dd744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2be727a8f34a1d86c8c4a59cc48d90, user_id=439726d211b24daba1ce6d4aa2473493, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.618136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ab023-b65d-4b32-a6d1-a94b5a8dd744 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.639027 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 902/1789] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:21 2022] PUT /identity/v3/projects/8b2be727a8f34a1d86c8c4a59cc48d90/users/439726d211b24daba1ce6d4aa2473493/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:21.641254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406a29-6990-43e3-b3da-3e0446b55882 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.641781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406a29-6990-43e3-b3da-3e0446b55882 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.642294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406a29-6990-43e3-b3da-3e0446b55882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.660050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.662181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.662914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.663683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] PATH_INFO: `/v3/projects/411ac0caf1d14d3ea49d55aafc8ba351/users/5ac81bf2390d471394f68327363cee28/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.673161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bd406a29-6990-43e3-b3da-3e0446b55882 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:21.674547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd406a29-6990-43e3-b3da-3e0446b55882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.699501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411ac0caf1d14d3ea49d55aafc8ba351, user_id=5ac81bf2390d471394f68327363cee28, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.705095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.725598 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 888/1790] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:21 2022] PUT /identity/v3/projects/411ac0caf1d14d3ea49d55aafc8ba351/users/5ac81bf2390d471394f68327363cee28/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:21.727186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.730848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.748321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:21.760557 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 903/1791] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:21.762176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc9026-2900-45c4-b557-e798e39de4ee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.762489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc9026-2900-45c4-b557-e798e39de4ee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.762765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc9026-2900-45c4-b557-e798e39de4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.785881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7dbc9026-2900-45c4-b557-e798e39de4ee None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:21.787133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dbc9026-2900-45c4-b557-e798e39de4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.833042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98463a-e412-4f65-8fc5-1fbd81db4bf4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.847225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.848470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.848983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.849480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.850944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.854605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.891411 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 889/1792] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:21.891411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:21.891845 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 904/1793] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:21.892005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:21.892161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0dff-bd29-4685-8cdb-9fc59c83ab13 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.892161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0dff-bd29-4685-8cdb-9fc59c83ab13 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.892161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0dff-bd29-4685-8cdb-9fc59c83ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.914238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fca0b-f5b1-453b-bf5e-610b3b63b76e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:21.922589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903b116-fb24-4f7c-a594-6c5a474b1d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:21.923763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b116-fb24-4f7c-a594-6c5a474b1d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.924232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b116-fb24-4f7c-a594-6c5a474b1d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.924698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b116-fb24-4f7c-a594-6c5a474b1d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.926053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903b116-fb24-4f7c-a594-6c5a474b1d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:21.929134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903b116-fb24-4f7c-a594-6c5a474b1d8e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:21.976028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:21.982426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 890/1794] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:21 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:21.984701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba374-b400-4adc-b812-b1ebd46fda99 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:21.985371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba374-b400-4adc-b812-b1ebd46fda99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:21.985717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba374-b400-4adc-b812-b1ebd46fda99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:21.992188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e6d0dff-bd29-4685-8cdb-9fc59c83ab13 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:21.994541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e6d0dff-bd29-4685-8cdb-9fc59c83ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:22.041076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e92ba374-b400-4adc-b812-b1ebd46fda99 None None] MFA Rules not processed for user `439726d211b24daba1ce6d4aa2473493`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:22.043368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e92ba374-b400-4adc-b812-b1ebd46fda99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:22.106852 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 905/1795] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:22.109167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf9c51-df83-4309-be8b-065608b9af72 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:22.109651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf9c51-df83-4309-be8b-065608b9af72 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:22.110134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf9c51-df83-4309-be8b-065608b9af72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:22.145575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9ddf9c51-df83-4309-be8b-065608b9af72 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:22.149769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ddf9c51-df83-4309-be8b-065608b9af72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:22.229822 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 891/1796] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:22.231393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ba374-b400-4adc-b812-b1ebd46fda99 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:22.295655 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 906/1797] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:22.297772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf9c51-df83-4309-be8b-065608b9af72 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:22.316711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf9c51-df83-4309-be8b-065608b9af72 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:22.326389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:22.328124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:22.328648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:22.329234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] PATH_INFO: `/v3/projects/990c59ae01bd47c78548b1a08114c9ae/users/6f03ab9c2050476eadef3d20ef3df476/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:22.352930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ba374-b400-4adc-b812-b1ebd46fda99 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:22.359390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:22.360056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990c59ae01bd47c78548b1a08114c9ae, user_id=6f03ab9c2050476eadef3d20ef3df476, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:22.360736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:22.361313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:22.361878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:22.362795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:22.363259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:22.365132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:22.366065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:22.387001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 892/1798] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:22.388599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:22.390661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:22.393731 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 907/1799] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:22 2022] PUT /identity/v3/projects/990c59ae01bd47c78548b1a08114c9ae/users/6f03ab9c2050476eadef3d20ef3df476/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:22.399601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:22.421615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:22.481752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f9a9b-f9ed-42d1-adb0-4779f2b74fc0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:22.579037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:22.580247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:22.580785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:22.581499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:22.632438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3476-0e91-466a-83b9-114cfe4c66f6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:22.643108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:22.644309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:22.644808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:22.645312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:22.646655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:22.651056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:22.703083 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 908/1800] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:22 2022] POST /identity/v3/users => generated 296 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:22.705072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:22.708499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:22.729227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:22.729989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:22.732070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:22.750245 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 893/1801] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:22.751373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:22.764876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1873542-d602-4b6b-9e37-a39170621f92 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:22.771326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:22.772424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:22.772897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:22.773399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:22.774730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:22.777972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:22.818175 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 894/1802] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:22 2022] POST /identity/v3/projects => generated 395 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:22.819697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:22.912903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:22.919762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d726-7244-4dae-9ac9-bb18af695f8b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:22.927774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:22.928402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:22.928770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:22.929437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:22.958538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11ff5-5d7d-41b8-a089-a1f39450fe35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:23.057243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.059054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.074263 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 895/1803] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:23.074919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:23.093289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dbae-ce4f-43c5-abb8-e75850430ef1 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:23.105131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e35d0f-cdea-4fa7-b113-d03c64f13946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:23.106019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35d0f-cdea-4fa7-b113-d03c64f13946 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.106323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35d0f-cdea-4fa7-b113-d03c64f13946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.107033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35d0f-cdea-4fa7-b113-d03c64f13946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.107508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e35d0f-cdea-4fa7-b113-d03c64f13946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.110824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e35d0f-cdea-4fa7-b113-d03c64f13946 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.120948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:23.122495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.123251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.125089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.173752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 896/1804] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:23 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:23.175219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6535-b8ee-4e77-9f3c-8d1360f7684b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.176628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6535-b8ee-4e77-9f3c-8d1360f7684b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.177052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6535-b8ee-4e77-9f3c-8d1360f7684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.218911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ef2c6535-b8ee-4e77-9f3c-8d1360f7684b None None] MFA Rules not processed for user `6f03ab9c2050476eadef3d20ef3df476`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:23.220230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ef2c6535-b8ee-4e77-9f3c-8d1360f7684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:23.311179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.313673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.328052 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 909/1805] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:35:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:23.328395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:23.345503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa6da-b288-42af-a6fc-e854127deee6 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:23.351828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 897/1806] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:23.355668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6535-b8ee-4e77-9f3c-8d1360f7684b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:23.410890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:23.467214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:23.468100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.468866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.469395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.470647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.492006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.541718 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 910/1807] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:23.546012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:23.603368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584a3f6-def4-4c67-8933-b4f32b3fc45c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:23.615170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6535-b8ee-4e77-9f3c-8d1360f7684b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:23.636317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:23.636662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:23.637593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.637979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.638181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.638335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.638800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.640536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.641223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.641424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.643258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.646635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.679177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:23.744024 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 911/1808] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:23 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:23.744024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:23.745455 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 898/1809] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:23 2022] POST /identity/v3/users => generated 298 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:23.748408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:23.753529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:23.791967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fa827-56ad-445d-b3b5-04338f564fa5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:23.796464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f372f-8e75-4bf0-9d8d-e445091ffd8a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:23.811865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:23.812622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:23.814104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.816916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.817413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] PATH_INFO: `/v3/projects/5bdc824cd62144b291d93b7d0046971c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.819085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:23.819728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:23.820264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:23.821771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdc824cd62144b291d93b7d0046971c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.822265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:23.826307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.828081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:23.970346 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 912/1810] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:23 2022] POST /identity/v3/projects => generated 389 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:23.970346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:23.983468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdc824cd62144b291d93b7d0046971c', 'request_id': 'req-d59c344f-302e-4ffb-9435-c77f2738f49d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:24.021358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdc824cd62144b291d93b7d0046971c', 'request_id': 'req-d59c344f-302e-4ffb-9435-c77f2738f49d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:24.031061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdc824cd62144b291d93b7d0046971c', 'request_id': 'req-d59c344f-302e-4ffb-9435-c77f2738f49d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:24.087708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] The token cache is being invalidate because project 5bdc824cd62144b291d93b7d0046971c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:24.088304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:24.093121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:24.107078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 899/1811] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:23 2022] DELETE /identity/v3/projects/5bdc824cd62144b291d93b7d0046971c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:24.111237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:24.135380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:24.315592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ce74c-14a8-424e-9df5-7d2ba38495b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:24.329825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:24.332007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:24.332544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:24.333068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] PATH_INFO: `/v3/projects/21ff6e8454654167baface1d864bff63/users/46999c33374645d5a4fd240b493788fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:24.421219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ff6e8454654167baface1d864bff63, user_id=46999c33374645d5a4fd240b493788fd, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:24.438118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:24.501691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c344f-302e-4ffb-9435-c77f2738f49d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:24.506026 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 913/1812] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:23 2022] PUT /identity/v3/projects/21ff6e8454654167baface1d864bff63/users/46999c33374645d5a4fd240b493788fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:24.507939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:24.512086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:24.723034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:24.723034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:24.723034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:24.723034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:24.724346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:24.738487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:24.753568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4d4aa-6d83-4b3b-8439-3b9178184a5b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:24.765663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e56e9b-1cd8-4e3b-b343-2b9f4dc042a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:24.767385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56e9b-1cd8-4e3b-b343-2b9f4dc042a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:24.768101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56e9b-1cd8-4e3b-b343-2b9f4dc042a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:24.768830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56e9b-1cd8-4e3b-b343-2b9f4dc042a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:24.771105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e56e9b-1cd8-4e3b-b343-2b9f4dc042a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:24.777212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e56e9b-1cd8-4e3b-b343-2b9f4dc042a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:24.808734 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 914/1813] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:24.812182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:24.813205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:24.814393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:24.824915 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 900/1814] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 717 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:24.826482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:24.844530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:24.847115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:24.902871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:24.904209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:24.915766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f638c-deee-4180-b816-7470f6732be0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:24.948730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:24.949973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:24.950471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:24.950961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:24.952362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:24.973441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:24.980045 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 915/1815] 10.222.0.110 () {58 vars in 1016 bytes} [Thu Jul 14 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:24.981006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:24.982527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:25.002234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607cb0-52c1-4ab4-8a6f-040c4087d62e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.009002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.010135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.010529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.010726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] PATH_INFO: `/v3/users/4bb66869992a481ea95facd573afc7c1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.012313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb66869992a481ea95facd573afc7c1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.014361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.062302 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 901/1816] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:24 2022] POST /identity/v3/users => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:25.064829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.076573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:25.099709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:25.106113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa5aa5-2d09-43ca-ad8a-03314a8a57a3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.129943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.130723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.130965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.131378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.132139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.137395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.146634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb66869992a481ea95facd573afc7c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:25.172824 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 902/1817] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:25.175129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.186178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb66869992a481ea95facd573afc7c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:25.198415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d49233-cf9b-44ab-918f-ffe80b93ac87 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.205845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb66869992a481ea95facd573afc7c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:25.206612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb66869992a481ea95facd573afc7c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:25.215507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.216365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.216635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.216969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.219285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.222939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.227391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb66869992a481ea95facd573afc7c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:25.245815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 916/1818] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:24 2022] DELETE /identity/v3/users/4bb66869992a481ea95facd573afc7c1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:25.247291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.254092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:25.256327 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 903/1819] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:25.257333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.276376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:25.306825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d699-1eff-4151-b20a-5f980f1b9cd5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.473353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.474966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.476304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16886d0a-e78d-4621-9af1-d7ccc4f1c57b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.477118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.477777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.480188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.484557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.515765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.518682 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 904/1820] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:25.519925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.522321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.522874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.523412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.523849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:25.525855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.529469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.554193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9297fe1-fb80-4dc9-8f42-29df651d70e6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.560638 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 917/1821] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:25.562989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.565901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.566172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:25.567808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.568289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.568733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] PATH_INFO: `/v3/projects/21ff6e8454654167baface1d864bff63/users/46999c33374645d5a4fd240b493788fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.575246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ff6e8454654167baface1d864bff63, user_id=46999c33374645d5a4fd240b493788fd, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.581724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.606700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411756b4-1af2-4d5d-a183-346ed83d9986 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.611331 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 905/1822] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:25 2022] PUT /identity/v3/projects/21ff6e8454654167baface1d864bff63/users/46999c33374645d5a4fd240b493788fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:25.612320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.661052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:25.788285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f73e-5bc0-42c9-8e0c-efd4fa761ebe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:25.813009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.816154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.817477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.818759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] PATH_INFO: `/v3/projects/49fd5ede998f41f6a19664edf06abd23/users/f5fdb5c974da4a3c87f8bd4dd2564487/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.853954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:25.858877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:25.859606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:25.859938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] PATH_INFO: `/v3/projects/32689bcc311e474cba2dc75cf73fef80/users/714f1f4e21004e188fb386adb8dd0c05/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:25.895215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fd5ede998f41f6a19664edf06abd23, user_id=f5fdb5c974da4a3c87f8bd4dd2564487, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.898764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.903866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32689bcc311e474cba2dc75cf73fef80, user_id=714f1f4e21004e188fb386adb8dd0c05, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:25.910321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:25.926594 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 906/1823] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:25 2022] PUT /identity/v3/projects/49fd5ede998f41f6a19664edf06abd23/users/f5fdb5c974da4a3c87f8bd4dd2564487/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:25.927884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.960547 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 918/1824] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:25 2022] PUT /identity/v3/projects/32689bcc311e474cba2dc75cf73fef80/users/714f1f4e21004e188fb386adb8dd0c05/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:25.960547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:25.960547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:26.090719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:26.156173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28c845-5a52-4f65-a52d-0904607062b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:26.165881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db135d1-b480-4f8f-a340-041bbb052eb3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:26.173483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bee317-64e0-4a06-8ed2-64c9fc0f834e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:26.175001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bee317-64e0-4a06-8ed2-64c9fc0f834e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:26.175602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bee317-64e0-4a06-8ed2-64c9fc0f834e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:26.176115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bee317-64e0-4a06-8ed2-64c9fc0f834e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:26.181229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8bee317-64e0-4a06-8ed2-64c9fc0f834e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:26.205230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bee317-64e0-4a06-8ed2-64c9fc0f834e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:26.208753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bee317-64e0-4a06-8ed2-64c9fc0f834e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:26.231568 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 919/1825] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:26.234189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444c9e7-fdda-4624-ba87-b9ca42ba4a0c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:26.235016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444c9e7-fdda-4624-ba87-b9ca42ba4a0c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:26.235555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444c9e7-fdda-4624-ba87-b9ca42ba4a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:26.304697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b444c9e7-fdda-4624-ba87-b9ca42ba4a0c None None] MFA Rules not processed for user `46999c33374645d5a4fd240b493788fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:26.308317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b444c9e7-fdda-4624-ba87-b9ca42ba4a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:26.424838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:26.428014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:26.428749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:26.429209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] PATH_INFO: `/v3/projects/613e034ca44149c8b8597f01b6e20add/users/aaef0be07d364068bcce4d5e1cda3e68/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:26.468755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=613e034ca44149c8b8597f01b6e20add, user_id=aaef0be07d364068bcce4d5e1cda3e68, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:26.480046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:26.530713 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 907/1826] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:25 2022] PUT /identity/v3/projects/613e034ca44149c8b8597f01b6e20add/users/aaef0be07d364068bcce4d5e1cda3e68/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:26.530713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:26.587320 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 920/1827] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:26.589396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373e18-a6c4-4d25-88a0-22342c50d9f2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:26.589930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373e18-a6c4-4d25-88a0-22342c50d9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:26.594053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373e18-a6c4-4d25-88a0-22342c50d9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:26.694536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a6373e18-a6c4-4d25-88a0-22342c50d9f2 None None] MFA Rules not processed for user `714f1f4e21004e188fb386adb8dd0c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:26.698035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6373e18-a6c4-4d25-88a0-22342c50d9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:26.740591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:26.745668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792719d1-de2d-4e79-a235-61efebaaa3ff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:26.760907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6580fde-0f42-43b7-8118-6b4eafd06ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:26.762915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6580fde-0f42-43b7-8118-6b4eafd06ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:26.764871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6580fde-0f42-43b7-8118-6b4eafd06ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:26.765415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6580fde-0f42-43b7-8118-6b4eafd06ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:26.784349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6580fde-0f42-43b7-8118-6b4eafd06ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:26.786299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6580fde-0f42-43b7-8118-6b4eafd06ebc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:26.806657 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 908/1828] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:26.809410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024fe19-e30e-4b13-a9fc-beee73c0ac97 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:26.809835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024fe19-e30e-4b13-a9fc-beee73c0ac97 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:26.810238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024fe19-e30e-4b13-a9fc-beee73c0ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:26.887418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5024fe19-e30e-4b13-a9fc-beee73c0ac97 None None] MFA Rules not processed for user `aaef0be07d364068bcce4d5e1cda3e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:26.888960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5024fe19-e30e-4b13-a9fc-beee73c0ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:26.905316 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 921/1829] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:26.908386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:26.908839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:26.909457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:26.951120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] MFA Rules not processed for user `cdac1d4106674c7ab0cfe39939de9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:26.957639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:27.101487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 909/1830] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:27.102479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024fe19-e30e-4b13-a9fc-beee73c0ac97 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:27.118056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:27.122502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024fe19-e30e-4b13-a9fc-beee73c0ac97 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:27.139696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:27.140990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:27.141418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:27.148504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] PATH_INFO: `/v3/projects/49fd5ede998f41f6a19664edf06abd23/users/f5fdb5c974da4a3c87f8bd4dd2564487/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:27.151776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fd5ede998f41f6a19664edf06abd23, user_id=f5fdb5c974da4a3c87f8bd4dd2564487, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:27.154735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:27.180649 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 910/1831] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:27 2022] PUT /identity/v3/projects/49fd5ede998f41f6a19664edf06abd23/users/f5fdb5c974da4a3c87f8bd4dd2564487/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:27.181698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:27.249847 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 922/1832] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:27.273565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:27.276962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:27.323861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869ed75-940c-4e04-83d5-8e5b23fae644 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:27.388323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fbb61-011f-47a9-a2d7-24bac4f7c857 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:27.412349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:27.413570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:27.414098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:27.415017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:27.416550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:27.420950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:27.542430 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 911/1833] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:27 2022] POST /identity/v3/projects => generated 387 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:27.544141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:27.551492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:27.582218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:27.586651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:27.587971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:27.591189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] PATH_INFO: `/v3/projects/79d73fce2da04827bff55cc94108244e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:27.602907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d73fce2da04827bff55cc94108244e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:27.613760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:27.836093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d73fce2da04827bff55cc94108244e', 'request_id': 'req-bf7a601b-1eeb-4407-94aa-a445e3de3606'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:27.845967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d73fce2da04827bff55cc94108244e', 'request_id': 'req-bf7a601b-1eeb-4407-94aa-a445e3de3606'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:27.847743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:27.871515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d73fce2da04827bff55cc94108244e', 'request_id': 'req-bf7a601b-1eeb-4407-94aa-a445e3de3606'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:27.902906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] The token cache is being invalidate because project 79d73fce2da04827bff55cc94108244e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:27.903535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:27.908733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bf7a601b-1eeb-4407-94aa-a445e3de3606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:27.912791 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 923/1834] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:27 2022] DELETE /identity/v3/projects/79d73fce2da04827bff55cc94108244e => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:27.915294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:27.915858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:27.926094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:27.968936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7b61-fd10-4cb8-8f55-d4098fefc170 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:27.990762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] MFA Rules not processed for user `f5fdb5c974da4a3c87f8bd4dd2564487`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:27.996998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.122675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:28.124145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:28.124677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:28.125279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:28.129623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.145695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:28.249725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:28.253298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:28.297458 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 912/1835] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:28.298628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:28.310431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.447287 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 924/1836] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 534 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:28.449042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:28.455178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.521538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d4f4d-4445-4905-9cff-462d4e9fcf69 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:28.530166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfafbb7-fbb4-4a71-ad36-175c32cae3ab service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:28.538790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7b4d9-6d6d-49d2-bf28-d6bc45c9172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:28.540281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7b4d9-6d6d-49d2-bf28-d6bc45c9172a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:28.541603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7b4d9-6d6d-49d2-bf28-d6bc45c9172a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:28.543439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7b4d9-6d6d-49d2-bf28-d6bc45c9172a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:28.544495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7b4d9-6d6d-49d2-bf28-d6bc45c9172a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:28.548495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e4f83-d79b-46c0-8faf-a8e24dc19b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:28.551837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e4f83-d79b-46c0-8faf-a8e24dc19b07 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:28.552074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e4f83-d79b-46c0-8faf-a8e24dc19b07 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:28.552230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e4f83-d79b-46c0-8faf-a8e24dc19b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:28.555360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7b4d9-6d6d-49d2-bf28-d6bc45c9172a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:28.557756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-961e4f83-d79b-46c0-8faf-a8e24dc19b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.611148 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 913/1837] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:28 2022] POST /identity/v3/users => generated 300 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:28.620058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c783aa-846a-435a-9e90-fc8efce9563b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:28.621101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c783aa-846a-435a-9e90-fc8efce9563b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:28.621517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c783aa-846a-435a-9e90-fc8efce9563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:28.684678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-44c783aa-846a-435a-9e90-fc8efce9563b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:28.686190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44c783aa-846a-435a-9e90-fc8efce9563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.706797 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 914/1838] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:28.708324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad49b88-5e6f-4a1a-8013-b6ad34f7a386 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:28.708738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad49b88-5e6f-4a1a-8013-b6ad34f7a386 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:28.709134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad49b88-5e6f-4a1a-8013-b6ad34f7a386 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:28.711496 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 915/1839] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:28.713516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad49b88-5e6f-4a1a-8013-b6ad34f7a386 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:28.819906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad49b88-5e6f-4a1a-8013-b6ad34f7a386 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:28.833419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e4f83-d79b-46c0-8faf-a8e24dc19b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:28.835529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e4f83-d79b-46c0-8faf-a8e24dc19b07 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:28.850661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:28.858081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:28.858564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:28.859140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:28.859338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 925/1840] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:28.860976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c78f9-a224-4a9a-84ee-6e88131306ec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:28.865984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c78f9-a224-4a9a-84ee-6e88131306ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:28.866478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c78f9-a224-4a9a-84ee-6e88131306ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:28.873641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:28.884564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:28.918604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0e5c78f9-a224-4a9a-84ee-6e88131306ec None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:28.919850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0e5c78f9-a224-4a9a-84ee-6e88131306ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.947440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 916/1841] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:28.947440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:28.955499 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 926/1842] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:28.956915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c78f9-a224-4a9a-84ee-6e88131306ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:28.974841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:28.985716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c78f9-a224-4a9a-84ee-6e88131306ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:29.006967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:29.008058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:29.009143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:29.009435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] PATH_INFO: `/v3/projects/9458ee8fb1dd4588aab091fcde73e70b/users/806e1be95d434c15a6a17d97ee5ef1c5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:29.054693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9458ee8fb1dd4588aab091fcde73e70b, user_id=806e1be95d434c15a6a17d97ee5ef1c5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:29.062232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:29.062738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:29.104512 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 927/1843] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:28 2022] PUT /identity/v3/projects/9458ee8fb1dd4588aab091fcde73e70b/users/806e1be95d434c15a6a17d97ee5ef1c5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:29.104512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:29.108629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc20cd-5a7e-4280-86d7-93557211f5ef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:29.278114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:29.280608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439726d211b24daba1ce6d4aa2473493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b2be727a8f34a1d86c8c4a59cc48d90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:29.282273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:29.282273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:29.282273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] PATH_INFO: `/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:29.286713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb7498cccd6f46fd8a445d9f7455e31a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:29.301618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:29.312838 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 917/1844] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:28 2022] GET /identity/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a => generated 395 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:29.314254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:29.353959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8870826-b0cd-4dcb-bd8e-c249faccbee6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:29.392787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:29.396005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:29.409420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:29.415896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:29.416315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:29.420365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:29.420365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:29.422090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:29.496858 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 928/1845] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:29.501325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:29.534243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f486d-5239-4090-813d-d6bc7c238f62 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:29.553213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:29.557934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:29.559123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:29.560248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:29.562103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:29.565284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:29.605142 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 918/1846] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:29.605142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:29.650932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14ebf-bf5c-4e92-9876-f176d1fdc36b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:29.668566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:29.671926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:29.675238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:29.676144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:29.678122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:29.690630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:29.780261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd0b7d-8ab0-4a2d-bfd3-44b269c53829 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:29.791200 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 919/1847] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:29 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:29.793002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:30.067393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e737f-7c73-47ec-8fc1-08021d1dc5d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:30.073598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e737f-7c73-47ec-8fc1-08021d1dc5d2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.074336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e737f-7c73-47ec-8fc1-08021d1dc5d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.075363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e737f-7c73-47ec-8fc1-08021d1dc5d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.077643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4ff9-4c2a-491b-aee4-41688d14fd0d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:30.089976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1cd0-8758-4610-ac58-729cb1daf043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:30.091031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1cd0-8758-4610-ac58-729cb1daf043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.118374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1cd0-8758-4610-ac58-729cb1daf043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.118931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1cd0-8758-4610-ac58-729cb1daf043 admin admin] PATH_INFO: `/v3/projects/9458ee8fb1dd4588aab091fcde73e70b/users/806e1be95d434c15a6a17d97ee5ef1c5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.122278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1cd0-8758-4610-ac58-729cb1daf043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9458ee8fb1dd4588aab091fcde73e70b, user_id=806e1be95d434c15a6a17d97ee5ef1c5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:30.126402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1cd0-8758-4610-ac58-729cb1daf043 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:30.158296 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 920/1848] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:29 2022] PUT /identity/v3/projects/9458ee8fb1dd4588aab091fcde73e70b/users/806e1be95d434c15a6a17d97ee5ef1c5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:30.160075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c728ec-48f2-49ad-8d2f-4705736ffa4e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.163113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c728ec-48f2-49ad-8d2f-4705736ffa4e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.165296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c728ec-48f2-49ad-8d2f-4705736ffa4e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.169034 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 921/1849] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:35:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:30.169852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c728ec-48f2-49ad-8d2f-4705736ffa4e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:30.371778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c728ec-48f2-49ad-8d2f-4705736ffa4e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:30.383509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e737f-7c73-47ec-8fc1-08021d1dc5d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:30.386406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff597bd-483e-417b-baba-ed5659c16bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:30.386841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e737f-7c73-47ec-8fc1-08021d1dc5d2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:30.387540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff597bd-483e-417b-baba-ed5659c16bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.387868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff597bd-483e-417b-baba-ed5659c16bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.388256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff597bd-483e-417b-baba-ed5659c16bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.389088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff597bd-483e-417b-baba-ed5659c16bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:30.397354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff597bd-483e-417b-baba-ed5659c16bb2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:30.443817 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 929/1850] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 945 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:30.451135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 922/1851] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:30 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:30.451135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df0bb9-3304-46ae-ac68-8805baa641d6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.451135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df0bb9-3304-46ae-ac68-8805baa641d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.451135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df0bb9-3304-46ae-ac68-8805baa641d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.452012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6a9e-7432-46c1-a529-680b1488a312 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.452662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6a9e-7432-46c1-a529-680b1488a312 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.453186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6a9e-7432-46c1-a529-680b1488a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.490501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:30.507842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b8df0bb9-3304-46ae-ac68-8805baa641d6 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:30.516025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8df0bb9-3304-46ae-ac68-8805baa641d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:30.559822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:30.590924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b60c6a9e-7432-46c1-a529-680b1488a312 None None] MFA Rules not processed for user `806e1be95d434c15a6a17d97ee5ef1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:30.593620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b60c6a9e-7432-46c1-a529-680b1488a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:30.876900 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 923/1852] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:35:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:30.878337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df0bb9-3304-46ae-ac68-8805baa641d6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:30.903161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df0bb9-3304-46ae-ac68-8805baa641d6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:30.912020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:30.916406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.918191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.919398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.923834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:30.928218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:30.939885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 930/1853] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:30.971011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9744e-15ed-4a1d-ba0a-7233c60d35df None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:30.971857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9744e-15ed-4a1d-ba0a-7233c60d35df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:30.972904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9744e-15ed-4a1d-ba0a-7233c60d35df None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:30.974574 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 924/1854] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:30.975986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:30.977664 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 931/1855] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:30.992833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9744e-15ed-4a1d-ba0a-7233c60d35df None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:31.039466 n-d-768852-23 devstack@keystone.service[80581]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9744e-15ed-4a1d-ba0a-7233c60d35df None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 14 14:35:31.039842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9744e-15ed-4a1d-ba0a-7233c60d35df None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:31.048282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867d91b-54f7-4cdc-9729-0e39f5df4767 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:31.070150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:31.071080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:31.071953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:31.072231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:31.072996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:31.075792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:31.113668 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 925/1856] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:31.114712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:31.144061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0ca0b-4247-4161-b903-32a882421e23 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:31.158787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00e84d-c061-4645-9488-f5651dfef1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:31.159824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00e84d-c061-4645-9488-f5651dfef1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:31.160150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00e84d-c061-4645-9488-f5651dfef1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:31.160434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00e84d-c061-4645-9488-f5651dfef1ed admin admin] PATH_INFO: `/v3/projects/bf71b0fddf3a49ceafb9448f89062a2b/users/d1dedf8a62b244f9bdad41ef83f63bb6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:31.228897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00e84d-c061-4645-9488-f5651dfef1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf71b0fddf3a49ceafb9448f89062a2b, user_id=d1dedf8a62b244f9bdad41ef83f63bb6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:31.231886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00e84d-c061-4645-9488-f5651dfef1ed admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:31.287450 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 926/1857] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:31 2022] PUT /identity/v3/projects/bf71b0fddf3a49ceafb9448f89062a2b/users/d1dedf8a62b244f9bdad41ef83f63bb6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:31.298469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a69c-ac92-4368-8212-d84bbad649b4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:31.298469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a69c-ac92-4368-8212-d84bbad649b4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:31.298469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a69c-ac92-4368-8212-d84bbad649b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:31.307323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9744e-15ed-4a1d-ba0a-7233c60d35df None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:31.416887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2574a69c-ac92-4368-8212-d84bbad649b4 None None] MFA Rules not processed for user `d1dedf8a62b244f9bdad41ef83f63bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:31.419133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2574a69c-ac92-4368-8212-d84bbad649b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:31.555050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439726d211b24daba1ce6d4aa2473493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b2be727a8f34a1d86c8c4a59cc48d90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:31.559169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:31.559531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:31.559834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] PATH_INFO: `/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:31.562698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb7498cccd6f46fd8a445d9f7455e31a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:31.568493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:31.571164 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 932/1858] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:30 2022] GET /identity/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a => generated 395 bytes in 581 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:35:31.646990 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 927/1859] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:31.653488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:31.699875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a69c-ac92-4368-8212-d84bbad649b4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:31.807212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:31.886821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:31.930490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3da8-17d1-4715-9afc-4846c5b5be9a tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:31.944378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:31.945100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:31.945629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:31.945991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:31.946726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:31.953785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:31.956075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a69c-ac92-4368-8212-d84bbad649b4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:31.980011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:31.981189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:31.983074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:31.983435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:31.990567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:32.062340 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 933/1860] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:31 2022] POST /identity/v3/projects => generated 375 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:35:32.068387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:32.249130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:32.250810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:32.318967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f95d-6d06-4ddf-8111-5b0965f10d5b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:32.324301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 928/1861] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:35:32.324301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:32.339019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:32.340327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:32.340935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:32.341531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:32.343727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:32.347138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:32.375717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf246-bccf-4c6b-8dac-4bca317ea86b service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:32.414757 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 934/1862] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:32 2022] POST /identity/v3/users => generated 294 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:32.415339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:32.545076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:32.545793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:32.546065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:32.546507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:32.676903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:32.681610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:32.685669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b7789-8357-4b12-a938-21c6502bad0e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:32.702876 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 929/1863] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:32.704340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:32.721515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936f3b5-b9d9-4e08-a05f-8bd41c055554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:32.722699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936f3b5-b9d9-4e08-a05f-8bd41c055554 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:32.728993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936f3b5-b9d9-4e08-a05f-8bd41c055554 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:32.729644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936f3b5-b9d9-4e08-a05f-8bd41c055554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:32.751220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b486-9f2e-48de-b713-9ca604bab8d2 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:32.774927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:32.779955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:32.780617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:32.783041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:32.784337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:32.784944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936f3b5-b9d9-4e08-a05f-8bd41c055554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:32.787803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:32.795342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936f3b5-b9d9-4e08-a05f-8bd41c055554 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:32.829560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 930/1864] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:32.836861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:32.849393 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 935/1865] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:32.864473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6048773-bad2-47f4-9b0c-4368a8151531 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:32.865444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6048773-bad2-47f4-9b0c-4368a8151531 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:32.870919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a6b2d-ce2c-4114-addf-a1d4f3f1e954 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:32.875051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6048773-bad2-47f4-9b0c-4368a8151531 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:32.884350 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 936/1866] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:32 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:32.888556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:32.889731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:32.890144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:32.890499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] PATH_INFO: `/v3/projects/3e8e42cde0f341859c4cfad519a00629/users/e785586506c041eea84416c0f679328a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:32.894515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6048773-bad2-47f4-9b0c-4368a8151531 None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:32.902160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:32.928746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6048773-bad2-47f4-9b0c-4368a8151531 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:32.938901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8e42cde0f341859c4cfad519a00629, user_id=e785586506c041eea84416c0f679328a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:32.944439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:32.990333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 931/1867] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:32 2022] PUT /identity/v3/projects/3e8e42cde0f341859c4cfad519a00629/users/e785586506c041eea84416c0f679328a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:35:32.996648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:33.014296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:33.117980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6048773-bad2-47f4-9b0c-4368a8151531 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:33.265761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528b47-52d2-4386-82ba-e66445d65b69 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:33.284970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:33.285764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:33.288103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:33.290000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:33.295193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:33.303504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:33.320459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e75701-861a-4062-883e-fbfe1ffddd2d tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439726d211b24daba1ce6d4aa2473493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b2be727a8f34a1d86c8c4a59cc48d90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:33.322792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75701-861a-4062-883e-fbfe1ffddd2d tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:33.324635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75701-861a-4062-883e-fbfe1ffddd2d tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:33.325164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75701-861a-4062-883e-fbfe1ffddd2d tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] PATH_INFO: `/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:33.333170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e75701-861a-4062-883e-fbfe1ffddd2d tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb7498cccd6f46fd8a445d9f7455e31a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:33.341622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e75701-861a-4062-883e-fbfe1ffddd2d tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:33.346612 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 932/1868] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:33.352833 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 937/1869] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:32 2022] GET /identity/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a => generated 395 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:35:33.359362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:33.408567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b8542-0b05-48f9-8c64-68e64504b7eb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:33.433232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:33.434311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:33.434607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:33.436030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] PATH_INFO: `/v3/projects/3e8e42cde0f341859c4cfad519a00629/users/e785586506c041eea84416c0f679328a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:33.447140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8e42cde0f341859c4cfad519a00629, user_id=e785586506c041eea84416c0f679328a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:33.457661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:33.510441 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 933/1870] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:33 2022] PUT /identity/v3/projects/3e8e42cde0f341859c4cfad519a00629/users/e785586506c041eea84416c0f679328a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:33.535125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a869a-5858-4b7e-9053-5087bb16a15f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:33.535125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a869a-5858-4b7e-9053-5087bb16a15f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:33.535696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a869a-5858-4b7e-9053-5087bb16a15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:33.732972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dc9a869a-5858-4b7e-9053-5087bb16a15f None None] MFA Rules not processed for user `e785586506c041eea84416c0f679328a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:33.740082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc9a869a-5858-4b7e-9053-5087bb16a15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:33.964982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:34.301207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 938/1871] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 761 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:34.392347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc038c5-71d8-462b-a930-21c05d8e16fb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:34.423454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:34.425046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:34.425532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:34.425932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:34.429077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:34.492310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a869a-5858-4b7e-9053-5087bb16a15f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:34.538015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:34.541440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:34.556629 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 934/1872] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:34.586632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a869a-5858-4b7e-9053-5087bb16a15f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:34.608424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ecb56-7771-4587-9bb2-c9f9fd3469a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:34.609608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecb56-7771-4587-9bb2-c9f9fd3469a6 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:34.610026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecb56-7771-4587-9bb2-c9f9fd3469a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:34.610605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecb56-7771-4587-9bb2-c9f9fd3469a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:34.656111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ecb56-7771-4587-9bb2-c9f9fd3469a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:34.661391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ecb56-7771-4587-9bb2-c9f9fd3469a6 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:34.712432 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 939/1873] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:34.936856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:34.958899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:34.970739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0083d4-6fce-48d6-bb8c-b903c4b32a2e service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:35.017569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:35.020906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:35.021406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:35.022805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:35.321955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:35.339145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:35.416616 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 935/1874] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:35.845825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:35.847309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:35.848034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:35.898565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:35.898565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:36.123687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:36.153562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828ff6-e51a-4397-8ce5-05ab286c3a69 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:36.196235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:36.202131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:36.203209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:36.207149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:36.207744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:36.219828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:36.259082 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 940/1875] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:35:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:36.279773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:36.281393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:36.467180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e03c4-79ad-4995-b1b9-681754e85a9b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:36.472540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:36.475508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:36.487325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:36.491332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:36.491610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:36.491893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:36.519327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:36.526533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:36.526812 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 936/1876] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:35:36.572171 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 941/1877] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:36.636003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:36.777260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:36.778921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:36.984567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2856-8061-4f86-a9d7-e1b93b9bda66 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:37.006925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:37.007933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:37.015335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:37.029961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] PATH_INFO: `/v3/users/d1dedf8a62b244f9bdad41ef83f63bb6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:37.038078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dedf8a62b244f9bdad41ef83f63bb6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:37.054436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:37.056510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefb3f4-00b1-4f61-837a-999a1edcdb4f service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:37.084113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:37.085821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:37.087740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:37.088675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] PATH_INFO: `/v3/users/6f03ab9c2050476eadef3d20ef3df476` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:37.097073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f03ab9c2050476eadef3d20ef3df476)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:37.116073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:37.299186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f03ab9c2050476eadef3d20ef3df476'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.331979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f03ab9c2050476eadef3d20ef3df476'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.346590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:37.361994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f03ab9c2050476eadef3d20ef3df476'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.364440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f03ab9c2050476eadef3d20ef3df476'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.391777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dedf8a62b244f9bdad41ef83f63bb6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.427688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a78b37f-89a8-45c6-ace5-a07631410960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f03ab9c2050476eadef3d20ef3df476'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.440709 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 942/1878] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:36 2022] DELETE /identity/v3/users/6f03ab9c2050476eadef3d20ef3df476 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:37.454519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6859974-7459-42c2-8b14-61557c41bbd6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:37.454795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6859974-7459-42c2-8b14-61557c41bbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:37.455091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6859974-7459-42c2-8b14-61557c41bbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:37.491409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dedf8a62b244f9bdad41ef83f63bb6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.497107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dedf8a62b244f9bdad41ef83f63bb6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.526584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dedf8a62b244f9bdad41ef83f63bb6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.531052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-95505b6a-337c-470f-9e86-7a231fe89a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dedf8a62b244f9bdad41ef83f63bb6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:37.533412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:37.562423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a6859974-7459-42c2-8b14-61557c41bbd6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:37.563823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6859974-7459-42c2-8b14-61557c41bbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:37.568537 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 937/1879] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:36 2022] DELETE /identity/v3/users/d1dedf8a62b244f9bdad41ef83f63bb6 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:37.571923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:37.572533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:37.573148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:37.617173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:37.619728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:37.778754 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 938/1880] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:37.837918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:37.839740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:37.918736 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 943/1881] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:37.930233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:37.930919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:37.931474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:37.934407 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 944/1882] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:35:37.943422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:37.946472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:38.015341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f340a06-33cd-40c4-93f8-957ac2e6d2b6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:38.020459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:38.021182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:38.021486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:38.021841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:38.052443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:38.058323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:38.092689 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 939/1883] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:38.093957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:38.119333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bea156-2863-44d7-9a1c-24e8a2ecfcb0 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:38.131960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:38.134223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:38.136034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:38.136519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:38.222609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:38.242308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:38.244781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:38.246998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:38.301987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 940/1884] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:38.484020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acced4-b438-4953-aef8-0b80d78faafb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:38.500477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:38.503514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:38.514024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d9937-90bf-437c-af18-ff31fd41e3f2 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439726d211b24daba1ce6d4aa2473493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b2be727a8f34a1d86c8c4a59cc48d90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:38.514956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d9937-90bf-437c-af18-ff31fd41e3f2 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:38.515323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d9937-90bf-437c-af18-ff31fd41e3f2 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:38.515689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d9937-90bf-437c-af18-ff31fd41e3f2 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] PATH_INFO: `/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:38.522642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d9937-90bf-437c-af18-ff31fd41e3f2 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb7498cccd6f46fd8a445d9f7455e31a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:38.533476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d9937-90bf-437c-af18-ff31fd41e3f2 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:38.547763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 945/1885] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:37 2022] GET /identity/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a => generated 395 bytes in 605 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:38.553471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747561-3570-442e-9f4e-dd0a443da9a1 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:38.569354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:38.573071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:38.573673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:38.574589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] PATH_INFO: `/v3/users/714f1f4e21004e188fb386adb8dd0c05` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:38.579806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714f1f4e21004e188fb386adb8dd0c05)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:38.586198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:38.771311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaa90c-cff7-4e57-817a-c94066f4b71e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:38.773183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaa90c-cff7-4e57-817a-c94066f4b71e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:38.774222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaa90c-cff7-4e57-817a-c94066f4b71e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:38.777501 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 946/1886] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:38.793057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:38.798405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaa90c-cff7-4e57-817a-c94066f4b71e None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:38.799336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714f1f4e21004e188fb386adb8dd0c05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:38.851544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714f1f4e21004e188fb386adb8dd0c05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:38.854504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714f1f4e21004e188fb386adb8dd0c05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:38.872846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaa90c-cff7-4e57-817a-c94066f4b71e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:38.895585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714f1f4e21004e188fb386adb8dd0c05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:38.898883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714f1f4e21004e188fb386adb8dd0c05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:38.902300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaa90c-cff7-4e57-817a-c94066f4b71e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:38.913559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8188-88a3-4ef0-b5be-a4c4f713cbe1 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439726d211b24daba1ce6d4aa2473493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b2be727a8f34a1d86c8c4a59cc48d90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:38.919293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8188-88a3-4ef0-b5be-a4c4f713cbe1 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:38.920610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8188-88a3-4ef0-b5be-a4c4f713cbe1 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:38.921147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8188-88a3-4ef0-b5be-a4c4f713cbe1 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] PATH_INFO: `/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:38.926408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8188-88a3-4ef0-b5be-a4c4f713cbe1 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb7498cccd6f46fd8a445d9f7455e31a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:38.937340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8188-88a3-4ef0-b5be-a4c4f713cbe1 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:38.943349 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 947/1887] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:38 2022] GET /identity/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a => generated 395 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:38.962743 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 941/1888] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:38 2022] DELETE /identity/v3/users/714f1f4e21004e188fb386adb8dd0c05 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:38.967012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7bbee-bad0-47b2-82f0-946c5e2b531d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:38.967662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7bbee-bad0-47b2-82f0-946c5e2b531d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:38.968198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7bbee-bad0-47b2-82f0-946c5e2b531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:39.024096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-04b7bbee-bad0-47b2-82f0-946c5e2b531d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:39.031131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04b7bbee-bad0-47b2-82f0-946c5e2b531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:39.180740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:39.355226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 948/1889] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:39.436098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:39.437472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:39.614205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527bcc-6e8d-46f8-b6d8-d428bd8b0f38 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:39.624790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:39.629679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:39.631096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:39.631096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:39.676337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:39.677968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:39.735756 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 942/1890] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:35:39.895390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253f559-a275-4c74-8870-9f1cac9114b9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:39.895809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253f559-a275-4c74-8870-9f1cac9114b9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:39.896309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253f559-a275-4c74-8870-9f1cac9114b9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:39.901850 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 949/1891] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:35:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:39.912423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:35:39.914797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:40.297170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:40.304457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:40.585067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253f559-a275-4c74-8870-9f1cac9114b9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:40.588572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2253f559-a275-4c74-8870-9f1cac9114b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:40.600384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d038ac-38af-4d38-92dd-51a66336eb74 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:40.620156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7a6b-a904-4ebf-b273-78da1053ca41 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439726d211b24daba1ce6d4aa2473493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b2be727a8f34a1d86c8c4a59cc48d90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:40.622690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7a6b-a904-4ebf-b273-78da1053ca41 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:40.623625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7a6b-a904-4ebf-b273-78da1053ca41 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:40.624203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7a6b-a904-4ebf-b273-78da1053ca41 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] PATH_INFO: `/v3/projects/613e034ca44149c8b8597f01b6e20add` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:40.626677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b7a6b-a904-4ebf-b273-78da1053ca41 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorizing `identity:get_project(project_id=613e034ca44149c8b8597f01b6e20add)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:40.629540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b7a6b-a904-4ebf-b273-78da1053ca41 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:40.633916 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 943/1892] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:35:39 2022] GET /identity/v3/projects/613e034ca44149c8b8597f01b6e20add => generated 395 bytes in 722 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:40.635980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:40.636546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:40.637061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:40.647023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:40.729672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:40.737262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253f559-a275-4c74-8870-9f1cac9114b9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:40.740043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:40.788732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:40.793126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:40.794357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:40.795221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] PATH_INFO: `/v3/projects/bf71b0fddf3a49ceafb9448f89062a2b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:40.800848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf71b0fddf3a49ceafb9448f89062a2b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:40.813291 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 944/1893] 10.222.0.104 () {58 vars in 1016 bytes} [Thu Jul 14 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:40.822392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:40.871394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:40.873926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:40.949718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b838de6-52b3-4d39-abf9-bea577f6054a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:40.985511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:41.003707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:41.004460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:41.005012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:41.040882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf71b0fddf3a49ceafb9448f89062a2b', 'request_id': 'req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.059671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf71b0fddf3a49ceafb9448f89062a2b', 'request_id': 'req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.076455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf71b0fddf3a49ceafb9448f89062a2b', 'request_id': 'req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.077381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:41.081403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:41.098241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] The token cache is being invalidate because project bf71b0fddf3a49ceafb9448f89062a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:41.098767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.099838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.108782 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 950/1894] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:40 2022] DELETE /identity/v3/projects/bf71b0fddf3a49ceafb9448f89062a2b => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:41.114689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:41.116803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:41.143593 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 945/1895] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:35:41.323207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c0ba9-df5c-4c73-a1c4-d8bbfa6f9a79 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:41.341499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:41.342874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:41.344235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:41.344817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] PATH_INFO: `/v3/users/e785586506c041eea84416c0f679328a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:41.355736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e785586506c041eea84416c0f679328a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:41.358650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:41.489221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:41.491868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:41.515007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e785586506c041eea84416c0f679328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.522124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f4083-2afd-4e71-aac8-f8150bd8e0f3 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:41.542848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:41.554538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:41.562044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e785586506c041eea84416c0f679328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.570512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:41.577021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:41.577528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] PATH_INFO: `/v3/projects/990c59ae01bd47c78548b1a08114c9ae` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:41.587221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e785586506c041eea84416c0f679328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.589002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e785586506c041eea84416c0f679328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.610879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] RBAC: Authorizing `identity:delete_project(project_id=990c59ae01bd47c78548b1a08114c9ae)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:41.615339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:41.618233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e785586506c041eea84416c0f679328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.655156 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 951/1896] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:41 2022] DELETE /identity/v3/users/e785586506c041eea84416c0f679328a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:35:41.656649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:41.663390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:41.783673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081453e1-47c2-4616-bb85-b2adfaee1ad4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:41.794751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:41.796251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:41.796798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:41.797315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] PATH_INFO: `/v3/users/db565d2fc4e84662b84966271a080b52` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:41.799532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db565d2fc4e84662b84966271a080b52)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:41.804477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:41.923478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990c59ae01bd47c78548b1a08114c9ae', 'request_id': 'req-cb789992-de43-4779-8ff5-b43c0b24320e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.929369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db565d2fc4e84662b84966271a080b52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.951827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990c59ae01bd47c78548b1a08114c9ae', 'request_id': 'req-cb789992-de43-4779-8ff5-b43c0b24320e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.970388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990c59ae01bd47c78548b1a08114c9ae', 'request_id': 'req-cb789992-de43-4779-8ff5-b43c0b24320e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.983900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db565d2fc4e84662b84966271a080b52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.994673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] The token cache is being invalidate because project 990c59ae01bd47c78548b1a08114c9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:41.995407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.996994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:41.999540 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 946/1897] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:41 2022] DELETE /identity/v3/projects/990c59ae01bd47c78548b1a08114c9ae => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:42.014795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db565d2fc4e84662b84966271a080b52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.015904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db565d2fc4e84662b84966271a080b52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.021534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:42.028356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:42.038739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-503d8155-2639-495c-a2ac-db927c9b2759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db565d2fc4e84662b84966271a080b52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.061557 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 952/1898] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:41 2022] DELETE /identity/v3/users/db565d2fc4e84662b84966271a080b52 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:42.063658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:42.064443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:42.065043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:42.119389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:42.121028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:42.270997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:42.284979 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 953/1899] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:42.286968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:42.292400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:42.319023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94bbe6-5ae2-459b-9ddc-da30eb0946f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:42.326870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:42.328974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:42.330391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:42.331212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] PATH_INFO: `/v3/projects/32689bcc311e474cba2dc75cf73fef80` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:42.332986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32689bcc311e474cba2dc75cf73fef80)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:42.340145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:42.420847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789992-de43-4779-8ff5-b43c0b24320e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:42.437624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32689bcc311e474cba2dc75cf73fef80', 'request_id': 'req-11269d4b-01d3-4281-bba7-3c057fef885c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.455476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32689bcc311e474cba2dc75cf73fef80', 'request_id': 'req-11269d4b-01d3-4281-bba7-3c057fef885c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.471352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32689bcc311e474cba2dc75cf73fef80', 'request_id': 'req-11269d4b-01d3-4281-bba7-3c057fef885c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.503079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] The token cache is being invalidate because project 32689bcc311e474cba2dc75cf73fef80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:42.505513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.508818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.513893 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 954/1900] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:42 2022] DELETE /identity/v3/projects/32689bcc311e474cba2dc75cf73fef80 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:42.515357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:42.519643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:42.645554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:42.648346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:42.653256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:42.653704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] PATH_INFO: `/v3/users/f5fdb5c974da4a3c87f8bd4dd2564487` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:42.660602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5fdb5c974da4a3c87f8bd4dd2564487)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:42.669759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:42.740247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:42.779025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11269d4b-01d3-4281-bba7-3c057fef885c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:42.790722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:42.792795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:42.793259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:42.793623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:42.797416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:42.819294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:42.821992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:42.837760 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 955/1901] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:42.838855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:42.841577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:42.845029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5fdb5c974da4a3c87f8bd4dd2564487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.857391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa824a-2d00-460c-a622-8ff81daa7cea service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:42.864218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:42.865315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:42.866212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:42.866599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] PATH_INFO: `/v3/users/806e1be95d434c15a6a17d97ee5ef1c5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:42.868467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806e1be95d434c15a6a17d97ee5ef1c5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:42.870861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:42.884848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5fdb5c974da4a3c87f8bd4dd2564487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.892193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5fdb5c974da4a3c87f8bd4dd2564487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.916046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5fdb5c974da4a3c87f8bd4dd2564487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.919177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5fdb5c974da4a3c87f8bd4dd2564487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:42.953774 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 947/1902] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:42 2022] DELETE /identity/v3/users/f5fdb5c974da4a3c87f8bd4dd2564487 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:43.003045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806e1be95d434c15a6a17d97ee5ef1c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:43.067504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806e1be95d434c15a6a17d97ee5ef1c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:43.099781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806e1be95d434c15a6a17d97ee5ef1c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:43.101848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806e1be95d434c15a6a17d97ee5ef1c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:43.127156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:43.138726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b34921c-bb4c-4382-8f38-c9ec4dc9dbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806e1be95d434c15a6a17d97ee5ef1c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:43.167750 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 956/1903] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:42 2022] DELETE /identity/v3/users/806e1be95d434c15a6a17d97ee5ef1c5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:43.796804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:43.798393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:43.878717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b60dd-f174-4842-b7a6-d8ecb22d64e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:43.961596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:43.962475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:43.962629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:44.000742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:44.002257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:44.002648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:44.003011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] PATH_INFO: `/v3/projects/3e8e42cde0f341859c4cfad519a00629` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:44.004963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8e42cde0f341859c4cfad519a00629)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:44.008861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:44.071869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] MFA Rules not processed for user `5ac81bf2390d471394f68327363cee28`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:44.077019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:44.109946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:44.122283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8e42cde0f341859c4cfad519a00629', 'request_id': 'req-fd0fe081-eef6-40dc-8116-5920f0e34cc0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.141976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8e42cde0f341859c4cfad519a00629', 'request_id': 'req-fd0fe081-eef6-40dc-8116-5920f0e34cc0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.156565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8e42cde0f341859c4cfad519a00629', 'request_id': 'req-fd0fe081-eef6-40dc-8116-5920f0e34cc0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.189475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] The token cache is being invalidate because project 3e8e42cde0f341859c4cfad519a00629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:44.189771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.191149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd0fe081-eef6-40dc-8116-5920f0e34cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.201764 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 948/1904] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:43 2022] DELETE /identity/v3/projects/3e8e42cde0f341859c4cfad519a00629 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:44.205903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:44.206687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:44.208625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:44.281736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:44.284246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:44.384978 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 957/1905] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:44.386674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:44.392800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:44.433114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d028b7-008f-4450-9894-28fd94ac69f5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:44.462019 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 949/1906] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:44.462534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:44.464511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:44.486076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d08b-b5f7-4291-b718-2941a7433942 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:44.492691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42423420-e2e1-4b35-9315-a9b00059cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:44.493470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423420-e2e1-4b35-9315-a9b00059cc37 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:44.494413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423420-e2e1-4b35-9315-a9b00059cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:44.494711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42423420-e2e1-4b35-9315-a9b00059cc37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:44.495636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42423420-e2e1-4b35-9315-a9b00059cc37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:44.499251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42423420-e2e1-4b35-9315-a9b00059cc37 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:44.538499 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 950/1907] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:44 2022] POST /identity/v3/projects => generated 403 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:44.540362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb772c5-c11a-48f6-994d-ac95fbd5d0e1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:44.540655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb772c5-c11a-48f6-994d-ac95fbd5d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:44.540999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb772c5-c11a-48f6-994d-ac95fbd5d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:44.566668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9eb772c5-c11a-48f6-994d-ac95fbd5d0e1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:44.569052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9eb772c5-c11a-48f6-994d-ac95fbd5d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:44.692267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:44.693260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:44.695019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:44.695398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] PATH_INFO: `/v3/projects/9458ee8fb1dd4588aab091fcde73e70b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:44.700229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9458ee8fb1dd4588aab091fcde73e70b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:44.706763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:44.717211 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 951/1908] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:44.719031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb772c5-c11a-48f6-994d-ac95fbd5d0e1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:44.749096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb772c5-c11a-48f6-994d-ac95fbd5d0e1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:44.765276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:44.768155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:44.768468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:44.768791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:44.769585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:44.779490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:44.830220 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 952/1909] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:44 2022] POST /identity/v3/users => generated 308 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:44.831076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:44.844714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9458ee8fb1dd4588aab091fcde73e70b', 'request_id': 'req-b586083a-06bf-4367-a40c-9e97a4b031df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.858669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67af30-fc99-43fd-aad5-3ea1c76d0fd5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:44.860487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9458ee8fb1dd4588aab091fcde73e70b', 'request_id': 'req-b586083a-06bf-4367-a40c-9e97a4b031df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.876650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9458ee8fb1dd4588aab091fcde73e70b', 'request_id': 'req-b586083a-06bf-4367-a40c-9e97a4b031df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.906722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] The token cache is being invalidate because project 9458ee8fb1dd4588aab091fcde73e70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:44.908130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.910426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:44.919652 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 958/1910] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:44 2022] DELETE /identity/v3/projects/9458ee8fb1dd4588aab091fcde73e70b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:44.921473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:44.925542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:44.958459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:44.985645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:45.099370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2aaf-ec31-4481-91b3-6ca5f8fa44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:45.100903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2aaf-ec31-4481-91b3-6ca5f8fa44ce admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.101324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2aaf-ec31-4481-91b3-6ca5f8fa44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.102945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2aaf-ec31-4481-91b3-6ca5f8fa44ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.104063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2aaf-ec31-4481-91b3-6ca5f8fa44ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:45.106939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2aaf-ec31-4481-91b3-6ca5f8fa44ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:45.112353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2aaf-ec31-4481-91b3-6ca5f8fa44ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:45.167109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 953/1911] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:45.169025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.169859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.170586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.204997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586083a-06bf-4367-a40c-9e97a4b031df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:45.207758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:45.209530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:45.229891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:45.230672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.230921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.231207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.232854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:45.234658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:45.238482 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 954/1912] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:45.239715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:45.256241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:45.286855 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 959/1913] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:45.290089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:45.300893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:45.303151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae892a-7c6f-400c-9e1b-85c1bf29bc85 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:45.325639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506159a-d417-45cf-95e9-8b73eee38b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:45.327135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506159a-d417-45cf-95e9-8b73eee38b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.327777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506159a-d417-45cf-95e9-8b73eee38b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.328268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506159a-d417-45cf-95e9-8b73eee38b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.330108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506159a-d417-45cf-95e9-8b73eee38b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:45.338063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506159a-d417-45cf-95e9-8b73eee38b58 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:45.341396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811408af-77c6-4ae6-a634-d7167bc58632 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:45.362844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:45.362844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.363185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.363393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] PATH_INFO: `/v3/projects/49fd5ede998f41f6a19664edf06abd23` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.365420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fd5ede998f41f6a19664edf06abd23)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:45.367940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:45.496752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 955/1914] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:45 2022] POST /identity/v3/projects => generated 395 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:45.514905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.516585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.518497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.567999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fd5ede998f41f6a19664edf06abd23', 'request_id': 'req-290a7912-d46f-4307-b4f9-a3ac52113faa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:45.584403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:45.588757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:45.589984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fd5ede998f41f6a19664edf06abd23', 'request_id': 'req-290a7912-d46f-4307-b4f9-a3ac52113faa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:45.609896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fd5ede998f41f6a19664edf06abd23', 'request_id': 'req-290a7912-d46f-4307-b4f9-a3ac52113faa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:45.649211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] The token cache is being invalidate because project 49fd5ede998f41f6a19664edf06abd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:45.649477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:45.651324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:45.656903 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 960/1915] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:45 2022] DELETE /identity/v3/projects/49fd5ede998f41f6a19664edf06abd23 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:45.657749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:45.660002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:45.820729 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 956/1916] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:45.824517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:45.828975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:45.833651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7912-d46f-4307-b4f9-a3ac52113faa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:45.853737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:45.856314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.857187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.857749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] PATH_INFO: `/v3/projects/b7015f2895544dff93606ed57e81b476/users/0e61db381bdc4520b56d8245623ee345/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.864260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb97f-6baa-4aed-926e-f65ac4ee06a5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:45.875251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0f898-8a6e-4cfd-b127-84077858002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:45.876913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0f898-8a6e-4cfd-b127-84077858002f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.877637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0f898-8a6e-4cfd-b127-84077858002f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.878316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0f898-8a6e-4cfd-b127-84077858002f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.879946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0f898-8a6e-4cfd-b127-84077858002f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:45.884401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0f898-8a6e-4cfd-b127-84077858002f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:45.919841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7015f2895544dff93606ed57e81b476, user_id=0e61db381bdc4520b56d8245623ee345, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:45.928482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:45.953762 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 957/1917] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:45 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:45.958086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415d472-3b5d-46bb-a6f9-a457d38e5f5c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.961733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415d472-3b5d-46bb-a6f9-a457d38e5f5c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.962279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415d472-3b5d-46bb-a6f9-a457d38e5f5c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.989904 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 958/1918] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:35:45 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:45.991796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3c447-c1d4-494d-9386-06e293a10640 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:45.992924 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 961/1919] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:45 2022] PUT /identity/v3/projects/b7015f2895544dff93606ed57e81b476/users/0e61db381bdc4520b56d8245623ee345/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:45.994836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3c447-c1d4-494d-9386-06e293a10640 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:45.997370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3c447-c1d4-494d-9386-06e293a10640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:45.999939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.049975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-50a3c447-c1d4-494d-9386-06e293a10640 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:46.053519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-50a3c447-c1d4-494d-9386-06e293a10640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:46.082891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:46.208615 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 959/1920] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:46.210515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3c447-c1d4-494d-9386-06e293a10640 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.231093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200d4c-726c-41fb-8c6a-6daba3f38fee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:46.237229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3c447-c1d4-494d-9386-06e293a10640 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:46.245475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e860fc8-70ed-47b6-8189-91e63edf9514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:46.248599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:46.249836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.250309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860fc8-70ed-47b6-8189-91e63edf9514 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.251901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.252200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860fc8-70ed-47b6-8189-91e63edf9514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.252822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860fc8-70ed-47b6-8189-91e63edf9514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.253339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.254987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:46.255908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e860fc8-70ed-47b6-8189-91e63edf9514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:46.258454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e860fc8-70ed-47b6-8189-91e63edf9514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:46.260583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e860fc8-70ed-47b6-8189-91e63edf9514 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:46.262160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:46.292948 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 960/1921] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:46.295800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.302205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 962/1922] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:46.304033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620783b2-0cfd-408a-9263-db693fdd42c3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.305967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620783b2-0cfd-408a-9263-db693fdd42c3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.306464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620783b2-0cfd-408a-9263-db693fdd42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.332225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325a1c1-b077-4679-8cc6-931827d7126a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:46.355394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340877b-8f17-4bcf-ba08-beb240e3886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:46.356257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340877b-8f17-4bcf-ba08-beb240e3886d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.356573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340877b-8f17-4bcf-ba08-beb240e3886d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.356890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340877b-8f17-4bcf-ba08-beb240e3886d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.357742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340877b-8f17-4bcf-ba08-beb240e3886d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:46.360086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340877b-8f17-4bcf-ba08-beb240e3886d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:46.370160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-620783b2-0cfd-408a-9263-db693fdd42c3 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:46.371251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:46.371488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-620783b2-0cfd-408a-9263-db693fdd42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:46.394623 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 961/1923] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:46.396309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551584-dc4c-4e51-ae68-d694bd35d144 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.396601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551584-dc4c-4e51-ae68-d694bd35d144 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.396939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551584-dc4c-4e51-ae68-d694bd35d144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.452390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-06551584-dc4c-4e51-ae68-d694bd35d144 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:46.453655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-06551584-dc4c-4e51-ae68-d694bd35d144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:46.486029 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 962/1924] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:46.487200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06551584-dc4c-4e51-ae68-d694bd35d144 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.520018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06551584-dc4c-4e51-ae68-d694bd35d144 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:46.540236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:46.543818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.547193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.547193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.552592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:46.554564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:46.590724 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 963/1925] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:46.592102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.608855 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 963/1926] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:35:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:46.609949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620783b2-0cfd-408a-9263-db693fdd42c3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.636107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b0ef-aa2f-4f11-9133-277b2c9c54cd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:46.640785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620783b2-0cfd-408a-9263-db693fdd42c3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:46.664986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:46.666090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.666644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.667142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.668182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:46.671018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:46.672953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:46.675259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:46.675698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:46.676106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] PATH_INFO: `/v3/projects/b7015f2895544dff93606ed57e81b476/users/0e61db381bdc4520b56d8245623ee345/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:46.678869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7015f2895544dff93606ed57e81b476, user_id=0e61db381bdc4520b56d8245623ee345, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:46.682139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:46.716212 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 964/1927] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:46 2022] PUT /identity/v3/projects/b7015f2895544dff93606ed57e81b476/users/0e61db381bdc4520b56d8245623ee345/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:46.721121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.756624 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 964/1928] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:46 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:46.763394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:46.881385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695ba1-d347-47f0-8966-a8c312e89038 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:46.963773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:47.020918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:47.021780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:47.022191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:47.022591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:47.023713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:47.023949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:47.026057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:47.061418 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 965/1929] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:47.069105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:47.073030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:47.103651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2705bf-9a8d-428c-9765-af71611d0b41 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:47.136589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:47.140752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:47.142647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:47.143489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] PATH_INFO: `/v3/projects/6e033f599b294c1f9a66eb4703aba0e6/users/aeb3928894284b77b4aea925a38470ba/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:47.217710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e033f599b294c1f9a66eb4703aba0e6, user_id=aeb3928894284b77b4aea925a38470ba, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:47.229398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541016b-15bd-46a8-9708-253ebbd35c95 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:47.229718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:47.236134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:47.236963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:47.237269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:47.237601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:47.255055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:47.257016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:47.290131 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 966/1930] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:47.291189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:47.296916 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 965/1931] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:46 2022] PUT /identity/v3/projects/6e033f599b294c1f9a66eb4703aba0e6/users/aeb3928894284b77b4aea925a38470ba/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:47.298978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:47.300902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:47.338075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc9f02-7474-4071-acad-091364c765d1 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:47.565261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:47.567079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:47.567572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:47.567841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] PATH_INFO: `/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:47.571594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb7498cccd6f46fd8a445d9f7455e31a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:47.580743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:47.611498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaa129-f533-4725-b2d0-b431efd1cf9d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:47.633640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:47.634374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:47.635195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:47.640834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:47.641615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:47.650471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:47.723538 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 966/1932] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:47 2022] POST /identity/v3/users => generated 285 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:47.723852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:47.763194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ad6b-64a6-4f6a-bcf3-6f8b016d694e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:47.814436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb7498cccd6f46fd8a445d9f7455e31a', 'request_id': 'req-70ac6707-e333-4224-b6d5-e80b312a7ef1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:47.844961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb7498cccd6f46fd8a445d9f7455e31a', 'request_id': 'req-70ac6707-e333-4224-b6d5-e80b312a7ef1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:47.851031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:47.866403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:47.873319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb7498cccd6f46fd8a445d9f7455e31a', 'request_id': 'req-70ac6707-e333-4224-b6d5-e80b312a7ef1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:47.913471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] The token cache is being invalidate because project cb7498cccd6f46fd8a445d9f7455e31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:47.918935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:47.922239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70ac6707-e333-4224-b6d5-e80b312a7ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:47.930443 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 967/1933] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:47 2022] DELETE /identity/v3/projects/cb7498cccd6f46fd8a445d9f7455e31a => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:47.932258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:47.936238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:47.937657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:47.940423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:47.950635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:47.951111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:47.951425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:47.956531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:47.959033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:48.030764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:48.042932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:48.067710 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 967/1934] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:47 2022] POST /identity/v3/projects => generated 393 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:48.068516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:48.078359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:48.092477 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 968/1935] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:48.093865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:48.101531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:48.149939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63fbd7-6be1-4d4a-9e92-586657d2aa55 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:48.291922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b850791-90fe-4f31-a925-e3c3e909ffd5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:48.319504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:48.320950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:48.321393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:48.321804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:48.322735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:48.324856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:48.357139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:48.359800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:48.360283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:48.361258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] PATH_INFO: `/v3/users/439726d211b24daba1ce6d4aa2473493` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:48.364691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439726d211b24daba1ce6d4aa2473493)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:48.368863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 968/1936] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:48.370454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:48.370653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:48.374625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:48.394903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966f8e9-05a4-4fe3-af6e-b573b52f2f08 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:48.417263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:48.418473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:48.419326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:48.419950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:48.421201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:48.425978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:48.485125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 969/1937] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:48 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:48.486648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:48.507816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:48.614209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439726d211b24daba1ce6d4aa2473493'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:48.671529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439726d211b24daba1ce6d4aa2473493'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:48.742950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439726d211b24daba1ce6d4aa2473493'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:48.745807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439726d211b24daba1ce6d4aa2473493'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:48.846437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666672e6-1ebf-4409-8e9d-c82d37a3194c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:48.855530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439726d211b24daba1ce6d4aa2473493'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:48.858690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:48.859997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:48.862729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:48.863534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:48.871066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:48.884948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 969/1938] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:48 2022] DELETE /identity/v3/users/439726d211b24daba1ce6d4aa2473493 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:48.890530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:48.899312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:48.952517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:48.955121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:49.015387 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 970/1939] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:49.016478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:49.020192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:49.045286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a4b9-de54-4627-a63b-a1480c8b5460 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:49.128588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:49.187083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:49.188126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.188423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.188709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.189674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:49.193025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:49.220046 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 971/1940] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:49.225223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:49.244136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f6053-fd53-4a1a-b9f6-f5fa88dfd7bb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:49.247662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472a52d-5025-4f72-8e10-32e52d37cff1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:49.252080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:49.252864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.253215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.253543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.254917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:49.255898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:49.256989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.257621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.258491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:49.258974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.260034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:49.262097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:49.274549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:49.286127 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 972/1941] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:49.289439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:49.295698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 970/1942] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:49.297081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:49.306112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d023-14f4-43a3-8c88-3d7498f3fbfc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:49.312202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5e2c9-95f4-462b-88ee-eba97502f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:49.314329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e2c9-95f4-462b-88ee-eba97502f897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.314623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e2c9-95f4-462b-88ee-eba97502f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.314911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e2c9-95f4-462b-88ee-eba97502f897 admin admin] PATH_INFO: `/v3/projects/9edac8d7a06f46298130ba087137c1e6/users/9e812f9d0deb4cb1a88f9082e9dab45b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.323234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0dd9b-fb2e-4423-a515-aff5ad8cb9e7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:49.342204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ad2ee-5a67-407b-b05a-c047106e45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:49.343543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad2ee-5a67-407b-b05a-c047106e45cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.344108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad2ee-5a67-407b-b05a-c047106e45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.344664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad2ee-5a67-407b-b05a-c047106e45cf admin admin] PATH_INFO: `/v3/projects/856e4cd681b647e28879415d0f4f0c83/users/a9fc12efbede47f2bfaef35a71e9c522/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.372055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5e2c9-95f4-462b-88ee-eba97502f897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edac8d7a06f46298130ba087137c1e6, user_id=9e812f9d0deb4cb1a88f9082e9dab45b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:49.376596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5e2c9-95f4-462b-88ee-eba97502f897 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:49.382810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ad2ee-5a67-407b-b05a-c047106e45cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=856e4cd681b647e28879415d0f4f0c83, user_id=a9fc12efbede47f2bfaef35a71e9c522, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:49.387298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ad2ee-5a67-407b-b05a-c047106e45cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:49.425418 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 973/1943] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:49 2022] PUT /identity/v3/projects/9edac8d7a06f46298130ba087137c1e6/users/9e812f9d0deb4cb1a88f9082e9dab45b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:49.440552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159ee2-2042-41e9-91c1-8c387e767d03 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.441616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159ee2-2042-41e9-91c1-8c387e767d03 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.443302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159ee2-2042-41e9-91c1-8c387e767d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.458395 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 971/1944] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:49 2022] PUT /identity/v3/projects/856e4cd681b647e28879415d0f4f0c83/users/a9fc12efbede47f2bfaef35a71e9c522/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:49.461125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a77c-81fc-437c-929b-de9d680c503d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.462125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a77c-81fc-437c-929b-de9d680c503d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.463511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a77c-81fc-437c-929b-de9d680c503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.536802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-30159ee2-2042-41e9-91c1-8c387e767d03 None None] MFA Rules not processed for user `9e812f9d0deb4cb1a88f9082e9dab45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:49.538328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-30159ee2-2042-41e9-91c1-8c387e767d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:49.546867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7093a77c-81fc-437c-929b-de9d680c503d None None] MFA Rules not processed for user `a9fc12efbede47f2bfaef35a71e9c522`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:49.549343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7093a77c-81fc-437c-929b-de9d680c503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:49.725135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 974/1945] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:49.730717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30159ee2-2042-41e9-91c1-8c387e767d03 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:49.750680 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 972/1946] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:49.759309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a77c-81fc-437c-929b-de9d680c503d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:49.907501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30159ee2-2042-41e9-91c1-8c387e767d03 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:49.922898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a77c-81fc-437c-929b-de9d680c503d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:49.925165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:49.925992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.926388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.926787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.927639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:49.932682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:49.941928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:49.942805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:49.943207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:49.943715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:49.944571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:49.952654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.002959 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 975/1947] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:49 2022] POST /identity/v3/projects => generated 393 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:50.009189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.033179 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 973/1948] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:49 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:50.034561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.058473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:50.168049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0327b5c-e33c-4b33-bec9-605a4bbf4846 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.230198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:50.293550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096d1d3-1208-4552-b958-7537e0c57fe3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.307343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.308322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.308683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.309045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.309876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.312674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.353347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 974/1949] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:50 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:50.363471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.383880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c210df-02db-4f33-93c7-9d6c110f879b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.391206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.391935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.392234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.392515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.392751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.393276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.393624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.394787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.394934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.395359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.397022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.400775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.423724 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 975/1950] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:35:50.428546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.453258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b56a-25f2-4baa-8176-ed85b67a7916 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.458906 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 976/1951] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:50 2022] POST /identity/v3/users => generated 303 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:35:50.463180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.481324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.484882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aae95-3e9e-4255-b778-ae22f00177bc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.485477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.486681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.486994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] PATH_INFO: `/v3/projects/8ca8229b82da488d8d6ecdd0dae61574/users/a71ac4623bd04916b8088947993451be/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.498489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.499456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.499826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.500227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.501105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.502959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.533561 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 977/1952] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:50.536325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.544486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca8229b82da488d8d6ecdd0dae61574, user_id=a71ac4623bd04916b8088947993451be, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.554525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.558229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014955-f107-44d5-bac3-a030aac08936 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.572166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.573679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.573679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.574227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] PATH_INFO: `/v3/projects/e3269bf4a03d401e97e85dbe92d544db/users/674cce7c5b0744509c71d199a67bc40d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.590437 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 976/1953] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:50 2022] PUT /identity/v3/projects/8ca8229b82da488d8d6ecdd0dae61574/users/a71ac4623bd04916b8088947993451be/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:35:50.594087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.615246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3269bf4a03d401e97e85dbe92d544db, user_id=674cce7c5b0744509c71d199a67bc40d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.619113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.661098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 978/1954] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:50 2022] PUT /identity/v3/projects/e3269bf4a03d401e97e85dbe92d544db/users/674cce7c5b0744509c71d199a67bc40d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:50.665882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.771917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ee326-f6db-4782-8181-0eb95b92fbef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.855608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034501c-16da-4f66-94a0-20260843d64e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.877345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.879022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.891077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.891754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.892208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.893308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.893441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.893729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.894014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.894963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.896836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.908737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.911464 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 977/1955] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:50.913865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.930842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:50.957680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfd8d4-f947-41e6-943d-16dcf5343ad5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:50.961547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:50.962072 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 979/1956] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:50.962555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:50.963710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:50.964016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:50.964418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] PATH_INFO: `/v3/projects/8b2be727a8f34a1d86c8c4a59cc48d90` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:50.966829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2be727a8f34a1d86c8c4a59cc48d90)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:50.975309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:50.992932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a2d27-3463-4f92-805d-94e2d07375f8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:51.027376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:51.033681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:51.038267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:51.042197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] PATH_INFO: `/v3/projects/8ca8229b82da488d8d6ecdd0dae61574/users/a71ac4623bd04916b8088947993451be/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:51.053662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca8229b82da488d8d6ecdd0dae61574, user_id=a71ac4623bd04916b8088947993451be, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:51.090602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:51.121621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:51.138333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 980/1957] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:50 2022] PUT /identity/v3/projects/8ca8229b82da488d8d6ecdd0dae61574/users/a71ac4623bd04916b8088947993451be/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:51.139109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:51.247874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:51.290579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2be727a8f34a1d86c8c4a59cc48d90', 'request_id': 'req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:51.309443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2be727a8f34a1d86c8c4a59cc48d90', 'request_id': 'req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:51.321828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0768-8b9b-42f5-9013-12fd669a9114 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:51.357003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2be727a8f34a1d86c8c4a59cc48d90', 'request_id': 'req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:51.408157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] The token cache is being invalidate because project 8b2be727a8f34a1d86c8c4a59cc48d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:51.409129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:51.419008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788b0fab-3aec-4eaa-8b6e-2a3e28c1af1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:51.432285 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 978/1958] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:50 2022] DELETE /identity/v3/projects/8b2be727a8f34a1d86c8c4a59cc48d90 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:51.436201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb5a35-940d-4d1b-aa77-abfa04d3b63e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:51.438995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb5a35-940d-4d1b-aa77-abfa04d3b63e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:51.439706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb5a35-940d-4d1b-aa77-abfa04d3b63e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:51.444327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 979/1959] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:35:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:35:51.446826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80f03-2ac7-43d8-9117-4dd9a8c3ccfa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:51.447612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80f03-2ac7-43d8-9117-4dd9a8c3ccfa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:51.448249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80f03-2ac7-43d8-9117-4dd9a8c3ccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:51.505435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d7c80f03-2ac7-43d8-9117-4dd9a8c3ccfa None None] MFA Rules not processed for user `a71ac4623bd04916b8088947993451be`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:51.513596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7c80f03-2ac7-43d8-9117-4dd9a8c3ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:51.592961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:51.593939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:51.594327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:51.594814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] PATH_INFO: `/v3/projects/e3269bf4a03d401e97e85dbe92d544db/users/674cce7c5b0744509c71d199a67bc40d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:51.609301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3269bf4a03d401e97e85dbe92d544db, user_id=674cce7c5b0744509c71d199a67bc40d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:51.616259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:51.678130 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 981/1960] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:51 2022] PUT /identity/v3/projects/e3269bf4a03d401e97e85dbe92d544db/users/674cce7c5b0744509c71d199a67bc40d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:51.684763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:51.694426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:51.727031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 980/1961] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:51.729477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3efc-3bf0-4878-96ce-3bc96eee1ec6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:51.732839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3efc-3bf0-4878-96ce-3bc96eee1ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:51.733198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3efc-3bf0-4878-96ce-3bc96eee1ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:51.780215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-20ec3efc-3bf0-4878-96ce-3bc96eee1ec6 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:51.784157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20ec3efc-3bf0-4878-96ce-3bc96eee1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:51.916360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7f691-69ba-4842-8aba-1b082ae403f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:51.928603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:51.929850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:51.930142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:51.930422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] PATH_INFO: `/v3/users/aaef0be07d364068bcce4d5e1cda3e68` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:51.933772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaef0be07d364068bcce4d5e1cda3e68)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:51.937369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:52.031357 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 981/1962] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:52.035951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:52.036328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:52.036649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:52.081882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:52.094565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaef0be07d364068bcce4d5e1cda3e68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:52.126674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] MFA Rules not processed for user `674cce7c5b0744509c71d199a67bc40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:52.134431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:52.158822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaef0be07d364068bcce4d5e1cda3e68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:52.162852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaef0be07d364068bcce4d5e1cda3e68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:52.190007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaef0be07d364068bcce4d5e1cda3e68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:52.193006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaef0be07d364068bcce4d5e1cda3e68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:52.231521 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 982/1963] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:51 2022] DELETE /identity/v3/users/aaef0be07d364068bcce4d5e1cda3e68 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:52.232519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:52.234001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:52.236983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:52.335259 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 982/1964] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:52.445103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:52.448415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:52.451075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ab77c-8a95-4db6-8a48-054e9ad2debe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:52.473032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:52.477179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:52.479071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:52.479856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:52.484701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:52.509622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a28b-9f98-44fb-99e4-d5f8cc5411b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:52.528889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:52.529922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:52.530369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:52.531725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:52.539883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:52.574782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:52.580705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:52.634049 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 983/1965] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:35:52.718436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:52.728098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:52.732183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:52.759133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc7013-8f7c-4f74-a683-6b9edd8b560a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:52.772818 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 983/1966] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:52.778614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:52.779847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:52.779847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:52.780115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:52.856708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:52.934803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c440ac-0d1c-4732-a54b-350d34cd0f28 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:52.938170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:52.939919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:52.955453 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 984/1967] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:52.983648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6233-1487-4c64-8083-b54fc1b00876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:52.984065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6233-1487-4c64-8083-b54fc1b00876 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:52.984366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6233-1487-4c64-8083-b54fc1b00876 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:52.984631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6233-1487-4c64-8083-b54fc1b00876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:52.987381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eeca6233-1487-4c64-8083-b54fc1b00876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:53.168439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:53.179056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:53.213151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:53.251350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6233-1487-4c64-8083-b54fc1b00876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:53.254398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6233-1487-4c64-8083-b54fc1b00876 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:53.291164 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 984/1968] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:35:53.432773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d29a30-946d-4dfe-8858-7a874e6d3a54 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:53.462782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:53.466894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:53.467330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:53.467846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] PATH_INFO: `/v3/projects/613e034ca44149c8b8597f01b6e20add` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:53.478818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613e034ca44149c8b8597f01b6e20add)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:53.490915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:53.632218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613e034ca44149c8b8597f01b6e20add', 'request_id': 'req-52377fd3-c367-46c8-b3d9-f5f599c94cc1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:53.635387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:53.644042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613e034ca44149c8b8597f01b6e20add', 'request_id': 'req-52377fd3-c367-46c8-b3d9-f5f599c94cc1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:53.655582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613e034ca44149c8b8597f01b6e20add', 'request_id': 'req-52377fd3-c367-46c8-b3d9-f5f599c94cc1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:53.677456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] The token cache is being invalidate because project 613e034ca44149c8b8597f01b6e20add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:53.678484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:53.680233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52377fd3-c367-46c8-b3d9-f5f599c94cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:53.682687 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 985/1969] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:53 2022] DELETE /identity/v3/projects/613e034ca44149c8b8597f01b6e20add => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:53.693564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1a40-5415-4dd0-a56f-dc25312d5921 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:53.694629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1a40-5415-4dd0-a56f-dc25312d5921 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:53.697064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1a40-5415-4dd0-a56f-dc25312d5921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:53.768108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-339a1a40-5415-4dd0-a56f-dc25312d5921 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:53.772756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-339a1a40-5415-4dd0-a56f-dc25312d5921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:54.024420 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 985/1970] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:54.036732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085c04-b8d4-4b0c-8758-f1d6e519dfec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:54.036732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085c04-b8d4-4b0c-8758-f1d6e519dfec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:54.037078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085c04-b8d4-4b0c-8758-f1d6e519dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:54.087481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-75085c04-b8d4-4b0c-8758-f1d6e519dfec None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:54.088822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75085c04-b8d4-4b0c-8758-f1d6e519dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:54.123396 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 986/1971] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:54.127999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a1a40-5415-4dd0-a56f-dc25312d5921 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:54.166601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a1a40-5415-4dd0-a56f-dc25312d5921 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:54.178982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:54.180946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:54.181543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:54.182663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:54.184697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:35:54.185415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:54.196773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:54.292369 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 986/1972] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:35:54.300363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085c04-b8d4-4b0c-8758-f1d6e519dfec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:54.337964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085c04-b8d4-4b0c-8758-f1d6e519dfec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:54.348112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:54.350885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:54.354466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:54.356426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:54.358072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:54.359035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:54.360791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:54.377970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:54.381406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f53c8-436a-498d-9700-0b310c485816 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:54.395842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:54.397300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:54.398009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:54.399033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] PATH_INFO: `/v3/users/9e812f9d0deb4cb1a88f9082e9dab45b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:54.402452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e812f9d0deb4cb1a88f9082e9dab45b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:54.408308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:54.490939 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 987/1973] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:54 2022] POST /identity/v3/projects => generated 403 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:54.495099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:54.524782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e812f9d0deb4cb1a88f9082e9dab45b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:54.550341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e812f9d0deb4cb1a88f9082e9dab45b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:54.551834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e812f9d0deb4cb1a88f9082e9dab45b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:54.589784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e812f9d0deb4cb1a88f9082e9dab45b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:54.590953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e812f9d0deb4cb1a88f9082e9dab45b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:54.618699 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 987/1974] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:54 2022] DELETE /identity/v3/users/9e812f9d0deb4cb1a88f9082e9dab45b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:54.623066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:54.624658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:54.665889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647fc4-d267-49ed-bbad-ba9e9d6093a9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:54.751157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:54.801173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde937c8-58fc-4c1b-ad9d-04b25240ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:54.802965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde937c8-58fc-4c1b-ad9d-04b25240ddb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:54.803439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde937c8-58fc-4c1b-ad9d-04b25240ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:54.806740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde937c8-58fc-4c1b-ad9d-04b25240ddb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:54.807741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde937c8-58fc-4c1b-ad9d-04b25240ddb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:54.817299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cb333-7dfd-464c-a2f1-e6dcdeef3dc7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:54.821363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde937c8-58fc-4c1b-ad9d-04b25240ddb2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:54.844092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:54.845403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:54.845799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:54.846521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] PATH_INFO: `/v3/users/a9fc12efbede47f2bfaef35a71e9c522` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:54.848325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fc12efbede47f2bfaef35a71e9c522)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:54.850721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:54.898036 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 988/1975] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:54 2022] POST /identity/v3/users => generated 302 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:54.898036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:54.898891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:54.900127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:54.959528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:54.963820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:54.983431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fc12efbede47f2bfaef35a71e9c522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:54.995792 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 989/1976] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:54.995792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:55.001019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:55.037155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fc12efbede47f2bfaef35a71e9c522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:55.038920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fc12efbede47f2bfaef35a71e9c522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:55.051702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fc12efbede47f2bfaef35a71e9c522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:55.053183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fc12efbede47f2bfaef35a71e9c522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:55.060391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6951ec-d5c3-4bee-92b1-fd1f14188538 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:55.076991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a12fd3-d883-4d4a-9d6d-ed691f8cc304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:55.078380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12fd3-d883-4d4a-9d6d-ed691f8cc304 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:55.079380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12fd3-d883-4d4a-9d6d-ed691f8cc304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:55.079881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12fd3-d883-4d4a-9d6d-ed691f8cc304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:55.080860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a12fd3-d883-4d4a-9d6d-ed691f8cc304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:55.082800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a12fd3-d883-4d4a-9d6d-ed691f8cc304 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:55.089090 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 988/1977] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:54 2022] DELETE /identity/v3/users/a9fc12efbede47f2bfaef35a71e9c522 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:55.089090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:55.090978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:55.109561 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 990/1978] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:55.111662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:55.112261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:55.112700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:55.162152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:55.167771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:55.238284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:55.282015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82fb55-b7fd-490a-bc07-7dc5d1d09ba4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:55.289792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:55.290989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:55.291540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:55.292002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:55.296911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:55.337527 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 991/1979] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:55.337527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:55.337527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:55.365940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78d512-1058-4fd0-84e9-02bcf0add723 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:55.379998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:55.382991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:55.383396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:55.383689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:55.384503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:55.392917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:55.422115 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 992/1980] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:55.425201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:55.430461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:55.463642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e405a-c95c-4f1e-a8d2-d6696be5dff2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:55.473472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:55.474207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:55.475029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:55.475029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:55.509887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:55.511514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:55.539650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 993/1981] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:55.540549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:55.563408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c72fe-dc7c-4e88-b93f-38ab3bf09a3b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:55.571858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab159-9dfc-4caf-9d6d-cb7f888d6959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:55.573837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab159-9dfc-4caf-9d6d-cb7f888d6959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:55.574051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab159-9dfc-4caf-9d6d-cb7f888d6959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:55.574497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab159-9dfc-4caf-9d6d-cb7f888d6959 admin admin] PATH_INFO: `/v3/projects/1af6b7871fcf4df79a177aba661ea860/users/a9cd2138240b448588764fa7c372209b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:55.644777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ab159-9dfc-4caf-9d6d-cb7f888d6959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af6b7871fcf4df79a177aba661ea860, user_id=a9cd2138240b448588764fa7c372209b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:55.647044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:55.651657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ab159-9dfc-4caf-9d6d-cb7f888d6959 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:55.656964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:55.699834 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 994/1982] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:55 2022] PUT /identity/v3/projects/1af6b7871fcf4df79a177aba661ea860/users/a9cd2138240b448588764fa7c372209b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:55.712404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b2298-7373-4519-b466-e4d0c59c7618 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:55.712725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b2298-7373-4519-b466-e4d0c59c7618 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:55.713014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b2298-7373-4519-b466-e4d0c59c7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:55.715527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 989/1983] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:55.794883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-263b2298-7373-4519-b466-e4d0c59c7618 None None] MFA Rules not processed for user `a9cd2138240b448588764fa7c372209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:55.796114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-263b2298-7373-4519-b466-e4d0c59c7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:55.919458 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 995/1984] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:35:55.925831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:55.971072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c2b2-3d4d-427a-8a63-c97c7174d854 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:56.010676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:56.127702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:56.128860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:56.129368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:56.130266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:56.130977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:56.134964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:56.202760 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 990/1985] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:35:55 2022] POST /identity/v3/projects => generated 403 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:56.207885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b2298-7373-4519-b466-e4d0c59c7618 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:56.229465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b2298-7373-4519-b466-e4d0c59c7618 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:56.371232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:56.372490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:56.373167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:56.373714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:56.374654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:56.377554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:56.423709 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 996/1986] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:35:56 2022] POST /identity/v3/users => generated 308 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:35:56.423970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:56.463236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7e179-e03b-429a-8e6d-a8fd9af4d963 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:56.483520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:56.485581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:56.486162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:56.488208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:56.490054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:56.495149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:56.543169 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 991/1987] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:35:56.545279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:56.561845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:56.592302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2f1c-1c58-4005-8f9f-27136d283839 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:56.615596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:56.617454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:56.620718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:56.621876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] PATH_INFO: `/v3/projects/799dc90bf7044769839dcdd9b59b234e/users/d469489a18ed4f92808a3738f2a3b1d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:56.706144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=799dc90bf7044769839dcdd9b59b234e, user_id=d469489a18ed4f92808a3738f2a3b1d0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:56.720622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:56.791150 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 997/1988] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:56 2022] PUT /identity/v3/projects/799dc90bf7044769839dcdd9b59b234e/users/d469489a18ed4f92808a3738f2a3b1d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:56.792928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:56.902808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681ccd5-c359-462c-855e-c125d3a46c7c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:57.267611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e9f27-a928-4a52-a9ee-76fd3a0b21a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:57.285344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9f27-a928-4a52-a9ee-76fd3a0b21a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:57.285864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9f27-a928-4a52-a9ee-76fd3a0b21a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:57.286343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9f27-a928-4a52-a9ee-76fd3a0b21a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:57.303192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e9f27-a928-4a52-a9ee-76fd3a0b21a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:57.308790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e9f27-a928-4a52-a9ee-76fd3a0b21a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:57.353968 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 992/1989] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 558 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:35:57.356889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:57.401479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e9a0e-614e-4e43-855b-770855701d6b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:57.426302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:57.428236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:57.429190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:57.430435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] PATH_INFO: `/v3/projects/799dc90bf7044769839dcdd9b59b234e/users/d469489a18ed4f92808a3738f2a3b1d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:57.439157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799dc90bf7044769839dcdd9b59b234e, user_id=d469489a18ed4f92808a3738f2a3b1d0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:57.460091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:57.533761 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 998/1990] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:35:57 2022] PUT /identity/v3/projects/799dc90bf7044769839dcdd9b59b234e/users/d469489a18ed4f92808a3738f2a3b1d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:57.542449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:57.542940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:57.544316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:57.689358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] MFA Rules not processed for user `d469489a18ed4f92808a3738f2a3b1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:35:57.697126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:58.066587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:58.069570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:58.115632 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 993/1991] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 576 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:35:58.195209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:58.200972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:58.279143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:58.400405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e690b-e398-4af2-9d94-4fc9255de626 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:58.416624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:58.418416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:58.419201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:58.420008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] PATH_INFO: `/v3/projects/856e4cd681b647e28879415d0f4f0c83` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:58.426078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856e4cd681b647e28879415d0f4f0c83)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:58.430842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:58.514295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd943f-2546-4f37-864e-7df633aa1316 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:58.536273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:58.539856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:58.540489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:58.540991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] PATH_INFO: `/v3/projects/9edac8d7a06f46298130ba087137c1e6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:58.550063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edac8d7a06f46298130ba087137c1e6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:58.551528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:58.666628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856e4cd681b647e28879415d0f4f0c83', 'request_id': 'req-b1f8809f-87d2-4e5b-bf5e-c81648926159'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.674639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edac8d7a06f46298130ba087137c1e6', 'request_id': 'req-f359cdad-c652-42d1-a014-9d926fa3c1d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.694493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856e4cd681b647e28879415d0f4f0c83', 'request_id': 'req-b1f8809f-87d2-4e5b-bf5e-c81648926159'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.701177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edac8d7a06f46298130ba087137c1e6', 'request_id': 'req-f359cdad-c652-42d1-a014-9d926fa3c1d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.709307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856e4cd681b647e28879415d0f4f0c83', 'request_id': 'req-b1f8809f-87d2-4e5b-bf5e-c81648926159'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.721768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edac8d7a06f46298130ba087137c1e6', 'request_id': 'req-f359cdad-c652-42d1-a014-9d926fa3c1d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.749517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] The token cache is being invalidate because project 856e4cd681b647e28879415d0f4f0c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:58.750129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.754762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.756657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] The token cache is being invalidate because project 9edac8d7a06f46298130ba087137c1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:35:58.756962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.758844 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 999/1992] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:58 2022] DELETE /identity/v3/projects/856e4cd681b647e28879415d0f4f0c83 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:58.761322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:58.762217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:58.765406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:58.767424 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 994/1993] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:58 2022] DELETE /identity/v3/projects/9edac8d7a06f46298130ba087137c1e6 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:58.768434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:58.774751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:58.941141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359cdad-c652-42d1-a014-9d926fa3c1d6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:58.955749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:58.957571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:58.958250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:58.958536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] PATH_INFO: `/v3/users/a71ac4623bd04916b8088947993451be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:58.961307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71ac4623bd04916b8088947993451be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:58.963396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:58.964611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:59.013377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8809f-87d2-4e5b-bf5e-c81648926159 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:59.110010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:59.116818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71ac4623bd04916b8088947993451be'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.151530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71ac4623bd04916b8088947993451be'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.152612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71ac4623bd04916b8088947993451be'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.178057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71ac4623bd04916b8088947993451be'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.179731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71ac4623bd04916b8088947993451be'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.194894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:59.203439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:59.203725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:59.204050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:59.208343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:59.212964 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 995/1994] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:58 2022] DELETE /identity/v3/users/a71ac4623bd04916b8088947993451be => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:59.214075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:59.222544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:59.379679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b9be8-44b6-448a-9f72-984304ccf60c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:59.386194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:59.387227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:59.387665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:59.388032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] PATH_INFO: `/v3/users/674cce7c5b0744509c71d199a67bc40d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:59.389795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=674cce7c5b0744509c71d199a67bc40d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:59.392305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:59.422457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:59.425029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:59.450673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1000/1995] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:59.474171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674cce7c5b0744509c71d199a67bc40d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.511842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:35:59.513412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674cce7c5b0744509c71d199a67bc40d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.513817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:59.514736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674cce7c5b0744509c71d199a67bc40d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.537386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59337d-6ab0-475c-9bbd-67441accd0fe service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:35:59.539619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674cce7c5b0744509c71d199a67bc40d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.540797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674cce7c5b0744509c71d199a67bc40d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:35:59.590645 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 996/1996] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:59 2022] DELETE /identity/v3/users/674cce7c5b0744509c71d199a67bc40d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:35:59.686056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:35:59.687663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:35:59.688146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:35:59.688611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:35:59.691261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:35:59.753933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:59.880703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:35:59.884359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:35:59.911831 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1001/1997] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:35:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:01.524558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:01.526891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:01.690299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:01.734945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4af3b-6858-4d2c-8249-1f880141ed47 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:01.740664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:01.742252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:01.742676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:01.744124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] PATH_INFO: `/v3/users/a9cd2138240b448588764fa7c372209b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:01.745947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cd2138240b448588764fa7c372209b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:01.748493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:01.907802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cd2138240b448588764fa7c372209b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:01.920225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:01.922694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:01.936596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cd2138240b448588764fa7c372209b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:01.937454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cd2138240b448588764fa7c372209b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:01.948263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cd2138240b448588764fa7c372209b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:01.949117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cd2138240b448588764fa7c372209b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:01.973873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00384e8f-603d-4624-93b0-370109d677ed service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:01.993257 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 997/1998] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:01 2022] DELETE /identity/v3/users/a9cd2138240b448588764fa7c372209b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:01.994785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:01.998165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.000698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:02.002500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.003455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.004103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] PATH_INFO: `/v3/projects/8ca8229b82da488d8d6ecdd0dae61574` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.007381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca8229b82da488d8d6ecdd0dae61574)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:02.015972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:02.149305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2a7e-af0e-4837-a8e5-f7ff533898a8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:02.197847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca8229b82da488d8d6ecdd0dae61574', 'request_id': 'req-c8539e96-0e2a-445d-996b-24df8ab3f064'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.219843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca8229b82da488d8d6ecdd0dae61574', 'request_id': 'req-c8539e96-0e2a-445d-996b-24df8ab3f064'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.258156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca8229b82da488d8d6ecdd0dae61574', 'request_id': 'req-c8539e96-0e2a-445d-996b-24df8ab3f064'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.285375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] The token cache is being invalidate because project 8ca8229b82da488d8d6ecdd0dae61574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:02.285662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.287843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c8539e96-0e2a-445d-996b-24df8ab3f064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.294290 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1002/1999] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:01 2022] DELETE /identity/v3/projects/8ca8229b82da488d8d6ecdd0dae61574 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:02.294290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392820d-a655-4726-a95a-66eb11b90186 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.294290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392820d-a655-4726-a95a-66eb11b90186 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.294290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392820d-a655-4726-a95a-66eb11b90186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.338961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a392820d-a655-4726-a95a-66eb11b90186 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:02.340597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a392820d-a655-4726-a95a-66eb11b90186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.341906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:02.344808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.345337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.345623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] PATH_INFO: `/v3/projects/e3269bf4a03d401e97e85dbe92d544db` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.347608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3269bf4a03d401e97e85dbe92d544db)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:02.350102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1003/2000] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:02.350319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:02.352199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1872a9-b225-4656-a833-34ac1848cb76 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.352683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1872a9-b225-4656-a833-34ac1848cb76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.353110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1872a9-b225-4656-a833-34ac1848cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.377839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0a1872a9-b225-4656-a833-34ac1848cb76 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:02.378595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:02.380293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a1872a9-b225-4656-a833-34ac1848cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.403364 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1004/2001] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:02.411202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459dcb0-a1eb-45ad-8cda-1283d66b0395 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.412464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459dcb0-a1eb-45ad-8cda-1283d66b0395 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.412956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459dcb0-a1eb-45ad-8cda-1283d66b0395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.455055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0459dcb0-a1eb-45ad-8cda-1283d66b0395 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:02.457290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0459dcb0-a1eb-45ad-8cda-1283d66b0395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.467827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3269bf4a03d401e97e85dbe92d544db', 'request_id': 'req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.482956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3269bf4a03d401e97e85dbe92d544db', 'request_id': 'req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.500563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3269bf4a03d401e97e85dbe92d544db', 'request_id': 'req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.525256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] The token cache is being invalidate because project e3269bf4a03d401e97e85dbe92d544db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:02.525822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.526401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:02.531501 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 998/2002] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:01 2022] DELETE /identity/v3/projects/e3269bf4a03d401e97e85dbe92d544db => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:02.531501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:02.531501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.580136 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1005/2003] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:36:02.582222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc759-6ce6-47d3-be88-c65d6b4f19fd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.582803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc759-6ce6-47d3-be88-c65d6b4f19fd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.583546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc759-6ce6-47d3-be88-c65d6b4f19fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.629739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e13dc759-6ce6-47d3-be88-c65d6b4f19fd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:02.631752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e13dc759-6ce6-47d3-be88-c65d6b4f19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.654430 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1006/2004] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:02.655393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc759-6ce6-47d3-be88-c65d6b4f19fd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:02.680153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc759-6ce6-47d3-be88-c65d6b4f19fd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:02.687103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb670-de4c-4e83-910e-a474c673db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:02.687851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb670-de4c-4e83-910e-a474c673db76 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.688365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb670-de4c-4e83-910e-a474c673db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.688670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb670-de4c-4e83-910e-a474c673db76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.689469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb670-de4c-4e83-910e-a474c673db76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:02.689856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb670-de4c-4e83-910e-a474c673db76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:02.696422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb670-de4c-4e83-910e-a474c673db76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:02.722500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da9f2-7d56-4753-9e8a-d9d1d9bfab61 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:02.730447 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1007/2005] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:02.733348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:02.734716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.735210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.735389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a89c1-5b2b-48a0-96c0-c1bf3b3c9461 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.735721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a89c1-5b2b-48a0-96c0-c1bf3b3c9461 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.735923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.739314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a89c1-5b2b-48a0-96c0-c1bf3b3c9461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.745046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.781439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-750a89c1-5b2b-48a0-96c0-c1bf3b3c9461 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:02.781439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-750a89c1-5b2b-48a0-96c0-c1bf3b3c9461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:02.789038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:02.791443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:02.805853 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1008/2006] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:02.805853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a89c1-5b2b-48a0-96c0-c1bf3b3c9461 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:02.815559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a89c1-5b2b-48a0-96c0-c1bf3b3c9461 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:02.824922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:02.825959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.826255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.826537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.827384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:02.829405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:02.849298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:02.850910 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 999/2007] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:02.851935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:02.885633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9987e3d-578c-46e5-8c5b-29f70391af0f service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:02.903873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:02.904688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:02.904857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:02.905107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:02.905872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:02.906181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:02.908001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:02.940058 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1000/2008] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:02.941624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:02.942459 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1009/2009] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:02.948780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:02.961135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f86ef-0a26-4e31-a605-eadf23f568d4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.048002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.049623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.050093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.050519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.051447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.055043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.100611 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1001/2010] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:03.107186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:03.119812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a017323-cc47-4a3f-9a1a-fc7d834829dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.146981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:03.290280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.290993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.291298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.292476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.293271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.297319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.313385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d104d7-394d-4ed0-a7d3-3d8abad346b6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.326626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.327464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.327872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.328153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.329529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.336246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.369579 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1010/2011] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:02 2022] POST /identity/v3/users => generated 287 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:03.371602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:03.394509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e4c9c-54c8-44cc-9e6a-65d25c1be767 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.399326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1002/2012] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:03 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:03.405015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:03.412355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.413084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.413374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.413692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.414475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.416218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.439154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdfe5a-cc41-4658-b6e5-da05cc375467 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.447523 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1011/2013] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:03.449741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.450694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.451119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.454276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:03.455066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.457645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.461345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.480745 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1003/2014] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:03.486888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:03.488258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3066-542f-4327-8753-6e880930c3f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.502250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42af44f-26c2-438c-bfd5-9d355da826b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.505417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa523-ef88-4a04-8c8a-f3773992a6d2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.512361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.514243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.514594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.514883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.515762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.517829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.520446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af44f-26c2-438c-bfd5-9d355da826b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.521162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af44f-26c2-438c-bfd5-9d355da826b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.521688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af44f-26c2-438c-bfd5-9d355da826b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.523881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42af44f-26c2-438c-bfd5-9d355da826b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.527084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42af44f-26c2-438c-bfd5-9d355da826b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.535321 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1004/2015] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:03.541224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:03.599837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1012/2016] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:03.603463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73932f4e-83e8-4f3c-94cd-9d12e9f4e1ba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.603993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73932f4e-83e8-4f3c-94cd-9d12e9f4e1ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.604493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73932f4e-83e8-4f3c-94cd-9d12e9f4e1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.611837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e89cb-8c30-41d3-b7ad-ad161787493a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:03.645849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:03.648624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:03.649052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:03.665453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] PATH_INFO: `/v3/projects/7508909f8d2d488baf0bb21f4f5d93c1/users/a3cdaa06f78d4905a825ba969be0784c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:03.769168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-73932f4e-83e8-4f3c-94cd-9d12e9f4e1ba None None] MFA Rules not processed for user `0e61db381bdc4520b56d8245623ee345`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:03.780929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73932f4e-83e8-4f3c-94cd-9d12e9f4e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:03.800300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7508909f8d2d488baf0bb21f4f5d93c1, user_id=a3cdaa06f78d4905a825ba969be0784c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:03.823897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:03.930113 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1005/2017] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:03 2022] PUT /identity/v3/projects/7508909f8d2d488baf0bb21f4f5d93c1/users/a3cdaa06f78d4905a825ba969be0784c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:03.939114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:04.174238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:04.296074 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1013/2018] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 674 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:04.299851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545c1e-67ff-45de-98c9-c69a833d7bb8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:04.314502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545c1e-67ff-45de-98c9-c69a833d7bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:04.315184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545c1e-67ff-45de-98c9-c69a833d7bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:04.316099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b928-e1af-4b9a-bb3d-61d329c7eb9e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:04.335327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e56f6-36d3-41c3-bb0c-1abfd06f3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:04.336923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e56f6-36d3-41c3-bb0c-1abfd06f3e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:04.337542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e56f6-36d3-41c3-bb0c-1abfd06f3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:04.338024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e56f6-36d3-41c3-bb0c-1abfd06f3e84 admin admin] PATH_INFO: `/v3/projects/ca16294bad684859bedaad46fbf13f54/users/94a7b16a3fcb40ff8d2cc9bb76796e7e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:04.448295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e56f6-36d3-41c3-bb0c-1abfd06f3e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca16294bad684859bedaad46fbf13f54, user_id=94a7b16a3fcb40ff8d2cc9bb76796e7e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:04.457334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9a545c1e-67ff-45de-98c9-c69a833d7bb8 None None] MFA Rules not processed for user `a3cdaa06f78d4905a825ba969be0784c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:04.459388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a545c1e-67ff-45de-98c9-c69a833d7bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:04.475824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e56f6-36d3-41c3-bb0c-1abfd06f3e84 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:04.535031 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1006/2019] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:03 2022] PUT /identity/v3/projects/ca16294bad684859bedaad46fbf13f54/users/94a7b16a3fcb40ff8d2cc9bb76796e7e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:04.550388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ad51-211c-4d57-9b02-0886c8a80419 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:04.552160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ad51-211c-4d57-9b02-0886c8a80419 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:04.552340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ad51-211c-4d57-9b02-0886c8a80419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:04.656133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b8c5ad51-211c-4d57-9b02-0886c8a80419 None None] MFA Rules not processed for user `94a7b16a3fcb40ff8d2cc9bb76796e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:04.658120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8c5ad51-211c-4d57-9b02-0886c8a80419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:04.747007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:04.782469 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1014/2020] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:04.789939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a545c1e-67ff-45de-98c9-c69a833d7bb8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:04.827238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a545c1e-67ff-45de-98c9-c69a833d7bb8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:04.875887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1007/2021] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:04.887600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ad51-211c-4d57-9b02-0886c8a80419 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:05.048901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:05.050263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:05.050812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:05.051342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:05.052318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:05.055239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:05.109493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ad51-211c-4d57-9b02-0886c8a80419 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:05.124510 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1015/2022] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:04 2022] POST /identity/v3/projects => generated 377 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:05.133327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:05.139661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:05.140847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:05.141329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:05.141907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:05.143680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:05.152492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:05.284508 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1008/2023] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:04 2022] POST /identity/v3/projects => generated 371 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:05.294521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:05.349918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835bd38-8ae4-4d0d-962d-76ac0448008e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:05.384171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:05.544432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6447b-5eda-4649-833b-611f877c8887 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:05.560311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:05.561362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:05.561710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:05.562102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:05.563140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:05.572437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:05.625114 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1009/2024] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:05 2022] POST /identity/v3/users => generated 292 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:05.626847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:05.646416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060ae3b-61e0-440a-8b49-0640a31ca964 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:05.659668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:05.661164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:05.661164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:05.661164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:05.662360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:05.666159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:05.685349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:05.686098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:05.686390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:05.687127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:05.687681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:05.689661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:05.696087 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1010/2025] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:36:05.697528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:05.705332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:05.771823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1016/2026] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:05 2022] POST /identity/v3/users => generated 295 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:05.772562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca061908-2eb2-4525-a245-b65052606f0b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:05.772766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:05.791555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:05.792715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:05.793216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:05.793611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] PATH_INFO: `/v3/projects/1af6b7871fcf4df79a177aba661ea860` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:05.802507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af6b7871fcf4df79a177aba661ea860)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:05.811876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:05.823993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b21d7-582f-4e9f-b718-045e1eb1fdf9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:05.878244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:05.882663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:05.908222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:05.909109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] PATH_INFO: `/v3/projects/6aad72622d75444d8b0e8d6b7d99fb5f/users/e32a6eb27b714d9c9ce2463e677484ad/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:05.974777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:05.999497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aad72622d75444d8b0e8d6b7d99fb5f, user_id=e32a6eb27b714d9c9ce2463e677484ad, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:06.020305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:06.030091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af6b7871fcf4df79a177aba661ea860', 'request_id': 'req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.063298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af6b7871fcf4df79a177aba661ea860', 'request_id': 'req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.077196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af6b7871fcf4df79a177aba661ea860', 'request_id': 'req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.104430 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1017/2027] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:05 2022] PUT /identity/v3/projects/6aad72622d75444d8b0e8d6b7d99fb5f/users/e32a6eb27b714d9c9ce2463e677484ad/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:06.106720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:06.111588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] The token cache is being invalidate because project 1af6b7871fcf4df79a177aba661ea860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:06.113583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.119728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.123105 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1011/2028] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:05 2022] DELETE /identity/v3/projects/1af6b7871fcf4df79a177aba661ea860 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:06.127757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:06.141910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:06.413013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329f298-9e8f-4731-a760-ca250bc160e8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:06.427745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:06.435572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:06.437601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:06.439553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:06.440712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:06.443645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:06.477412 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1018/2029] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:06.480006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:06.484746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:06.519820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d0471-df1c-4db3-b1d2-30b723636c53 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:06.544517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:06.545423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:06.545834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:06.546409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:06.547330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:06.550159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67c195-ba15-4b54-aa07-0ad2fc9bce68 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:06.552437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:06.598947 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1019/2030] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:06.600512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:06.611246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:06.686908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6c2d-f840-4210-bd9a-027f560ace85 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:06.732903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:06.733773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:06.734186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:06.734571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] PATH_INFO: `/v3/users/d469489a18ed4f92808a3738f2a3b1d0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:06.739309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d469489a18ed4f92808a3738f2a3b1d0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:06.742174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:06.855573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:06.856441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:06.856879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:06.857254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:06.867821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:06.905551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd469489a18ed4f92808a3738f2a3b1d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.923329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:06.952359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd469489a18ed4f92808a3738f2a3b1d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.972806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd469489a18ed4f92808a3738f2a3b1d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.974133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd469489a18ed4f92808a3738f2a3b1d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:06.998477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd469489a18ed4f92808a3738f2a3b1d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:07.032876 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1020/2031] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:06 2022] DELETE /identity/v3/users/d469489a18ed4f92808a3738f2a3b1d0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:07.032876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:07.040936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:07.324914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c30a8-8fe5-4259-a8dc-08e7474a63d4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:07.354993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:07.355997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:07.356292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:07.356587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] PATH_INFO: `/v3/projects/91cb4b19113a426c82c7f40900b69e35/users/81cd9d0b9d3744cc9d5da869109ba6eb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:07.373030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:07.409425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cb4b19113a426c82c7f40900b69e35, user_id=81cd9d0b9d3744cc9d5da869109ba6eb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:07.412871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:07.448898 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1021/2032] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:07 2022] PUT /identity/v3/projects/91cb4b19113a426c82c7f40900b69e35/users/81cd9d0b9d3744cc9d5da869109ba6eb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:07.449544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:07.456259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:07.485051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:07.490924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:07.546114 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1012/2033] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 1422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:07.550657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:07.558063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:07.625079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184fa9c-5b12-4f66-895c-8f0ff0a23c6b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:07.648292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a45c7c-3e20-4d5e-999e-015dd5b6771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:07.649263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45c7c-3e20-4d5e-999e-015dd5b6771d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:07.649551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45c7c-3e20-4d5e-999e-015dd5b6771d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:07.649874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45c7c-3e20-4d5e-999e-015dd5b6771d admin admin] PATH_INFO: `/v3/projects/6aad72622d75444d8b0e8d6b7d99fb5f/users/e32a6eb27b714d9c9ce2463e677484ad/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:07.652048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996857c4-3ee4-4d56-8ee2-886140305322 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:07.656787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a45c7c-3e20-4d5e-999e-015dd5b6771d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aad72622d75444d8b0e8d6b7d99fb5f, user_id=e32a6eb27b714d9c9ce2463e677484ad, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:07.659626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a45c7c-3e20-4d5e-999e-015dd5b6771d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:07.674018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:07.674751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:07.675053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:07.675368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:07.676138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:07.677851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:07.710011 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1022/2034] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:07 2022] PUT /identity/v3/projects/6aad72622d75444d8b0e8d6b7d99fb5f/users/e32a6eb27b714d9c9ce2463e677484ad/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:07.725306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c22a5-fd7c-4dde-88cc-280f97945224 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:07.725590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c22a5-fd7c-4dde-88cc-280f97945224 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:07.725871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c22a5-fd7c-4dde-88cc-280f97945224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:07.763387 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1013/2035] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:07.771516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:07.812233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dbf88-97a2-4619-bb5c-b5091845470b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:07.824406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-754c22a5-fd7c-4dde-88cc-280f97945224 None None] MFA Rules not processed for user `e32a6eb27b714d9c9ce2463e677484ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:07.825714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-754c22a5-fd7c-4dde-88cc-280f97945224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:07.996830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:08.105225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8416a-a6a4-4e14-96ac-ea86a68024de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:08.107584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8416a-a6a4-4e14-96ac-ea86a68024de admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.108278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8416a-a6a4-4e14-96ac-ea86a68024de admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.108929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8416a-a6a4-4e14-96ac-ea86a68024de admin admin] PATH_INFO: `/v3/projects/91cb4b19113a426c82c7f40900b69e35/users/81cd9d0b9d3744cc9d5da869109ba6eb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:08.114388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8416a-a6a4-4e14-96ac-ea86a68024de admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cb4b19113a426c82c7f40900b69e35, user_id=81cd9d0b9d3744cc9d5da869109ba6eb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:08.126380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8416a-a6a4-4e14-96ac-ea86a68024de admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:08.162696 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1014/2036] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:07 2022] PUT /identity/v3/projects/91cb4b19113a426c82c7f40900b69e35/users/81cd9d0b9d3744cc9d5da869109ba6eb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:08.188176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.190042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.190843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:08.195739 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1023/2037] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:08.206495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.212362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.213122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:08.280591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] MFA Rules not processed for user `aeb3928894284b77b4aea925a38470ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:08.282364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:08.297954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] MFA Rules not processed for user `81cd9d0b9d3744cc9d5da869109ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:08.299797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:08.511536 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1015/2038] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:08.513546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:08.519575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:08.527690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1024/2039] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:08.534144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:08.539842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:08.709933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf5056-999f-491d-b64b-4d49f650e3e3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:08.738878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:08.740798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.741110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.741396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:08.743734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:08.750451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:08.750993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:08.801805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415efcb1-3ebd-4c69-986a-5c937da309f7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:08.810662 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1025/2040] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:08 2022] POST /identity/v3/projects => generated 397 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:08.810662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:08.813209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:08.938558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:08.972876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81500892-9c55-4bc1-9dde-3093575ed4e3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:08.979198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:08.981395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.981922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.982459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:08.991831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:08.993843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.994671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.995420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] PATH_INFO: `/v3/projects/799dc90bf7044769839dcdd9b59b234e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:08.998212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799dc90bf7044769839dcdd9b59b234e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:09.002372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:09.108708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:09.110429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:09.114017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799dc90bf7044769839dcdd9b59b234e', 'request_id': 'req-404a6398-bdad-4be7-b690-42ac3937c900'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:09.125325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799dc90bf7044769839dcdd9b59b234e', 'request_id': 'req-404a6398-bdad-4be7-b690-42ac3937c900'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:09.146620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799dc90bf7044769839dcdd9b59b234e', 'request_id': 'req-404a6398-bdad-4be7-b690-42ac3937c900'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:09.147302 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1016/2041] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:09.149368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:09.163671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6253f1-cf1f-4016-bf50-31cef728723e service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:09.182265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] The token cache is being invalidate because project 799dc90bf7044769839dcdd9b59b234e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:09.182830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:09.186224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-404a6398-bdad-4be7-b690-42ac3937c900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:09.189342 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1026/2042] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:08 2022] DELETE /identity/v3/projects/799dc90bf7044769839dcdd9b59b234e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:09.197457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.198185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.198687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.234390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:09.235413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:09.365871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144fde5-8ccf-4e64-9d08-6e74aec1bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:09.367560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144fde5-8ccf-4e64-9d08-6e74aec1bbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.368018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144fde5-8ccf-4e64-9d08-6e74aec1bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.368486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144fde5-8ccf-4e64-9d08-6e74aec1bbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.369813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144fde5-8ccf-4e64-9d08-6e74aec1bbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:09.373247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144fde5-8ccf-4e64-9d08-6e74aec1bbf2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:09.472089 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1027/2043] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:09.475399 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1017/2044] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:09 2022] POST /identity/v3/users => generated 305 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:09.475651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:09.475749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.475749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.475749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.479553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:09.537032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:09.538391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:09.584303 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1018/2045] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:09.586701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:09.591662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:09.622821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd45c-0896-4257-abb7-5454dd53f4e3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:09.639935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:09.640838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.642083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.642734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.647239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:09.649034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:09.661384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:09.691808 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1019/2046] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:09.693033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:09.694232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6125ef-6d7b-4274-90c0-89bfcd4b8c44 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:09.713578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05815b0a-396c-4e51-a3e3-424fd753566b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:09.718965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:09.720947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.720947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.721635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.731431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:09.731957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.732233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.732512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.733288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:09.733596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:09.739987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:09.743587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:09.777711 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1020/2047] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:09.778616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:09.799041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:09.806164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b737-fa01-4341-ba88-4ed798e4bc91 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:09.818768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:09.821425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.821713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.821982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] PATH_INFO: `/v3/projects/d77ab24584e7456483cd2853f9759081/users/21fcf956ceb74a1db7802d7b3fac5322/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.864689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77ab24584e7456483cd2853f9759081, user_id=21fcf956ceb74a1db7802d7b3fac5322, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:09.872307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:09.917229 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1021/2048] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:09 2022] PUT /identity/v3/projects/d77ab24584e7456483cd2853f9759081/users/21fcf956ceb74a1db7802d7b3fac5322/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:09.922017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:10.076678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:10.080204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:10.091364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2548055-9bcf-4b84-867b-de2fa61aef55 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:10.105509 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1028/2049] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:10.107181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:10.124850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:10.127544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.129512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb0f1-d223-4941-9a68-df9f6870d92f service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:10.129887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.131396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.136079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:10.139582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e739d82-692a-42bf-a87b-e42e62665c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:10.140954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e739d82-692a-42bf-a87b-e42e62665c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.141439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e739d82-692a-42bf-a87b-e42e62665c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.142076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e739d82-692a-42bf-a87b-e42e62665c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.143532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e739d82-692a-42bf-a87b-e42e62665c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:10.149734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e739d82-692a-42bf-a87b-e42e62665c58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:10.150360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:10.178306 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1029/2050] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:10.184265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f0ec9-f8f3-40e9-8bab-eb82b4f95077 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.187735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f0ec9-f8f3-40e9-8bab-eb82b4f95077 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.188265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f0ec9-f8f3-40e9-8bab-eb82b4f95077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.236703 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1022/2051] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:09 2022] POST /identity/v3/projects => generated 389 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:10.239546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:10.277845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f35f0ec9-f8f3-40e9-8bab-eb82b4f95077 None None] MFA Rules not processed for user `cdac1d4106674c7ab0cfe39939de9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:10.280477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f35f0ec9-f8f3-40e9-8bab-eb82b4f95077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:10.429534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19792b8-8baf-4d6b-b4fe-3b0d13cfb17c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:10.448784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:10.452444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.452444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.452444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] PATH_INFO: `/v3/projects/d77ab24584e7456483cd2853f9759081/users/21fcf956ceb74a1db7802d7b3fac5322/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.458670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77ab24584e7456483cd2853f9759081, user_id=21fcf956ceb74a1db7802d7b3fac5322, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:10.462934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:10.503482 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1030/2052] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:10.507132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1023/2053] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:10 2022] PUT /identity/v3/projects/d77ab24584e7456483cd2853f9759081/users/21fcf956ceb74a1db7802d7b3fac5322/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:10.509028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f0ec9-f8f3-40e9-8bab-eb82b4f95077 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:10.583106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f0ec9-f8f3-40e9-8bab-eb82b4f95077 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:10.828511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:10.830425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.830425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.830425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.831661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:10.847481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:10.913196 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1031/2054] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:10 2022] POST /identity/v3/users => generated 295 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:10.914935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:10.932615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da709-e3db-4167-891d-f3c9c4f6ca7e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:10.943756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:10.945861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.946851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.947891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.949549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:10.961266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:11.009116 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1024/2055] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:11.014879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:11.044423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481fb4-5119-42a9-9035-36294322e17f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:11.067306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b87e0-7eac-44e8-9496-b0adb6317d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:11.069510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b87e0-7eac-44e8-9496-b0adb6317d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:11.070842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b87e0-7eac-44e8-9496-b0adb6317d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:11.083857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b87e0-7eac-44e8-9496-b0adb6317d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:11.092774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b87e0-7eac-44e8-9496-b0adb6317d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:11.103098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b87e0-7eac-44e8-9496-b0adb6317d07 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:11.146128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:11.156486 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1032/2056] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:11.163373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a27ee7-808d-4918-bdfb-e32acb64c043 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:11.180016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:11.181123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:11.181419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:11.185064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] PATH_INFO: `/v3/projects/ce14bfe058b242e193d5377c812b6074/users/fe88e53b32834e0a898e32406dc313b6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:11.241215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce14bfe058b242e193d5377c812b6074, user_id=fe88e53b32834e0a898e32406dc313b6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:11.252282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:11.283240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1025/2057] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:11 2022] PUT /identity/v3/projects/ce14bfe058b242e193d5377c812b6074/users/fe88e53b32834e0a898e32406dc313b6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:11.311713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:11.312310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:11.312893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:11.458874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] MFA Rules not processed for user `fe88e53b32834e0a898e32406dc313b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:11.461431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:11.519818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:11.815932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:11.821040 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1033/2058] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:11.824621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:12.124367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201254-2522-42a3-a902-1dc09aba1eaa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:12.158205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:12.168276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:12.169287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:12.170423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:12.172438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:12.177239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:12.232596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:12.235982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:12.304739 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1026/2059] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:11 2022] POST /identity/v3/projects => generated 391 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:12.309032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:12.318610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f81c4e-6c51-4234-92ff-51605678d05b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:12.591602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff03c3-a34b-47d1-8bcd-2ac030a3ed8e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:12.612401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:12.616519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:12.616786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:12.620444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:12.622985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:12.632289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:12.696142 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1027/2060] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:12 2022] POST /identity/v3/users => generated 302 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:12.697158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:12.701575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:12.727418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa512-4fd3-4fa2-9ee8-46ae284013ce admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:12.728852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:12.734220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:12.734935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:12.735120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:12.735899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] PATH_INFO: `/v3/users/a3cdaa06f78d4905a825ba969be0784c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:12.736223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:12.736519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:12.736925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] PATH_INFO: `/v3/users/514824382c1f44c3a4cb77582c04c14e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:12.738909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514824382c1f44c3a4cb77582c04c14e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:12.742088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:12.746688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cdaa06f78d4905a825ba969be0784c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:12.751082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:12.851100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514824382c1f44c3a4cb77582c04c14e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:12.908775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514824382c1f44c3a4cb77582c04c14e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:12.912268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514824382c1f44c3a4cb77582c04c14e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:12.952662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cdaa06f78d4905a825ba969be0784c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:12.957146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514824382c1f44c3a4cb77582c04c14e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:12.968786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514824382c1f44c3a4cb77582c04c14e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:12.972833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:13.025917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cdaa06f78d4905a825ba969be0784c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:13.058284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cdaa06f78d4905a825ba969be0784c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:13.062426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cdaa06f78d4905a825ba969be0784c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:13.068083 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1028/2061] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:12 2022] DELETE /identity/v3/users/514824382c1f44c3a4cb77582c04c14e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:13.081952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:13.093165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aec9777b-b73e-419e-81fb-34046738a5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cdaa06f78d4905a825ba969be0784c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:13.095905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:13.129589 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1034/2062] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:12 2022] DELETE /identity/v3/users/a3cdaa06f78d4905a825ba969be0784c => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:13.131856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581dac-0533-49a4-b5d5-67816f04efe4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:13.135103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581dac-0533-49a4-b5d5-67816f04efe4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:13.135700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581dac-0533-49a4-b5d5-67816f04efe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:13.175763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d1581dac-0533-49a4-b5d5-67816f04efe4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:13.178543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1581dac-0533-49a4-b5d5-67816f04efe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:13.380525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:13.546708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539a636-9150-45f7-a5a1-845722f14329 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:13.567991 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1035/2063] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:13.572743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:13.573257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:13.573732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:13.585245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:13.586497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:13.589583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:13.590115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:13.591656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:13.608380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:13.677942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:13.685824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:13.689133 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1029/2064] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 620 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:13.690696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:13.701741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:13.723305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1036/2065] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:13.728618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:13.732156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:13.768751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24138-7332-46f0-82a9-9165b39a7bba None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:13.782138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:13.789279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:13.790181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:13.793611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] PATH_INFO: `/v3/users/94a7b16a3fcb40ff8d2cc9bb76796e7e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:13.798742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a7b16a3fcb40ff8d2cc9bb76796e7e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:13.809640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:13.933847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd161a65-fb11-48e8-bbcc-5f33dc5d635f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:13.948567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a7b16a3fcb40ff8d2cc9bb76796e7e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:13.950300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:13.951812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:13.952567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:13.953281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:13.994301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a7b16a3fcb40ff8d2cc9bb76796e7e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:13.999725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:14.003335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:14.012286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a7b16a3fcb40ff8d2cc9bb76796e7e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:14.012286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a7b16a3fcb40ff8d2cc9bb76796e7e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:14.031749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a7b16a3fcb40ff8d2cc9bb76796e7e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:14.050910 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1037/2066] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:13 2022] DELETE /identity/v3/users/94a7b16a3fcb40ff8d2cc9bb76796e7e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:14.050910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:14.055416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:14.061366 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1030/2067] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:14.063463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:14.076234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:14.144015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fd804-10c0-46ba-a542-060217b91000 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:14.274407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e9e0-9aed-4805-822f-8cc060cadc9f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:14.284754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701add-5ad0-48aa-86bb-a46c7acd5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:14.287619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701add-5ad0-48aa-86bb-a46c7acd5b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.289830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701add-5ad0-48aa-86bb-a46c7acd5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.292318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701add-5ad0-48aa-86bb-a46c7acd5b99 admin admin] PATH_INFO: `/v3/projects/093082ab1b114e0abc0a1a0cadc2d81e/users/5a2e523b4bbc4df0b669c9b4b7c762fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:14.348918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701add-5ad0-48aa-86bb-a46c7acd5b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093082ab1b114e0abc0a1a0cadc2d81e, user_id=5a2e523b4bbc4df0b669c9b4b7c762fd, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:14.354037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701add-5ad0-48aa-86bb-a46c7acd5b99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:14.355113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:14.356176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.356839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.358261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:14.363979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:14.417592 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1038/2068] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:14 2022] PUT /identity/v3/projects/093082ab1b114e0abc0a1a0cadc2d81e/users/5a2e523b4bbc4df0b669c9b4b7c762fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:14.423489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68f62-ec18-43e7-a91a-384ee97d844d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.423865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68f62-ec18-43e7-a91a-384ee97d844d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.424112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68f62-ec18-43e7-a91a-384ee97d844d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:14.433732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:14.437619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:14.473122 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1031/2069] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:14.476183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:14.477675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a0a68f62-ec18-43e7-a91a-384ee97d844d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:14.482178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a0a68f62-ec18-43e7-a91a-384ee97d844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:14.518994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fdfa-f845-4cc5-87b4-5a888cac3783 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:14.543932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:14.643666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:14.713350 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1039/2070] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:14.718491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:14.720040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.720468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.720889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:14.721764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:14.725659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:14.750657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68f62-ec18-43e7-a91a-384ee97d844d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:14.761113 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1032/2071] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:14.766043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68f62-ec18-43e7-a91a-384ee97d844d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:14.778437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:14.792044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:14.814084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2d412-15c6-40f8-bca8-778faa81fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:14.820406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2d412-15c6-40f8-bca8-778faa81fc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.828262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2d412-15c6-40f8-bca8-778faa81fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.828777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2d412-15c6-40f8-bca8-778faa81fc99 admin admin] PATH_INFO: `/v3/projects/093082ab1b114e0abc0a1a0cadc2d81e/users/5a2e523b4bbc4df0b669c9b4b7c762fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:14.839513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2d412-15c6-40f8-bca8-778faa81fc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093082ab1b114e0abc0a1a0cadc2d81e, user_id=5a2e523b4bbc4df0b669c9b4b7c762fd, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:14.847937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2d412-15c6-40f8-bca8-778faa81fc99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:14.906763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1040/2072] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:14 2022] PUT /identity/v3/projects/093082ab1b114e0abc0a1a0cadc2d81e/users/5a2e523b4bbc4df0b669c9b4b7c762fd/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:14.909520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.909980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.910325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:15.013989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bb9b9-5f22-47b6-9de8-c6a30215e255 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:15.075804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] MFA Rules not processed for user `5a2e523b4bbc4df0b669c9b4b7c762fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:15.085338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:15.274124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:15.274831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:15.275184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:15.277893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:15.431226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1041/2073] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:15.483593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:15.486419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:15.511591 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1033/2074] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:15.528142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:15.530661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:15.920946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4cc14-1f1b-4842-acef-61b1aee65cda None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:15.947444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:15.948688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:15.949449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:15.949969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:16.003372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:16.008446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:16.095229 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1042/2075] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:16.351827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:16.353549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:16.374325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c694f13-4fa9-488f-8eb5-2cb226765fdd service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:16.391435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:16.392547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:16.392986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:16.393380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] PATH_INFO: `/v3/projects/7508909f8d2d488baf0bb21f4f5d93c1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:16.395594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7508909f8d2d488baf0bb21f4f5d93c1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:16.399259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:16.506433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:16.536484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7508909f8d2d488baf0bb21f4f5d93c1', 'request_id': 'req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:16.561716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7508909f8d2d488baf0bb21f4f5d93c1', 'request_id': 'req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:16.615356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7508909f8d2d488baf0bb21f4f5d93c1', 'request_id': 'req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:16.676179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] The token cache is being invalidate because project 7508909f8d2d488baf0bb21f4f5d93c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:16.677729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:16.681232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:16.699566 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1034/2076] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:16 2022] DELETE /identity/v3/projects/7508909f8d2d488baf0bb21f4f5d93c1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:16.710044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:16.740677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:16.742200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8521-9ec3-4e1b-b9c2-0b600a0da738 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:16.742376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:16.798731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:16.950774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:16.954897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:16.955207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:16.955536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] PATH_INFO: `/v3/users/81cd9d0b9d3744cc9d5da869109ba6eb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:16.958212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cd9d0b9d3744cc9d5da869109ba6eb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:16.964440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b154ff-2a86-4a7f-bdf3-2c132e0cb829 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:16.966233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:16.974476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:16.975795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:16.976213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:16.976535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] PATH_INFO: `/v3/projects/ca16294bad684859bedaad46fbf13f54` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:16.979737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca16294bad684859bedaad46fbf13f54)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:16.981858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:17.159601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca16294bad684859bedaad46fbf13f54', 'request_id': 'req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.183204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cd9d0b9d3744cc9d5da869109ba6eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.188735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca16294bad684859bedaad46fbf13f54', 'request_id': 'req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.215645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca16294bad684859bedaad46fbf13f54', 'request_id': 'req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.247545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cd9d0b9d3744cc9d5da869109ba6eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.252100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] The token cache is being invalidate because project ca16294bad684859bedaad46fbf13f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:17.252428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.255003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.261313 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1035/2077] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:16 2022] DELETE /identity/v3/projects/ca16294bad684859bedaad46fbf13f54 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:17.262635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:17.269962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:17.289696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cd9d0b9d3744cc9d5da869109ba6eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.291763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cd9d0b9d3744cc9d5da869109ba6eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.348083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cd9d0b9d3744cc9d5da869109ba6eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.366600 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1043/2078] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:16 2022] DELETE /identity/v3/users/81cd9d0b9d3744cc9d5da869109ba6eb => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:17.368919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:17.376867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:17.598111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:17.634226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba203-e10d-43bf-83e8-57d909f7798e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:17.657645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:17.659232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:17.659807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:17.660277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] PATH_INFO: `/v3/users/fe88e53b32834e0a898e32406dc313b6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:17.667642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe88e53b32834e0a898e32406dc313b6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:17.671610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:17.675263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fc480-9bb6-4c73-bc12-62a7442f8c4f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:17.693280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:17.698124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:17.699762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:17.704126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] PATH_INFO: `/v3/projects/95e6cb6b271e40129098cf47adfb06e2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:17.708479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e6cb6b271e40129098cf47adfb06e2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:17.716665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:17.820103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:17.850186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe88e53b32834e0a898e32406dc313b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.888544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe88e53b32834e0a898e32406dc313b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.914400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e6cb6b271e40129098cf47adfb06e2', 'request_id': 'req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.921964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe88e53b32834e0a898e32406dc313b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.923783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe88e53b32834e0a898e32406dc313b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.939369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe88e53b32834e0a898e32406dc313b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.949056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e6cb6b271e40129098cf47adfb06e2', 'request_id': 'req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:17.952721 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1044/2079] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:17 2022] DELETE /identity/v3/users/fe88e53b32834e0a898e32406dc313b6 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:17.954112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:17.968280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:18.008098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e6cb6b271e40129098cf47adfb06e2', 'request_id': 'req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.080315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] The token cache is being invalidate because project 95e6cb6b271e40129098cf47adfb06e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:18.080841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.089648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a28f8b5-542d-4ab1-8778-3b2df1e1502c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.100493 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1036/2080] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:17 2022] DELETE /identity/v3/projects/95e6cb6b271e40129098cf47adfb06e2 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:18.105592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:18.112808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:18.117378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:18.229647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:18.231753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:18.346971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39b38b-1f04-4bf3-8705-2d889e8319b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:18.361554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:18.363077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:18.363942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:18.364476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] PATH_INFO: `/v3/users/e32a6eb27b714d9c9ce2463e677484ad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:18.368405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32a6eb27b714d9c9ce2463e677484ad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:18.373238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:18.510002 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1037/2081] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:18.513420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32a6eb27b714d9c9ce2463e677484ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.517892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:18.521187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:18.546726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32a6eb27b714d9c9ce2463e677484ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.577309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32a6eb27b714d9c9ce2463e677484ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.577991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32a6eb27b714d9c9ce2463e677484ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.585557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fad24-b2e5-48e8-8ba4-3442b0da418d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:18.596513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6adfcba9-5b9c-4c2d-a192-49e4116b3586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32a6eb27b714d9c9ce2463e677484ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.606647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:18.607412 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1045/2082] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:17 2022] DELETE /identity/v3/users/e32a6eb27b714d9c9ce2463e677484ad => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:18.608283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:18.608680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e939d1-074e-4483-8f00-ea0978fe78a7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:18.608825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:18.608953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e939d1-074e-4483-8f00-ea0978fe78a7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:18.609380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e939d1-074e-4483-8f00-ea0978fe78a7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:18.610948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1046/2083] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:18.611819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e939d1-074e-4483-8f00-ea0978fe78a7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:18.612147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] PATH_INFO: `/v3/users/36043899ed164e7489b8d8d25b27c802` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:18.620378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36043899ed164e7489b8d8d25b27c802)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:18.621961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-26e939d1-074e-4483-8f00-ea0978fe78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:18.624801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:18.778474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:18.845460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e939d1-074e-4483-8f00-ea0978fe78a7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:18.850615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:18.851890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:18.852188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:18.852468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:18.858147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:18.891980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36043899ed164e7489b8d8d25b27c802'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.947075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36043899ed164e7489b8d8d25b27c802'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.949544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36043899ed164e7489b8d8d25b27c802'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.977802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36043899ed164e7489b8d8d25b27c802'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.981391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-beccfbf9-412f-42a6-bfc8-8623d72af591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36043899ed164e7489b8d8d25b27c802'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:18.988309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:19.025825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:19.028112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:19.037339 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1038/2084] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:18 2022] DELETE /identity/v3/users/36043899ed164e7489b8d8d25b27c802 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:19.040837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:19.052116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:19.052816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1047/2085] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:19.053190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:19.116116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:19.118647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:19.359089 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1039/2086] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:19.402948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:19.404610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:19.605923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a10b7-f9cb-4b6c-836c-6921a38d6c3f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:19.612125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fd893-e00e-447f-af4e-2d289839f664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:19.612827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd893-e00e-447f-af4e-2d289839f664 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:19.613191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd893-e00e-447f-af4e-2d289839f664 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:19.613423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd893-e00e-447f-af4e-2d289839f664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:19.634953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fd893-e00e-447f-af4e-2d289839f664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:19.637434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fd893-e00e-447f-af4e-2d289839f664 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:19.664479 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1048/2087] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:19.848607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:19.850722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:20.013345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2bbde-f336-498a-9fe2-1711b2d70edc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:20.045735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:20.056345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:20.057159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:20.057507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] PATH_INFO: `/v3/users/a876582ed4d94e9da876592597aa1c06` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:20.069171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a876582ed4d94e9da876592597aa1c06)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:20.075679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:20.282939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a876582ed4d94e9da876592597aa1c06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:20.330252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a876582ed4d94e9da876592597aa1c06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:20.331235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a876582ed4d94e9da876592597aa1c06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:20.344697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a876582ed4d94e9da876592597aa1c06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:20.345502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a876582ed4d94e9da876592597aa1c06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:20.372505 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1040/2088] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:19 2022] DELETE /identity/v3/users/a876582ed4d94e9da876592597aa1c06 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:20.377469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:20.378212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:20.378212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:20.419940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:20.421341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:20.567944 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1049/2089] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:20.653437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:20.655890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:20.696651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:20.699091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:20.701530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:20.782000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aae11-ec75-49f6-9e7a-8a75d7a1e6fa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:20.824560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:20.831771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:20.832851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:20.833636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] PATH_INFO: `/v3/projects/91cb4b19113a426c82c7f40900b69e35` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:20.860740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cb4b19113a426c82c7f40900b69e35)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:20.870303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:20.973311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:21.029805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a4121-e21e-4f75-9ebe-a98569cd45d6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:21.051195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:21.052790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:21.053685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:21.055620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:21.103918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:21.111763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:21.164148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cb4b19113a426c82c7f40900b69e35', 'request_id': 'req-db7b974b-a020-4410-9916-77be295ce103'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.167484 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1041/2090] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:36:21.169104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:21.171594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:21.186583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cb4b19113a426c82c7f40900b69e35', 'request_id': 'req-db7b974b-a020-4410-9916-77be295ce103'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.200522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cb4b19113a426c82c7f40900b69e35', 'request_id': 'req-db7b974b-a020-4410-9916-77be295ce103'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.222139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b275589-2f7a-48f4-b59b-dd96fbedf69e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:21.265776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] The token cache is being invalidate because project 91cb4b19113a426c82c7f40900b69e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:21.266237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.267716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.272428 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1050/2091] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:20 2022] DELETE /identity/v3/projects/91cb4b19113a426c82c7f40900b69e35 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:21.274019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:21.277093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:21.444416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:21.447010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:21.448447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:21.449146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] PATH_INFO: `/v3/projects/e17d7a3778d741e481f5a85e2e89f099` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:21.451155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17d7a3778d741e481f5a85e2e89f099)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:21.455436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:21.495735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b974b-a020-4410-9916-77be295ce103 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:21.520465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:21.521933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:21.522445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:21.523531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] PATH_INFO: `/v3/projects/6aad72622d75444d8b0e8d6b7d99fb5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:21.529768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aad72622d75444d8b0e8d6b7d99fb5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:21.533039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:21.540451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17d7a3778d741e481f5a85e2e89f099', 'request_id': 'req-5982cf4e-97e1-49ab-a797-9f6e5b64105c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.557157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17d7a3778d741e481f5a85e2e89f099', 'request_id': 'req-5982cf4e-97e1-49ab-a797-9f6e5b64105c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.573857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17d7a3778d741e481f5a85e2e89f099', 'request_id': 'req-5982cf4e-97e1-49ab-a797-9f6e5b64105c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.615810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] The token cache is being invalidate because project e17d7a3778d741e481f5a85e2e89f099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:21.616330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.618974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5982cf4e-97e1-49ab-a797-9f6e5b64105c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.634106 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1042/2092] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:21 2022] DELETE /identity/v3/projects/e17d7a3778d741e481f5a85e2e89f099 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:21.638876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff64f6-1443-4b02-886c-347e35f8c5c9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:21.640391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff64f6-1443-4b02-886c-347e35f8c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:21.642098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff64f6-1443-4b02-886c-347e35f8c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:21.677450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aad72622d75444d8b0e8d6b7d99fb5f', 'request_id': 'req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.696383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8dff64f6-1443-4b02-886c-347e35f8c5c9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:21.700364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aad72622d75444d8b0e8d6b7d99fb5f', 'request_id': 'req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.705168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8dff64f6-1443-4b02-886c-347e35f8c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:21.728408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aad72622d75444d8b0e8d6b7d99fb5f', 'request_id': 'req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.777722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] The token cache is being invalidate because project 6aad72622d75444d8b0e8d6b7d99fb5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:21.778769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.780390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23b74b7e-07a0-4c72-8f47-e0ac626cd4da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:21.784076 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1051/2093] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:21 2022] DELETE /identity/v3/projects/6aad72622d75444d8b0e8d6b7d99fb5f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:21.787864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef372-1eff-43ee-a3d5-67b86bc36c20 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:21.788972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef372-1eff-43ee-a3d5-67b86bc36c20 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:21.789792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef372-1eff-43ee-a3d5-67b86bc36c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:21.827435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:21.908250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-991ef372-1eff-43ee-a3d5-67b86bc36c20 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:21.910980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-991ef372-1eff-43ee-a3d5-67b86bc36c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:21.940812 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1043/2094] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:21.960339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ec810-14bf-499f-8dfe-f92ecdd72335 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:21.961482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ec810-14bf-499f-8dfe-f92ecdd72335 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:21.962074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ec810-14bf-499f-8dfe-f92ecdd72335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.018295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:22.034884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-447ec810-14bf-499f-8dfe-f92ecdd72335 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:22.038064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-447ec810-14bf-499f-8dfe-f92ecdd72335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.066686 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1044/2095] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:22.069400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.070604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.071143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.122828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:22.133895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.165383 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1045/2096] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:22.166635 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1052/2097] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:22.168470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.171215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.171585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432a9e-beae-4887-b19c-313679e27fbe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.173326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432a9e-beae-4887-b19c-313679e27fbe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.173633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432a9e-beae-4887-b19c-313679e27fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.204242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b936f96-488d-4eac-a16d-0a1afabf0112 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:22.217056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e9432a9e-beae-4887-b19c-313679e27fbe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:22.219028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9432a9e-beae-4887-b19c-313679e27fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.219719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:22.220516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.220839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.221169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] PATH_INFO: `/v3/projects/ce14bfe058b242e193d5377c812b6074` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.225984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce14bfe058b242e193d5377c812b6074)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:22.228338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:22.236101 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1053/2098] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:22.244480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da270a6-a2f7-4e28-8522-d398524f49f2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.244480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da270a6-a2f7-4e28-8522-d398524f49f2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.244480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da270a6-a2f7-4e28-8522-d398524f49f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.295420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4da270a6-a2f7-4e28-8522-d398524f49f2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:22.295420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4da270a6-a2f7-4e28-8522-d398524f49f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.321614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1054/2099] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:22.323803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da270a6-a2f7-4e28-8522-d398524f49f2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.341831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce14bfe058b242e193d5377c812b6074', 'request_id': 'req-ff94051b-af37-41bd-84e5-2ee2b7636dd0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.352499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da270a6-a2f7-4e28-8522-d398524f49f2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:22.356475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce14bfe058b242e193d5377c812b6074', 'request_id': 'req-ff94051b-af37-41bd-84e5-2ee2b7636dd0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.372583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce14bfe058b242e193d5377c812b6074', 'request_id': 'req-ff94051b-af37-41bd-84e5-2ee2b7636dd0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.396810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] The token cache is being invalidate because project ce14bfe058b242e193d5377c812b6074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:22.397712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.401052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.405879 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1046/2100] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:22 2022] DELETE /identity/v3/projects/ce14bfe058b242e193d5377c812b6074 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:22.407997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.411190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.499352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:22.500445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.500925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.501433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.504459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:22.507466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:22.514164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:22.550413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1055/2101] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:22.551911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.555578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.585038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27abff-5f74-43dd-8309-ea7093627bb6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:22.597272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:22.603211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.603924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.604422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.605841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:22.606207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94051b-af37-41bd-84e5-2ee2b7636dd0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:22.606373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:22.610418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:22.613730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:22.614079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.614473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.614888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.616122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:22.617281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:22.620094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:22.639913 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1056/2102] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:22.641481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.645818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.653969 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1047/2103] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:22.655959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.658931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.692867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e6149-79e9-4d43-99d9-2fbbd3fbad0b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:22.701300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:22.702102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29db0-7292-4b10-9116-6a9467d4c36f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:22.705320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.705800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.706273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] PATH_INFO: `/v3/users/5a2e523b4bbc4df0b669c9b4b7c762fd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.710986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2e523b4bbc4df0b669c9b4b7c762fd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:22.712130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:22.713953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.714235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.714617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:22.714802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] PATH_INFO: `/v3/projects/4e1e3e2e4d114865804976a40c6cac55` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.717214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1e3e2e4d114865804976a40c6cac55)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:22.721583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:22.849127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2e523b4bbc4df0b669c9b4b7c762fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.875313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:22.912423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2e523b4bbc4df0b669c9b4b7c762fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.918382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1e3e2e4d114865804976a40c6cac55', 'request_id': 'req-aeb8a9f6-da22-4567-8313-9b79895a9bba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.940000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2e523b4bbc4df0b669c9b4b7c762fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.941708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2e523b4bbc4df0b669c9b4b7c762fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.956935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1e3e2e4d114865804976a40c6cac55', 'request_id': 'req-aeb8a9f6-da22-4567-8313-9b79895a9bba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.969021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2e523b4bbc4df0b669c9b4b7c762fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.983301 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1057/2104] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:22 2022] DELETE /identity/v3/users/5a2e523b4bbc4df0b669c9b4b7c762fd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:22.985386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1e3e2e4d114865804976a40c6cac55', 'request_id': 'req-aeb8a9f6-da22-4567-8313-9b79895a9bba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:22.986490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.990315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:23.021591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:23.029023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] The token cache is being invalidate because project 4e1e3e2e4d114865804976a40c6cac55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:23.029498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:23.031343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:23.040002 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1048/2105] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:22 2022] DELETE /identity/v3/projects/4e1e3e2e4d114865804976a40c6cac55 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:23.041486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:23.046006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:23.312720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede058-449b-432d-b9a3-6bc9ea52511e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:23.321841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:23.323323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.324243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.325141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.326799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:23.330830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:23.370911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8a9f6-da22-4567-8313-9b79895a9bba admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:23.381673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:23.383714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.384603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.385804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.386458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:23.391489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:23.410178 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1058/2106] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:22 2022] POST /identity/v3/projects => generated 369 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:23.412286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:23.419400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:23.504082 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1049/2107] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:23 2022] POST /identity/v3/projects => generated 385 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:23.505217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:23.512566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:23.679758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949506a-8171-4dc3-aecf-7bedda0130e6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:23.760369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fb28-3354-41a5-a26e-d39778cff602 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:23.775976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:23.779885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.780397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.780912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] PATH_INFO: `/v3/users/b7e3c609731c4325ab021b29b7a5fce7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.787568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e3c609731c4325ab021b29b7a5fce7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:23.795910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:23.816301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:23.818422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.819179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.820734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.822385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:23.828925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:23.902318 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1059/2108] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:23 2022] POST /identity/v3/projects => generated 395 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:23.905585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:23.915092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e3c609731c4325ab021b29b7a5fce7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:23.917900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:23.950432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:23.963801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:23.982210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e3c609731c4325ab021b29b7a5fce7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:23.992592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e3c609731c4325ab021b29b7a5fce7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:24.015310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e3c609731c4325ab021b29b7a5fce7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:24.019246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e3c609731c4325ab021b29b7a5fce7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:24.028036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc668a-df3a-4c15-8944-1ec56887c355 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.036060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.037078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.037389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.051695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.056690 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1050/2109] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:23 2022] DELETE /identity/v3/users/b7e3c609731c4325ab021b29b7a5fce7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:24.057592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.058782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.060892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.063935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:24.127490 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1060/2110] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:23 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:24.127490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.131251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:24.167963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ff51f-ae62-4c33-adbb-c2bb271e94f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.290033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814687-9872-49cd-835b-b112766d6d8b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.301048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.301872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.302267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.302685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.303548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.306333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.340767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1051/2111] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:24 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:24.342007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.344370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:24.348335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.350008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.350521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.351689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.353066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.358085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.361313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14ba5-fc49-4d94-a2e7-680279a990c3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.368904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.370813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.371370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.371838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.372806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.375214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.391630 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1052/2112] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:24.392899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.406752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c629-ec4d-44ca-9b9a-db4c80818ead admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.416523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.417835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.418440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.419002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.420022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.422529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.436331 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1061/2113] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:24 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:24.438462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.439731 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1053/2114] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:24.452849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.466326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8855d8-231c-4591-96a9-107e7daaaccb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.477469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.478820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.479465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.479991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.481525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.485490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.485885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8038-09ee-4028-84b9-2462481ec5dc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.499787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.501125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.501651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.502121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.503313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.505457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.514782 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1062/2115] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:24.516707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.525167 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1054/2116] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:36:24.526375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.545402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53d7d3-f164-483a-a7ea-9031b7bf2e55 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.546439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d1d8-848e-45c8-871f-cd3df38e515f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.557324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.558798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.559324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.559793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] PATH_INFO: `/v3/projects/c46a694ba42e4d1ba55d161224195378/users/038556a90129478eb04699f574ea7e1b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.570922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.572861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.573384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.577826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.580617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.583077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46a694ba42e4d1ba55d161224195378, user_id=038556a90129478eb04699f574ea7e1b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.583962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.587466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.609834 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1055/2117] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:24 2022] PUT /identity/v3/projects/c46a694ba42e4d1ba55d161224195378/users/038556a90129478eb04699f574ea7e1b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:24.610961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.616742 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1063/2118] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:24.626524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.659544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985f0d-e76f-4fbc-974b-e575eb870ebf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.716568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f03b-e1d2-4ff6-b439-9ab2feb1046a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.723769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34818df-25be-4715-864f-531fcbd33504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.724921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34818df-25be-4715-864f-531fcbd33504 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.725510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34818df-25be-4715-864f-531fcbd33504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.728731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34818df-25be-4715-864f-531fcbd33504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.730017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34818df-25be-4715-864f-531fcbd33504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.733137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34818df-25be-4715-864f-531fcbd33504 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.751065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:24.760562 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1056/2119] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:24.762707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a915-9575-4407-928c-16c2f4f8d219 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.763220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a915-9575-4407-928c-16c2f4f8d219 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.763678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a915-9575-4407-928c-16c2f4f8d219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.825357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-87f7a915-9575-4407-928c-16c2f4f8d219 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:24.831465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-87f7a915-9575-4407-928c-16c2f4f8d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:24.867763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.868899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1057/2120] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:24.871639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.872124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.872617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] PATH_INFO: `/v3/projects/5a041638b2ef4261b6f3f2fbf3ba06c7/users/80a79275009a41e38a6d41e10bc6c066/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.873167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a915-9575-4407-928c-16c2f4f8d219 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.912605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a915-9575-4407-928c-16c2f4f8d219 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:24.931426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e50aa-8fb1-4174-a8ce-4a3e7bada7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:24.936034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a041638b2ef4261b6f3f2fbf3ba06c7, user_id=80a79275009a41e38a6d41e10bc6c066, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:24.939328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e50aa-8fb1-4174-a8ce-4a3e7bada7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:24.939891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e50aa-8fb1-4174-a8ce-4a3e7bada7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:24.940409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e50aa-8fb1-4174-a8ce-4a3e7bada7ab admin admin] PATH_INFO: `/v3/projects/77b50ee668ec44bc85aecfcb400b5886/users/80ded9d9bced47de824b783c45e658d8/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:24.946566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:24.982470 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1064/2121] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:24 2022] PUT /identity/v3/projects/5a041638b2ef4261b6f3f2fbf3ba06c7/users/80a79275009a41e38a6d41e10bc6c066/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:24.986231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:24.994037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:25.014805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e50aa-8fb1-4174-a8ce-4a3e7bada7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b50ee668ec44bc85aecfcb400b5886, user_id=80ded9d9bced47de824b783c45e658d8, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:25.021046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e50aa-8fb1-4174-a8ce-4a3e7bada7ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:25.031516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:25.079151 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1058/2122] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:24 2022] PUT /identity/v3/projects/77b50ee668ec44bc85aecfcb400b5886/users/80ded9d9bced47de824b783c45e658d8/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:25.087125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b9f8d-a00e-4fae-9004-da969116b564 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:25.087873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b9f8d-a00e-4fae-9004-da969116b564 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:25.088563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b9f8d-a00e-4fae-9004-da969116b564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:25.129710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b43b9f8d-a00e-4fae-9004-da969116b564 None None] MFA Rules not processed for user `80a79275009a41e38a6d41e10bc6c066`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:25.131627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b43b9f8d-a00e-4fae-9004-da969116b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:25.186441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be707ab-ba07-4c1c-a895-c66df077a5e8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:25.255836 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1059/2123] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:25.260226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c866-60d9-4681-ac68-5e813aa21dba None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:25.260738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c866-60d9-4681-ac68-5e813aa21dba None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:25.267587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c866-60d9-4681-ac68-5e813aa21dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:25.320255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:25.321289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:25.321778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:25.327916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:25.329299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b229c866-60d9-4681-ac68-5e813aa21dba None None] MFA Rules not processed for user `80ded9d9bced47de824b783c45e658d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:25.331147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b229c866-60d9-4681-ac68-5e813aa21dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:25.440945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:25.442822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:25.458834 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1065/2124] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:25.461103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:25.474124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2907d4-ad26-4b5a-b4cb-330f4e38abc6 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:25.481778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:25.482617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:25.482978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:25.483375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:25.484400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:25.490169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:25.495759 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1060/2125] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:25.497842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229c866-60d9-4681-ac68-5e813aa21dba None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:25.527037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229c866-60d9-4681-ac68-5e813aa21dba None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:25.533520 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1066/2126] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:25 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:25.534733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:25.630655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:25.645877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e239026-5800-4e79-8419-5e1b27e97222 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:25.655773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:25.656496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:25.656807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:25.657074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:25.658148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:25.660807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:25.661920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:25.697657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:25.699700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:25.700625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:25.701284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:25.703508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:25.710321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:25.714936 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1067/2127] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:25 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:25.717314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:25.742717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d72e37-0c0d-40b8-8ade-95d101f85e96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:25.753252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:25.755589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:25.756432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:25.756998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:25.758570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:25.762450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:25.787323 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1068/2128] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:25.795118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:25.807828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1061/2129] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:25 2022] POST /identity/v3/projects => generated 393 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:25.809160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:25.817489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:25.841095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec1e59-4c78-41fc-85b5-bfa16fcb9e20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:26.030882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312e303-1304-43d8-afda-9b25df4e74a3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:26.058406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:26.061240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:26.062609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:26.063103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] PATH_INFO: `/v3/projects/093082ab1b114e0abc0a1a0cadc2d81e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:26.082453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093082ab1b114e0abc0a1a0cadc2d81e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:26.094024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:26.136961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:26.141571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:26.142846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:26.144772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] PATH_INFO: `/v3/projects/29a1e40575c74678bc876d06ad0983aa/users/9c10ed09a01740fb9c8c539aec0932e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:26.192750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a1e40575c74678bc876d06ad0983aa, user_id=9c10ed09a01740fb9c8c539aec0932e4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:26.199020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:26.213667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093082ab1b114e0abc0a1a0cadc2d81e', 'request_id': 'req-47f65dd1-1eae-4075-884d-70fd4803ed03'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:26.226237 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1069/2130] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:25 2022] PUT /identity/v3/projects/29a1e40575c74678bc876d06ad0983aa/users/9c10ed09a01740fb9c8c539aec0932e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:26.226237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:26.236070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093082ab1b114e0abc0a1a0cadc2d81e', 'request_id': 'req-47f65dd1-1eae-4075-884d-70fd4803ed03'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:26.258680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093082ab1b114e0abc0a1a0cadc2d81e', 'request_id': 'req-47f65dd1-1eae-4075-884d-70fd4803ed03'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:26.277991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] The token cache is being invalidate because project 093082ab1b114e0abc0a1a0cadc2d81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:26.278875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:26.280038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:26.288137 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1062/2131] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:25 2022] DELETE /identity/v3/projects/093082ab1b114e0abc0a1a0cadc2d81e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:26.288137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:26.288137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:26.431155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65dd1-1eae-4075-884d-70fd4803ed03 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:26.454677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:26.496182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c71dd-3b0c-42b3-806a-f6f2d306d596 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:26.512474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7004479-5458-43eb-aa5e-a3c8b2551146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:26.514390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7004479-5458-43eb-aa5e-a3c8b2551146 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:26.514677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7004479-5458-43eb-aa5e-a3c8b2551146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:26.516120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7004479-5458-43eb-aa5e-a3c8b2551146 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:26.518089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7004479-5458-43eb-aa5e-a3c8b2551146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:26.523531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7004479-5458-43eb-aa5e-a3c8b2551146 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:26.608910 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1070/2132] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:26 2022] POST /identity/v3/users => generated 303 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:26.613891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:26.614394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:26.619424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:26.653766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:26.654934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:26.658700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:26.658700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:26.667220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:26.670416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:26.712520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1063/2133] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:26.714399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:26.715111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:26.716649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:26.719582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:26.754448 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1071/2134] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:26.756134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:26.760308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:26.762638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472a3e0-3b1f-4fab-a70a-ec0d77e08abf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:26.776658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:26.782830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:26.783904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:26.784506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] PATH_INFO: `/v3/projects/5f0d3e417558482f8ad745ca722d94ff` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:26.786568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0d3e417558482f8ad745ca722d94ff)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:26.793854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:26.806623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d6da-092d-4e61-b501-a788b322d9ae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:26.827507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:26.828581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:26.828981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:26.829364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:26.834296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:26.843842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:26.893522 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1072/2135] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:26.895930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:26.951313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc66d32-f61a-414e-89f2-1e6c6902d247 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:26.953233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0d3e417558482f8ad745ca722d94ff', 'request_id': 'req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:26.989022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0d3e417558482f8ad745ca722d94ff', 'request_id': 'req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:27.025616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0d3e417558482f8ad745ca722d94ff', 'request_id': 'req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:27.037136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:27.057792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] The token cache is being invalidate because project 5f0d3e417558482f8ad745ca722d94ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:27.058447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:27.059842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b8a96f3-7679-4bfc-8dcd-c3881e0739c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:27.063844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1064/2136] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:26 2022] DELETE /identity/v3/projects/5f0d3e417558482f8ad745ca722d94ff => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:27.067010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba7f5-1d6a-4524-b175-d7817bf7a682 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:27.067537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba7f5-1d6a-4524-b175-d7817bf7a682 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:27.068030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba7f5-1d6a-4524-b175-d7817bf7a682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:27.113499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-49aba7f5-1d6a-4524-b175-d7817bf7a682 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:27.117688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-49aba7f5-1d6a-4524-b175-d7817bf7a682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:27.131525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:27.132720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:27.133172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:27.133597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] PATH_INFO: `/v3/projects/29a1e40575c74678bc876d06ad0983aa/users/9c10ed09a01740fb9c8c539aec0932e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:27.138313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a1e40575c74678bc876d06ad0983aa, user_id=9c10ed09a01740fb9c8c539aec0932e4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:27.142499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:27.171718 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1073/2137] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:26 2022] PUT /identity/v3/projects/29a1e40575c74678bc876d06ad0983aa/users/9c10ed09a01740fb9c8c539aec0932e4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:27.172846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:27.188764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:27.429442 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1065/2138] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:27.432630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7640de-621b-4887-8ed7-b4d2b9a1d0f7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:27.433304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7640de-621b-4887-8ed7-b4d2b9a1d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:27.433987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7640de-621b-4887-8ed7-b4d2b9a1d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:27.478542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4b7640de-621b-4887-8ed7-b4d2b9a1d0f7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:27.481147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b7640de-621b-4887-8ed7-b4d2b9a1d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:27.483450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b863d-5b31-4e79-bd66-a47d3ead8602 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:27.491448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4958-8682-499d-8791-2123e208067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:27.493793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4958-8682-499d-8791-2123e208067e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:27.494454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4958-8682-499d-8791-2123e208067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:27.495200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4958-8682-499d-8791-2123e208067e admin admin] PATH_INFO: `/v3/projects/1690e461b4d3484aba8b101d67a0fa0b/users/6583ee5ac8c443e7a217970a931890ae/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:27.526393 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1066/2139] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:27.529506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653ebf-4aaf-46f1-ade4-7d5694fe9453 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:27.534350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653ebf-4aaf-46f1-ade4-7d5694fe9453 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:27.534984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653ebf-4aaf-46f1-ade4-7d5694fe9453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:27.545612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4958-8682-499d-8791-2123e208067e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1690e461b4d3484aba8b101d67a0fa0b, user_id=6583ee5ac8c443e7a217970a931890ae, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:27.555263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4958-8682-499d-8791-2123e208067e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:27.621185 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1074/2140] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:27 2022] PUT /identity/v3/projects/1690e461b4d3484aba8b101d67a0fa0b/users/6583ee5ac8c443e7a217970a931890ae/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:27.624670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4958-8682-499d-8791-2123e208067e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:27.702193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-11653ebf-4aaf-46f1-ade4-7d5694fe9453 None None] MFA Rules not processed for user `9c10ed09a01740fb9c8c539aec0932e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:27.708359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11653ebf-4aaf-46f1-ade4-7d5694fe9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:27.768102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:27.974805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4958-8682-499d-8791-2123e208067e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:27.994949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:27.998563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:27.999027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:27.999598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.001149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:28.001844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:28.005460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:28.034145 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1067/2141] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:28.039247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523c77-6f14-4cd1-805e-21829701a124 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.039793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523c77-6f14-4cd1-805e-21829701a124 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.040243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523c77-6f14-4cd1-805e-21829701a124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.056982 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1075/2142] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:28.058599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:28.105484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958638e9-6acd-4e79-a181-ecd587f9477d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:28.126642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eddba-c41d-43a8-b4c6-0a165c45fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:28.130457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eddba-c41d-43a8-b4c6-0a165c45fe14 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.131601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b9523c77-6f14-4cd1-805e-21829701a124 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:28.133260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eddba-c41d-43a8-b4c6-0a165c45fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.134043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eddba-c41d-43a8-b4c6-0a165c45fe14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.135914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9523c77-6f14-4cd1-805e-21829701a124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:28.139292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eddba-c41d-43a8-b4c6-0a165c45fe14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:28.142369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eddba-c41d-43a8-b4c6-0a165c45fe14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:28.201294 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1076/2143] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:28.208531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8e771-5370-4232-a1ca-7d52fbfefd99 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.210237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8e771-5370-4232-a1ca-7d52fbfefd99 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.211788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8e771-5370-4232-a1ca-7d52fbfefd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.235776 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1068/2144] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:28.236905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523c77-6f14-4cd1-805e-21829701a124 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:28.266267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523c77-6f14-4cd1-805e-21829701a124 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:28.281079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:28.282073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.282373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.283321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.284144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70f8e771-5370-4232-a1ca-7d52fbfefd99 None None] MFA Rules not processed for user `80a79275009a41e38a6d41e10bc6c066`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:28.284393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:28.286969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:28.287388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70f8e771-5370-4232-a1ca-7d52fbfefd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:28.336200 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1069/2145] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:28 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:28.336200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:28.369402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:28.435198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7053-602c-4606-83d8-b879bb74eacc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:28.448691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:28.449686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.449975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.450305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] PATH_INFO: `/v3/projects/1690e461b4d3484aba8b101d67a0fa0b/users/6583ee5ac8c443e7a217970a931890ae/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.453818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1690e461b4d3484aba8b101d67a0fa0b, user_id=6583ee5ac8c443e7a217970a931890ae, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:28.457912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:28.474856 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1070/2146] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:28 2022] PUT /identity/v3/projects/1690e461b4d3484aba8b101d67a0fa0b/users/6583ee5ac8c443e7a217970a931890ae/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:28.477013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:28.531019 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1077/2147] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:28.533233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8e771-5370-4232-a1ca-7d52fbfefd99 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:28.565319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8e771-5370-4232-a1ca-7d52fbfefd99 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:28.641489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9edb7-d0ce-4715-8ff1-589c98c7773b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:28.651927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611229e-aad0-4f61-aa82-7ea329747c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:28.654051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611229e-aad0-4f61-aa82-7ea329747c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.654655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611229e-aad0-4f61-aa82-7ea329747c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.655146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611229e-aad0-4f61-aa82-7ea329747c62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.657120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611229e-aad0-4f61-aa82-7ea329747c62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:28.657750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611229e-aad0-4f61-aa82-7ea329747c62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:28.660989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611229e-aad0-4f61-aa82-7ea329747c62 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:28.690767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1071/2148] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:28.692985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe4937-94a7-4849-849b-87c1ce024aee None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.693748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe4937-94a7-4849-849b-87c1ce024aee None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.694255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe4937-94a7-4849-849b-87c1ce024aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.755446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:28.757042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.758690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:28.761801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.762857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.762857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:28.771143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8afe4937-94a7-4849-849b-87c1ce024aee None None] MFA Rules not processed for user `6583ee5ac8c443e7a217970a931890ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:28.773546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:28.776526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8afe4937-94a7-4849-849b-87c1ce024aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:28.817582 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1078/2149] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:28 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:28.817582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:28.823475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:28.952911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62126c39-fb63-4787-ba87-3f1408bbf3f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:28.975498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:28.979556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.985991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.987492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.992307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:29.015252 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1072/2150] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:29.017238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe4937-94a7-4849-849b-87c1ce024aee None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.035024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe4937-94a7-4849-849b-87c1ce024aee None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:29.044932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:29.045695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.046046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.046341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.052082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.058616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.129693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:29.135227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.143243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.159031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1079/2151] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:29.161071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.167840 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1073/2152] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:29 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:29.170816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.177153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:29.191282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b1e68-4d5e-484f-9765-2fa0a27c425a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:29.423425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:29.426725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.429462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.432221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.436544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.446907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.473249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330132a-6850-4847-ae7c-02289c1fe5bf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:29.499529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:29.500264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.501102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1080/2153] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:29.502428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.502789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.502986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.544836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55561a9-ad0c-4a49-90ab-1e73de171245 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:29.556461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:29.557641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.558141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.558948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.560407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.565226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.642334 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1081/2154] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:29 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:29.642715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.673312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb3c61-3c60-4ae4-9a79-f49dc0301198 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:29.686656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:29.688764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.689335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.690022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.695257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.704838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.705570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.707840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.737481 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1074/2155] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:29.742199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.751047 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1082/2156] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:29.753064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.760798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:29.775500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0b586-495e-4a01-b940-38709cdf41d1 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:29.790950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ec493-ffbd-47c8-846e-db8fc8c25226 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:29.805099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745a06-7fcd-4026-96e6-87cea05ccc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:29.807905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745a06-7fcd-4026-96e6-87cea05ccc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.808386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745a06-7fcd-4026-96e6-87cea05ccc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.809210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745a06-7fcd-4026-96e6-87cea05ccc6e admin admin] PATH_INFO: `/v3/projects/c2b5bf90e58d4785a6caeea427f690b3/users/f9a82921fa07436899f0344a397b7ad3/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.815256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:29.824960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.827056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.831488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.833948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.845785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.858184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745a06-7fcd-4026-96e6-87cea05ccc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b5bf90e58d4785a6caeea427f690b3, user_id=f9a82921fa07436899f0344a397b7ad3, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:29.867684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745a06-7fcd-4026-96e6-87cea05ccc6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:29.903876 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1075/2157] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:29.906313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:29.931182 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1083/2158] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:29 2022] PUT /identity/v3/projects/c2b5bf90e58d4785a6caeea427f690b3/users/f9a82921fa07436899f0344a397b7ad3/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:29.942239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d92c1-e9ab-4fc6-8155-40cc30585f58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:29.943223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d92c1-e9ab-4fc6-8155-40cc30585f58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:29.944521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d92c1-e9ab-4fc6-8155-40cc30585f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:29.992494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79071e-2e2b-482f-800c-5e822f13a411 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:30.034575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-740d92c1-e9ab-4fc6-8155-40cc30585f58 None None] MFA Rules not processed for user `f9a82921fa07436899f0344a397b7ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:30.038912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-740d92c1-e9ab-4fc6-8155-40cc30585f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:30.139479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:30.140454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:30.140969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:30.141361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:30.142248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:30.144115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:30.178558 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1076/2159] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:30.181044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:30.202264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b177f-55de-4103-a6f7-447eff93e8f2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:30.215633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566dee3-3b84-444c-9f86-f06b92e2aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:30.216918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566dee3-3b84-444c-9f86-f06b92e2aa9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:30.217248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566dee3-3b84-444c-9f86-f06b92e2aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:30.217683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566dee3-3b84-444c-9f86-f06b92e2aa9d admin admin] PATH_INFO: `/v3/projects/561457f24d2a4debadbaffd81f89226d/users/5d20fa2dcb7b4e32ad52a634f1626910/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:30.266112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566dee3-3b84-444c-9f86-f06b92e2aa9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=561457f24d2a4debadbaffd81f89226d, user_id=5d20fa2dcb7b4e32ad52a634f1626910, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:30.271344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566dee3-3b84-444c-9f86-f06b92e2aa9d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:30.284718 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1084/2160] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:30.288637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d92c1-e9ab-4fc6-8155-40cc30585f58 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:30.308293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1077/2161] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:30 2022] PUT /identity/v3/projects/561457f24d2a4debadbaffd81f89226d/users/5d20fa2dcb7b4e32ad52a634f1626910/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:30.319881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d92c1-e9ab-4fc6-8155-40cc30585f58 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:30.332659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310d9d-065a-426a-a7fd-4ebe0c602fd8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:30.333106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310d9d-065a-426a-a7fd-4ebe0c602fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:30.333536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310d9d-065a-426a-a7fd-4ebe0c602fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:30.396476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c8310d9d-065a-426a-a7fd-4ebe0c602fd8 None None] MFA Rules not processed for user `5d20fa2dcb7b4e32ad52a634f1626910`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:30.400780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8310d9d-065a-426a-a7fd-4ebe0c602fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:30.401036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:30.511711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:30.514677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:30.514952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:30.515441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:30.517276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:30.521642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:30.571563 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1078/2162] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:30.636751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310d9d-065a-426a-a7fd-4ebe0c602fd8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:30.638931 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1085/2163] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:30 2022] POST /identity/v3/projects => generated 373 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:30.662143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310d9d-065a-426a-a7fd-4ebe0c602fd8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:30.768468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:30.771668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:30.841302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:30.862450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:30.864849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:30.866209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:30.866683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:30.868669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:30.875550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:30.921554 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1079/2164] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:30 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:30.927056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:30.963954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322602e2-4b4f-419d-9325-73f4269c08b1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:30.975044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:30.976066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:30.976472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:30.976876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:30.978404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:30.981068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:31.016877 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1080/2165] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:31.024520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:31.068004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da2cc-8545-4414-b051-a2380933e246 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:31.107526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:31.112577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.113474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.115193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] PATH_INFO: `/v3/projects/3e98db1ac3ee404c9d63572599c19654/users/4dd686c468f7432bbb71af8b92d7af9f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.118598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8849-86fc-4747-b3cb-36903b24bcd3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:31.140374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:31.141194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.145579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.146006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.209026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e98db1ac3ee404c9d63572599c19654, user_id=4dd686c468f7432bbb71af8b92d7af9f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:31.230408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:31.288498 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1081/2166] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:31 2022] PUT /identity/v3/projects/3e98db1ac3ee404c9d63572599c19654/users/4dd686c468f7432bbb71af8b92d7af9f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:31.295659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:31.469875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:31.477723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:31.529105 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1086/2167] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:36:31.541660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:31.591592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e75d2-c1a6-4c0c-8ab3-8ad613d25331 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:31.621604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:31.624052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.627667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.645563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.650029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bee80-1134-4677-9114-20760cbb2874 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:31.651696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:31.654230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:31.690743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:31.695738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.697311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.697755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] PATH_INFO: `/v3/users/80ded9d9bced47de824b783c45e658d8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.701316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ded9d9bced47de824b783c45e658d8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:31.716269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:31.716442 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1087/2168] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:31.718310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:31.753991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8177c7c-2cb5-497d-b947-28b3678bdda5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:31.779711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a18c7-eb93-4c5d-a04f-56caccb8f4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:31.780845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a18c7-eb93-4c5d-a04f-56caccb8f4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.781252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a18c7-eb93-4c5d-a04f-56caccb8f4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.781656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a18c7-eb93-4c5d-a04f-56caccb8f4df admin admin] PATH_INFO: `/v3/projects/3e98db1ac3ee404c9d63572599c19654/users/4dd686c468f7432bbb71af8b92d7af9f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.790032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a18c7-eb93-4c5d-a04f-56caccb8f4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e98db1ac3ee404c9d63572599c19654, user_id=4dd686c468f7432bbb71af8b92d7af9f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:31.797446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a18c7-eb93-4c5d-a04f-56caccb8f4df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:31.857367 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1088/2169] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:31 2022] PUT /identity/v3/projects/3e98db1ac3ee404c9d63572599c19654/users/4dd686c468f7432bbb71af8b92d7af9f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:31.877357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab0a4-fc7b-4bc2-9871-42e6176731a0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.877357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab0a4-fc7b-4bc2-9871-42e6176731a0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.877357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab0a4-fc7b-4bc2-9871-42e6176731a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.885203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ded9d9bced47de824b783c45e658d8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:31.940141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ded9d9bced47de824b783c45e658d8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:31.947180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ded9d9bced47de824b783c45e658d8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:31.977213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ded9d9bced47de824b783c45e658d8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:31.981190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f2f8610a-2efb-4e2a-924b-f796a47616bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ded9d9bced47de824b783c45e658d8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:31.983917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-227ab0a4-fc7b-4bc2-9871-42e6176731a0 None None] MFA Rules not processed for user `4dd686c468f7432bbb71af8b92d7af9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:31.993482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-227ab0a4-fc7b-4bc2-9871-42e6176731a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:32.036801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1082/2170] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:31 2022] DELETE /identity/v3/users/80ded9d9bced47de824b783c45e658d8 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:32.042935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:32.043233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:32.043566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:32.152945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:32.154256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:32.175680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:32.222650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:32.348962 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1089/2171] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:36:32.371476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ab0a4-fc7b-4bc2-9871-42e6176731a0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:32.449444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ab0a4-fc7b-4bc2-9871-42e6176731a0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:32.454103 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1083/2172] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:32.514438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:32.517408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:32.806690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ea4e3-936e-41ae-bc02-adca9ad7a0f4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:32.818837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:32.821070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:32.821653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:32.822301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:32.870768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:32.875692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:32.876015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:32.878096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:32.880927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:32.884258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:32.889422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:32.893925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:32.898382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:32.948422 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1084/2173] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:32.952816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1090/2174] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 582 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:32.961110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:32.990797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:32.997306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:33.006755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15667cb-447c-4f5d-9d64-dad3deaecd25 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:33.036667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287ffff-7910-42d3-a7b7-3db0293eab6b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:33.041674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:33.045788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:33.046338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:33.047452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:33.047982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:33.049150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:33.049794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:33.050243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:33.050748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] PATH_INFO: `/v3/users/5d20fa2dcb7b4e32ad52a634f1626910` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:33.054796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d20fa2dcb7b4e32ad52a634f1626910)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:33.057783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:33.064747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:33.159033 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1085/2175] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:32 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:33.161059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:33.270548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d20fa2dcb7b4e32ad52a634f1626910'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:33.290884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d20fa2dcb7b4e32ad52a634f1626910'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:33.316427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d20fa2dcb7b4e32ad52a634f1626910'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:33.317874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d20fa2dcb7b4e32ad52a634f1626910'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:33.331987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a929f067-7fae-4779-8f5c-32f3255d9709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d20fa2dcb7b4e32ad52a634f1626910'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:33.368614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1091/2176] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:32 2022] DELETE /identity/v3/users/5d20fa2dcb7b4e32ad52a634f1626910 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:33.375934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:33.376220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:33.380121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:33.421818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a33f19-6e5a-4af3-bfc8-0881ecb8f521 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:33.480819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:33.484712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:33.629997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:33.697318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:33.725012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:33.729108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:33.729327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:33.730365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:33.731296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:33.731619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:33.738076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:33.743637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1092/2177] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:33.762159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1086/2178] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:33.774302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:33.776957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:33.790616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:33.793460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:33.979571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3941f6-fcf1-4135-898f-f1835347f5ae tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:33.987831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02be67-ed53-47a2-a325-5f3a5917dcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:33.988326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02be67-ed53-47a2-a325-5f3a5917dcfd service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:33.994010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02be67-ed53-47a2-a325-5f3a5917dcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:33.994386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02be67-ed53-47a2-a325-5f3a5917dcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:34.016359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02be67-ed53-47a2-a325-5f3a5917dcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:34.018757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02be67-ed53-47a2-a325-5f3a5917dcfd service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:34.041650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1087/2179] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:34.082501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dae75-fd69-4379-ae64-ae8bc9d04f8f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:34.102206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:34.104486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:34.105388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:34.107212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:34.123036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:34.177263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:34.183086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:34.218633 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1093/2180] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:34.269905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d5bf-c193-4999-92c3-fd31dd2ba049 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:34.269905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d5bf-c193-4999-92c3-fd31dd2ba049 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:34.269905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d5bf-c193-4999-92c3-fd31dd2ba049 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:34.271245 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1088/2181] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:34.279959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:34.351494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:34.391053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3ab4c-4180-42d8-9b3a-6b9344456c1d service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:34.421400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:34.425519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:34.426366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:34.427619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/02d5fe168a564052879bff6e9bd5f464` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:34.431977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=02d5fe168a564052879bff6e9bd5f464)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:34.442605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:34.450445 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1094/2182] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:34 2022] GET /identity/v3/projects/02d5fe168a564052879bff6e9bd5f464 => generated 371 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:34.547118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177cd4f-d8eb-4722-94d5-06e0e720a5db None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:34.549039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177cd4f-d8eb-4722-94d5-06e0e720a5db None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:34.549796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177cd4f-d8eb-4722-94d5-06e0e720a5db None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:34.570516 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1089/2183] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:34 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:34.576072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:34.583182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:34.660241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:34.745984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00368d05-a966-4222-9ee9-d86df036e08e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:34.760617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:34.763033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:34.763645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:34.764079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/02d5fe168a564052879bff6e9bd5f464` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:34.766668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=02d5fe168a564052879bff6e9bd5f464)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:34.772442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:34.779685 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1095/2184] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:34 2022] GET /identity/v3/projects/02d5fe168a564052879bff6e9bd5f464 => generated 371 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:35.015011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664782e-b4ce-4b1f-a130-b5a1e8b59662 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.015621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664782e-b4ce-4b1f-a130-b5a1e8b59662 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.016053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664782e-b4ce-4b1f-a130-b5a1e8b59662 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.018415 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1090/2185] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:36:35.026499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:35.046078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:35.062435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36a6dd-54b6-4865-ac35-3c82eeb7e6f7 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:35.072812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9663-dd09-4dbb-aa1c-613791793e3a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:35.074204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9663-dd09-4dbb-aa1c-613791793e3a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.074662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9663-dd09-4dbb-aa1c-613791793e3a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.075125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9663-dd09-4dbb-aa1c-613791793e3a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/02d5fe168a564052879bff6e9bd5f464` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.077028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9663-dd09-4dbb-aa1c-613791793e3a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=02d5fe168a564052879bff6e9bd5f464)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:35.080269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9663-dd09-4dbb-aa1c-613791793e3a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:35.094498 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1096/2186] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:35 2022] GET /identity/v3/projects/02d5fe168a564052879bff6e9bd5f464 => generated 371 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:36:35.115329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664782e-b4ce-4b1f-a130-b5a1e8b59662 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:35.147900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664782e-b4ce-4b1f-a130-b5a1e8b59662 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:35.156185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:35.157524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.158347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.159550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/02d5fe168a564052879bff6e9bd5f464` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.169612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=02d5fe168a564052879bff6e9bd5f464)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:35.176234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:35.321600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d5fe168a564052879bff6e9bd5f464', 'request_id': 'req-de5264e0-97d3-4c3a-8bd5-e286693dac9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:35.355814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d5fe168a564052879bff6e9bd5f464', 'request_id': 'req-de5264e0-97d3-4c3a-8bd5-e286693dac9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:35.400248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d5fe168a564052879bff6e9bd5f464', 'request_id': 'req-de5264e0-97d3-4c3a-8bd5-e286693dac9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:35.440221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] The token cache is being invalidate because project 02d5fe168a564052879bff6e9bd5f464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:35.440545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:35.443443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:35.447932 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1091/2187] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:35 2022] DELETE /identity/v3/projects/02d5fe168a564052879bff6e9bd5f464 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:35.476826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea999b-de92-499f-8ef5-c580e2beff81 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.479036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea999b-de92-499f-8ef5-c580e2beff81 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.479725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea999b-de92-499f-8ef5-c580e2beff81 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.482055 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1097/2188] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:35.496413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:35.499090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:35.604485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea999b-de92-499f-8ef5-c580e2beff81 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:35.608302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12ea999b-de92-499f-8ef5-c580e2beff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:35.790673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea999b-de92-499f-8ef5-c580e2beff81 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:35.805807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:35.808351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.809499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.811019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] PATH_INFO: `/v3/projects/77b50ee668ec44bc85aecfcb400b5886` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.815835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b50ee668ec44bc85aecfcb400b5886)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:35.823137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:35.849679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:35.856943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:35.917966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:35.970542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:36.015371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b50ee668ec44bc85aecfcb400b5886', 'request_id': 'req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.043946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b50ee668ec44bc85aecfcb400b5886', 'request_id': 'req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.069316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5264e0-97d3-4c3a-8bd5-e286693dac9a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:36.069771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b50ee668ec44bc85aecfcb400b5886', 'request_id': 'req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.121013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] The token cache is being invalidate because project 77b50ee668ec44bc85aecfcb400b5886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:36.122883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.125962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.130807 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1098/2189] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:35 2022] DELETE /identity/v3/projects/77b50ee668ec44bc85aecfcb400b5886 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:36.150425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:36.158731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:36.262581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:36.269932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:36.270800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:36.271872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/c2b5bf90e58d4785a6caeea427f690b3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:36.280632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2b5bf90e58d4785a6caeea427f690b3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:36.286068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:36.297988 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1092/2190] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:35 2022] GET /identity/v3/projects/c2b5bf90e58d4785a6caeea427f690b3 => generated 375 bytes in 802 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:36.316678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:36.321013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:36.381722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b8f0-951b-4043-a7b9-aab7948c2e1a tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:36.422920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:36.423951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:36.424455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:36.424942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:36.426326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:36.428827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:36.442603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b69a5-f1b9-4b61-a98c-d11515d3fbf8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:36.452529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:36.461091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:36.462314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:36.463118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] PATH_INFO: `/v3/users/6583ee5ac8c443e7a217970a931890ae` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:36.467214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6583ee5ac8c443e7a217970a931890ae)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:36.467535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:36.483646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:36.541207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1093/2191] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:36.542791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:36.598738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0c8c-48df-47a1-95d7-f405fc0a52bb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:36.620988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:36.622415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:36.622625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:36.623094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:36.624475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:36.626636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6583ee5ac8c443e7a217970a931890ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.627929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:36.655000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6583ee5ac8c443e7a217970a931890ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.700114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6583ee5ac8c443e7a217970a931890ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.704728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6583ee5ac8c443e7a217970a931890ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.710667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1094/2192] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:36 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:36.716277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:36.745473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b01320b4-81fa-4fba-a04a-594f217e9259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6583ee5ac8c443e7a217970a931890ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:36.764203 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1099/2193] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:36 2022] DELETE /identity/v3/users/6583ee5ac8c443e7a217970a931890ae => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:36.854859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3e83c-749f-4a9f-ac92-e9c6ec14fbdc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:36.885867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb356-4ad8-4339-8be4-4c2c60e1ddfb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:36.887401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb356-4ad8-4339-8be4-4c2c60e1ddfb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:36.887750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb356-4ad8-4339-8be4-4c2c60e1ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:36.960457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b40fb356-4ad8-4339-8be4-4c2c60e1ddfb None None] MFA Rules not processed for user `21fcf956ceb74a1db7802d7b3fac5322`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:36.964340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b40fb356-4ad8-4339-8be4-4c2c60e1ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:36.966166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:37.022141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b305-f593-4e97-84da-b8415a86d3eb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:37.022504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b305-f593-4e97-84da-b8415a86d3eb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:37.022918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b305-f593-4e97-84da-b8415a86d3eb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:37.023311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b305-f593-4e97-84da-b8415a86d3eb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:37.024760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b305-f593-4e97-84da-b8415a86d3eb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:37.025152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b305-f593-4e97-84da-b8415a86d3eb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:37.028239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b305-f593-4e97-84da-b8415a86d3eb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:37.053023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1095/2194] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:36:37.069524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:37.081498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:37.082778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:37.083450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:37.093212 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1096/2195] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:36:37.103485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:37.106490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:37.171029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1100/2196] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:37.183300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:37.183616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:37.183943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:37.240252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] MFA Rules not processed for user `aeb3928894284b77b4aea925a38470ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:37.242470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:37.284791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:37.287681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:37.322323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d72ee2-6459-4b7d-aa65-b1047d486779 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:37.332872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:37.333794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:37.334090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:37.334746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/47b89aafe8624cdd8678a7755dda641e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:37.358813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=47b89aafe8624cdd8678a7755dda641e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:37.367537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:37.377508 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1097/2197] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:37 2022] GET /identity/v3/projects/47b89aafe8624cdd8678a7755dda641e => generated 371 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:37.442205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1101/2198] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:37.528276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:37.564483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7f5cd-c525-4eb6-82c6-78ee49b35651 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:37.582065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42345b-78e4-4616-9691-0ef719fdeef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:37.583515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42345b-78e4-4616-9691-0ef719fdeef2 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:37.584662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42345b-78e4-4616-9691-0ef719fdeef2 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:37.585391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42345b-78e4-4616-9691-0ef719fdeef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:37.599034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b42345b-78e4-4616-9691-0ef719fdeef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:37.640866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42345b-78e4-4616-9691-0ef719fdeef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:37.645357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42345b-78e4-4616-9691-0ef719fdeef2 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:37.683138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:37.687531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:37.696093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1098/2199] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:37.899007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb57c4b-2066-411a-9fe0-91cff63b4ab9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:37.913049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:37.915968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:37.916879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:37.917703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] PATH_INFO: `/v3/projects/561457f24d2a4debadbaffd81f89226d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:37.921442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=561457f24d2a4debadbaffd81f89226d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:37.926685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:38.092928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561457f24d2a4debadbaffd81f89226d', 'request_id': 'req-a4ce5306-9589-4752-a324-9900e3119e5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:38.125559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561457f24d2a4debadbaffd81f89226d', 'request_id': 'req-a4ce5306-9589-4752-a324-9900e3119e5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:38.146405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561457f24d2a4debadbaffd81f89226d', 'request_id': 'req-a4ce5306-9589-4752-a324-9900e3119e5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:38.197012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] The token cache is being invalidate because project 561457f24d2a4debadbaffd81f89226d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:38.198050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:38.203012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4ce5306-9589-4752-a324-9900e3119e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:38.208634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1102/2200] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:37 2022] DELETE /identity/v3/projects/561457f24d2a4debadbaffd81f89226d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:38.231091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b05e-6d98-4a32-a092-4d398d94a266 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.232924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b05e-6d98-4a32-a092-4d398d94a266 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.234495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b05e-6d98-4a32-a092-4d398d94a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.343870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0ee0b05e-6d98-4a32-a092-4d398d94a266 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:38.352454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ee0b05e-6d98-4a32-a092-4d398d94a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:38.603453 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1099/2201] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:38.622729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdcaff-9303-4770-bbce-5de5a05846ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.623226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdcaff-9303-4770-bbce-5de5a05846ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.623892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdcaff-9303-4770-bbce-5de5a05846ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.648651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:38.699077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e8bdcaff-9303-4770-bbce-5de5a05846ab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:38.713721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8bdcaff-9303-4770-bbce-5de5a05846ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:38.776773 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1103/2202] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:38.779545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b05e-6d98-4a32-a092-4d398d94a266 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:38.809993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b05e-6d98-4a32-a092-4d398d94a266 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:38.840438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3eba2-1785-46b8-b3f0-5f0d6f832df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:38.842092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eba2-1785-46b8-b3f0-5f0d6f832df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.842586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eba2-1785-46b8-b3f0-5f0d6f832df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.843087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eba2-1785-46b8-b3f0-5f0d6f832df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.844567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3eba2-1785-46b8-b3f0-5f0d6f832df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:38.845112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3eba2-1785-46b8-b3f0-5f0d6f832df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:38.848380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3eba2-1785-46b8-b3f0-5f0d6f832df9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:38.889604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdcaff-9303-4770-bbce-5de5a05846ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:38.891933 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1100/2203] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:38.920155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdcaff-9303-4770-bbce-5de5a05846ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:38.931263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.932668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.934024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.943156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:38.945953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.946720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.947252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.950985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:38.961414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:38.983060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:38.986946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:39.042281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:39.075795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1104/2204] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:38 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:39.078871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:39.093278 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1101/2205] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:36:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:36:39.243947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:39.246820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:39.261272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9333a-b0d6-48ad-90bd-b5c3f056e38f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:39.408208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4050f-2a7c-4fae-b083-3739732d7b20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:39.435515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:39.439667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:39.440980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:39.444206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:39.450777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:39.467283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:39.488704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:39.491428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:39.493162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:39.495055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:39.539214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:39.549232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:39.569290 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1105/2206] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:39 2022] POST /identity/v3/users => generated 302 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:39.571055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:39.586971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:39.611912 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1102/2207] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:39.613546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:39.616312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:39.651223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29715df-d538-420b-b089-492592255ba5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:39.671083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5f7de-faf4-4e54-b790-b8c42b78ae9b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:39.672542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:39.673801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:39.674163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:39.674513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] PATH_INFO: `/v3/users/5ac81bf2390d471394f68327363cee28` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:39.677464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac81bf2390d471394f68327363cee28)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:39.683252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:39.704015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:39.705566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:39.706082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:39.706590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] PATH_INFO: `/v3/projects/1690e461b4d3484aba8b101d67a0fa0b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:39.718528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1690e461b4d3484aba8b101d67a0fa0b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:39.722393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:39.861685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac81bf2390d471394f68327363cee28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:39.893489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac81bf2390d471394f68327363cee28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:39.914445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac81bf2390d471394f68327363cee28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:39.916363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac81bf2390d471394f68327363cee28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:39.933738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1690e461b4d3484aba8b101d67a0fa0b', 'request_id': 'req-b27597ba-46d4-496f-9cae-7483dac09cb4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:39.964909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1690e461b4d3484aba8b101d67a0fa0b', 'request_id': 'req-b27597ba-46d4-496f-9cae-7483dac09cb4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:39.985040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1690e461b4d3484aba8b101d67a0fa0b', 'request_id': 'req-b27597ba-46d4-496f-9cae-7483dac09cb4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:39.990730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac81bf2390d471394f68327363cee28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:40.026111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] The token cache is being invalidate because project 1690e461b4d3484aba8b101d67a0fa0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:40.026670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:40.034086 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1106/2208] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:39 2022] DELETE /identity/v3/users/5ac81bf2390d471394f68327363cee28 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:40.036088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:40.038786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:40.040415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b27597ba-46d4-496f-9cae-7483dac09cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:40.043112 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1103/2209] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:39 2022] DELETE /identity/v3/projects/1690e461b4d3484aba8b101d67a0fa0b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:40.050325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247312f-ec0f-4ffa-a930-6bd26b4db462 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:40.050762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247312f-ec0f-4ffa-a930-6bd26b4db462 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:40.051233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247312f-ec0f-4ffa-a930-6bd26b4db462 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:40.054647 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1104/2210] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:40.056893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133957d3-ce1e-4f89-9f61-ac603148ce32 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:40.057410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133957d3-ce1e-4f89-9f61-ac603148ce32 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:40.057856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133957d3-ce1e-4f89-9f61-ac603148ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:40.135705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-133957d3-ce1e-4f89-9f61-ac603148ce32 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:40.137693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-133957d3-ce1e-4f89-9f61-ac603148ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:40.170346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:40.298847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5bfc-52c0-4e95-bed8-8d04e65d7d69 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:40.324241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:40.325423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:40.325910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:40.326404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:40.327854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:40.331093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:40.396327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1107/2211] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:40.397616 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1105/2212] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:40.401825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:40.403683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:40.405745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:40.407398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:40.408325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:40.457737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:40.478676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:40.488904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:40.524292 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1106/2213] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:40.528752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:40.534346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:40.584246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc90c16-d3e2-4d53-8488-805948cceeae None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:40.606659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:40.607968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:40.608569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:40.609171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:40.612641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:40.618777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:40.673540 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1107/2214] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:40.675258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:40.716669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53374c64-a388-4d53-a4a4-509791af6a2a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:40.738805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:40.740079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:40.740593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:40.741176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:40.743073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:40.752243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:40.757036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:40.788870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:40.797464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:40.804340 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1108/2215] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:40.805637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:40.808336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:40.857523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92077e-4a7e-475f-a197-9ebecdcc38c6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:40.901544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:40.906504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:40.907808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:40.911243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] PATH_INFO: `/v3/projects/411ac0caf1d14d3ea49d55aafc8ba351` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:40.915770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411ac0caf1d14d3ea49d55aafc8ba351)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:40.932447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:41.052425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65103c3-a109-4254-89d4-10e9dee178d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:41.064869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:41.066079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:41.068945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:41.070094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/47b89aafe8624cdd8678a7755dda641e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:41.074524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=47b89aafe8624cdd8678a7755dda641e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:41.082926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:41.101767 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1108/2216] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:40 2022] GET /identity/v3/projects/47b89aafe8624cdd8678a7755dda641e => generated 371 bytes in 703 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:41.104918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:41.157636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37898894-ce43-47a5-902c-00b919f4db2e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:41.206805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411ac0caf1d14d3ea49d55aafc8ba351', 'request_id': 'req-46fb036d-2401-403a-9dda-49683873bac6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:41.252136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411ac0caf1d14d3ea49d55aafc8ba351', 'request_id': 'req-46fb036d-2401-403a-9dda-49683873bac6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:41.296155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411ac0caf1d14d3ea49d55aafc8ba351', 'request_id': 'req-46fb036d-2401-403a-9dda-49683873bac6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:41.320734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:41.324086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:41.324321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:41.324487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] PATH_INFO: `/v3/projects/ab3c7bb172ef49c6a5154aee18c8a1bd/users/160fe1ec6b2d45e48990558af381a0ef/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:41.355469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] The token cache is being invalidate because project 411ac0caf1d14d3ea49d55aafc8ba351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:41.356365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:41.362932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:41.370913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3c7bb172ef49c6a5154aee18c8a1bd, user_id=160fe1ec6b2d45e48990558af381a0ef, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:41.372040 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1109/2217] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:40 2022] DELETE /identity/v3/projects/411ac0caf1d14d3ea49d55aafc8ba351 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:41.375899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:41.380469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:41.384649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:41.386193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:41.417599 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1109/2218] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:41 2022] PUT /identity/v3/projects/ab3c7bb172ef49c6a5154aee18c8a1bd/users/160fe1ec6b2d45e48990558af381a0ef/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:41.425374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:41.432406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:41.456917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb036d-2401-403a-9dda-49683873bac6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:41.694950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b79f1-897b-489f-b231-b593daaae5eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:41.703765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:41.704737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:41.705206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:41.705641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:41.708248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:41.708934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:41.712106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:41.728666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c693d-43ab-45d0-8d59-8ad6e5d396d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:41.729910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c693d-43ab-45d0-8d59-8ad6e5d396d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:41.730427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c693d-43ab-45d0-8d59-8ad6e5d396d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:41.730946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c693d-43ab-45d0-8d59-8ad6e5d396d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:41.732389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c693d-43ab-45d0-8d59-8ad6e5d396d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:41.736434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c693d-43ab-45d0-8d59-8ad6e5d396d6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:41.749670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1110/2219] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:41.750917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:41.758296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:41.792722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69debba8-916a-469d-b06e-7bdcfbb1cb85 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:41.805839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:41.807334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:41.807923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:41.808431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] PATH_INFO: `/v3/users/0e61db381bdc4520b56d8245623ee345` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:41.810258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e61db381bdc4520b56d8245623ee345)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:41.813192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:41.849103 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1110/2220] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:41 2022] POST /identity/v3/projects => generated 373 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:41.851936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:41.852465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:41.852988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:41.934114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:41.936680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:41.945602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e61db381bdc4520b56d8245623ee345'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:42.007337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e61db381bdc4520b56d8245623ee345'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:42.049055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e61db381bdc4520b56d8245623ee345'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:42.050116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e61db381bdc4520b56d8245623ee345'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:42.087406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e61db381bdc4520b56d8245623ee345'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:42.119017 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1111/2221] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:41 2022] DELETE /identity/v3/users/0e61db381bdc4520b56d8245623ee345 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:42.122881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:42.149663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:42.159909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:42.270264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1111/2222] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:42.271813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:42.283451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:42.335414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ec8f3-2d2a-48b0-a536-605f52e3355e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:42.473207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc3c3-5ce6-44bb-889b-bd118ff7963f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:42.498513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:42.499858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:42.499968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:42.500391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:42.501494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:42.509429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:42.552936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:42.619505 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1112/2223] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:42 2022] POST /identity/v3/users => generated 383 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:42.623298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:42.633007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:42.646092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:42.646917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:42.647860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:42.648146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:42.648904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:42.651104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:42.712122 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1112/2224] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:42 2022] POST /identity/v3/users => generated 287 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:42.716580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:42.756354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42082af-a5ee-478f-ae2c-f3fc756619e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:42.789515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:42.790717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:42.791521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:42.791794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:42.801151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:42.801952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:42.805375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:42.884350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd138a2-25a4-4dfd-9539-5c18b8ddd64e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:42.918951 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1113/2225] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:42.943169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:42.944981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:42.949422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:42.950464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:42.964030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:42.976616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:42.983492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:43.019947 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1113/2226] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:43.024399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:43.030167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:43.031014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7636be5-9284-48b5-b250-9b7c9d020524 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:43.063786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cbf0e-e58b-45d2-9fd6-f356285de0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:43.066541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbf0e-e58b-45d2-9fd6-f356285de0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.067126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbf0e-e58b-45d2-9fd6-f356285de0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.067658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbf0e-e58b-45d2-9fd6-f356285de0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:43.072607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cbf0e-e58b-45d2-9fd6-f356285de0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:43.075771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cbf0e-e58b-45d2-9fd6-f356285de0a0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:43.079436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adbe90-e4c5-454a-8f15-fc4d833e5879 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:43.096684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:43.098037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.098714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.099234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] PATH_INFO: `/v3/projects/b7015f2895544dff93606ed57e81b476` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:43.109368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7015f2895544dff93606ed57e81b476)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:43.111934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:43.180866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1114/2227] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:43.190420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579036b3-0e02-4d4c-ad38-c14cd1b971b1 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.195898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579036b3-0e02-4d4c-ad38-c14cd1b971b1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.201515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579036b3-0e02-4d4c-ad38-c14cd1b971b1 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:43.207860 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1115/2228] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:43 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:43.210079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579036b3-0e02-4d4c-ad38-c14cd1b971b1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:43.314396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579036b3-0e02-4d4c-ad38-c14cd1b971b1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:43.324278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:43.326503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.327342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.327855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:43.331256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:43.335188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:43.367472 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1116/2229] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:43.367472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:43.369979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:43.432703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7015f2895544dff93606ed57e81b476', 'request_id': 'req-594d1260-7e2c-480a-940e-02e3fec99833'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:43.460473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7015f2895544dff93606ed57e81b476', 'request_id': 'req-594d1260-7e2c-480a-940e-02e3fec99833'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:43.480719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7015f2895544dff93606ed57e81b476', 'request_id': 'req-594d1260-7e2c-480a-940e-02e3fec99833'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:43.500710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] The token cache is being invalidate because project b7015f2895544dff93606ed57e81b476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:43.501022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:43.501711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:43.503700 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1114/2230] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:43 2022] DELETE /identity/v3/projects/b7015f2895544dff93606ed57e81b476 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:43.504533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:43.512470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:43.579952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:43.607344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e5ad3-a3a6-484f-b405-4f7cca808fd1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:43.699128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d1260-7e2c-480a-940e-02e3fec99833 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:43.703716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ccd86-b9e3-4324-8154-f6cb4d545a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:43.705173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ccd86-b9e3-4324-8154-f6cb4d545a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.705173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ccd86-b9e3-4324-8154-f6cb4d545a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.705449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ccd86-b9e3-4324-8154-f6cb4d545a33 admin admin] PATH_INFO: `/v3/projects/f617f695a4584d6bbe8c5ae3f867aaef/users/9ae4fc7d48b94492b7b22fdb619ef7d6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:43.747250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:43.753000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ccd86-b9e3-4324-8154-f6cb4d545a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f617f695a4584d6bbe8c5ae3f867aaef, user_id=9ae4fc7d48b94492b7b22fdb619ef7d6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:43.756421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ccd86-b9e3-4324-8154-f6cb4d545a33 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:43.779137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:43.811704 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1115/2231] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:43 2022] PUT /identity/v3/projects/f617f695a4584d6bbe8c5ae3f867aaef/users/9ae4fc7d48b94492b7b22fdb619ef7d6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:43.814378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156374-d2a3-477d-b94d-1e9a168a567e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.816805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156374-d2a3-477d-b94d-1e9a168a567e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.817793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156374-d2a3-477d-b94d-1e9a168a567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:43.892497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-64156374-d2a3-477d-b94d-1e9a168a567e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:43.896158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64156374-d2a3-477d-b94d-1e9a168a567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:43.909111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0a337-1c85-47c9-ba60-aff75b41e233 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:43.911224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a337-1c85-47c9-ba60-aff75b41e233 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.912189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a337-1c85-47c9-ba60-aff75b41e233 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.913651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a337-1c85-47c9-ba60-aff75b41e233 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/47b89aafe8624cdd8678a7755dda641e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:43.916917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0a337-1c85-47c9-ba60-aff75b41e233 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=47b89aafe8624cdd8678a7755dda641e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:43.922070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0a337-1c85-47c9-ba60-aff75b41e233 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:43.927251 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1117/2232] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:43 2022] GET /identity/v3/projects/47b89aafe8624cdd8678a7755dda641e => generated 371 bytes in 564 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:43.930629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416ec02-5dad-42bc-8f9b-ed8c5fa6460f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:43.931682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416ec02-5dad-42bc-8f9b-ed8c5fa6460f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:43.932524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416ec02-5dad-42bc-8f9b-ed8c5fa6460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.012296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9416ec02-5dad-42bc-8f9b-ed8c5fa6460f None None] MFA Rules not processed for user `9ae4fc7d48b94492b7b22fdb619ef7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:44.016563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9416ec02-5dad-42bc-8f9b-ed8c5fa6460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:44.030191 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1116/2233] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:44.040894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a67e5-fa5a-4052-907a-6b4db0821b19 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.041203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a67e5-fa5a-4052-907a-6b4db0821b19 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.041651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a67e5-fa5a-4052-907a-6b4db0821b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.068788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-db6a67e5-fa5a-4052-907a-6b4db0821b19 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:44.070197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db6a67e5-fa5a-4052-907a-6b4db0821b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:44.086718 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1117/2234] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:44.092559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a67e5-fa5a-4052-907a-6b4db0821b19 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:44.126034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a67e5-fa5a-4052-907a-6b4db0821b19 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:44.146412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:44.147142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.148067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.148356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.149132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:44.149448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:44.157910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:44.207374 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1118/2235] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:44.208885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:44.240346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf472-9d6f-4cb5-9545-3094e6279b3d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:44.259080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:44.261970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.262258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.264547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.267478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:44.277873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:44.329434 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1119/2236] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:44 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:44.333410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:44.341497 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1118/2237] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:44.430723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6deae-cb1e-4b97-a7a1-9f5eacb76bce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:44.438622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:44.439821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.439821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.440570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.440993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:44.445267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:44.483802 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1120/2238] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:44 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:36:44.489017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416ec02-5dad-42bc-8f9b-ed8c5fa6460f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:44.501888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:44.504644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:44.521587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416ec02-5dad-42bc-8f9b-ed8c5fa6460f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:44.558052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:44.559645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.560298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.560958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.562650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:44.566503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:44.651004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:44.660795 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1119/2239] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:44.681174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:44.739234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd719-940e-493b-a31f-c10793a53f26 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:44.746757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea238-98bc-41bc-8556-0a085546996b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:44.770080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:44.772814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.775440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.777287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.780349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:44.781825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:44.783486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.796044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.796625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.798055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:44.842694 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1120/2240] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:44.848360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:44.880348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a790e7b-23dd-4f42-a933-70d711d95699 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:44.909987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655905c-bdfb-42dc-9311-6303022f6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:44.911335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655905c-bdfb-42dc-9311-6303022f6a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:44.912160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655905c-bdfb-42dc-9311-6303022f6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:44.912859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655905c-bdfb-42dc-9311-6303022f6a42 admin admin] PATH_INFO: `/v3/projects/37c6e6fc4a9e4a8ab44ea9b14b7eefc5/users/82254dd6dfcc4f2f96995a0133a901b4/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:44.955053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655905c-bdfb-42dc-9311-6303022f6a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c6e6fc4a9e4a8ab44ea9b14b7eefc5, user_id=82254dd6dfcc4f2f96995a0133a901b4, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:44.966500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655905c-bdfb-42dc-9311-6303022f6a42 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:44.998766 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1121/2241] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:44 2022] PUT /identity/v3/projects/37c6e6fc4a9e4a8ab44ea9b14b7eefc5/users/82254dd6dfcc4f2f96995a0133a901b4/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:45.000999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7eb3-446f-49be-94b1-008fead5b85e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:45.001541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7eb3-446f-49be-94b1-008fead5b85e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:45.002018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7eb3-446f-49be-94b1-008fead5b85e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:45.004757 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1122/2242] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:45.012387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9e76a-d569-4daf-9e1e-5fb1d1482e99 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:45.012695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9e76a-d569-4daf-9e1e-5fb1d1482e99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:45.012982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9e76a-d569-4daf-9e1e-5fb1d1482e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:45.018305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:45.025094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:45.073971 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1121/2243] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:36:45.075242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:45.077024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:45.089213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cff9e76a-d569-4daf-9e1e-5fb1d1482e99 None None] MFA Rules not processed for user `82254dd6dfcc4f2f96995a0133a901b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:45.091937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cff9e76a-d569-4daf-9e1e-5fb1d1482e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:45.119686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:45.121327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:45.317639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ad411-6cb5-445c-ab70-e4ace469f0ce service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:45.352705 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1123/2244] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:45.357577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9e76a-d569-4daf-9e1e-5fb1d1482e99 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:45.416995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:45.492834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:45.496836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:45.498401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:45.498902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/47b89aafe8624cdd8678a7755dda641e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:45.503024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=47b89aafe8624cdd8678a7755dda641e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:45.510126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:45.534820 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1122/2245] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:45 2022] GET /identity/v3/projects/47b89aafe8624cdd8678a7755dda641e => generated 371 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:45.588390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:45.609253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9e76a-d569-4daf-9e1e-5fb1d1482e99 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:45.612817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749fce-94e5-46f3-b473-6350434b2e9c tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:45.628375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:45.629136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:45.629432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:45.629719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:45.630600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:45.632720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:45.635225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:45.637559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:45.641699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:45.642261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/users/1efa7a84824941a6a36fa1586ff886de` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:45.712856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1efa7a84824941a6a36fa1586ff886de)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:45.720284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:45.737619 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1124/2246] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:45 2022] POST /identity/v3/projects => generated 393 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:45.741420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:45.765496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:45.829332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1efa7a84824941a6a36fa1586ff886de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:45.851679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1efa7a84824941a6a36fa1586ff886de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:45.869739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1efa7a84824941a6a36fa1586ff886de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:45.871647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1efa7a84824941a6a36fa1586ff886de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:45.893985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1efa7a84824941a6a36fa1586ff886de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:45.913682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6306e1-7d00-4afa-a1cd-3378e3e38fe3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:45.918172 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1123/2247] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:45 2022] DELETE /identity/v3/users/1efa7a84824941a6a36fa1586ff886de => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:45.921803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:45.924264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:46.046023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:46.046752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:46.047044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:46.047380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:46.048162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:46.050222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:46.095206 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1125/2248] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:45 2022] POST /identity/v3/users => generated 303 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:46.099304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:46.104205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:46.111279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680978ba-3ea6-4a1f-a30f-94fa1aacb0c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:46.118354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:46.119872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:46.120348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:46.120721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/47b89aafe8624cdd8678a7755dda641e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:46.122596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=47b89aafe8624cdd8678a7755dda641e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:46.125249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:46.128490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd00c-321b-44fc-8659-ec183d3c49e2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:46.135578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:46.139570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:46.140129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:46.140594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:46.141578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:46.144817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:46.164812 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1126/2249] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:46.166305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:46.196196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045fc0-1f01-4d7d-905c-ad9e44f39236 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:46.207950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:46.209717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:46.209945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:46.211637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] PATH_INFO: `/v3/projects/ffd977efd139496dad278ed5933f8379/users/3f1be8b33b93467197f8902f4c740ca1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:46.250264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b89aafe8624cdd8678a7755dda641e', 'request_id': 'req-025d8c81-2ca0-4c9f-a959-9d6698307977'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:46.260721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b89aafe8624cdd8678a7755dda641e', 'request_id': 'req-025d8c81-2ca0-4c9f-a959-9d6698307977'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:46.272555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b89aafe8624cdd8678a7755dda641e', 'request_id': 'req-025d8c81-2ca0-4c9f-a959-9d6698307977'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:46.273618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd977efd139496dad278ed5933f8379, user_id=3f1be8b33b93467197f8902f4c740ca1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:46.277421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:46.293484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:46.309450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] The token cache is being invalidate because project 47b89aafe8624cdd8678a7755dda641e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:46.309854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:46.310835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:46.320550 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1124/2250] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:45 2022] DELETE /identity/v3/projects/47b89aafe8624cdd8678a7755dda641e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:46.322290 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1127/2251] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:46 2022] PUT /identity/v3/projects/ffd977efd139496dad278ed5933f8379/users/3f1be8b33b93467197f8902f4c740ca1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:46.326192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:46.327700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:46.386641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:46.551491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d8c81-2ca0-4c9f-a959-9d6698307977 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:46.847637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33b3cc-daf6-4cdf-830c-523f34d2ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:46.848991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b3cc-daf6-4cdf-830c-523f34d2ccce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:46.849605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b3cc-daf6-4cdf-830c-523f34d2ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:46.851137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b3cc-daf6-4cdf-830c-523f34d2ccce admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:46.852826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33b3cc-daf6-4cdf-830c-523f34d2ccce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:46.863296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33b3cc-daf6-4cdf-830c-523f34d2ccce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:46.901460 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1125/2252] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:36:46.905220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:46.920371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765a12-aab6-40b0-9609-f5278148c1cd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:46.942358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fdf35-d642-4d98-98d5-58b23e789d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:46.943582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fdf35-d642-4d98-98d5-58b23e789d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:46.945195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fdf35-d642-4d98-98d5-58b23e789d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:46.945615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fdf35-d642-4d98-98d5-58b23e789d8f admin admin] PATH_INFO: `/v3/projects/ffd977efd139496dad278ed5933f8379/users/3f1be8b33b93467197f8902f4c740ca1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:46.949047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fdf35-d642-4d98-98d5-58b23e789d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd977efd139496dad278ed5933f8379, user_id=3f1be8b33b93467197f8902f4c740ca1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:46.957196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fdf35-d642-4d98-98d5-58b23e789d8f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:46.992852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e471a-7059-4f17-a968-f3a6b5f74260 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:46.993398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e471a-7059-4f17-a968-f3a6b5f74260 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:46.993766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e471a-7059-4f17-a968-f3a6b5f74260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:46.995312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1128/2253] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:46 2022] PUT /identity/v3/projects/ffd977efd139496dad278ed5933f8379/users/3f1be8b33b93467197f8902f4c740ca1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:47.051067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b54e471a-7059-4f17-a968-f3a6b5f74260 None None] MFA Rules not processed for user `3f1be8b33b93467197f8902f4c740ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:47.055188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b54e471a-7059-4f17-a968-f3a6b5f74260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:47.216492 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1126/2254] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:47.221669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:47.222121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:47.222515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:47.267511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] MFA Rules not processed for user `82254dd6dfcc4f2f96995a0133a901b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:47.269151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:47.344720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:47.345046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:47.345284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:47.347371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1127/2255] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:47.375403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:47.377638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:47.412155 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1129/2256] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:47.527962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:47.619183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:47.640106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:47.668241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:47.671377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:47.956458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6115c38-61cc-4ffd-aad0-9cdd55d19ca8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:47.959775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21483ff-ad2a-48d7-b456-4686611b6ed8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:47.968223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:47.969284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:47.970279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:47.970595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] PATH_INFO: `/v3/users/9ae4fc7d48b94492b7b22fdb619ef7d6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:47.972392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae4fc7d48b94492b7b22fdb619ef7d6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:47.974400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:47.980562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909912d-da37-4680-8220-d3942a6c2921 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:47.982605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909912d-da37-4680-8220-d3942a6c2921 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:47.986825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909912d-da37-4680-8220-d3942a6c2921 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:47.987595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909912d-da37-4680-8220-d3942a6c2921 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/c2b5bf90e58d4785a6caeea427f690b3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:47.994768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909912d-da37-4680-8220-d3942a6c2921 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2b5bf90e58d4785a6caeea427f690b3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:47.999984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909912d-da37-4680-8220-d3942a6c2921 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:48.015232 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1128/2257] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:47 2022] GET /identity/v3/projects/c2b5bf90e58d4785a6caeea427f690b3 => generated 375 bytes in 639 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:48.088223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae4fc7d48b94492b7b22fdb619ef7d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:48.130189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae4fc7d48b94492b7b22fdb619ef7d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:48.131174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae4fc7d48b94492b7b22fdb619ef7d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:48.160717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae4fc7d48b94492b7b22fdb619ef7d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:48.161929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae4fc7d48b94492b7b22fdb619ef7d6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:48.199024 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1130/2258] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:47 2022] DELETE /identity/v3/users/9ae4fc7d48b94492b7b22fdb619ef7d6 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:48.205795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:48.206317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:48.207158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:48.279309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:48.281960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:48.283358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:48.288003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:48.311133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:48.473749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9272095-8e84-4100-9810-397e756b5f22 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:48.483827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fdd44-6a10-42ac-aaf4-0c43ca6cf66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:48.485516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fdd44-6a10-42ac-aaf4-0c43ca6cf66d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:48.485949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1129/2259] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:48.486358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fdd44-6a10-42ac-aaf4-0c43ca6cf66d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:48.486808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fdd44-6a10-42ac-aaf4-0c43ca6cf66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:48.491593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-632fdd44-6a10-42ac-aaf4-0c43ca6cf66d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:48.545551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:48.550027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:48.595751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fdd44-6a10-42ac-aaf4-0c43ca6cf66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:48.598641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fdd44-6a10-42ac-aaf4-0c43ca6cf66d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:48.611360 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1131/2260] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:48.825413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:48.825982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:48.831864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:48.833777 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1132/2261] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:36:48.837701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17517a-4b98-4e57-96b2-f13783acf470 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:48.843923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508cee3-0162-44f8-8a7c-f44ef2753684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:48.845181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cee3-0162-44f8-8a7c-f44ef2753684 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:48.845760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cee3-0162-44f8-8a7c-f44ef2753684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:48.846378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cee3-0162-44f8-8a7c-f44ef2753684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:48.849240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:48.851256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:48.862792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cee3-0162-44f8-8a7c-f44ef2753684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:48.864670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cee3-0162-44f8-8a7c-f44ef2753684 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:48.878068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1130/2262] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:48.897771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:48.899623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:49.007980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f575f-9c29-4656-9f89-98c045c7c49b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:49.033905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:49.040520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:49.041445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:49.042179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/c2b5bf90e58d4785a6caeea427f690b3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:49.047540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2b5bf90e58d4785a6caeea427f690b3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:49.061179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:49.067524 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1133/2263] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:48 2022] GET /identity/v3/projects/c2b5bf90e58d4785a6caeea427f690b3 => generated 375 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:36:51.364593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f51f-04ca-4668-96b5-70648a25143b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:51.364593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f51f-04ca-4668-96b5-70648a25143b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:51.364593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f51f-04ca-4668-96b5-70648a25143b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:51.366765 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1131/2264] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:36:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:51.372986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:36:51.466543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:51.496672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063cf3-9765-4056-9d7c-38c102d8c8cc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:51.512581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac815ab-d0f4-4d1f-a284-7019ebfa1c70 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd686c468f7432bbb71af8b92d7af9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e98db1ac3ee404c9d63572599c19654', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:51.513487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac815ab-d0f4-4d1f-a284-7019ebfa1c70 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:51.513784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac815ab-d0f4-4d1f-a284-7019ebfa1c70 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:51.514095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac815ab-d0f4-4d1f-a284-7019ebfa1c70 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] PATH_INFO: `/v3/projects/c2b5bf90e58d4785a6caeea427f690b3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:51.516616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac815ab-d0f4-4d1f-a284-7019ebfa1c70 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2b5bf90e58d4785a6caeea427f690b3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:51.521230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac815ab-d0f4-4d1f-a284-7019ebfa1c70 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:51.549013 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1134/2265] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:36:51 2022] GET /identity/v3/projects/c2b5bf90e58d4785a6caeea427f690b3 => generated 375 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:52.414870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f51f-04ca-4668-96b5-70648a25143b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:52.418416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bba2f51f-04ca-4668-96b5-70648a25143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:52.502467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f51f-04ca-4668-96b5-70648a25143b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:52.527809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:52.530134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:52.531062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:52.532198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] PATH_INFO: `/v3/users/f9a82921fa07436899f0344a397b7ad3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:52.535624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a82921fa07436899f0344a397b7ad3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:52.541121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:52.628674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:52.707879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a82921fa07436899f0344a397b7ad3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:52.746706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a82921fa07436899f0344a397b7ad3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:52.769986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a82921fa07436899f0344a397b7ad3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:52.772779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a82921fa07436899f0344a397b7ad3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:52.798841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5e399aa-3b51-473c-8dc5-7b68eae89d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a82921fa07436899f0344a397b7ad3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:52.842461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:52.843786 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1132/2266] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:52 2022] DELETE /identity/v3/users/f9a82921fa07436899f0344a397b7ad3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:52.844003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:52.844003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:52.918840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:52.922364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:53.104347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:53.287235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1135/2267] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:53.362021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:53.362884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:53.363512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:53.426117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] MFA Rules not processed for user `038556a90129478eb04699f574ea7e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:53.427908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:53.430072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:53.432503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:53.709591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648821ec-edbb-4408-a7f3-fe585c1d8cf3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:53.716761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:53.717941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:53.718588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:53.719069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:53.739138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:53.741952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:53.755456 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1133/2268] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:53.758355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:53.764264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1136/2269] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:53.765990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:53.869101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639adb83-2316-4175-91ee-52149bf28ad9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:53.892859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:53.894467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:53.895181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:53.896224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:53.900294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:53.913610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:54.016685 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1134/2270] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:53 2022] POST /identity/v3/projects => generated 371 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:54.028034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:54.082461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b4fae-f730-49dd-9911-b357ecf68b9a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:54.373542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:54.374838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:54.375400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:54.375900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:54.377252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:54.385377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:54.450105 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1137/2271] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:54 2022] POST /identity/v3/users => generated 292 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:54.455358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:54.532733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ffab2-7d97-4b04-8416-f13c3a015d5a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:54.558941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:54.561892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:54.563110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:54.563957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:54.566218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:54.569631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:54.574177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:54.583510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:54.593680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e682c-e3fd-47c2-b8ed-1e9d294d32bd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:54.622768 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1135/2272] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:54.623000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:54.623975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:54.624261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:54.624542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] PATH_INFO: `/v3/projects/f617f695a4584d6bbe8c5ae3f867aaef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:54.628622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:54.632456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f617f695a4584d6bbe8c5ae3f867aaef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:54.637849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:54.650468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069175dd-726c-4d70-b429-c01e69f836f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:54.668315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:54.669555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:54.669914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:54.670252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] PATH_INFO: `/v3/projects/2b48d3eab3d74e5991ae923626a4766d/users/e50d4c0db2134001bddd5695d79cc66e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:54.713831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b48d3eab3d74e5991ae923626a4766d, user_id=e50d4c0db2134001bddd5695d79cc66e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:54.716922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:54.751241 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1136/2273] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:54 2022] PUT /identity/v3/projects/2b48d3eab3d74e5991ae923626a4766d/users/e50d4c0db2134001bddd5695d79cc66e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:54.758532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:54.806811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f617f695a4584d6bbe8c5ae3f867aaef', 'request_id': 'req-fa2cf001-272d-46bc-a583-3e938e6100f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:54.822496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f617f695a4584d6bbe8c5ae3f867aaef', 'request_id': 'req-fa2cf001-272d-46bc-a583-3e938e6100f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:54.837426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f617f695a4584d6bbe8c5ae3f867aaef', 'request_id': 'req-fa2cf001-272d-46bc-a583-3e938e6100f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:54.839367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:54.874742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] The token cache is being invalidate because project f617f695a4584d6bbe8c5ae3f867aaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:54.875183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:54.877787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa2cf001-272d-46bc-a583-3e938e6100f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:54.883568 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1138/2274] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:54 2022] DELETE /identity/v3/projects/f617f695a4584d6bbe8c5ae3f867aaef => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:54.886210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8b90-20d3-41a4-8373-2dd14e430fb3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:54.886752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8b90-20d3-41a4-8373-2dd14e430fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:54.887193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8b90-20d3-41a4-8373-2dd14e430fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:54.934776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:54.972471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-459d8b90-20d3-41a4-8373-2dd14e430fb3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:54.979295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-459d8b90-20d3-41a4-8373-2dd14e430fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:55.065544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615639a-49c9-49f1-8a2f-d54afddc5096 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:55.178713 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1139/2275] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:55.180261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a6f3f-64af-44c1-b4d4-91b287bd9eb4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:55.180728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a6f3f-64af-44c1-b4d4-91b287bd9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:55.181376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a6f3f-64af-44c1-b4d4-91b287bd9eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:55.226609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcde76-7e2e-4666-8386-ee23b78b8f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:55.227348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcde76-7e2e-4666-8386-ee23b78b8f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:55.227638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcde76-7e2e-4666-8386-ee23b78b8f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:55.227918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcde76-7e2e-4666-8386-ee23b78b8f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:55.228694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcde76-7e2e-4666-8386-ee23b78b8f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:55.238072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcde76-7e2e-4666-8386-ee23b78b8f76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:55.253481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-108a6f3f-64af-44c1-b4d4-91b287bd9eb4 None None] MFA Rules not processed for user `cdac1d4106674c7ab0cfe39939de9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:55.254777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-108a6f3f-64af-44c1-b4d4-91b287bd9eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:55.265577 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1137/2276] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:55.267168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:55.267496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:55.267782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:55.316110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:55.317607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:55.354958 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1138/2277] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:55.358262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:55.361585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:55.441614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd062873-fa93-4cbb-9dfb-4b5655299fa0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:55.479059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:55.483061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:55.484084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:55.484892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] PATH_INFO: `/v3/projects/2b48d3eab3d74e5991ae923626a4766d/users/e50d4c0db2134001bddd5695d79cc66e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:55.489701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b48d3eab3d74e5991ae923626a4766d, user_id=e50d4c0db2134001bddd5695d79cc66e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:55.511332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:55.562835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1140/2278] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:55.562835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a6f3f-64af-44c1-b4d4-91b287bd9eb4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:55.570613 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1139/2279] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:55 2022] PUT /identity/v3/projects/2b48d3eab3d74e5991ae923626a4766d/users/e50d4c0db2134001bddd5695d79cc66e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:55.596447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a6f3f-64af-44c1-b4d4-91b287bd9eb4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:55.793993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:55.794998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:55.795699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:55.796488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:55.799063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:36:55.799750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:55.804742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:55.843577 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1141/2280] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:55.849574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:55.869588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc79f2-d02f-4bb4-bfdb-53f66f798642 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:55.881507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:55.883860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:55.887320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:55.888665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:55.894833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:55.900499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:56.006214 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1140/2281] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:36:55 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:56.020076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:56.051169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac785518-4636-403e-b76b-774ad19b0766 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:56.128134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:56.186651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:56.187716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:56.187716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:56.188000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:56.189267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:56.193294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:56.230095 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1142/2282] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:36:56 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:36:56.231344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:56.275031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1287d-5cc9-40e6-9f7c-95ed046ffa05 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:56.303724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:56.304940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:56.305433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:56.310485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:56.312325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:56.315495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:56.341174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1141/2283] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:56.346634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:56.367472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc47294-f144-4cdd-9cf2-86734bd84598 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:56.379031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cecc91-d395-4d6b-b8f5-dca33da877d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:56.379798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cecc91-d395-4d6b-b8f5-dca33da877d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:56.380087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cecc91-d395-4d6b-b8f5-dca33da877d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:56.380365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cecc91-d395-4d6b-b8f5-dca33da877d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:56.381136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cecc91-d395-4d6b-b8f5-dca33da877d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:56.385575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cecc91-d395-4d6b-b8f5-dca33da877d0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:56.405115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:56.411974 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1143/2284] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:36:56.421612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa277cd-69b9-4871-8844-0a82f86d01ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:56.429050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:56.430596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:56.430981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:56.431395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] PATH_INFO: `/v3/projects/539d0db946ce42d3874dd1005d0bfbc2/users/966707982d9846cbb0200b301b3801aa/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:56.473428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539d0db946ce42d3874dd1005d0bfbc2, user_id=966707982d9846cbb0200b301b3801aa, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:56.484093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:56.525952 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1142/2285] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:36:56 2022] PUT /identity/v3/projects/539d0db946ce42d3874dd1005d0bfbc2/users/966707982d9846cbb0200b301b3801aa/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:56.537843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae26f1-10a9-46ba-9758-6be040ca3390 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:56.538271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae26f1-10a9-46ba-9758-6be040ca3390 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:56.538615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae26f1-10a9-46ba-9758-6be040ca3390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:56.575805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c2ae26f1-10a9-46ba-9758-6be040ca3390 None None] MFA Rules not processed for user `966707982d9846cbb0200b301b3801aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:56.577772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c2ae26f1-10a9-46ba-9758-6be040ca3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:56.673581 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1144/2286] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:56.935624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:56.940676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:57.113722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:57.149315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890fb9b-fce3-45d3-9d76-b75149743388 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:57.168834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d702e8-5b63-48e9-8a70-938230a77bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:57.169806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d702e8-5b63-48e9-8a70-938230a77bc0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:57.170665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d702e8-5b63-48e9-8a70-938230a77bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:57.170665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d702e8-5b63-48e9-8a70-938230a77bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:57.196941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d702e8-5b63-48e9-8a70-938230a77bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:57.198799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d702e8-5b63-48e9-8a70-938230a77bc0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:57.216792 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1143/2287] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:57.386327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae26f1-10a9-46ba-9758-6be040ca3390 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:57.670767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae26f1-10a9-46ba-9758-6be040ca3390 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:57.686029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:57.687681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:57.688172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:57.688841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] PATH_INFO: `/v3/users/966707982d9846cbb0200b301b3801aa` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:57.691642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966707982d9846cbb0200b301b3801aa)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:57.708028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:57.864328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:57.896159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966707982d9846cbb0200b301b3801aa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:57.940200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966707982d9846cbb0200b301b3801aa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:57.944641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966707982d9846cbb0200b301b3801aa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:57.982526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966707982d9846cbb0200b301b3801aa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:57.985244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966707982d9846cbb0200b301b3801aa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:58.049894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1145/2288] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:57 2022] DELETE /identity/v3/users/966707982d9846cbb0200b301b3801aa => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:36:58.056134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:58.058490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:58.059782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:58.146285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:58.152651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:58.410261 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1144/2289] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:58.471045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:58.473472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:58.637953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:58.645160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:58.747679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca64015-4009-4ea3-9e89-71344e0525b1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:58.763342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:58.764594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:58.765120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:58.768960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:58.813917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:58.817380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:58.869046 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1146/2290] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:58.873233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:58.879531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:58.922965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60aa080-f5d8-402c-a9aa-d733ccaf3884 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:58.939976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:58.941618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:58.942813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:58.943308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4dae1-5883-4ca9-8b26-0541257d14f9 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:58.944908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:58.950266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:58.971220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:58.973027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:58.973510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:58.973996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] PATH_INFO: `/v3/projects/c2b5bf90e58d4785a6caeea427f690b3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:58.981577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b5bf90e58d4785a6caeea427f690b3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:58.994416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:59.201985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b5bf90e58d4785a6caeea427f690b3', 'request_id': 'req-e4c8bf30-86d3-4490-bf02-1af29e871f08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.211171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:59.218567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:59.227972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b5bf90e58d4785a6caeea427f690b3', 'request_id': 'req-e4c8bf30-86d3-4490-bf02-1af29e871f08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.253918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b5bf90e58d4785a6caeea427f690b3', 'request_id': 'req-e4c8bf30-86d3-4490-bf02-1af29e871f08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.272578 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1145/2291] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:36:59.323038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] The token cache is being invalidate because project c2b5bf90e58d4785a6caeea427f690b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:36:59.323671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.331748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.336961 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1147/2292] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:58 2022] DELETE /identity/v3/projects/c2b5bf90e58d4785a6caeea427f690b3 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:36:59.342484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:59.362431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3263-b1ab-454a-bec9-4ac059f68771 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:59.382493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:59.492647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:59.493798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:59.494087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:59.494365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] PATH_INFO: `/v3/users/4dd686c468f7432bbb71af8b92d7af9f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:59.497395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd686c468f7432bbb71af8b92d7af9f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:59.498294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:59.572650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd686c468f7432bbb71af8b92d7af9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.593382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd686c468f7432bbb71af8b92d7af9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.610379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd686c468f7432bbb71af8b92d7af9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.612088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd686c468f7432bbb71af8b92d7af9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.629336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c7e604a-0bd8-4669-99dd-9d2028f75cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd686c468f7432bbb71af8b92d7af9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:36:59.642330 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1146/2293] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:36:59 2022] DELETE /identity/v3/users/4dd686c468f7432bbb71af8b92d7af9f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:00.705646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:00.708051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:00.756823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8bf30-86d3-4490-bf02-1af29e871f08 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:00.982703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:01.079775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:01.081777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:01.085738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:01.091981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] PATH_INFO: `/v3/projects/539d0db946ce42d3874dd1005d0bfbc2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:01.097012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539d0db946ce42d3874dd1005d0bfbc2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:01.108813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:01.403407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539d0db946ce42d3874dd1005d0bfbc2', 'request_id': 'req-b6e2f654-a851-4d15-816d-2c167ce960d4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:01.431474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539d0db946ce42d3874dd1005d0bfbc2', 'request_id': 'req-b6e2f654-a851-4d15-816d-2c167ce960d4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:01.468617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539d0db946ce42d3874dd1005d0bfbc2', 'request_id': 'req-b6e2f654-a851-4d15-816d-2c167ce960d4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:01.553557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] The token cache is being invalidate because project 539d0db946ce42d3874dd1005d0bfbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:37:01.561922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:01.564155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b6e2f654-a851-4d15-816d-2c167ce960d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:01.570328 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1148/2294] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:00 2022] DELETE /identity/v3/projects/539d0db946ce42d3874dd1005d0bfbc2 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:01.577557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d62b-51ea-4045-afd6-ec88a499011e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:01.578405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d62b-51ea-4045-afd6-ec88a499011e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:01.578405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d62b-51ea-4045-afd6-ec88a499011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:01.652756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8624d62b-51ea-4045-afd6-ec88a499011e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:01.654242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8624d62b-51ea-4045-afd6-ec88a499011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:01.857038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1147/2295] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:01.867887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6e7b-e52e-4fcd-9070-c79ea5d8b269 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:01.868468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6e7b-e52e-4fcd-9070-c79ea5d8b269 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:01.869303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6e7b-e52e-4fcd-9070-c79ea5d8b269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:01.942109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-925d6e7b-e52e-4fcd-9070-c79ea5d8b269 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:01.947205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-925d6e7b-e52e-4fcd-9070-c79ea5d8b269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:01.985090 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1149/2296] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:01.992272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624d62b-51ea-4045-afd6-ec88a499011e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:02.026816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624d62b-51ea-4045-afd6-ec88a499011e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:02.047996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:02.054201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:02.054911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:02.055577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:02.057228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:37:02.060129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:02.067097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:02.137322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1148/2297] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:37:02.142813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6e7b-e52e-4fcd-9070-c79ea5d8b269 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:02.162653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6e7b-e52e-4fcd-9070-c79ea5d8b269 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:02.183660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:02.192273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:02.193378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:02.195881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:02.197950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:02.203969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:02.304443 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1150/2298] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:37:02 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:02.310723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:02.344447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc7e28-02ed-479a-90c1-71e42fc0a789 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:02.417409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:02.626419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:02.633168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:02.634439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:02.636264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:02.640026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:02.650366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:02.777633 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1149/2299] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:37:02 2022] POST /identity/v3/users => generated 294 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:02.784748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:02.870786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84f7e-eadc-4390-95da-3a2e9a9e0487 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:02.900698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:02.904022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:02.905592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:02.912579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:02.915232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:02.926352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:02.978624 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1151/2300] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:02.985102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:03.054376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574628d-2005-4da8-9ec2-305b9183ffe9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:03.067519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e391c-9b38-4b4f-b417-4d8415244d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:03.070593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e391c-9b38-4b4f-b417-4d8415244d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:03.071602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e391c-9b38-4b4f-b417-4d8415244d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:03.072325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e391c-9b38-4b4f-b417-4d8415244d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:03.075173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e391c-9b38-4b4f-b417-4d8415244d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:03.090002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e391c-9b38-4b4f-b417-4d8415244d96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:03.157029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1150/2301] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:03.162604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:03.195986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9381b7d-b704-4707-93dd-a18d4ccec8d2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:03.234119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:03.235450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:03.235930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:03.236348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] PATH_INFO: `/v3/projects/60ce739658f145558450d454a2928bec/users/ef291d4288eb481dac5564aaeaa81717/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:03.322142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ce739658f145558450d454a2928bec, user_id=ef291d4288eb481dac5564aaeaa81717, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:03.333417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:03.433236 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1152/2302] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:03 2022] PUT /identity/v3/projects/60ce739658f145558450d454a2928bec/users/ef291d4288eb481dac5564aaeaa81717/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:03.440891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:03.443198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:03.443824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:03.511523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:03.520009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:03.795492 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1151/2303] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:03.845565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:03.849422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:04.144919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd983ed-3a8d-4e3f-b458-387c0ddd5883 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:04.157558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:04.159031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:04.159780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:04.160396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:04.226078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:04.229531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:04.256409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1153/2304] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:05.150493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:05.152783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:05.197520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649316b6-1889-415b-9990-a5ee3f6cbde8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:05.214063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:05.218668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:05.219205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:05.219736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] PATH_INFO: `/v3/projects/3e98db1ac3ee404c9d63572599c19654` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:05.226477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e98db1ac3ee404c9d63572599c19654)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:05.234758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:05.317116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:05.319603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:05.339014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:05.371082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e98db1ac3ee404c9d63572599c19654', 'request_id': 'req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:05.407537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e98db1ac3ee404c9d63572599c19654', 'request_id': 'req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:05.422295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e98db1ac3ee404c9d63572599c19654', 'request_id': 'req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:05.456969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] The token cache is being invalidate because project 3e98db1ac3ee404c9d63572599c19654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:37:05.457451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:05.460172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca867b4e-6ce1-45e3-9cd1-133b4c2b45f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:05.463180 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1152/2305] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:05 2022] DELETE /identity/v3/projects/3e98db1ac3ee404c9d63572599c19654 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:05.473482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536449c0-4b3c-48e7-93e4-33828436f81b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:05.473934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536449c0-4b3c-48e7-93e4-33828436f81b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:05.474408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536449c0-4b3c-48e7-93e4-33828436f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:05.518926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-536449c0-4b3c-48e7-93e4-33828436f81b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:05.520548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-536449c0-4b3c-48e7-93e4-33828436f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:05.550112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac9d1-b609-4f6c-87b1-39a212038474 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:05.572332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:05.753311 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1153/2306] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:05.767895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398d7de-6074-450f-bbba-c5b6927cd108 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:05.768243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398d7de-6074-450f-bbba-c5b6927cd108 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:05.768929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398d7de-6074-450f-bbba-c5b6927cd108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:05.804336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:05.805046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:05.805436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:05.807616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:05.808506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b398d7de-6074-450f-bbba-c5b6927cd108 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:05.811791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b398d7de-6074-450f-bbba-c5b6927cd108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:05.814778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:05.833351 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1154/2307] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 14 14:37:05.835315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398d7de-6074-450f-bbba-c5b6927cd108 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:05.854331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398d7de-6074-450f-bbba-c5b6927cd108 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:05.861593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:05.861593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:05.862058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:05.862324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:05.864627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:37:05.865318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:05.868962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:05.897816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1155/2308] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:37:05.904612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:05.920752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297b6f0-7d53-46b3-9e99-dedc9eff0546 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:05.934544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:05.936170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:05.936662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:05.937154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:05.938170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:05.943417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:05.949547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:05.951558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:05.966225 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1154/2309] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:06.005130 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1156/2310] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:37:05 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:06.012305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:06.040515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0df701-7c79-4810-a5b2-0279637d4e99 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:06.143097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:06.187253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:06.189106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:06.190698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:06.190997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:06.191786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:06.195424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:06.239622 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1155/2311] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:37:06 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:06.244389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:06.264218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4656-29b8-472c-840c-c80d038d256b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:06.276154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:06.276880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:06.277549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:06.277842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:06.278631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:06.283173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:06.315153 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1157/2312] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:06.319467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:06.347874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d035078-3f76-490c-8481-cfbd5889a76e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:06.362083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263969e4-ca78-4325-8c33-44cac4e6b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:06.365385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263969e4-ca78-4325-8c33-44cac4e6b3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:06.366583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263969e4-ca78-4325-8c33-44cac4e6b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:06.367079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263969e4-ca78-4325-8c33-44cac4e6b3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:06.368189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263969e4-ca78-4325-8c33-44cac4e6b3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:06.371360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263969e4-ca78-4325-8c33-44cac4e6b3b6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:06.396527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1156/2313] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:06.403534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:06.435995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e6fb-f1ac-4e34-a4c7-5aaf8e3a8389 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:06.449098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:06.450601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:06.451716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:06.455745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] PATH_INFO: `/v3/projects/19e523df068d48f6a735e1e79b7d949a/users/12548f6689c34bfd9f17d0320b0c3ec6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:06.487040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e523df068d48f6a735e1e79b7d949a, user_id=12548f6689c34bfd9f17d0320b0c3ec6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:06.492641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:06.559761 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1158/2314] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:06 2022] PUT /identity/v3/projects/19e523df068d48f6a735e1e79b7d949a/users/12548f6689c34bfd9f17d0320b0c3ec6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:06.588658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc894be-451e-42d9-949b-9698b20dd7d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:06.588931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc894be-451e-42d9-949b-9698b20dd7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:06.589275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc894be-451e-42d9-949b-9698b20dd7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:06.668328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-adc894be-451e-42d9-949b-9698b20dd7d0 None None] MFA Rules not processed for user `12548f6689c34bfd9f17d0320b0c3ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:06.669836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-adc894be-451e-42d9-949b-9698b20dd7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:06.847971 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1157/2315] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:06.860196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:07.092965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc18f8-1b1a-46c9-8869-24c9edab6c5c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:07.105735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:07.106527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:07.106812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:07.107468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:07.110230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:07.114442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:07.260840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc894be-451e-42d9-949b-9698b20dd7d0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:07.269660 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1159/2316] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:37:06 2022] POST /identity/v3/projects => generated 389 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:07.287396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc894be-451e-42d9-949b-9698b20dd7d0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:07.561596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543ebf-6ded-4390-84de-2d95ab85fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:07.563902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543ebf-6ded-4390-84de-2d95ab85fc45 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:07.564293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543ebf-6ded-4390-84de-2d95ab85fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:07.564734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543ebf-6ded-4390-84de-2d95ab85fc45 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:07.565579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543ebf-6ded-4390-84de-2d95ab85fc45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:07.568173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543ebf-6ded-4390-84de-2d95ab85fc45 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:07.624466 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1158/2317] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:37:07 2022] POST /identity/v3/users => generated 301 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:07.629074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:07.657884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ace7-0b50-4309-9b68-534335fb58ff None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:07.658250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ace7-0b50-4309-9b68-534335fb58ff None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:07.658494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ace7-0b50-4309-9b68-534335fb58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:07.672255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dddb44-d798-4057-a1f1-088f402e4794 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:07.689264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:07.691814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:07.696168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:07.697504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:07.699227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:07.702080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-74b9ace7-0b50-4309-9b68-534335fb58ff None None] MFA Rules not processed for user `80a79275009a41e38a6d41e10bc6c066`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:07.705482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74b9ace7-0b50-4309-9b68-534335fb58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:07.707306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:07.774831 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1160/2318] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:07.783600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:07.840160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4311d-f5f0-4a65-913c-ea0203be7266 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:07.869661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:07.883857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:07.890271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:07.890872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] PATH_INFO: `/v3/projects/20a5b0593b77401ca96deb2388abd5a8/users/66e589bd05ed47afbf5cefdc79368346/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:07.903927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:07.926713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a5b0593b77401ca96deb2388abd5a8, user_id=66e589bd05ed47afbf5cefdc79368346, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:07.934745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:07.948819 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1159/2319] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:07.975664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:07.990089 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1161/2320] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:07 2022] PUT /identity/v3/projects/20a5b0593b77401ca96deb2388abd5a8/users/66e589bd05ed47afbf5cefdc79368346/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:07.996302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9ace7-0b50-4309-9b68-534335fb58ff None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:08.015725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9ace7-0b50-4309-9b68-534335fb58ff None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:08.134708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47b042-c938-4003-979c-845f651c696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:08.135518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47b042-c938-4003-979c-845f651c696c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:08.136194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47b042-c938-4003-979c-845f651c696c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:08.136566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47b042-c938-4003-979c-845f651c696c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:08.138786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47b042-c938-4003-979c-845f651c696c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:08.140612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47b042-c938-4003-979c-845f651c696c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:08.156476 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1160/2321] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:08.160524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:08.209079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8bb0-0d70-4a83-bfe6-f769a2ead322 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:08.247524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:08.249062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:08.249484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:08.249919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] PATH_INFO: `/v3/projects/20a5b0593b77401ca96deb2388abd5a8/users/66e589bd05ed47afbf5cefdc79368346/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:08.253843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a5b0593b77401ca96deb2388abd5a8, user_id=66e589bd05ed47afbf5cefdc79368346, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:08.260821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:08.288859 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1162/2322] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:08 2022] PUT /identity/v3/projects/20a5b0593b77401ca96deb2388abd5a8/users/66e589bd05ed47afbf5cefdc79368346/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:37:08.301196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51f6f-ff65-4085-a543-cd13214f14d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:08.301722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51f6f-ff65-4085-a543-cd13214f14d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:08.302229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51f6f-ff65-4085-a543-cd13214f14d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:08.371034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a7f51f6f-ff65-4085-a543-cd13214f14d0 None None] MFA Rules not processed for user `66e589bd05ed47afbf5cefdc79368346`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:08.375256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a7f51f6f-ff65-4085-a543-cd13214f14d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:08.542508 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1161/2323] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:09.408633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:09.411440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:09.644094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0153c-cb8c-4e9b-b624-b5b2a1228b6f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:09.653390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:09.654523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:09.655033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:09.655669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:09.769069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:09.771050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:09.784520 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1163/2324] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:37:12.097301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85321b8e-24ba-4cab-97c0-d640f390f646 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:12.098264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85321b8e-24ba-4cab-97c0-d640f390f646 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:12.098738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85321b8e-24ba-4cab-97c0-d640f390f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:12.166224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-85321b8e-24ba-4cab-97c0-d640f390f646 None None] MFA Rules not processed for user `160fe1ec6b2d45e48990558af381a0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:12.167532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-85321b8e-24ba-4cab-97c0-d640f390f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:12.401973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:12.438666 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1162/2325] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:37:12.440139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:12.441808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:12.597249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74202a-be9e-46f5-9401-57b86b0cbb6d service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:12.616917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:12.617665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:12.617947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:12.618410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:12.619371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:12.622092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:12.695173 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1164/2326] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:37:12 2022] POST /identity/v3/projects => generated 399 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:37:12.698585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85321b8e-24ba-4cab-97c0-d640f390f646 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:12.726598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85321b8e-24ba-4cab-97c0-d640f390f646 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:12.940385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:12.941382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:12.941620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:12.941913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:12.942685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:12.952411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:12.998741 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1163/2327] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:37:12 2022] POST /identity/v3/users => generated 306 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:13.003771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:13.059500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c012e-af0e-47d7-91d6-14305f364ebe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:13.083181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:13.085036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:13.085565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:13.086203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:13.087644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:13.093329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:13.097298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:13.124491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1165/2328] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:37:13.125440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:13.150942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f671ffc-7e5f-46ae-8fe1-19445db91aa5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:13.161402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:13.163307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:13.163796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:13.164179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] PATH_INFO: `/v3/projects/acc8515302ea49fc8741ea90168af96e/users/35ce03a26c00427186bb40ca3702ab57/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:13.194941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc8515302ea49fc8741ea90168af96e, user_id=35ce03a26c00427186bb40ca3702ab57, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:13.201421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:13.254850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:13.255602 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1164/2329] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:13 2022] PUT /identity/v3/projects/acc8515302ea49fc8741ea90168af96e/users/35ce03a26c00427186bb40ca3702ab57/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:37:13.283026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1626-977d-4c68-ab24-3ac74e801d3c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:13.656723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681da30-4299-4448-aeeb-99df88daf095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:13.657939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681da30-4299-4448-aeeb-99df88daf095 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:13.658633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681da30-4299-4448-aeeb-99df88daf095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:13.659246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681da30-4299-4448-aeeb-99df88daf095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:13.661000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681da30-4299-4448-aeeb-99df88daf095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:13.667708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681da30-4299-4448-aeeb-99df88daf095 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:13.716046 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1166/2330] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:13.719883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:13.784064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80324e-11f9-4c33-8638-4a09c6bfaddd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:13.827738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e433ac-1896-47a5-8a0c-6813f448c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:13.829406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e433ac-1896-47a5-8a0c-6813f448c9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:13.829926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e433ac-1896-47a5-8a0c-6813f448c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:13.835963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e433ac-1896-47a5-8a0c-6813f448c9c0 admin admin] PATH_INFO: `/v3/projects/acc8515302ea49fc8741ea90168af96e/users/35ce03a26c00427186bb40ca3702ab57/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:13.847982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e433ac-1896-47a5-8a0c-6813f448c9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc8515302ea49fc8741ea90168af96e, user_id=35ce03a26c00427186bb40ca3702ab57, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:13.861750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e433ac-1896-47a5-8a0c-6813f448c9c0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:13.928798 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1165/2331] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:13 2022] PUT /identity/v3/projects/acc8515302ea49fc8741ea90168af96e/users/35ce03a26c00427186bb40ca3702ab57/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:14.203181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d58ed-630b-46a6-8aeb-dd35338e0166 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:14.203506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d58ed-630b-46a6-8aeb-dd35338e0166 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:14.203824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d58ed-630b-46a6-8aeb-dd35338e0166 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:14.205774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1167/2332] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:37:14.234820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053b936-da92-4a38-8f4d-57c18e4a9c54 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:14.235451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053b936-da92-4a38-8f4d-57c18e4a9c54 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:14.236092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053b936-da92-4a38-8f4d-57c18e4a9c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:14.319912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9053b936-da92-4a38-8f4d-57c18e4a9c54 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:14.328167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9053b936-da92-4a38-8f4d-57c18e4a9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:14.701489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1166/2333] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:37:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:14.750962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d58ed-630b-46a6-8aeb-dd35338e0166 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:14.756988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-598d58ed-630b-46a6-8aeb-dd35338e0166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:14.851701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d58ed-630b-46a6-8aeb-dd35338e0166 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:14.872453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c10a8-be78-4dab-b47b-cde8c9dc41e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:14.873987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c10a8-be78-4dab-b47b-cde8c9dc41e2 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:14.877503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c10a8-be78-4dab-b47b-cde8c9dc41e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:14.878148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c10a8-be78-4dab-b47b-cde8c9dc41e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:14.903245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c10a8-be78-4dab-b47b-cde8c9dc41e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:14.907713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c10a8-be78-4dab-b47b-cde8c9dc41e2 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:14.938738 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1168/2334] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:15.498281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053b936-da92-4a38-8f4d-57c18e4a9c54 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:15.516412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053b936-da92-4a38-8f4d-57c18e4a9c54 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:15.539862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc5e59-6dd3-4ad2-8efe-f894807277fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:15.541702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc5e59-6dd3-4ad2-8efe-f894807277fe service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:15.543921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc5e59-6dd3-4ad2-8efe-f894807277fe service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:15.545881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc5e59-6dd3-4ad2-8efe-f894807277fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:15.554134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44bc5e59-6dd3-4ad2-8efe-f894807277fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:15.592885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc5e59-6dd3-4ad2-8efe-f894807277fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:15.595436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc5e59-6dd3-4ad2-8efe-f894807277fe service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:15.624592 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1167/2335] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:37:16.435667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd97c8-57b4-44cd-865f-aaaf461298db None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:16.436187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd97c8-57b4-44cd-865f-aaaf461298db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:16.436283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd97c8-57b4-44cd-865f-aaaf461298db None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:16.439295 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1169/2336] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:37:16.448893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafbb10-ce01-4894-b913-80814de4a6ea None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:16.449200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafbb10-ce01-4894-b913-80814de4a6ea None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:16.449503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafbb10-ce01-4894-b913-80814de4a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:16.532697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8dafbb10-ce01-4894-b913-80814de4a6ea None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:16.533977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8dafbb10-ce01-4894-b913-80814de4a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:16.620845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:16.779839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1168/2337] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:37:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:16.938116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd97c8-57b4-44cd-865f-aaaf461298db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:16.940139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffcd97c8-57b4-44cd-865f-aaaf461298db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:17.093676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd97c8-57b4-44cd-865f-aaaf461298db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:17.103950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:17.108180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:17.108998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:17.109442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:17.149125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:17.151997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:17.203212 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1170/2338] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:17.251027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:17.251599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:17.252064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:17.295814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:17.302460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:17.318778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1169/2339] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:37:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:37:17.549501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:17.589457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840fce-a63e-4d0c-9920-9c1ea3d8e107 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:17.609057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b325009-0775-4cb1-a290-51da63cb3f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:17.611479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325009-0775-4cb1-a290-51da63cb3f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:17.612170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325009-0775-4cb1-a290-51da63cb3f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:17.612712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325009-0775-4cb1-a290-51da63cb3f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:17.630036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b325009-0775-4cb1-a290-51da63cb3f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:17.636227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b325009-0775-4cb1-a290-51da63cb3f36 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:17.666158 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1171/2340] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:18.241261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:18.244244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:18.300237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452682-c80f-4580-b1af-d3a8a1f729e2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:18.317659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56074cbb-d59e-4756-8456-d99bbb419562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:18.319740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56074cbb-d59e-4756-8456-d99bbb419562 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:18.320327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56074cbb-d59e-4756-8456-d99bbb419562 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:18.320821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56074cbb-d59e-4756-8456-d99bbb419562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:18.423716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56074cbb-d59e-4756-8456-d99bbb419562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:18.425401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56074cbb-d59e-4756-8456-d99bbb419562 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:18.455812 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1170/2341] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:37:19.954541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c93be-474a-46a1-a48b-f4efc5f996c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:19.955736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c93be-474a-46a1-a48b-f4efc5f996c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:19.955736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c93be-474a-46a1-a48b-f4efc5f996c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:20.029225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-072c93be-474a-46a1-a48b-f4efc5f996c1 None None] MFA Rules not processed for user `e50d4c0db2134001bddd5695d79cc66e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:20.030819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-072c93be-474a-46a1-a48b-f4efc5f996c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:20.226645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:20.257192 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1172/2342] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:20.279969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1aba-6404-495e-ab4a-386d6b836dfd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:20.280765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1aba-6404-495e-ab4a-386d6b836dfd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:20.280765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1aba-6404-495e-ab4a-386d6b836dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:20.302169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-999b1aba-6404-495e-ab4a-386d6b836dfd None None] MFA Rules not processed for user `038556a90129478eb04699f574ea7e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:20.303416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-999b1aba-6404-495e-ab4a-386d6b836dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:20.382677 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1171/2343] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:37:21.075263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c93be-474a-46a1-a48b-f4efc5f996c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:21.090740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c93be-474a-46a1-a48b-f4efc5f996c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:21.101062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c377cdf-b218-493b-bd58-d9a8e7405010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:21.102221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377cdf-b218-493b-bd58-d9a8e7405010 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:21.102850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377cdf-b218-493b-bd58-d9a8e7405010 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:21.103709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377cdf-b218-493b-bd58-d9a8e7405010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:21.115025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c377cdf-b218-493b-bd58-d9a8e7405010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:21.130940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c377cdf-b218-493b-bd58-d9a8e7405010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:21.132950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c377cdf-b218-493b-bd58-d9a8e7405010 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:21.168022 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1173/2344] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:22.260471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b3185-f50c-4a07-a8e1-1c44ad1fe803 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:22.270775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b3185-f50c-4a07-a8e1-1c44ad1fe803 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:22.271659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b3185-f50c-4a07-a8e1-1c44ad1fe803 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:22.275106 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1172/2345] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:37:22 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:37:22.282615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ca75f-405a-4abc-a585-c6b9d86a2e10 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:22.284149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ca75f-405a-4abc-a585-c6b9d86a2e10 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:22.284880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ca75f-405a-4abc-a585-c6b9d86a2e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:22.336542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ba8ca75f-405a-4abc-a585-c6b9d86a2e10 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:22.337796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba8ca75f-405a-4abc-a585-c6b9d86a2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:22.361284 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1174/2346] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:37:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:22.397513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b3185-f50c-4a07-a8e1-1c44ad1fe803 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:22.422094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b3185-f50c-4a07-a8e1-1c44ad1fe803 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:22.430229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1206f-89d7-4939-9dde-acc3908c267e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:22.431544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1206f-89d7-4939-9dde-acc3908c267e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:22.432574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1206f-89d7-4939-9dde-acc3908c267e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:22.433244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1206f-89d7-4939-9dde-acc3908c267e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:22.452511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1206f-89d7-4939-9dde-acc3908c267e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:22.458159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1206f-89d7-4939-9dde-acc3908c267e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:22.487358 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1173/2347] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:28.768300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ca75f-405a-4abc-a585-c6b9d86a2e10 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:28.813891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ca75f-405a-4abc-a585-c6b9d86a2e10 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:28.840060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a58c-bea6-4a5d-9f5e-b8b4c24291ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:28.841936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a58c-bea6-4a5d-9f5e-b8b4c24291ce service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:28.842691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a58c-bea6-4a5d-9f5e-b8b4c24291ce service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:28.843474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a58c-bea6-4a5d-9f5e-b8b4c24291ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:28.848191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51a3a58c-bea6-4a5d-9f5e-b8b4c24291ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:29.066185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a58c-bea6-4a5d-9f5e-b8b4c24291ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:29.070696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a58c-bea6-4a5d-9f5e-b8b4c24291ce service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:29.144839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1175/2348] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:29.223086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a4642-fa8f-45d2-b4c0-d5af1538812d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:29.223935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a4642-fa8f-45d2-b4c0-d5af1538812d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:29.226376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a4642-fa8f-45d2-b4c0-d5af1538812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:29.319025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e93a4642-fa8f-45d2-b4c0-d5af1538812d None None] MFA Rules not processed for user `82254dd6dfcc4f2f96995a0133a901b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:29.322447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e93a4642-fa8f-45d2-b4c0-d5af1538812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:29.503745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:29.553750 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1174/2349] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:31.559090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aabce0-d59d-4796-8d79-5f18b767c479 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:31.559963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aabce0-d59d-4796-8d79-5f18b767c479 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:31.559963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aabce0-d59d-4796-8d79-5f18b767c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:31.663716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-84aabce0-d59d-4796-8d79-5f18b767c479 None None] MFA Rules not processed for user `ef291d4288eb481dac5564aaeaa81717`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:31.665073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84aabce0-d59d-4796-8d79-5f18b767c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:31.876218 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1176/2350] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:33.943967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a4642-fa8f-45d2-b4c0-d5af1538812d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:33.967112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a4642-fa8f-45d2-b4c0-d5af1538812d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:33.997672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:33.998183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:33.998472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:33.998751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:34.022800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:34.026141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:34.044023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1175/2351] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:37:38.923944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89948c-314c-4f1c-9570-e8dc66960cff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:38.924534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89948c-314c-4f1c-9570-e8dc66960cff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:38.924534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89948c-314c-4f1c-9570-e8dc66960cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:38.957435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f89948c-314c-4f1c-9570-e8dc66960cff None None] MFA Rules not processed for user `35ce03a26c00427186bb40ca3702ab57`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:38.959021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f89948c-314c-4f1c-9570-e8dc66960cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:39.034791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:39.089286 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1177/2352] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:39.891019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:39.938396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d388cb-f170-4e5f-a206-607b98d2390a service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:39.952301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4788e-6729-4479-be48-9d9470738c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:39.953840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4788e-6729-4479-be48-9d9470738c8d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:39.954289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4788e-6729-4479-be48-9d9470738c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:39.954578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4788e-6729-4479-be48-9d9470738c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:40.131409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4788e-6729-4479-be48-9d9470738c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:40.133169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4788e-6729-4479-be48-9d9470738c8d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:40.144184 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1176/2353] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:41.000736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89948c-314c-4f1c-9570-e8dc66960cff None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:41.028618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89948c-314c-4f1c-9570-e8dc66960cff None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:41.043753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead752ad-9ac7-42e9-8153-b27929108082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:41.044603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead752ad-9ac7-42e9-8153-b27929108082 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:41.044987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead752ad-9ac7-42e9-8153-b27929108082 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:41.045250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead752ad-9ac7-42e9-8153-b27929108082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:41.069799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead752ad-9ac7-42e9-8153-b27929108082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:41.073759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead752ad-9ac7-42e9-8153-b27929108082 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:41.107790 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1178/2354] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:42.784799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6ee16-60a4-4c07-9ae4-de4fb95068e4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:42.788429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6ee16-60a4-4c07-9ae4-de4fb95068e4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:42.790286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6ee16-60a4-4c07-9ae4-de4fb95068e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:42.821260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cef6ee16-60a4-4c07-9ae4-de4fb95068e4 None None] MFA Rules not processed for user `aeb3928894284b77b4aea925a38470ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:42.822890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cef6ee16-60a4-4c07-9ae4-de4fb95068e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:42.930938 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1177/2355] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:43.744080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60f221-7503-4c2f-abec-c1f38a61b15b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:43.745488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60f221-7503-4c2f-abec-c1f38a61b15b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:43.746241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60f221-7503-4c2f-abec-c1f38a61b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:43.794992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7c60f221-7503-4c2f-abec-c1f38a61b15b None None] MFA Rules not processed for user `cdac1d4106674c7ab0cfe39939de9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:43.798619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c60f221-7503-4c2f-abec-c1f38a61b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:43.982491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1179/2356] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:44.885328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6ee16-60a4-4c07-9ae4-de4fb95068e4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:45.024013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6ee16-60a4-4c07-9ae4-de4fb95068e4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:45.029848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:45.031232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:45.033026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:45.033639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] PATH_INFO: `/v3/users/12548f6689c34bfd9f17d0320b0c3ec6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:45.035490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12548f6689c34bfd9f17d0320b0c3ec6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:45.039952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:45.071087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:45.139881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12548f6689c34bfd9f17d0320b0c3ec6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:45.180058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12548f6689c34bfd9f17d0320b0c3ec6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:45.183842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12548f6689c34bfd9f17d0320b0c3ec6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:45.203676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12548f6689c34bfd9f17d0320b0c3ec6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:45.208311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12548f6689c34bfd9f17d0320b0c3ec6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:45.242670 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1178/2357] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:37:44 2022] DELETE /identity/v3/users/12548f6689c34bfd9f17d0320b0c3ec6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:45.244468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:45.245132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:45.245132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:45.278824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:45.284153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:45.563552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1180/2358] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:45.580750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:45.582492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:45.792522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f783-96cd-41d4-81a5-42a6f974fc0c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:45.800404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:45.801709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:45.802844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:45.803447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:45.834433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:45.836151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:45.866021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1179/2359] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:46.622873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:46.626725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:46.648196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410d65-f864-4353-9a57-c41126d9e853 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:46.657312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:46.661154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:46.662025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:46.662711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] PATH_INFO: `/v3/projects/19e523df068d48f6a735e1e79b7d949a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:46.679209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e523df068d48f6a735e1e79b7d949a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:46.683956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:46.837302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e523df068d48f6a735e1e79b7d949a', 'request_id': 'req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:46.861540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e523df068d48f6a735e1e79b7d949a', 'request_id': 'req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:46.876758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e523df068d48f6a735e1e79b7d949a', 'request_id': 'req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:46.900342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:46.926539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] The token cache is being invalidate because project 19e523df068d48f6a735e1e79b7d949a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:37:46.928185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:46.930618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:46.940568 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1181/2360] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:46 2022] DELETE /identity/v3/projects/19e523df068d48f6a735e1e79b7d949a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:46.952015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:46.981778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c349ced-4fbb-410d-9b8b-3fc57f3e3bea service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:47.223800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:47.225911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:47.227470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:47.228044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] PATH_INFO: `/v3/users/66e589bd05ed47afbf5cefdc79368346` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:47.230915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e589bd05ed47afbf5cefdc79368346)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:47.236520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:47.359000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:47.386670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e589bd05ed47afbf5cefdc79368346'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:47.446399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e589bd05ed47afbf5cefdc79368346'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:47.447753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e589bd05ed47afbf5cefdc79368346'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:47.482775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e589bd05ed47afbf5cefdc79368346'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:47.486636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b74ad870-ee6c-41f3-90c8-8f4d9375af04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e589bd05ed47afbf5cefdc79368346'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:47.547796 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1180/2361] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:37:46 2022] DELETE /identity/v3/users/66e589bd05ed47afbf5cefdc79368346 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:48.182322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:48.185811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:48.256930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a9313-6f5b-48df-b6e8-a2ed10306f26 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:48.453773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:48.456270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:48.456735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:48.457606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] PATH_INFO: `/v3/projects/20a5b0593b77401ca96deb2388abd5a8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:48.460815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a5b0593b77401ca96deb2388abd5a8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:48.464444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:48.634885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a5b0593b77401ca96deb2388abd5a8', 'request_id': 'req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:48.654342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a5b0593b77401ca96deb2388abd5a8', 'request_id': 'req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:48.672692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a5b0593b77401ca96deb2388abd5a8', 'request_id': 'req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:48.778388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] The token cache is being invalidate because project 20a5b0593b77401ca96deb2388abd5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:37:48.784900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:48.796282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54414b6f-a2f7-4414-ad43-4cf79f6c4f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:48.799943 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1182/2362] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:48 2022] DELETE /identity/v3/projects/20a5b0593b77401ca96deb2388abd5a8 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:48.805443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ec4c3-309f-4008-a2a5-7218277c516a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:48.807531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ec4c3-309f-4008-a2a5-7218277c516a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:48.807997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ec4c3-309f-4008-a2a5-7218277c516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:48.839476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8c9ec4c3-309f-4008-a2a5-7218277c516a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:48.841779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c9ec4c3-309f-4008-a2a5-7218277c516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:48.931641 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1181/2363] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:48.942894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a117-4a40-4086-a198-f4a50ead771d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:48.942894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a117-4a40-4086-a198-f4a50ead771d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:48.942894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a117-4a40-4086-a198-f4a50ead771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:48.982903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d878a117-4a40-4086-a198-f4a50ead771d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:48.987258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d878a117-4a40-4086-a198-f4a50ead771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:49.014361 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1183/2364] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:49.016793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ec4c3-309f-4008-a2a5-7218277c516a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:49.034348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ec4c3-309f-4008-a2a5-7218277c516a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:49.050296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:49.051176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:49.052035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:49.055909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:49.057008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:37:49.057616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:49.063311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:49.111498 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1182/2365] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:37:49.115586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a117-4a40-4086-a198-f4a50ead771d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:49.129964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a117-4a40-4086-a198-f4a50ead771d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:49.139104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:49.140091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:49.140524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:49.142745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:49.143852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:49.147205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:49.227598 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1184/2366] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:49.228631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:49.246101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45ed65-0b5e-404f-b3c8-65ee5752e47c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:49.363134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:49.364051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:49.364408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:49.365104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:49.366095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:49.369800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:49.426561 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1183/2367] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:37:49 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:37:49.431541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:49.458115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330ca7-39a1-45df-b81c-474f44605fe1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:49.473827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:49.475398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:49.475783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:49.476091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:49.477024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:49.478837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:49.511076 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1185/2368] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:49.515166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:49.548714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee77a5-14a7-4840-8848-5d41c5866818 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:49.586675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a957eb5-a9b3-4c83-a57e-635c6ef17744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:49.592284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957eb5-a9b3-4c83-a57e-635c6ef17744 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:49.594157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957eb5-a9b3-4c83-a57e-635c6ef17744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:49.596243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957eb5-a9b3-4c83-a57e-635c6ef17744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:49.600298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a957eb5-a9b3-4c83-a57e-635c6ef17744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:49.609082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a957eb5-a9b3-4c83-a57e-635c6ef17744 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:49.669143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1184/2369] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:49.675493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:49.720760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb1d62-03e1-4357-a559-a2f97d50b9c1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:49.749586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:49.756994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:49.758407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:49.759667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] PATH_INFO: `/v3/projects/b1c0e8ba57d34db18ed461dc962a5e83/users/0fcd19b670624ba3afda2975aef28523/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:49.816174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c0e8ba57d34db18ed461dc962a5e83, user_id=0fcd19b670624ba3afda2975aef28523, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:49.822678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:49.863244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1186/2370] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:49 2022] PUT /identity/v3/projects/b1c0e8ba57d34db18ed461dc962a5e83/users/0fcd19b670624ba3afda2975aef28523/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:49.876759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9fadc-6c9d-494c-8673-04b314f2564e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:49.877246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9fadc-6c9d-494c-8673-04b314f2564e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:49.877848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9fadc-6c9d-494c-8673-04b314f2564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:49.943587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0ce9fadc-6c9d-494c-8673-04b314f2564e None None] MFA Rules not processed for user `0fcd19b670624ba3afda2975aef28523`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:49.945999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ce9fadc-6c9d-494c-8673-04b314f2564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:49.973397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:50.097766 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1185/2371] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:50.103617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:50.216134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:50.327602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c9638-5a65-4849-a166-6d7e94100da1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:50.342878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:50.343632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:50.344046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:50.344337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:50.345085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:50.347385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:50.404979 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1187/2372] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:37:50 2022] POST /identity/v3/projects => generated 375 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:37:50.405985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9fadc-6c9d-494c-8673-04b314f2564e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:50.428457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9fadc-6c9d-494c-8673-04b314f2564e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:50.603728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:50.605640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:50.606609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:50.607488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:50.609625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:50.614115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:50.686801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1186/2373] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:37:50 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:37:50.689587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:50.710006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f538311-6e87-46e0-9b26-9397db3e4154 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:50.729416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:50.730151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:50.730447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:50.730738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:50.731557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:50.733320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:50.763052 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1188/2374] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:37:50.764981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:50.780590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bf51-e9b2-48e9-a603-0c56c56fa70f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:50.796450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:50.797876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:50.798793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:50.799096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] PATH_INFO: `/v3/projects/d20ef74afe3748a3bdc4372b07f57c4a/users/18ad404b202d4b0ea3e30ba98aaf9960/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:50.847146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20ef74afe3748a3bdc4372b07f57c4a, user_id=18ad404b202d4b0ea3e30ba98aaf9960, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:50.851127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:50.889319 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1187/2375] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:50 2022] PUT /identity/v3/projects/d20ef74afe3748a3bdc4372b07f57c4a/users/18ad404b202d4b0ea3e30ba98aaf9960/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:50.899260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:50.912506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ec3d9-9907-442a-8608-55d9430195a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:51.088326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a029cd-9007-4b85-8e1c-8c421f4eb7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:51.090465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a029cd-9007-4b85-8e1c-8c421f4eb7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:51.091794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a029cd-9007-4b85-8e1c-8c421f4eb7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:51.093443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a029cd-9007-4b85-8e1c-8c421f4eb7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:51.095966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a029cd-9007-4b85-8e1c-8c421f4eb7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:51.100119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a029cd-9007-4b85-8e1c-8c421f4eb7a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:51.126583 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1189/2376] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:37:51.132284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:51.158160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662583-03e2-423e-a229-6d8350b3810d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:51.168477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bead1b-d63a-46bb-8f89-65f22d853a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:51.170662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bead1b-d63a-46bb-8f89-65f22d853a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:51.171633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bead1b-d63a-46bb-8f89-65f22d853a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:51.172813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bead1b-d63a-46bb-8f89-65f22d853a03 admin admin] PATH_INFO: `/v3/projects/d20ef74afe3748a3bdc4372b07f57c4a/users/18ad404b202d4b0ea3e30ba98aaf9960/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:51.178645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bead1b-d63a-46bb-8f89-65f22d853a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20ef74afe3748a3bdc4372b07f57c4a, user_id=18ad404b202d4b0ea3e30ba98aaf9960, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:51.187406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bead1b-d63a-46bb-8f89-65f22d853a03 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:51.222950 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1188/2377] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:37:51 2022] PUT /identity/v3/projects/d20ef74afe3748a3bdc4372b07f57c4a/users/18ad404b202d4b0ea3e30ba98aaf9960/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:51.233821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018e2a-e4ff-4c28-9880-cf0dbe18c5d3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:51.234120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018e2a-e4ff-4c28-9880-cf0dbe18c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:51.234410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018e2a-e4ff-4c28-9880-cf0dbe18c5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:51.270023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f6018e2a-e4ff-4c28-9880-cf0dbe18c5d3 None None] MFA Rules not processed for user `18ad404b202d4b0ea3e30ba98aaf9960`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:51.272263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6018e2a-e4ff-4c28-9880-cf0dbe18c5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:51.372759 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1190/2378] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:51.441188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:51.441503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:51.441793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:51.445767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2edc21-37f6-4c66-b0c6-a86636ad6543 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:51.446061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2edc21-37f6-4c66-b0c6-a86636ad6543 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:51.446349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2edc21-37f6-4c66-b0c6-a86636ad6543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:51.465079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] MFA Rules not processed for user `0fcd19b670624ba3afda2975aef28523`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:51.466489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:51.467147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ce2edc21-37f6-4c66-b0c6-a86636ad6543 None None] MFA Rules not processed for user `160fe1ec6b2d45e48990558af381a0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:51.468554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce2edc21-37f6-4c66-b0c6-a86636ad6543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:51.494509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:51.563514 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1189/2379] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:37:51.568270 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1191/2380] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:37:52.347050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:52.347906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:52.381354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:52.532856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c655c88-51a3-4857-98a6-8f598d0d66f6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:52.544868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf3199-5c52-44b6-92b5-2210fec34079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:52.546050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf3199-5c52-44b6-92b5-2210fec34079 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:52.546526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf3199-5c52-44b6-92b5-2210fec34079 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:52.547012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf3199-5c52-44b6-92b5-2210fec34079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:52.562728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf3199-5c52-44b6-92b5-2210fec34079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:52.566174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf3199-5c52-44b6-92b5-2210fec34079 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:52.583315 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1190/2381] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:54.744399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2edc21-37f6-4c66-b0c6-a86636ad6543 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:54.764159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2edc21-37f6-4c66-b0c6-a86636ad6543 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:54.772944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1e38e-3db0-4798-92d7-2beff53e71a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:54.773950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1e38e-3db0-4798-92d7-2beff53e71a4 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:54.774417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1e38e-3db0-4798-92d7-2beff53e71a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:54.774908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1e38e-3db0-4798-92d7-2beff53e71a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:54.777761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61d1e38e-3db0-4798-92d7-2beff53e71a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:54.920678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1e38e-3db0-4798-92d7-2beff53e71a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:54.922378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1e38e-3db0-4798-92d7-2beff53e71a4 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:54.939365 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1192/2382] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:57.730904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15dd7-a995-4320-8c7c-f41f84c33b7a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:57.731800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15dd7-a995-4320-8c7c-f41f84c33b7a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:57.731800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a15dd7-a995-4320-8c7c-f41f84c33b7a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:57.733771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1191/2383] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:37:57.744824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f3ba-f061-439d-8d6f-11439ffa06d5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:57.746196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f3ba-f061-439d-8d6f-11439ffa06d5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:57.746721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f3ba-f061-439d-8d6f-11439ffa06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:57.774186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-02b8f3ba-f061-439d-8d6f-11439ffa06d5 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:57.776778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02b8f3ba-f061-439d-8d6f-11439ffa06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:57.908032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1193/2384] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:37:57.936515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a15dd7-a995-4320-8c7c-f41f84c33b7a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:57.938566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f3a15dd7-a995-4320-8c7c-f41f84c33b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:57.960472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a15dd7-a995-4320-8c7c-f41f84c33b7a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:57.966960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:57.967751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:57.968106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:57.968566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:57.983114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:57.985099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:57.998585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1192/2385] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:37:58.642011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f3ba-f061-439d-8d6f-11439ffa06d5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:58.656394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f3ba-f061-439d-8d6f-11439ffa06d5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:58.663498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe19b2-f519-472b-8931-33b090ceadaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:58.664605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe19b2-f519-472b-8931-33b090ceadaa service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:58.664960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe19b2-f519-472b-8931-33b090ceadaa service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:58.665353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe19b2-f519-472b-8931-33b090ceadaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:58.667816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9fe19b2-f519-472b-8931-33b090ceadaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:58.683899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe19b2-f519-472b-8931-33b090ceadaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:58.685846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe19b2-f519-472b-8931-33b090ceadaa service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:58.699202 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1194/2386] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:37:59.346316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:59.346316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:59.495011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecd05c-9bd2-45f0-b9b3-828e1bd05f5b service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:37:59.514528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:37:59.519787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:59.523767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:59.524816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] PATH_INFO: `/v3/users/80a79275009a41e38a6d41e10bc6c066` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:59.527940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a79275009a41e38a6d41e10bc6c066)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:37:59.532891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:37:59.581817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862806f-552c-47d2-8d53-fab17a6a7a11 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:59.582502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862806f-552c-47d2-8d53-fab17a6a7a11 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:59.582901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862806f-552c-47d2-8d53-fab17a6a7a11 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:59.589122 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1195/2387] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:37:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:37:59.596480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:59.597496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:59.598340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:59.644270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a79275009a41e38a6d41e10bc6c066'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:59.646976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:59.650550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:59.673207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a79275009a41e38a6d41e10bc6c066'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:59.673905 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1196/2388] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:37:59.674425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a79275009a41e38a6d41e10bc6c066'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:59.703851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:37:59.708391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:59.724831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a79275009a41e38a6d41e10bc6c066'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:59.726913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84799172-7c21-449e-afc4-c1f391d2e8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a79275009a41e38a6d41e10bc6c066'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:37:59.792844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1193/2389] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:37:59 2022] DELETE /identity/v3/users/80a79275009a41e38a6d41e10bc6c066 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:37:59.798046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:37:59.798932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:37:59.799807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:37:59.815464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:59.820783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:59.862553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:37:59.870403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:37:59.878048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0be3e-fd4e-4eff-a890-1f0e93c6e8d2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:00.019410 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1194/2390] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:00.021992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:00.023252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:00.023859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:00.024394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:00.031847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:00.070600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:00.073280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:00.108411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6740a61-0e58-40da-b73e-8c25eeb89ce4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:00.116876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794574c-3ef8-4f75-8e86-70890245405c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:00.118268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794574c-3ef8-4f75-8e86-70890245405c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:00.118753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794574c-3ef8-4f75-8e86-70890245405c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:00.119304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794574c-3ef8-4f75-8e86-70890245405c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:00.141018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794574c-3ef8-4f75-8e86-70890245405c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:00.144335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794574c-3ef8-4f75-8e86-70890245405c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:00.168435 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1195/2391] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:00.227536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:00.230488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:00.267719 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1197/2392] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:37:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:00.285953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:00.287163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:00.287677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:00.323148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:00.325258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:00.338559 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1196/2393] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:00.356434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:00.358690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:00.379222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b29b-7331-40b9-88cb-44ec98a36790 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:00.386289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:00.387709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:00.388365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:00.388956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:00.405259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:00.407142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:00.419176 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1198/2394] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:00.828964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:00.831505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:00.877182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195b21-cbb2-4808-9d49-6db45c121e41 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:00.888195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:00.889763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:00.890376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:00.890972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] PATH_INFO: `/v3/projects/5a041638b2ef4261b6f3f2fbf3ba06c7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:00.894493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a041638b2ef4261b6f3f2fbf3ba06c7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:00.899499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:01.021564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'request_id': 'req-dffe1bca-7452-42bc-9930-8214ff40fb9b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.044637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'request_id': 'req-dffe1bca-7452-42bc-9930-8214ff40fb9b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.056486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'request_id': 'req-dffe1bca-7452-42bc-9930-8214ff40fb9b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.093878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] The token cache is being invalidate because project 5a041638b2ef4261b6f3f2fbf3ba06c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:01.094475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.095808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.111499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:01.120101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1197/2395] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:00 2022] DELETE /identity/v3/projects/5a041638b2ef4261b6f3f2fbf3ba06c7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:01.143981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f188-75d9-455c-8271-b66f84087410 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:01.398308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:01.400318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:01.402596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:01.403432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] PATH_INFO: `/v3/users/9c10ed09a01740fb9c8c539aec0932e4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:01.409122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c10ed09a01740fb9c8c539aec0932e4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:01.413786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:01.495403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:01.580729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c10ed09a01740fb9c8c539aec0932e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.616581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c10ed09a01740fb9c8c539aec0932e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.637120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c10ed09a01740fb9c8c539aec0932e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.638785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c10ed09a01740fb9c8c539aec0932e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.658131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c10ed09a01740fb9c8c539aec0932e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:01.676485 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1199/2396] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:01 2022] DELETE /identity/v3/users/9c10ed09a01740fb9c8c539aec0932e4 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:02.908108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:02.912748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:02.990856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe1bca-7452-42bc-9930-8214ff40fb9b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:03.201822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:03.203885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:03.204388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:03.208730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] PATH_INFO: `/v3/projects/29a1e40575c74678bc876d06ad0983aa` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:03.211980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a1e40575c74678bc876d06ad0983aa)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:03.215843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:03.234242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:03.300192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:03.301898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:03.358502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a1e40575c74678bc876d06ad0983aa', 'request_id': 'req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:03.376338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a1e40575c74678bc876d06ad0983aa', 'request_id': 'req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:03.397511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a1e40575c74678bc876d06ad0983aa', 'request_id': 'req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:03.427610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] The token cache is being invalidate because project 29a1e40575c74678bc876d06ad0983aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:03.428420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:03.430803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ffb56b5-05a1-4409-a32f-608f1fc7d5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:03.439360 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1198/2397] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:02 2022] DELETE /identity/v3/projects/29a1e40575c74678bc876d06ad0983aa => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:03.441518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456dba4-009a-4bcc-a826-7fbd1c6c4309 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:03.442152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456dba4-009a-4bcc-a826-7fbd1c6c4309 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:03.442642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456dba4-009a-4bcc-a826-7fbd1c6c4309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:03.475847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9456dba4-009a-4bcc-a826-7fbd1c6c4309 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:03.477774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867521-930c-4c2b-a767-051976b24570 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:03.479658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9456dba4-009a-4bcc-a826-7fbd1c6c4309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:03.606658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553b076-986d-4d95-a41e-e3ef385f6c1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:03.607605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b076-986d-4d95-a41e-e3ef385f6c1c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:03.608181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b076-986d-4d95-a41e-e3ef385f6c1c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:03.608617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b076-986d-4d95-a41e-e3ef385f6c1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:03.611173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8553b076-986d-4d95-a41e-e3ef385f6c1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:03.626741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553b076-986d-4d95-a41e-e3ef385f6c1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:03.628817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553b076-986d-4d95-a41e-e3ef385f6c1c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:03.645098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1200/2398] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:03.716156 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1199/2399] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:03.724937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3164-a02d-4c18-94d8-0f7adbdee3d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:03.725238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3164-a02d-4c18-94d8-0f7adbdee3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:03.725525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3164-a02d-4c18-94d8-0f7adbdee3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:03.750910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-490a3164-a02d-4c18-94d8-0f7adbdee3d6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:03.752268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-490a3164-a02d-4c18-94d8-0f7adbdee3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:03.763355 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1201/2400] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:03.768189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456dba4-009a-4bcc-a826-7fbd1c6c4309 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:03.793422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456dba4-009a-4bcc-a826-7fbd1c6c4309 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:03.806539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:03.808398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:03.809995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:03.810720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:03.812372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:03.814512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:03.820110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:03.896985 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1200/2401] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:03.898835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3164-a02d-4c18-94d8-0f7adbdee3d6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:03.930742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3164-a02d-4c18-94d8-0f7adbdee3d6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:03.962986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:03.962986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:03.962986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:03.962986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:03.965037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:03.970057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:04.097642 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1202/2402] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:03 2022] POST /identity/v3/projects => generated 389 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:04.106324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:04.149211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fe94-cce0-4ac2-b992-b9df4a25f759 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:04.294072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:04.294781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:04.295163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:04.295480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:04.296207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:04.298533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:04.332460 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1201/2403] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:04 2022] POST /identity/v3/users => generated 295 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:04.333188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:04.357991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:04.369324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e6c72-8a0a-4243-9e19-b55c1008eedd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:04.394159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:04.395905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:04.396635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:04.397473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:04.399118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:04.403392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:04.428022 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1203/2404] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:04.430809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:04.455612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffd83b-9cf1-48a9-baf2-18b45e1095c4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:04.472238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b584f27-9c8d-4d03-ae07-ce453579281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:04.472572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b584f27-9c8d-4d03-ae07-ce453579281a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:04.472953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b584f27-9c8d-4d03-ae07-ce453579281a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:04.473238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b584f27-9c8d-4d03-ae07-ce453579281a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:04.474848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b584f27-9c8d-4d03-ae07-ce453579281a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:04.479491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b584f27-9c8d-4d03-ae07-ce453579281a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:04.496255 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1202/2405] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:04.497971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:04.517559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ff6d-c8c5-4f81-a504-d0c271302fc8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:04.526442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:04.527840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:04.528233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:04.528603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] PATH_INFO: `/v3/projects/e8a7d6847f9448fbb8fdbae9c48be668/users/8b98909945cf4b59a96cf863e0883341/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:04.558179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a7d6847f9448fbb8fdbae9c48be668, user_id=8b98909945cf4b59a96cf863e0883341, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:04.561426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:04.581774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1204/2406] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:04 2022] PUT /identity/v3/projects/e8a7d6847f9448fbb8fdbae9c48be668/users/8b98909945cf4b59a96cf863e0883341/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:04.592658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc76c-922a-46ce-9c00-7a343cddd2f3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:04.592965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc76c-922a-46ce-9c00-7a343cddd2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:04.593343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc76c-922a-46ce-9c00-7a343cddd2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:04.600367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:04.660978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a2bc76c-922a-46ce-9c00-7a343cddd2f3 None None] MFA Rules not processed for user `8b98909945cf4b59a96cf863e0883341`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:04.667394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a2bc76c-922a-46ce-9c00-7a343cddd2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:04.803896 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1203/2407] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:04.806386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:04.994697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204439c-e860-42fa-9b17-35a5c6a68992 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:05.002616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:05.003816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.004275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.004675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.006050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:05.009081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:05.068105 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1205/2408] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:04 2022] POST /identity/v3/projects => generated 391 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:05.070234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc76c-922a-46ce-9c00-7a343cddd2f3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:05.105090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc76c-922a-46ce-9c00-7a343cddd2f3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:05.422189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:05.423460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.423878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.424384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.425691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:05.433750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:05.498442 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1204/2409] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:05 2022] POST /identity/v3/users => generated 302 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:05.503964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:05.528232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7d79f-7567-4786-9382-a4046f56fb7e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:05.538539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:05.539780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.540290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.540845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.548194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:05.566158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:05.616784 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1206/2410] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:05.621731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:05.646355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27d94c-ffa9-49dc-a050-58d26e37422d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:05.658715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:05.660784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.662088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.663166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] PATH_INFO: `/v3/projects/eb56f9a638ef4e34b1e77ef8df1b2fdc/users/35f781fac5404d4a9ffd9aa4cfe6c71f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.709256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb56f9a638ef4e34b1e77ef8df1b2fdc, user_id=35f781fac5404d4a9ffd9aa4cfe6c71f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:05.715964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:05.769886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1205/2411] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:05 2022] PUT /identity/v3/projects/eb56f9a638ef4e34b1e77ef8df1b2fdc/users/35f781fac5404d4a9ffd9aa4cfe6c71f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:05.776230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:05.800237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa716462-7477-4b4c-a8c5-79804bd717de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:05.935673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09cf75-d9e6-4bb7-9af0-c19e79d7d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:05.936956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09cf75-d9e6-4bb7-9af0-c19e79d7d2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.937605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09cf75-d9e6-4bb7-9af0-c19e79d7d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.938598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09cf75-d9e6-4bb7-9af0-c19e79d7d2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.940170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09cf75-d9e6-4bb7-9af0-c19e79d7d2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:05.948959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09cf75-d9e6-4bb7-9af0-c19e79d7d2f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:05.991970 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1207/2412] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:05.996408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.010138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bf7c2-895d-4844-a67c-bd820ae85ee0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.024935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.026578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.033996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.034515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] PATH_INFO: `/v3/projects/eb56f9a638ef4e34b1e77ef8df1b2fdc/users/35f781fac5404d4a9ffd9aa4cfe6c71f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.039489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb56f9a638ef4e34b1e77ef8df1b2fdc, user_id=35f781fac5404d4a9ffd9aa4cfe6c71f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.045220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.072819 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1206/2413] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:05 2022] PUT /identity/v3/projects/eb56f9a638ef4e34b1e77ef8df1b2fdc/users/35f781fac5404d4a9ffd9aa4cfe6c71f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:06.090665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce33c5-5edc-4a6a-9cf3-592d478eba09 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.091651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce33c5-5edc-4a6a-9cf3-592d478eba09 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.092604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce33c5-5edc-4a6a-9cf3-592d478eba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.174398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d1ce33c5-5edc-4a6a-9cf3-592d478eba09 None None] MFA Rules not processed for user `35f781fac5404d4a9ffd9aa4cfe6c71f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:06.184550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1ce33c5-5edc-4a6a-9cf3-592d478eba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:06.301383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:06.431198 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1208/2414] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:07.000646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:07.116964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:07.165217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abb25-4616-41ac-9a34-adf0b6ba1ecd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:07.171688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:07.173832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:07.174243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:07.174637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] PATH_INFO: `/v3/users/8b98909945cf4b59a96cf863e0883341` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:07.177506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b98909945cf4b59a96cf863e0883341)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:07.179993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:07.331128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b98909945cf4b59a96cf863e0883341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:07.385245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b98909945cf4b59a96cf863e0883341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:07.387206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b98909945cf4b59a96cf863e0883341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:07.432518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b98909945cf4b59a96cf863e0883341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:07.436739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b98909945cf4b59a96cf863e0883341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:07.466932 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1207/2415] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:06 2022] DELETE /identity/v3/users/8b98909945cf4b59a96cf863e0883341 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:07.474051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:07.474051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:07.474051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:07.505065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:07.506668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:07.667518 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1209/2416] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:07.705762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:07.707765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:07.823603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c5fc7-cc23-4b0f-aaf8-ca5eddb6be2f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:07.832595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:07.834374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:07.834681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:07.834971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:07.851795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:07.853659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:07.871037 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1208/2417] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:09.234209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:09.236933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:09.299778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b357a2-f07b-406e-a076-ea1918a469cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:09.328875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:09.330254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:09.330776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:09.331071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] PATH_INFO: `/v3/projects/e8a7d6847f9448fbb8fdbae9c48be668` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:09.335430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a7d6847f9448fbb8fdbae9c48be668)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:09.337450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:09.420240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a7d6847f9448fbb8fdbae9c48be668', 'request_id': 'req-a457ac5b-6ad5-453b-a772-3e5a650f8933'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.431503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a7d6847f9448fbb8fdbae9c48be668', 'request_id': 'req-a457ac5b-6ad5-453b-a772-3e5a650f8933'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.457372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a7d6847f9448fbb8fdbae9c48be668', 'request_id': 'req-a457ac5b-6ad5-453b-a772-3e5a650f8933'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.479791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] The token cache is being invalidate because project e8a7d6847f9448fbb8fdbae9c48be668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:09.480185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.481112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.486087 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1210/2418] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:09 2022] DELETE /identity/v3/projects/e8a7d6847f9448fbb8fdbae9c48be668 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:09.488287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:09.499336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d572310-efd3-4ac1-b870-a76e33832def service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:09.597383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:09.598637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:09.598906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:09.599189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] PATH_INFO: `/v3/users/35f781fac5404d4a9ffd9aa4cfe6c71f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:09.601293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f781fac5404d4a9ffd9aa4cfe6c71f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:09.603675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:09.613969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:09.706136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f781fac5404d4a9ffd9aa4cfe6c71f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.731536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f781fac5404d4a9ffd9aa4cfe6c71f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.732514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f781fac5404d4a9ffd9aa4cfe6c71f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.746346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f781fac5404d4a9ffd9aa4cfe6c71f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.747445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b51c4a2-6578-4b93-87b8-f57056ba59bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f781fac5404d4a9ffd9aa4cfe6c71f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:09.767688 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1209/2419] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:09 2022] DELETE /identity/v3/users/35f781fac5404d4a9ffd9aa4cfe6c71f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:11.227052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:11.229272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:11.256677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457ac5b-6ad5-453b-a772-3e5a650f8933 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:11.336308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:11.361614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:11.362681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:11.364906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:11.366750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] PATH_INFO: `/v3/projects/eb56f9a638ef4e34b1e77ef8df1b2fdc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:11.369658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb56f9a638ef4e34b1e77ef8df1b2fdc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:11.372364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:11.446632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb56f9a638ef4e34b1e77ef8df1b2fdc', 'request_id': 'req-1d1ac9e5-292c-4822-8860-732f90b2634c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:11.455086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb56f9a638ef4e34b1e77ef8df1b2fdc', 'request_id': 'req-1d1ac9e5-292c-4822-8860-732f90b2634c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:11.465354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb56f9a638ef4e34b1e77ef8df1b2fdc', 'request_id': 'req-1d1ac9e5-292c-4822-8860-732f90b2634c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:11.485931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] The token cache is being invalidate because project eb56f9a638ef4e34b1e77ef8df1b2fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:11.486555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:11.487535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d1ac9e5-292c-4822-8860-732f90b2634c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:11.490408 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1211/2420] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:11 2022] DELETE /identity/v3/projects/eb56f9a638ef4e34b1e77ef8df1b2fdc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:11.499460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551cad-84d5-4931-80c7-4776558ee506 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:11.500003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551cad-84d5-4931-80c7-4776558ee506 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:11.500428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551cad-84d5-4931-80c7-4776558ee506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:11.534184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-99551cad-84d5-4931-80c7-4776558ee506 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:11.536905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99551cad-84d5-4931-80c7-4776558ee506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:11.648081 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1210/2421] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:11.656052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76516ca-73c9-4b6e-a975-bf3a149cfb2c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:11.656605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76516ca-73c9-4b6e-a975-bf3a149cfb2c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:11.657080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76516ca-73c9-4b6e-a975-bf3a149cfb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:11.682979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f76516ca-73c9-4b6e-a975-bf3a149cfb2c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:11.685275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f76516ca-73c9-4b6e-a975-bf3a149cfb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:11.703339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1212/2422] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:11.706660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551cad-84d5-4931-80c7-4776558ee506 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:11.721880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551cad-84d5-4931-80c7-4776558ee506 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:11.729004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:11.730054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:11.730337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:11.730733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:11.731580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:11.731935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:11.733646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:11.754621 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1211/2423] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:11.759792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76516ca-73c9-4b6e-a975-bf3a149cfb2c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:11.779738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76516ca-73c9-4b6e-a975-bf3a149cfb2c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:11.795672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d992ab-3740-4fcf-a66f-e51c7186afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:11.797042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d992ab-3740-4fcf-a66f-e51c7186afeb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:11.797583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d992ab-3740-4fcf-a66f-e51c7186afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:11.797875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d992ab-3740-4fcf-a66f-e51c7186afeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:11.799208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d992ab-3740-4fcf-a66f-e51c7186afeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:11.810577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d992ab-3740-4fcf-a66f-e51c7186afeb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:11.875455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1213/2424] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:11 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:11.880340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:11.893954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc801b9-ba09-4e54-8d3d-e6c4175b3b6e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:11.957865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbc68e-fd82-458e-a641-004450f1528e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:11.959215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbc68e-fd82-458e-a641-004450f1528e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:11.959707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbc68e-fd82-458e-a641-004450f1528e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:11.961793 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1214/2425] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:38:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:38:11.971956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:11.972632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:11.973779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.007023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:12.008149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:12.042465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:12.043470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:12.044077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:12.044523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.045433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:12.054148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:12.120825 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1212/2426] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:11 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:12.122757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:12.134057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:12.145106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07d56-c80b-4f86-8472-7c052c4aea18 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:12.157726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:12.159796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:12.160732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:12.162614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.164640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:12.170082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:12.213519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1213/2427] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:12.216869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:12.236338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1215/2428] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:12.259585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b407143-f1e0-46e9-bf01-5e10874ce75e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:12.280751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:12.281877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:12.282305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:12.285935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.289900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:12.310525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:12.310918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:12.313746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:12.340754 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1214/2429] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:12.344580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:12.346294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c483163-b5e1-41cc-95ca-31497c5462e8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:12.357428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404771d-dce2-4ebc-8738-c18af58f8255 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:12.358895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404771d-dce2-4ebc-8738-c18af58f8255 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:12.359632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404771d-dce2-4ebc-8738-c18af58f8255 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:12.360291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404771d-dce2-4ebc-8738-c18af58f8255 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.372778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05e358-016d-46bb-91c8-6afe3cf986da admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:12.384865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc63865-73b3-4730-8c03-8267e5b972af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:12.386384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63865-73b3-4730-8c03-8267e5b972af admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:12.386699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404771d-dce2-4ebc-8738-c18af58f8255 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:12.386877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63865-73b3-4730-8c03-8267e5b972af admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:12.388047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63865-73b3-4730-8c03-8267e5b972af admin admin] PATH_INFO: `/v3/projects/1929268ec71e4edcbe8505af6d2186e4/users/ed04a11d94444f719af0c46e909b8566/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.394690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404771d-dce2-4ebc-8738-c18af58f8255 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:12.417390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc63865-73b3-4730-8c03-8267e5b972af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1929268ec71e4edcbe8505af6d2186e4, user_id=ed04a11d94444f719af0c46e909b8566, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:12.422204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc63865-73b3-4730-8c03-8267e5b972af admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:12.440056 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1216/2430] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:12.468776 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1215/2431] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:12 2022] PUT /identity/v3/projects/1929268ec71e4edcbe8505af6d2186e4/users/ed04a11d94444f719af0c46e909b8566/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:12.488741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875da34a-a625-49d8-9830-ceffffd1266b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:12.488741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875da34a-a625-49d8-9830-ceffffd1266b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:12.489684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875da34a-a625-49d8-9830-ceffffd1266b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.554996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-875da34a-a625-49d8-9830-ceffffd1266b None None] MFA Rules not processed for user `ed04a11d94444f719af0c46e909b8566`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:12.556222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-875da34a-a625-49d8-9830-ceffffd1266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:12.598311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:12.757379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292020-103e-40f5-b23d-8ec4def89040 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:12.758451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292020-103e-40f5-b23d-8ec4def89040 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:12.759021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292020-103e-40f5-b23d-8ec4def89040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:12.785671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-56292020-103e-40f5-b23d-8ec4def89040 None None] MFA Rules not processed for user `cdac1d4106674c7ab0cfe39939de9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:12.787529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-56292020-103e-40f5-b23d-8ec4def89040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:12.799450 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1217/2432] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:12.802172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875da34a-a625-49d8-9830-ceffffd1266b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:12.953778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1216/2433] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:13.040487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875da34a-a625-49d8-9830-ceffffd1266b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:13.049915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:13.051671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:13.053043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:13.053704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:13.055203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:13.060005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:13.142694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1218/2434] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:12 2022] POST /identity/v3/projects => generated 383 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:13.145211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56292020-103e-40f5-b23d-8ec4def89040 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:13.185471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56292020-103e-40f5-b23d-8ec4def89040 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:13.416150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:13.416898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:13.417188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:13.417501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:13.418417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:13.420791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:13.457411 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1217/2435] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:13 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:13.459565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:13.471242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a62f1-b4a8-4614-ae96-cba4157d3490 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:13.477701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:13.478400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:13.478729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:13.479031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:13.479936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:13.481635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:13.501734 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1219/2436] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:13.508680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:13.530483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467389bd-9504-4910-8372-a34276622f81 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:13.541005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:13.541943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:13.542215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:13.542491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] PATH_INFO: `/v3/projects/91ab48d1aa08402597a87b7a0edc0750/users/44e7a10d6dd843c3a69c2cdfcfdb7289/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:13.560350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ab48d1aa08402597a87b7a0edc0750, user_id=44e7a10d6dd843c3a69c2cdfcfdb7289, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:13.563385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:13.585493 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1218/2437] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:13 2022] PUT /identity/v3/projects/91ab48d1aa08402597a87b7a0edc0750/users/44e7a10d6dd843c3a69c2cdfcfdb7289/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:13.589522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:13.602941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25830-977b-44f8-92d6-0dd826e22cab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:13.698708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940da7f5-7d05-4c67-8051-ffd4a05f148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:13.700268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da7f5-7d05-4c67-8051-ffd4a05f148c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:13.700653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da7f5-7d05-4c67-8051-ffd4a05f148c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:13.701000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da7f5-7d05-4c67-8051-ffd4a05f148c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:13.701837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940da7f5-7d05-4c67-8051-ffd4a05f148c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:13.704810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940da7f5-7d05-4c67-8051-ffd4a05f148c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:13.729661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:13.736223 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1220/2438] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:13.743829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad3bcf-81b0-4a4a-be52-ba02bb4111f4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:13.778528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:13.779675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:13.779675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:13.779999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] PATH_INFO: `/v3/projects/91ab48d1aa08402597a87b7a0edc0750/users/44e7a10d6dd843c3a69c2cdfcfdb7289/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:13.788721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ab48d1aa08402597a87b7a0edc0750, user_id=44e7a10d6dd843c3a69c2cdfcfdb7289, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:13.797301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:13.848159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1219/2439] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:13 2022] PUT /identity/v3/projects/91ab48d1aa08402597a87b7a0edc0750/users/44e7a10d6dd843c3a69c2cdfcfdb7289/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:13.853347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2190b-dd11-4a47-aeab-1f3e32ad9d7b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:13.853728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2190b-dd11-4a47-aeab-1f3e32ad9d7b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:13.854043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2190b-dd11-4a47-aeab-1f3e32ad9d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:13.938743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2e2190b-dd11-4a47-aeab-1f3e32ad9d7b None None] MFA Rules not processed for user `44e7a10d6dd843c3a69c2cdfcfdb7289`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:13.940874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2e2190b-dd11-4a47-aeab-1f3e32ad9d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:14.005691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:14.257417 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1221/2440] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:15.533645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:15.537338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:15.592598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:15.795766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c06e-d4a2-428c-93a1-f9f48ccdb45d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:15.811353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723cc5-2430-4631-a4ea-48e84e5d0c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:15.812609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723cc5-2430-4631-a4ea-48e84e5d0c52 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:15.812907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723cc5-2430-4631-a4ea-48e84e5d0c52 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:15.813417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723cc5-2430-4631-a4ea-48e84e5d0c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:15.850852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92723cc5-2430-4631-a4ea-48e84e5d0c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:15.854094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92723cc5-2430-4631-a4ea-48e84e5d0c52 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:15.892332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1220/2441] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:17.345931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51fada-9093-417a-8ce8-572fc1e8bbc8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:17.346856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51fada-9093-417a-8ce8-572fc1e8bbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:17.347019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51fada-9093-417a-8ce8-572fc1e8bbc8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:17.350279 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1222/2442] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:38:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:17.405808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:17.406392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:17.406792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:17.433835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:17.436241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:17.558527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1221/2443] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:17.894077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51fada-9093-417a-8ce8-572fc1e8bbc8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:17.896539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cd51fada-9093-417a-8ce8-572fc1e8bbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:17.934033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:17.935540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:17.965116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ab34b-fedd-423a-b371-100ab5752e15 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:17.981440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:17.982141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:17.983014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:17.983014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:18.009454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:18.010148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:18.048591 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1222/2444] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:38:18.103727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51fada-9093-417a-8ce8-572fc1e8bbc8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:18.138295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:18.140623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:18.144536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:18.145236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] PATH_INFO: `/v3/users/ef291d4288eb481dac5564aaeaa81717` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:18.182434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef291d4288eb481dac5564aaeaa81717)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:18.186597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:18.357397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef291d4288eb481dac5564aaeaa81717'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.377401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:18.379428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:18.410971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d728d8-60e6-44d9-a7fe-77ef28c6d41e service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:18.422249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:18.423178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:18.423493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:18.424314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] PATH_INFO: `/v3/users/82254dd6dfcc4f2f96995a0133a901b4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:18.429311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=82254dd6dfcc4f2f96995a0133a901b4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:18.431459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:18.432611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef291d4288eb481dac5564aaeaa81717'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.460993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef291d4288eb481dac5564aaeaa81717'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.462098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef291d4288eb481dac5564aaeaa81717'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.496976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-960a9cc4-d047-4ffc-ac71-39cb130763b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef291d4288eb481dac5564aaeaa81717'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.521606 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1223/2445] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:17 2022] DELETE /identity/v3/users/ef291d4288eb481dac5564aaeaa81717 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:18.549991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82254dd6dfcc4f2f96995a0133a901b4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.588428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82254dd6dfcc4f2f96995a0133a901b4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.589091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82254dd6dfcc4f2f96995a0133a901b4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.600411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82254dd6dfcc4f2f96995a0133a901b4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.601895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82254dd6dfcc4f2f96995a0133a901b4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:18.611069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:18.644063 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1223/2446] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:18 2022] DELETE /identity/v3/users/82254dd6dfcc4f2f96995a0133a901b4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:18.650307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:18.650901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:18.651460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:18.681185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:18.682840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:18.735916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:18.828838 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1224/2447] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:18.897186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:18.898774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:19.027771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b823bce-08bd-4c8e-adc3-34ddd352d7ff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:19.043930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e216-da35-46cd-9ec5-ec34f27d6a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:19.044633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e216-da35-46cd-9ec5-ec34f27d6a45 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:19.047952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e216-da35-46cd-9ec5-ec34f27d6a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:19.048389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e216-da35-46cd-9ec5-ec34f27d6a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:19.075348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845e216-da35-46cd-9ec5-ec34f27d6a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:19.084339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845e216-da35-46cd-9ec5-ec34f27d6a45 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:19.114284 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1224/2448] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:19.137427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:19.142584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:19.170606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8af9f-8e2d-4851-a874-718820af77cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:19.179824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:19.182508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:19.182508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:19.183581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] PATH_INFO: `/v3/users/ed04a11d94444f719af0c46e909b8566` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:19.186709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed04a11d94444f719af0c46e909b8566)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:19.192597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:19.320110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed04a11d94444f719af0c46e909b8566'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.338443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed04a11d94444f719af0c46e909b8566'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.355691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed04a11d94444f719af0c46e909b8566'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.356425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed04a11d94444f719af0c46e909b8566'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.369164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed04a11d94444f719af0c46e909b8566'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.379062 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1225/2449] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:19 2022] DELETE /identity/v3/users/ed04a11d94444f719af0c46e909b8566 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:19.389141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:19.390494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:19.391118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:19.463711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:19.469012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:19.649603 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1225/2450] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:19.683970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:19.687596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:19.738784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d9a8a-6229-42e1-b8ee-573f0b805f81 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:19.748266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:19.749197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:19.749495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:19.749782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] PATH_INFO: `/v3/projects/60ce739658f145558450d454a2928bec` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:19.751237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ce739658f145558450d454a2928bec)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:19.753346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:19.764690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:19.767686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:19.837838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ce739658f145558450d454a2928bec', 'request_id': 'req-c30a8485-fc45-4dad-81d9-d620ec661968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.847482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ce739658f145558450d454a2928bec', 'request_id': 'req-c30a8485-fc45-4dad-81d9-d620ec661968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.856704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ce739658f145558450d454a2928bec', 'request_id': 'req-c30a8485-fc45-4dad-81d9-d620ec661968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.881409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d352-69ff-4eac-869b-353ae1d4ef55 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:19.885054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] The token cache is being invalidate because project 60ce739658f145558450d454a2928bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:19.885382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.886484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c30a8485-fc45-4dad-81d9-d620ec661968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:19.888943 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1226/2451] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:19 2022] DELETE /identity/v3/projects/60ce739658f145558450d454a2928bec => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:19.899144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:19.899350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:19.899854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:19.930354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:19.931673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:19.992045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6605f4-eac4-465e-a5ce-eef91e4dceb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:19.992564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:19.992770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6605f4-eac4-465e-a5ce-eef91e4dceb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:19.993292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6605f4-eac4-465e-a5ce-eef91e4dceb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:19.994209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6605f4-eac4-465e-a5ce-eef91e4dceb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:20.001124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb6605f4-eac4-465e-a5ce-eef91e4dceb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:20.017595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:20.074779 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1227/2452] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:20.076214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:20.077854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:20.099644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ab13e-0216-4479-ac9c-e83693613c6e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:20.120549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:20.122575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:20.123083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:20.123584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] PATH_INFO: `/v3/projects/37c6e6fc4a9e4a8ab44ea9b14b7eefc5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:20.127729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c6e6fc4a9e4a8ab44ea9b14b7eefc5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:20.132824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:20.159502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6605f4-eac4-465e-a5ce-eef91e4dceb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:20.161165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6605f4-eac4-465e-a5ce-eef91e4dceb9 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:20.175214 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1226/2453] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:20.177355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d00f26-6d34-4b91-8edc-2f22c68aea4f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:20.178471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d00f26-6d34-4b91-8edc-2f22c68aea4f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:20.179110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d00f26-6d34-4b91-8edc-2f22c68aea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:20.207565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-13d00f26-6d34-4b91-8edc-2f22c68aea4f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:20.210125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-13d00f26-6d34-4b91-8edc-2f22c68aea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:20.254188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'request_id': 'req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.287802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'request_id': 'req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.307566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'request_id': 'req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.344702 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1227/2454] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:20.349738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d00f26-6d34-4b91-8edc-2f22c68aea4f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:20.362116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] The token cache is being invalidate because project 37c6e6fc4a9e4a8ab44ea9b14b7eefc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:20.362449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d00f26-6d34-4b91-8edc-2f22c68aea4f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:20.362683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.365173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.369625 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1228/2455] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:20 2022] DELETE /identity/v3/projects/37c6e6fc4a9e4a8ab44ea9b14b7eefc5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:20.371771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:20.375376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:20.375751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:20.376045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:20.376480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:20.376849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:20.377227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:20.379391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:20.383092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:20.411554 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1228/2456] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:20.419603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:20.422049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995a6e-6bd9-492d-9c46-3ac90cfd8e52 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:20.429024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:20.435083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:20.437148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:20.437991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:20.438483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] PATH_INFO: `/v3/users/3f1be8b33b93467197f8902f4c740ca1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:20.441324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1be8b33b93467197f8902f4c740ca1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:20.445635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:20.451935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769dde-979c-4791-ade7-19fcf0472bbb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:20.461744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:20.462716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:20.463164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:20.463677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:20.464377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:20.466398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:20.545764 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1229/2457] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:20 2022] POST /identity/v3/projects => generated 397 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:20.547308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:20.648183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1be8b33b93467197f8902f4c740ca1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.681892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1be8b33b93467197f8902f4c740ca1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.694024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a196-22f0-4b50-82b6-bd9e4f6a3910 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:20.709909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1be8b33b93467197f8902f4c740ca1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.710744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1be8b33b93467197f8902f4c740ca1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.717579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:20.719209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:20.721131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:20.721529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:20.724206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:20.730215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:20.734252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1be8b33b93467197f8902f4c740ca1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:20.749928 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1229/2458] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:20 2022] DELETE /identity/v3/users/3f1be8b33b93467197f8902f4c740ca1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:20.787790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:20.798616 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1230/2459] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:20 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:20.804145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:20.805856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:20.885751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:21.001093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c3d2f-f38c-4a61-83ef-22623a3b9534 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:21.013166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:21.014993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:21.015741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:21.018730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:21.023706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:21.027659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:21.072973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:21.074333 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1230/2460] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:21.103128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8028c4-5491-4248-a982-08df48675ef5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:21.128474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3608eb2-a66f-4835-bc64-b4c8e34392ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:21.130604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3608eb2-a66f-4835-bc64-b4c8e34392ac admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:21.131007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3608eb2-a66f-4835-bc64-b4c8e34392ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:21.131676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3608eb2-a66f-4835-bc64-b4c8e34392ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:21.133993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3608eb2-a66f-4835-bc64-b4c8e34392ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:21.141830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3608eb2-a66f-4835-bc64-b4c8e34392ac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:21.224666 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1231/2461] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:21.225427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:21.250837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e095-6ae1-44c8-8dac-06a714877210 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:21.284395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:21.287083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:21.289092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:21.290709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] PATH_INFO: `/v3/projects/75c2a95595ca475ab6a5850654026798/users/a1dd9b84cff64f8f825579378817247e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:21.329496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c2a95595ca475ab6a5850654026798, user_id=a1dd9b84cff64f8f825579378817247e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:21.334525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:21.363201 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1231/2462] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:21 2022] PUT /identity/v3/projects/75c2a95595ca475ab6a5850654026798/users/a1dd9b84cff64f8f825579378817247e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:21.373974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:21.375414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:21.375414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:21.427747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:21.431740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:21.518123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:21.522813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:21.644233 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1232/2463] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:21.659135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:21.662475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:21.806097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71985f4-d155-4904-9e74-b6651529c030 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:21.813124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:21.814092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:21.815222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:21.815569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] PATH_INFO: `/v3/projects/ffd977efd139496dad278ed5933f8379` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:21.817761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd977efd139496dad278ed5933f8379)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:21.826371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:21.863607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bedcb6-5725-4ced-8ecc-626e78881eda None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:21.891751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8298e-f170-4d97-be6f-5712a3b2c208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:21.893009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8298e-f170-4d97-be6f-5712a3b2c208 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:21.897919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8298e-f170-4d97-be6f-5712a3b2c208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:21.898622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8298e-f170-4d97-be6f-5712a3b2c208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:21.965857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd977efd139496dad278ed5933f8379', 'request_id': 'req-f6d78fe3-3868-44a9-8f47-dced24918dd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:21.978232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8298e-f170-4d97-be6f-5712a3b2c208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:21.980341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd977efd139496dad278ed5933f8379', 'request_id': 'req-f6d78fe3-3868-44a9-8f47-dced24918dd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:21.989751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8298e-f170-4d97-be6f-5712a3b2c208 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:21.996445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd977efd139496dad278ed5933f8379', 'request_id': 'req-f6d78fe3-3868-44a9-8f47-dced24918dd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:22.028637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] The token cache is being invalidate because project ffd977efd139496dad278ed5933f8379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:22.028923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:22.031239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6d78fe3-3868-44a9-8f47-dced24918dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:22.032899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1233/2464] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:38:22.033673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1232/2465] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:21 2022] DELETE /identity/v3/projects/ffd977efd139496dad278ed5933f8379 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:22.043807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464ac16-f366-4a4d-9307-e422d1363fd5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.044297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464ac16-f366-4a4d-9307-e422d1363fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.045063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464ac16-f366-4a4d-9307-e422d1363fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.135695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a464ac16-f366-4a4d-9307-e422d1363fd5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:22.136980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8abe7a-0578-46b1-a831-5df0915f9b47 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.136980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8abe7a-0578-46b1-a831-5df0915f9b47 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.137195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8abe7a-0578-46b1-a831-5df0915f9b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.139182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a464ac16-f366-4a4d-9307-e422d1363fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:22.173065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2d8abe7a-0578-46b1-a831-5df0915f9b47 None None] MFA Rules not processed for user `038556a90129478eb04699f574ea7e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:22.174359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2d8abe7a-0578-46b1-a831-5df0915f9b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:22.266543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:22.297308 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1234/2466] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:22.315761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3213-13dd-4b62-ac83-3eba1142b75e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.318748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3213-13dd-4b62-ac83-3eba1142b75e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.322415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3213-13dd-4b62-ac83-3eba1142b75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.387372 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1233/2467] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:22.422540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-53ca3213-13dd-4b62-ac83-3eba1142b75e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:22.427122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53ca3213-13dd-4b62-ac83-3eba1142b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:22.449832 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1235/2468] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:22.455737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8abe7a-0578-46b1-a831-5df0915f9b47 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:22.506411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8abe7a-0578-46b1-a831-5df0915f9b47 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:22.522609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:22.526942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.527943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.529002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.530997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:22.531694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:22.543755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:22.591332 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1234/2469] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:22.593742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3213-13dd-4b62-ac83-3eba1142b75e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:22.611765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3213-13dd-4b62-ac83-3eba1142b75e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:22.618001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:22.619714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.619714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.620460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.621530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:22.623866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:22.660619 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1236/2470] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:22 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:22.667345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:22.681780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cce68-227e-4810-a108-e83038a2ade6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:22.771589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:22.776063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.776063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.776063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.776063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:22.779957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:22.820939 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1235/2471] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:22 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:22.826179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:22.833330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:22.843703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470cbc-8aa5-49b6-a6e1-53cf44cb127e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:22.853096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:22.854587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.854587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.855095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.856763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:22.857967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:22.873097 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1237/2472] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:22.878304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:22.891942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4cea-32eb-4120-837f-07a788828cdf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:22.899117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:22.900032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.900425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.900812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.902034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:22.904094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:22.919745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:22.922352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:22.942010 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1236/2473] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:22.946511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:22.950111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f08f88-a0dc-4d01-9ae8-6aa5c27dbaa2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:22.968668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f292d-add2-4581-9d02-fd68c6a111b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:22.969711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:22.970756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.971188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.971598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] PATH_INFO: `/v3/projects/1929268ec71e4edcbe8505af6d2186e4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:22.975103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1929268ec71e4edcbe8505af6d2186e4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:22.977768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:22.986062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba3ba9-4a23-4c97-9990-7fd5524a0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:22.987154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba3ba9-4a23-4c97-9990-7fd5524a0384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:22.987581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba3ba9-4a23-4c97-9990-7fd5524a0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:22.988114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba3ba9-4a23-4c97-9990-7fd5524a0384 admin admin] PATH_INFO: `/v3/projects/4db5c049426148339bc9e18e701d5d3c/users/86fb7c8f2aa741aa887f7bb1a1c19f3a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:23.030926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba3ba9-4a23-4c97-9990-7fd5524a0384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db5c049426148339bc9e18e701d5d3c, user_id=86fb7c8f2aa741aa887f7bb1a1c19f3a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:23.034131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba3ba9-4a23-4c97-9990-7fd5524a0384 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:23.077627 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1237/2474] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:22 2022] PUT /identity/v3/projects/4db5c049426148339bc9e18e701d5d3c/users/86fb7c8f2aa741aa887f7bb1a1c19f3a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:23.097029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:23.097699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:23.098186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:23.131975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1929268ec71e4edcbe8505af6d2186e4', 'request_id': 'req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.152380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1929268ec71e4edcbe8505af6d2186e4', 'request_id': 'req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.174569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1929268ec71e4edcbe8505af6d2186e4', 'request_id': 'req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.175834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] MFA Rules not processed for user `86fb7c8f2aa741aa887f7bb1a1c19f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:23.177279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:23.220717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] The token cache is being invalidate because project 1929268ec71e4edcbe8505af6d2186e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:23.222940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.224641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.234704 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1238/2475] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:22 2022] DELETE /identity/v3/projects/1929268ec71e4edcbe8505af6d2186e4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:23.236006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:23.241872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:23.380588 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1238/2476] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:23.386208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:23.392778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:23.416748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:23.443681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9edc-2c5c-4bc6-bd65-27176b80d16a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:23.461461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:23.462575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:23.462973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:23.465941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] PATH_INFO: `/v3/users/44e7a10d6dd843c3a69c2cdfcfdb7289` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:23.471934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e7a10d6dd843c3a69c2cdfcfdb7289)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:23.474703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:23.659536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e7a10d6dd843c3a69c2cdfcfdb7289'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.664025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f301-2a04-48bd-ad87-74e4967015d9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:23.687430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:23.694928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:23.694928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:23.694928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:23.695592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e7a10d6dd843c3a69c2cdfcfdb7289'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.695592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e7a10d6dd843c3a69c2cdfcfdb7289'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.699042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:23.723586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e7a10d6dd843c3a69c2cdfcfdb7289'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.725845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:23.727504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e7a10d6dd843c3a69c2cdfcfdb7289'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:23.733475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:23.779521 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1239/2477] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:23 2022] DELETE /identity/v3/users/44e7a10d6dd843c3a69c2cdfcfdb7289 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:23.793298 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1239/2478] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:23 2022] POST /identity/v3/projects => generated 391 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:23.798106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:23.802636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:24.009127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f15f8-1e35-4d4c-b866-25e061735a43 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:24.175199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:24.177229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:24.177829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:24.178466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:24.180073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:24.185717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:24.246814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:24.256006 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1240/2479] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:23 2022] POST /identity/v3/users => generated 302 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:24.272902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08633555-393d-4911-a79c-7a85a2a53c1f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:24.283349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:24.284778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:24.285498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:24.286698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:24.288267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:24.293006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:24.513369 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1240/2480] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:24.519455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:24.532590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d375fa-e5ac-4f85-9da8-a6b84c15f45f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:24.539682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:24.540657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:24.540943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:24.541228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] PATH_INFO: `/v3/projects/f004aa61dbd14b7d9984f9367a4c5949/users/08af42beb9cc4e6eaaeb0e99fcc7bd0a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:24.562964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f004aa61dbd14b7d9984f9367a4c5949, user_id=08af42beb9cc4e6eaaeb0e99fcc7bd0a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:24.566054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:24.600081 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1241/2481] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:24 2022] PUT /identity/v3/projects/f004aa61dbd14b7d9984f9367a4c5949/users/08af42beb9cc4e6eaaeb0e99fcc7bd0a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:24.601548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:24.621091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231882b-6a62-4e2d-a54d-39e2d73dedf2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:24.792049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02679d-5886-48bb-af29-f2fdc95f267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:24.808195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02679d-5886-48bb-af29-f2fdc95f267c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:24.808495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02679d-5886-48bb-af29-f2fdc95f267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:24.808773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02679d-5886-48bb-af29-f2fdc95f267c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:24.809574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02679d-5886-48bb-af29-f2fdc95f267c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:24.811370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02679d-5886-48bb-af29-f2fdc95f267c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:24.848211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:24.860885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1241/2482] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:24.877328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b47c-7579-4e51-8d39-81b5a0b6f9e8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:24.885360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:24.886399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:24.886693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:24.887652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] PATH_INFO: `/v3/projects/f004aa61dbd14b7d9984f9367a4c5949/users/08af42beb9cc4e6eaaeb0e99fcc7bd0a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:24.889947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f004aa61dbd14b7d9984f9367a4c5949, user_id=08af42beb9cc4e6eaaeb0e99fcc7bd0a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:24.894274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:24.935664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540e00-f951-4436-b283-2e2a3000239e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:24.935956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540e00-f951-4436-b283-2e2a3000239e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:24.936271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540e00-f951-4436-b283-2e2a3000239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:24.939768 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1242/2483] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:24 2022] PUT /identity/v3/projects/f004aa61dbd14b7d9984f9367a4c5949/users/08af42beb9cc4e6eaaeb0e99fcc7bd0a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:24.990892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-88540e00-f951-4436-b283-2e2a3000239e None None] MFA Rules not processed for user `08af42beb9cc4e6eaaeb0e99fcc7bd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:24.993242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88540e00-f951-4436-b283-2e2a3000239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:25.131388 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1242/2484] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:25.343899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:25.352087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:25.516221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:25.581830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d0d4-3bba-406a-9179-52d55e6a9ba5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:25.605071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:25.616590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:25.617495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:25.618027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:25.648230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:25.652723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:25.680499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88540e00-f951-4436-b283-2e2a3000239e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:25.683002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88540e00-f951-4436-b283-2e2a3000239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:25.701683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:25.716470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1243/2485] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:25.892665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88540e00-f951-4436-b283-2e2a3000239e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:25.898252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:25.899155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:25.899472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:25.899753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] PATH_INFO: `/v3/projects/91ab48d1aa08402597a87b7a0edc0750` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:25.908418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ab48d1aa08402597a87b7a0edc0750)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:25.910391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:26.059116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ab48d1aa08402597a87b7a0edc0750', 'request_id': 'req-567c4664-0ff9-42ab-a05b-f54d08a1bfac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:26.090302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ab48d1aa08402597a87b7a0edc0750', 'request_id': 'req-567c4664-0ff9-42ab-a05b-f54d08a1bfac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:26.108826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ab48d1aa08402597a87b7a0edc0750', 'request_id': 'req-567c4664-0ff9-42ab-a05b-f54d08a1bfac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:26.169150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] The token cache is being invalidate because project 91ab48d1aa08402597a87b7a0edc0750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:26.169603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:26.170654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-567c4664-0ff9-42ab-a05b-f54d08a1bfac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:26.173017 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1243/2486] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:25 2022] DELETE /identity/v3/projects/91ab48d1aa08402597a87b7a0edc0750 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:26.179702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:26.181228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.181424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b7996-f089-4932-92f2-b72913448ad0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.181837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b7996-f089-4932-92f2-b72913448ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.182310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b7996-f089-4932-92f2-b72913448ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.223932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930a1e-b6a0-4c37-b182-26fcf8911cc6 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:26.231254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c0b7996-f089-4932-92f2-b72913448ad0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:26.236508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c0b7996-f089-4932-92f2-b72913448ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.459436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:26.462790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.463124 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1244/2487] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:26.464199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.465365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.474876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.475886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1bbb-d38a-456a-a5a5-88bfe4291c03 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.476184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1bbb-d38a-456a-a5a5-88bfe4291c03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.476472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1bbb-d38a-456a-a5a5-88bfe4291c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.527941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d45a1bbb-d38a-456a-a5a5-88bfe4291c03 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:26.536835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d45a1bbb-d38a-456a-a5a5-88bfe4291c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.580064 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1245/2488] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:26.585587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1bbb-d38a-456a-a5a5-88bfe4291c03 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:26.635164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1bbb-d38a-456a-a5a5-88bfe4291c03 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:26.662673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:26.663829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.664323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.665170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.666506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:26.666823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:26.673189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:26.684577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:26.687046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:26.727067 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1244/2490] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:26.733697 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1246/2489] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:26.735120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:26.763326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:26.765743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.774796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9cf4-bf24-4568-9bf0-043331399adf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:26.788207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:26.790489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.791312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.792129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.793970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:26.800767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:26.841763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51a7d2-ff46-438e-bcbb-79c330ad6dca service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:26.848684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:26.868751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:26.869815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.874962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.875502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] PATH_INFO: `/v3/users/86fb7c8f2aa741aa887f7bb1a1c19f3a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.885334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fb7c8f2aa741aa887f7bb1a1c19f3a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:26.894103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:26.903442 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1247/2491] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:26 2022] POST /identity/v3/projects => generated 399 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:26.912027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:27.029251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fb7c8f2aa741aa887f7bb1a1c19f3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:27.142634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fb7c8f2aa741aa887f7bb1a1c19f3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:27.145684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fb7c8f2aa741aa887f7bb1a1c19f3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:27.162889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:27.170336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fb7c8f2aa741aa887f7bb1a1c19f3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:27.174183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20775f51-1730-4e82-9fed-091f96df5d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fb7c8f2aa741aa887f7bb1a1c19f3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:27.218508 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1245/2492] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:26 2022] DELETE /identity/v3/users/86fb7c8f2aa741aa887f7bb1a1c19f3a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:27.223408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:27.223727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:27.224096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:27.281210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:27.282548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:27.290750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c327462-ba9b-4718-b900-f494aee411eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:27.494501 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1246/2493] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:27.538101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:27.538826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:27.539123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:27.539437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:27.540160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:27.545434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:27.564669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:27.578342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:27.584988 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1248/2494] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:26 2022] POST /identity/v3/users => generated 300 bytes in 675 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:27.590922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:27.592870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:27.625043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aced2bf-2598-4d3b-9e72-482f86370c92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:27.637289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:27.638007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:27.638304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:27.638580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:27.641577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:27.643434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:27.674496 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1249/2495] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:27.678315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:27.706934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca783ab9-a7f8-40ae-8f21-11a807d04a70 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:27.728046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:27.728754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:27.729080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:27.729461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:27.730231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:27.731933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:27.767534 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1250/2496] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:27.770363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:27.809452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ed2fc-db03-4f51-8b75-f76bd82c9005 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:27.829181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb504-b671-431c-916e-bcac8ba8697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:27.830443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb504-b671-431c-916e-bcac8ba8697d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:27.830738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb504-b671-431c-916e-bcac8ba8697d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:27.831025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb504-b671-431c-916e-bcac8ba8697d admin admin] PATH_INFO: `/v3/projects/00e64dd29f7a471da6f7d60e9c00b9f8/users/b85e650a3f01453689cd189bbd5f9467/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:27.869163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fb504-b671-431c-916e-bcac8ba8697d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e64dd29f7a471da6f7d60e9c00b9f8, user_id=b85e650a3f01453689cd189bbd5f9467, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:27.872364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fb504-b671-431c-916e-bcac8ba8697d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:27.910200 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1251/2497] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:27 2022] PUT /identity/v3/projects/00e64dd29f7a471da6f7d60e9c00b9f8/users/b85e650a3f01453689cd189bbd5f9467/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:27.921937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc56db-62e8-4ce5-8ce3-9fa1d6a7777e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:27.922232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc56db-62e8-4ce5-8ce3-9fa1d6a7777e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:27.922621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc56db-62e8-4ce5-8ce3-9fa1d6a7777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:28.002293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fbdc56db-62e8-4ce5-8ce3-9fa1d6a7777e None None] MFA Rules not processed for user `b85e650a3f01453689cd189bbd5f9467`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:28.004089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbdc56db-62e8-4ce5-8ce3-9fa1d6a7777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:28.012993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7ef7-42aa-4ba7-8232-1dc2ee6763d5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:28.101313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:28.216766 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1252/2498] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:28.239346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc56db-62e8-4ce5-8ce3-9fa1d6a7777e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:28.303467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:28.304830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:28.305476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:28.306150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:28.508616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:28.515814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:28.518929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:28.538524 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1247/2499] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 975 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:28.582746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc56db-62e8-4ce5-8ce3-9fa1d6a7777e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:28.602699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:28.603337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:28.603698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:28.603951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:28.604796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:28.606845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:28.677477 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1253/2500] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:28 2022] POST /identity/v3/projects => generated 395 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:28.681611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:28.693950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f91eb-2116-4d69-b4e3-74653deb72ba service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:28.927759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:28.931682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:28.932565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:28.933045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:28.934649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:28.944695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:29.003047 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1248/2501] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:28 2022] POST /identity/v3/users => generated 304 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:29.006691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:29.018503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb226429-74ec-4e00-a2be-f32663b3c0b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:29.031043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:29.031595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:29.032068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:29.032501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:29.033406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:29.036361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:29.055222 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1254/2502] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:29.058154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:29.087242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6c0d3-3c36-43cf-9db9-48f95a2623aa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:29.098954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:29.101246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:29.103033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:29.103698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] PATH_INFO: `/v3/projects/78147ddf28bb4ccb9ebf752102fe5b50/users/23c92b4996ae4b5cab30c56786225383/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:29.192356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78147ddf28bb4ccb9ebf752102fe5b50, user_id=23c92b4996ae4b5cab30c56786225383, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:29.206937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:29.242929 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1249/2503] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:29 2022] PUT /identity/v3/projects/78147ddf28bb4ccb9ebf752102fe5b50/users/23c92b4996ae4b5cab30c56786225383/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:29.258863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:29.293475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c983-f57e-449d-88b9-8c36c1ac77f4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:29.407079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609e327-e7f5-4e03-993e-aa62839b231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:29.408290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e327-e7f5-4e03-993e-aa62839b231f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:29.408778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e327-e7f5-4e03-993e-aa62839b231f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:29.409284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e327-e7f5-4e03-993e-aa62839b231f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:29.410797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609e327-e7f5-4e03-993e-aa62839b231f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:29.415325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609e327-e7f5-4e03-993e-aa62839b231f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:29.444656 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1255/2504] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:29.453119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:29.468725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96a5a-0596-409c-bc4a-2ac94a38b190 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:29.475413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:29.476587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:29.476999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:29.477400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] PATH_INFO: `/v3/projects/78147ddf28bb4ccb9ebf752102fe5b50/users/23c92b4996ae4b5cab30c56786225383/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:29.481007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78147ddf28bb4ccb9ebf752102fe5b50, user_id=23c92b4996ae4b5cab30c56786225383, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:29.484489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:29.518033 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1250/2505] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:29 2022] PUT /identity/v3/projects/78147ddf28bb4ccb9ebf752102fe5b50/users/23c92b4996ae4b5cab30c56786225383/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:29.542673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:29.543148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:29.543585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:29.585541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] MFA Rules not processed for user `23c92b4996ae4b5cab30c56786225383`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:29.587022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:29.701649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:29.710885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:29.715119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:29.883948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1256/2506] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:29.912288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:29.914382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:29.990625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826e0b0-c3ec-4f2a-9d90-a8053ef90e52 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:29.999185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:30.000298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:30.001267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:30.001909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] PATH_INFO: `/v3/projects/4db5c049426148339bc9e18e701d5d3c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:30.004698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db5c049426148339bc9e18e701d5d3c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:30.009342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:30.122396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:30.125416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db5c049426148339bc9e18e701d5d3c', 'request_id': 'req-6ebf900e-784f-4a84-8fc2-7dc19645f88d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.152637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db5c049426148339bc9e18e701d5d3c', 'request_id': 'req-6ebf900e-784f-4a84-8fc2-7dc19645f88d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.170677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f69a15-d59e-4def-a34b-ac340d3599c8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:30.200388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db5c049426148339bc9e18e701d5d3c', 'request_id': 'req-6ebf900e-784f-4a84-8fc2-7dc19645f88d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.232350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] The token cache is being invalidate because project 4db5c049426148339bc9e18e701d5d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:30.232648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.235315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.241322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1251/2507] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:29 2022] DELETE /identity/v3/projects/4db5c049426148339bc9e18e701d5d3c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:30.244514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:30.248975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:30.339670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:30.340386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:30.340726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:30.341014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:30.344330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:30.532541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf900e-784f-4a84-8fc2-7dc19645f88d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:30.541162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:30.548564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:30.556464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:30.557702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:30.559404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:30.559837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] PATH_INFO: `/v3/users/08af42beb9cc4e6eaaeb0e99fcc7bd0a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:30.565484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=08af42beb9cc4e6eaaeb0e99fcc7bd0a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:30.578132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:30.594548 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1257/2508] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:30.750387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08af42beb9cc4e6eaaeb0e99fcc7bd0a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.792280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08af42beb9cc4e6eaaeb0e99fcc7bd0a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.793480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08af42beb9cc4e6eaaeb0e99fcc7bd0a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.814717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08af42beb9cc4e6eaaeb0e99fcc7bd0a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.818965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08af42beb9cc4e6eaaeb0e99fcc7bd0a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:30.868880 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1252/2509] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:30 2022] DELETE /identity/v3/users/08af42beb9cc4e6eaaeb0e99fcc7bd0a => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:31.526532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:31.529310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:31.545925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:31.561480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103a0fb-c08a-45cb-b693-d1214c9bcc9e service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:31.684227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:31.685086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:31.685446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:31.685801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:31.688679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:31.851089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:31.858553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:31.904742 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1258/2510] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:33.198780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:33.204924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:33.506186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:33.524645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b079da-fcb3-4141-a1d6-b51aaf605ebb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:33.539619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:33.542511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:33.543252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:33.544128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] PATH_INFO: `/v3/users/b85e650a3f01453689cd189bbd5f9467` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:33.547769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85e650a3f01453689cd189bbd5f9467)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:33.554341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:33.727383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:33.728898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:33.772586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856e1b6-46d8-4c6a-8d75-394ba7922ee0 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:33.786436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:33.787542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:33.787828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:33.788103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] PATH_INFO: `/v3/projects/f004aa61dbd14b7d9984f9367a4c5949` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:33.789492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f004aa61dbd14b7d9984f9367a4c5949)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:33.791569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:33.824972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85e650a3f01453689cd189bbd5f9467'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.897998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85e650a3f01453689cd189bbd5f9467'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.900979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85e650a3f01453689cd189bbd5f9467'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.934531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f004aa61dbd14b7d9984f9367a4c5949', 'request_id': 'req-57e4f621-5af2-46be-8dff-8f9429a4b3c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.938819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85e650a3f01453689cd189bbd5f9467'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.943644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1715192d-fa99-4992-96b6-1dd46bc89bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85e650a3f01453689cd189bbd5f9467'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.945824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f004aa61dbd14b7d9984f9367a4c5949', 'request_id': 'req-57e4f621-5af2-46be-8dff-8f9429a4b3c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.960243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f004aa61dbd14b7d9984f9367a4c5949', 'request_id': 'req-57e4f621-5af2-46be-8dff-8f9429a4b3c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:33.981941 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1253/2511] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:33 2022] DELETE /identity/v3/users/b85e650a3f01453689cd189bbd5f9467 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:33.991070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:33.991767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:33.992203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:33.995153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] The token cache is being invalidate because project f004aa61dbd14b7d9984f9367a4c5949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:33.995572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:34.000934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-57e4f621-5af2-46be-8dff-8f9429a4b3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:34.009192 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1259/2512] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:33 2022] DELETE /identity/v3/projects/f004aa61dbd14b7d9984f9367a4c5949 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:34.010843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48edd5-43e3-4633-bc53-6b62c0ab887d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.011217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48edd5-43e3-4633-bc53-6b62c0ab887d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.011602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48edd5-43e3-4633-bc53-6b62c0ab887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.025546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:34.027509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:34.055647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ae48edd5-43e3-4633-bc53-6b62c0ab887d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:34.061569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae48edd5-43e3-4633-bc53-6b62c0ab887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:34.095514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:34.163621 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1254/2513] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:34.236126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:34.240114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:34.260683 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1260/2514] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:34.275110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279950b-d2dc-4da6-b962-c6a298f9fd95 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.275456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279950b-d2dc-4da6-b962-c6a298f9fd95 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.275743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279950b-d2dc-4da6-b962-c6a298f9fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.318631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2279950b-d2dc-4da6-b962-c6a298f9fd95 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:34.322106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2279950b-d2dc-4da6-b962-c6a298f9fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:34.355811 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1261/2515] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:34.360707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279950b-d2dc-4da6-b962-c6a298f9fd95 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:34.386301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279950b-d2dc-4da6-b962-c6a298f9fd95 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:34.392741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:34.393613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.394002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.394381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.395582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:34.395992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:34.397924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:34.414307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e292e-986b-47fe-bada-92f68b8b288c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:34.415130 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1262/2516] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:34.420423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:34.422088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:34.422343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.422990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.423500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.437597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182456ef-2597-4521-a358-688e5573ce43 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:34.441203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:34.444074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:34.445004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:34.445806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.446197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.446620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.447620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:34.449715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:34.460154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1255/2517] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:34.498615 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1263/2518] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:34 2022] POST /identity/v3/projects => generated 411 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:34.498924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:34.513314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54a840-3f71-4756-8fe7-a7c6bbef58d4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:34.538028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:34.694677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:34.695691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.697138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.697536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.698444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:34.711460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:34.767319 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1256/2519] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:34 2022] POST /identity/v3/users => generated 306 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:34.772553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:34.797826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0570cd-418d-4597-a843-3a5e913b14e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:34.811997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:34.814879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.815460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.816058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.818260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:34.821825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:34.861195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:34.873696 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1264/2520] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:34.887720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa54e5-1459-44da-adfd-500c557e613c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:34.898197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce314-1a8f-4217-a547-a7a3a54aed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:34.900105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce314-1a8f-4217-a547-a7a3a54aed36 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.901699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce314-1a8f-4217-a547-a7a3a54aed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.902453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce314-1a8f-4217-a547-a7a3a54aed36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:34.904230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ce314-1a8f-4217-a547-a7a3a54aed36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:34.908085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ce314-1a8f-4217-a547-a7a3a54aed36 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:34.935089 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1257/2521] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:34.941697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:34.967177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11091c0-e435-44c9-b6c9-6ec9cb12df9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:34.977690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:34.979344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:34.980247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:34.980912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] PATH_INFO: `/v3/projects/597ba1a6e8624db1841a02a6f544039d/users/2cd356b55fa24209a77907ca05fc0315/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:35.002666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] RBAC: Authorizing `identity:create_grant(project_id=597ba1a6e8624db1841a02a6f544039d, user_id=2cd356b55fa24209a77907ca05fc0315, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:35.006214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:35.060923 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1265/2522] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:34 2022] PUT /identity/v3/projects/597ba1a6e8624db1841a02a6f544039d/users/2cd356b55fa24209a77907ca05fc0315/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:35.067509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:35.067509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:35.067509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:35.124163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:35.125639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:35.300337 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1258/2523] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:35.313162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:35.318194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:35.445388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d1849-2750-4156-b92e-ea8c3e67997a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:35.449916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:35.450663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:35.450947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:35.451229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:35.465663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:35.468791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:35.487528 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1266/2524] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:36.773442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:36.776526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:36.802413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81390039-ac66-489a-9fd9-27833d6e1864 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:36.808804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:36.809888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:36.810277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:36.811400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] PATH_INFO: `/v3/projects/00e64dd29f7a471da6f7d60e9c00b9f8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:36.812483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e64dd29f7a471da6f7d60e9c00b9f8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:36.815160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:36.934649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e64dd29f7a471da6f7d60e9c00b9f8', 'request_id': 'req-42048d4d-a545-4cd3-922b-d0be1472d075'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:36.949809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e64dd29f7a471da6f7d60e9c00b9f8', 'request_id': 'req-42048d4d-a545-4cd3-922b-d0be1472d075'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:36.959780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e64dd29f7a471da6f7d60e9c00b9f8', 'request_id': 'req-42048d4d-a545-4cd3-922b-d0be1472d075'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:36.981359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] The token cache is being invalidate because project 00e64dd29f7a471da6f7d60e9c00b9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:36.981859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:36.982775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:36.987317 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1259/2525] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:36 2022] DELETE /identity/v3/projects/00e64dd29f7a471da6f7d60e9c00b9f8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:36.992896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:37.047057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fcef5-8fe7-4d91-8e03-86f28f03d38d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:37.160187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:37.178842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:37.179634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:37.179889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:37.180168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] PATH_INFO: `/v3/users/23c92b4996ae4b5cab30c56786225383` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:37.181801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c92b4996ae4b5cab30c56786225383)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:37.184092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:37.313505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c92b4996ae4b5cab30c56786225383'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:37.354864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c92b4996ae4b5cab30c56786225383'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:37.368666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c92b4996ae4b5cab30c56786225383'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:37.369402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c92b4996ae4b5cab30c56786225383'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:37.389891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85a6c3d0-1eab-4376-8855-426cc6e722e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c92b4996ae4b5cab30c56786225383'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:37.406585 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1267/2526] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:36 2022] DELETE /identity/v3/users/23c92b4996ae4b5cab30c56786225383 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:38.181884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:38.183973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:38.226277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048d4d-a545-4cd3-922b-d0be1472d075 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:38.285200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:38.418482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:38.419433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.420148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.421291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] PATH_INFO: `/v3/projects/78147ddf28bb4ccb9ebf752102fe5b50` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.422873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78147ddf28bb4ccb9ebf752102fe5b50)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:38.423070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.423841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.423841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.424882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:38.561581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] MFA Rules not processed for user `a1dd9b84cff64f8f825579378817247e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:38.568448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:38.576844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78147ddf28bb4ccb9ebf752102fe5b50', 'request_id': 'req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:38.589258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78147ddf28bb4ccb9ebf752102fe5b50', 'request_id': 'req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:38.599634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78147ddf28bb4ccb9ebf752102fe5b50', 'request_id': 'req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:38.621943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] The token cache is being invalidate because project 78147ddf28bb4ccb9ebf752102fe5b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:38.622236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:38.623003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0d2dbf84-a23e-4c7d-ba34-8a1f43d74e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:38.631364 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1260/2527] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:38 2022] DELETE /identity/v3/projects/78147ddf28bb4ccb9ebf752102fe5b50 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:38.635195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746108e-68b0-4a96-ba07-8fdc17f4fab9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.635905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746108e-68b0-4a96-ba07-8fdc17f4fab9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.637575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746108e-68b0-4a96-ba07-8fdc17f4fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.711054 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1268/2528] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:38.734187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:38.739006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d746108e-68b0-4a96-ba07-8fdc17f4fab9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:38.745708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:38.746556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d746108e-68b0-4a96-ba07-8fdc17f4fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:38.923001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:38.944240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1261/2529] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:38.953337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586d491-9740-4df1-a303-539a855ab9df None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.953667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586d491-9740-4df1-a303-539a855ab9df None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.954040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586d491-9740-4df1-a303-539a855ab9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.985618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca9c2-2ba1-4857-96e2-bce3611d9816 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.011077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0586d491-9740-4df1-a303-539a855ab9df None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:39.014244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.024469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.026017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.026539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.027167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0586d491-9740-4df1-a303-539a855ab9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:39.055809 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1262/2530] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:39.058887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.063515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586d491-9740-4df1-a303-539a855ab9df None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.086987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.164539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586d491-9740-4df1-a303-539a855ab9df None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.176922 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1269/2531] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:39.238170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.238959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.239347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.239692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.240705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:39.241204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.243046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.281869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.282867 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1263/2532] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:39.303544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a06e2-3aa9-4f8c-8b47-47524a988acb service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.319471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.323702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.323893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.323994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.325399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.332541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.404966 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1270/2533] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:39 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:39.409305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.420282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964937b-a350-4e8e-858f-db1b9cdad106 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.485672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:39.592705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.593400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.593688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.593969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.594691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.596790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.645860 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1264/2534] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:39 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:39.646778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.667638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4adb8c-bf64-46f8-ad69-5feeaf77003a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.700227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.706555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.707219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.707360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.710233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.713685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.769441 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1271/2535] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:39.773109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.784204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2b1cb-bfa4-41fb-9097-d53de6567499 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.790106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfea00-ae30-47c8-980d-d11e817f9ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.790825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfea00-ae30-47c8-980d-d11e817f9ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.792632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfea00-ae30-47c8-980d-d11e817f9ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.792632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfea00-ae30-47c8-980d-d11e817f9ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.792632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfea00-ae30-47c8-980d-d11e817f9ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.794437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfea00-ae30-47c8-980d-d11e817f9ca2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.812257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.824927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901a4c-5a34-401d-b344-f9c0c2629369 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.825693 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1265/2536] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:39.830909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.832535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.833105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.833545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48/users/4b7661853e1a40c499c74bfdc76ec97a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.854671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8c4c31f9c94da6bb55cfbba495ca48, user_id=4b7661853e1a40c499c74bfdc76ec97a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.857693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.882061 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1272/2537] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:39 2022] PUT /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48/users/4b7661853e1a40c499c74bfdc76ec97a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:39.893265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118fde-5756-45c6-ad04-979d39014448 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.894554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118fde-5756-45c6-ad04-979d39014448 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.895138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118fde-5756-45c6-ad04-979d39014448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.935672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-86118fde-5756-45c6-ad04-979d39014448 None None] MFA Rules not processed for user `4b7661853e1a40c499c74bfdc76ec97a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:39.937305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-86118fde-5756-45c6-ad04-979d39014448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:40.104897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1266/2538] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:40.112505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:40.385007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacea5d-4743-4614-8e0e-1c9738df7bdf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:40.398862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:40.400056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:40.400998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:40.401428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:40.402311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:40.404511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:40.479495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118fde-5756-45c6-ad04-979d39014448 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:40.490107 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1273/2539] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:40 2022] POST /identity/v3/projects => generated 383 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:40.531600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118fde-5756-45c6-ad04-979d39014448 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:40.770839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:40.771620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:40.772329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:40.772727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:40.779198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:40.796482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:40.844285 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1267/2540] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:40 2022] POST /identity/v3/users => generated 298 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:40.845346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:40.857996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabb0a-9929-4685-bd93-63318b2f2541 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:40.889479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:40.890186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:40.890472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:40.890749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:40.891552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:40.893217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:40.934687 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1274/2541] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:40.936918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:40.953253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d193e-8ef8-4fb5-ba32-0ccee33c47de admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:40.974006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:40.979385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:40.979756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:40.980049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] PATH_INFO: `/v3/projects/e7c3348c390d40c0a31657f023534ba2/users/4f6bc38023484668bda2dc2724025351/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:41.021176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c3348c390d40c0a31657f023534ba2, user_id=4f6bc38023484668bda2dc2724025351, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:41.032835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:41.070460 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1268/2542] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:40 2022] PUT /identity/v3/projects/e7c3348c390d40c0a31657f023534ba2/users/4f6bc38023484668bda2dc2724025351/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:41.076675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:41.090849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2897b-fe73-4cdf-885b-e7875aaed137 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:41.239240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:41.258751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d2a46-4a68-434e-8db4-87e12d96d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:41.259492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2a46-4a68-434e-8db4-87e12d96d19c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:41.259778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2a46-4a68-434e-8db4-87e12d96d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:41.260112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2a46-4a68-434e-8db4-87e12d96d19c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:41.261088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d2a46-4a68-434e-8db4-87e12d96d19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:41.263387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d2a46-4a68-434e-8db4-87e12d96d19c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:41.286272 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1275/2543] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:41.287712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:41.297977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:41.315470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939b81-45bd-4d41-85a0-da8743efa8ca admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:41.325508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:41.327669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:41.328137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:41.328761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] PATH_INFO: `/v3/projects/e7c3348c390d40c0a31657f023534ba2/users/4f6bc38023484668bda2dc2724025351/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:41.331884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c3348c390d40c0a31657f023534ba2, user_id=4f6bc38023484668bda2dc2724025351, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:41.345424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:41.372810 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1269/2544] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:41 2022] PUT /identity/v3/projects/e7c3348c390d40c0a31657f023534ba2/users/4f6bc38023484668bda2dc2724025351/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:41.385532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:41.385968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:41.386615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:41.479339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] MFA Rules not processed for user `4f6bc38023484668bda2dc2724025351`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:41.480646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:41.685711 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1276/2545] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:41.739861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:42.002890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bd406-3d9d-4ab7-8096-774419c1e815 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:42.053103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd00d98-39e7-4ea6-8446-9649be70d990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:42.054904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd00d98-39e7-4ea6-8446-9649be70d990 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:42.055637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd00d98-39e7-4ea6-8446-9649be70d990 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:42.056296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd00d98-39e7-4ea6-8446-9649be70d990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:42.061798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5dd00d98-39e7-4ea6-8446-9649be70d990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:42.307746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd00d98-39e7-4ea6-8446-9649be70d990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:42.311902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd00d98-39e7-4ea6-8446-9649be70d990 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:42.347848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:42.350016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:42.362009 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1270/2546] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:42.393951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1921a0b-f4d6-4c67-9978-9fd3c272d960 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:42.410160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:42.412235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:42.412916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:42.413562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:42.436015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:42.437722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:42.472377 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1277/2547] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:38:42.512321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f3c7-9a31-4483-80b0-0b4be4b61e19 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:42.512721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f3c7-9a31-4483-80b0-0b4be4b61e19 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:42.513107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f3c7-9a31-4483-80b0-0b4be4b61e19 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:42.514872 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1271/2548] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:42.529710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:42.550497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:42.564130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48829bb5-32bd-4d01-a9e4-0994f90adce0 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:42.576294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:42.577479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:42.577979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:42.578444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:42.580184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:42.583403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:42.586362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1278/2549] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:42 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:43.241207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc04ae-d3f8-4568-9bd3-d4b3149f515c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:43.243428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc04ae-d3f8-4568-9bd3-d4b3149f515c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:43.243965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc04ae-d3f8-4568-9bd3-d4b3149f515c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:43.248966 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1272/2550] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:43.252385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:43.295114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:43.327836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e3c4d-662e-4db7-b425-5fa200480fa0 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:43.341992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:43.343981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:43.344445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:43.348515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:43.364960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:43.377345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:43.385290 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1279/2551] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:43 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:43.538445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e037-a726-4adf-827c-a989e66645ff None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:43.538873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e037-a726-4adf-827c-a989e66645ff None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:43.539164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e037-a726-4adf-827c-a989e66645ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:43.600931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4eb0e037-a726-4adf-827c-a989e66645ff None None] MFA Rules not processed for user `4b7661853e1a40c499c74bfdc76ec97a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:43.603727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4eb0e037-a726-4adf-827c-a989e66645ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:43.854392 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1273/2552] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:44.145386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:44.215478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75473c5c-f256-446d-905f-835429d68ed6 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:44.247600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101593-35f7-425a-b36e-d2088522c054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:44.249748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101593-35f7-425a-b36e-d2088522c054 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:44.250838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101593-35f7-425a-b36e-d2088522c054 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:44.251815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101593-35f7-425a-b36e-d2088522c054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:44.273257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30101593-35f7-425a-b36e-d2088522c054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:44.278562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30101593-35f7-425a-b36e-d2088522c054 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:44.323059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1280/2553] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:44.543888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:44.544463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:44.544463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:44.569241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] MFA Rules not processed for user `cdac1d4106674c7ab0cfe39939de9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:44.570810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:44.608374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:44.678075 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1274/2554] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:45.971347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177813-6c12-4c2e-9e1a-3e251677b52f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:45.972524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177813-6c12-4c2e-9e1a-3e251677b52f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:45.973747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177813-6c12-4c2e-9e1a-3e251677b52f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:45.976056 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1281/2555] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:45.984485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:46.019573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:46.047618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f752d9-a998-4b22-8b42-1c66a046b2cb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:46.059173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:46.062629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:46.063214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:46.074713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:46.079312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:46.086507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:46.103332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1275/2556] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:45 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:46.451545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf90e1-5a2d-4d7c-9cf0-1cc60110c6e6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:46.451915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf90e1-5a2d-4d7c-9cf0-1cc60110c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:46.452176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf90e1-5a2d-4d7c-9cf0-1cc60110c6e6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:46.453798 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1282/2557] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:46.460096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:46.484745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:46.521003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f7358-62d1-4311-a639-410329a4dd94 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:46.537359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:46.538314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:46.538545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:46.538826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:46.542975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:46.545707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:46.548826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1276/2558] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:46 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:46.620515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78693d-aa8e-4364-81ec-6e083e912d89 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:46.621285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78693d-aa8e-4364-81ec-6e083e912d89 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:46.621753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78693d-aa8e-4364-81ec-6e083e912d89 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:46.623672 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1283/2559] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:46.629176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:46.649346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:46.674459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433ffe-d8b6-4da4-819a-04a74b74d25b tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:46.690943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bbc2-dcb3-4049-91e5-40e58fb63332 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:46.696186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bbc2-dcb3-4049-91e5-40e58fb63332 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:46.696547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bbc2-dcb3-4049-91e5-40e58fb63332 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:46.696837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bbc2-dcb3-4049-91e5-40e58fb63332 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:46.698313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20bbc2-dcb3-4049-91e5-40e58fb63332 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:46.700609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20bbc2-dcb3-4049-91e5-40e58fb63332 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:46.707560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1277/2560] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:46 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:46.872467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:46.872761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:46.873055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:46.907153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] MFA Rules not processed for user `4b7661853e1a40c499c74bfdc76ec97a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:46.910062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:46.929220 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1284/2561] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:47.919555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed833-a3c8-435d-9d38-06742734088f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:47.920259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed833-a3c8-435d-9d38-06742734088f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:47.920566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed833-a3c8-435d-9d38-06742734088f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:47.925556 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1278/2562] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:47.932139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:47.984926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:48.007455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c2dd6-b0bb-4ffc-9b44-0d125391ff62 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:48.030458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8889f-9304-4e49-8017-433462a5e996 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:48.031723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8889f-9304-4e49-8017-433462a5e996 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:48.032207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8889f-9304-4e49-8017-433462a5e996 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:48.032744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8889f-9304-4e49-8017-433462a5e996 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:48.036086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8889f-9304-4e49-8017-433462a5e996 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:48.041784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8889f-9304-4e49-8017-433462a5e996 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:48.044653 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1285/2563] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:47 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:48.372649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:48.373422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610471c8-edfc-44d2-9eee-efbb5b0573c0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:48.373758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:48.373920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610471c8-edfc-44d2-9eee-efbb5b0573c0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:48.374334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610471c8-edfc-44d2-9eee-efbb5b0573c0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:48.374950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:48.379667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1279/2564] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:48.396313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610471c8-edfc-44d2-9eee-efbb5b0573c0 None None] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:48.421993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] MFA Rules not processed for user `aeb3928894284b77b4aea925a38470ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:48.425264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:48.457746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610471c8-edfc-44d2-9eee-efbb5b0573c0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:48.497276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610471c8-edfc-44d2-9eee-efbb5b0573c0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:48.512941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b0d82-65a5-4c49-9896-0d76082abf13 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:48.514360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b0d82-65a5-4c49-9896-0d76082abf13 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:48.514947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b0d82-65a5-4c49-9896-0d76082abf13 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:48.515502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b0d82-65a5-4c49-9896-0d76082abf13 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:48.520539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b0d82-65a5-4c49-9896-0d76082abf13 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:48.533921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b0d82-65a5-4c49-9896-0d76082abf13 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:48.539913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1280/2565] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:48 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:48.638925 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1286/2566] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:48.649050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396fda-dca4-4632-b019-687841fdd356 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:48.649490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396fda-dca4-4632-b019-687841fdd356 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:48.650024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396fda-dca4-4632-b019-687841fdd356 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:48.651844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1281/2567] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:38:48.666061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:48.720234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:48.772797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde29421-2302-43e4-adde-24fd35efd359 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:48.802235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c81f79-a17e-4b47-ba8f-33aba9ef73b4 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:48.803597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c81f79-a17e-4b47-ba8f-33aba9ef73b4 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:48.804161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c81f79-a17e-4b47-ba8f-33aba9ef73b4 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:48.805286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c81f79-a17e-4b47-ba8f-33aba9ef73b4 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:48.806319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c81f79-a17e-4b47-ba8f-33aba9ef73b4 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:48.809767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c81f79-a17e-4b47-ba8f-33aba9ef73b4 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:48.817657 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1287/2568] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:48 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:49.107491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf52fcc-660c-4ee6-8bdb-8c4580530754 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:49.108405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf52fcc-660c-4ee6-8bdb-8c4580530754 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:49.109507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf52fcc-660c-4ee6-8bdb-8c4580530754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:49.143242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4bf52fcc-660c-4ee6-8bdb-8c4580530754 None None] MFA Rules not processed for user `4b7661853e1a40c499c74bfdc76ec97a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:49.144974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4bf52fcc-660c-4ee6-8bdb-8c4580530754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:49.163820 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1282/2569] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:49.529640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feecac8-7f90-4173-8272-357d6aad41bb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:49.532686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feecac8-7f90-4173-8272-357d6aad41bb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:49.534843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feecac8-7f90-4173-8272-357d6aad41bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:49.669705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:49.679544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4feecac8-7f90-4173-8272-357d6aad41bb None None] MFA Rules not processed for user `2cd356b55fa24209a77907ca05fc0315`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:49.685885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4feecac8-7f90-4173-8272-357d6aad41bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:49.993044 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1288/2570] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:49.997662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0f73-7ab4-4af2-be90-c20762f4f010 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:49.998024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0f73-7ab4-4af2-be90-c20762f4f010 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:49.998479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0f73-7ab4-4af2-be90-c20762f4f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:50.091028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7fef0f73-7ab4-4af2-be90-c20762f4f010 None None] MFA Rules not processed for user `2cd356b55fa24209a77907ca05fc0315`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:50.099076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7fef0f73-7ab4-4af2-be90-c20762f4f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:50.147709 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1283/2571] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:52.082900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feecac8-7f90-4173-8272-357d6aad41bb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:52.106935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feecac8-7f90-4173-8272-357d6aad41bb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:52.115616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da6e5-ba40-4ad7-ba43-b47570a1a58d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:52.117147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da6e5-ba40-4ad7-ba43-b47570a1a58d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:52.117808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da6e5-ba40-4ad7-ba43-b47570a1a58d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:52.118438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da6e5-ba40-4ad7-ba43-b47570a1a58d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:52.131545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da6e5-ba40-4ad7-ba43-b47570a1a58d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:52.133438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da6e5-ba40-4ad7-ba43-b47570a1a58d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:52.159525 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1289/2572] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:52.638301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc753e-aaf9-4eba-8730-1b9040e49946 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:52.639593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc753e-aaf9-4eba-8730-1b9040e49946 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:52.640331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc753e-aaf9-4eba-8730-1b9040e49946 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:52.642697 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1284/2573] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:38:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:52.655501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:52.656419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:52.656999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:52.700034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:52.703413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:52.871762 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1290/2574] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:38:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:52.892407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc753e-aaf9-4eba-8730-1b9040e49946 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:52.896654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-09fc753e-aaf9-4eba-8730-1b9040e49946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:52.946034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc753e-aaf9-4eba-8730-1b9040e49946 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:52.961092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92e85e-73f3-4517-a050-e8ff9aaff3cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:52.962147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e85e-73f3-4517-a050-e8ff9aaff3cc service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:52.962594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e85e-73f3-4517-a050-e8ff9aaff3cc service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:52.965647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e85e-73f3-4517-a050-e8ff9aaff3cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:52.986402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92e85e-73f3-4517-a050-e8ff9aaff3cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:52.998787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92e85e-73f3-4517-a050-e8ff9aaff3cc service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:53.043814 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1285/2575] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:53.941070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:53.945639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:54.163901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a4b91-700f-48ad-baa1-5a6d2279d9bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:54.174450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:54.176897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:54.177762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:54.178555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] PATH_INFO: `/v3/users/a1dd9b84cff64f8f825579378817247e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:54.181816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1dd9b84cff64f8f825579378817247e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:54.188000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:54.309449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:54.349840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1dd9b84cff64f8f825579378817247e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:54.384466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1dd9b84cff64f8f825579378817247e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:54.407955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1dd9b84cff64f8f825579378817247e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:54.408663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1dd9b84cff64f8f825579378817247e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:54.439513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1dd9b84cff64f8f825579378817247e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:54.458293 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1291/2576] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:53 2022] DELETE /identity/v3/users/a1dd9b84cff64f8f825579378817247e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:55.321698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed853d-79dc-41bc-8445-a8a398b1d762 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:55.323230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed853d-79dc-41bc-8445-a8a398b1d762 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:55.323740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed853d-79dc-41bc-8445-a8a398b1d762 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:55.325813 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1286/2577] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:38:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:38:55.333466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:38:55.335743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:55.466366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed853d-79dc-41bc-8445-a8a398b1d762 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:55.470635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5aed853d-79dc-41bc-8445-a8a398b1d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:55.524147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:55.530340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:55.808682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3626-30ac-4c64-bd47-4ad06a8fd373 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:55.826489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370560-51a3-4dad-a4be-320c2013852d tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bc38023484668bda2dc2724025351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7c3348c390d40c0a31657f023534ba2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:55.828128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370560-51a3-4dad-a4be-320c2013852d tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:55.828555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370560-51a3-4dad-a4be-320c2013852d tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:55.829818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370560-51a3-4dad-a4be-320c2013852d tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:55.849805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe370560-51a3-4dad-a4be-320c2013852d tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:55.853242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe370560-51a3-4dad-a4be-320c2013852d tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:55.876404 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1292/2578] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:38:55 2022] GET /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 379 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:55.962478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed853d-79dc-41bc-8445-a8a398b1d762 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:55.974821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:55.976429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:55.978409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:55.979547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] PATH_INFO: `/v3/projects/75c2a95595ca475ab6a5850654026798` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:55.984175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c2a95595ca475ab6a5850654026798)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:55.988555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:56.164652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c2a95595ca475ab6a5850654026798', 'request_id': 'req-ea021e46-d0e0-45ad-95ed-b39c40a55e25'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:56.188602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c2a95595ca475ab6a5850654026798', 'request_id': 'req-ea021e46-d0e0-45ad-95ed-b39c40a55e25'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:56.252779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c2a95595ca475ab6a5850654026798', 'request_id': 'req-ea021e46-d0e0-45ad-95ed-b39c40a55e25'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:56.304085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] The token cache is being invalidate because project 75c2a95595ca475ab6a5850654026798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:38:56.304710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:56.306032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea021e46-d0e0-45ad-95ed-b39c40a55e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:56.312354 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1287/2579] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:55 2022] DELETE /identity/v3/projects/75c2a95595ca475ab6a5850654026798 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:56.318835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac72e0-2ba5-4f4d-a921-edba539c5048 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:56.319371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac72e0-2ba5-4f4d-a921-edba539c5048 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:56.319824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac72e0-2ba5-4f4d-a921-edba539c5048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:56.450831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5cac72e0-2ba5-4f4d-a921-edba539c5048 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:56.456677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5cac72e0-2ba5-4f4d-a921-edba539c5048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:56.628330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:56.678952 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1293/2580] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:56.699456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0bb5d-76b6-4753-a237-d795b94a2568 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:56.700334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0bb5d-76b6-4753-a237-d795b94a2568 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:56.700893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0bb5d-76b6-4753-a237-d795b94a2568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:56.756750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:56.799997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c9f0bb5d-76b6-4753-a237-d795b94a2568 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:56.803663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c9f0bb5d-76b6-4753-a237-d795b94a2568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:56.853442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac72e0-2ba5-4f4d-a921-edba539c5048 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:56.858471 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1288/2581] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:56.897947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac72e0-2ba5-4f4d-a921-edba539c5048 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:56.929877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:56.931714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:56.932357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:56.933007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:56.934661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:56.935420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:56.938825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:57.024655 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1294/2582] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:38:57.028386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0bb5d-76b6-4753-a237-d795b94a2568 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:57.046499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0bb5d-76b6-4753-a237-d795b94a2568 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:57.061893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e45d15-3655-48f1-95b9-885e5eb8e5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:57.062912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e45d15-3655-48f1-95b9-885e5eb8e5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:57.063454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e45d15-3655-48f1-95b9-885e5eb8e5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:57.064071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e45d15-3655-48f1-95b9-885e5eb8e5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:57.064960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e45d15-3655-48f1-95b9-885e5eb8e5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:57.069732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e45d15-3655-48f1-95b9-885e5eb8e5b1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:57.124500 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1289/2583] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:57 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:57.125298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:57.157649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3b86-a77f-4689-a42c-9fc08df7d94d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:57.393235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:57.394036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:57.394868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:57.394868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:57.395998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:57.398474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:57.432272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc8f07-b2bb-47ec-b8b5-50f60841718e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:57.432611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc8f07-b2bb-47ec-b8b5-50f60841718e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:57.433063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc8f07-b2bb-47ec-b8b5-50f60841718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:57.508560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-10bc8f07-b2bb-47ec-b8b5-50f60841718e None None] MFA Rules not processed for user `160fe1ec6b2d45e48990558af381a0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:57.520464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-10bc8f07-b2bb-47ec-b8b5-50f60841718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:57.534667 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1295/2584] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:57 2022] POST /identity/v3/users => generated 295 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:57.552144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:57.617606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa579102-986a-4d3a-8553-2cd3d7cc75b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:57.657166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:57.658550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:57.658878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:57.664228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:57.668072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:57.686316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:57.689899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1290/2585] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:57.767597 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1296/2586] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:57.767978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc8f07-b2bb-47ec-b8b5-50f60841718e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:57.798661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc8f07-b2bb-47ec-b8b5-50f60841718e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:57.810645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:57.812312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:57.812915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:57.813526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:57.814587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:57.824622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:57.865612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:57.870664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1291/2587] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:57.907022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c16d7f-2c1e-42bf-8bf0-61cdf0f09288 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:57.928147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fcf0e-09ed-4be3-985e-3ede3480ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:57.929308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fcf0e-09ed-4be3-985e-3ede3480ee0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:57.929725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fcf0e-09ed-4be3-985e-3ede3480ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:57.930131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fcf0e-09ed-4be3-985e-3ede3480ee0d admin admin] PATH_INFO: `/v3/projects/93c4325b23c544eab268df27d8f485af/users/2020ca323f8947adb35690d56979724d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.007831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:58.010146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:58.039865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fcf0e-09ed-4be3-985e-3ede3480ee0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c4325b23c544eab268df27d8f485af, user_id=2020ca323f8947adb35690d56979724d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:58.046059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fcf0e-09ed-4be3-985e-3ede3480ee0d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:58.046346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5931fc2-89d4-4020-b74f-d2f545773cf9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:58.059062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:58.064669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:58.066030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:58.068639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] PATH_INFO: `/v3/users/4b7661853e1a40c499c74bfdc76ec97a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.073638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7661853e1a40c499c74bfdc76ec97a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:58.079690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:58.082784 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1297/2588] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:57 2022] PUT /identity/v3/projects/93c4325b23c544eab268df27d8f485af/users/2020ca323f8947adb35690d56979724d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:58.090184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:58.091027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:58.091593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.139880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:58.148690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:58.426239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1298/2589] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:58.450828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:58.452400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:58.525073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:58.622781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7661853e1a40c499c74bfdc76ec97a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:58.667404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc5ba2-8d96-4392-8d5a-83bbe55734b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:58.683538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dae8e0-3ba4-409a-827e-8977ac13f866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:58.685282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae8e0-3ba4-409a-827e-8977ac13f866 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:58.685572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae8e0-3ba4-409a-827e-8977ac13f866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:58.689319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7661853e1a40c499c74bfdc76ec97a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:58.692607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7661853e1a40c499c74bfdc76ec97a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:58.695252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae8e0-3ba4-409a-827e-8977ac13f866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.726123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dae8e0-3ba4-409a-827e-8977ac13f866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:58.727824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dae8e0-3ba4-409a-827e-8977ac13f866 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:58.732876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7661853e1a40c499c74bfdc76ec97a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:58.739425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7661853e1a40c499c74bfdc76ec97a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:38:58.769024 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1299/2590] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:38:58.793023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1292/2591] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:38:58 2022] DELETE /identity/v3/users/4b7661853e1a40c499c74bfdc76ec97a => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:58.799375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:58.799805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:58.800220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.852548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:58.854118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:59.027338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1300/2592] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:59.056162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:59.059256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:59.225169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:59.288207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1132d0-be0d-4e90-a731-76a513650fc5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:59.295160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:59.296370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:59.296858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:59.297332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:59.319844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:59.322240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:59.347125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1293/2593] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:39:03.042610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:03.045311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:03.088044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605abaf5-82db-44df-9227-4d508cd8a3a9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:03.124089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:03.126975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:03.129294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:03.129725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] PATH_INFO: `/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:03.137056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8c4c31f9c94da6bb55cfbba495ca48)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:03.149132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:03.400807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8c4c31f9c94da6bb55cfbba495ca48', 'request_id': 'req-835658bb-3769-48c8-b492-673eb3509580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.413817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8c4c31f9c94da6bb55cfbba495ca48', 'request_id': 'req-835658bb-3769-48c8-b492-673eb3509580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.427356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8c4c31f9c94da6bb55cfbba495ca48', 'request_id': 'req-835658bb-3769-48c8-b492-673eb3509580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.447135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] The token cache is being invalidate because project 6c8c4c31f9c94da6bb55cfbba495ca48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:39:03.447659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.449067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.452474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1301/2594] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:39:03 2022] DELETE /identity/v3/projects/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:03.459335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:03.520544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14b885-686d-45bf-a7d5-0660bd1e761b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:03.658091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:03.659085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:03.659551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:03.659945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] PATH_INFO: `/v3/users/4f6bc38023484668bda2dc2724025351` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:03.661434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6bc38023484668bda2dc2724025351)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:03.663818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:03.747290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6bc38023484668bda2dc2724025351'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.783869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6bc38023484668bda2dc2724025351'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.787373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6bc38023484668bda2dc2724025351'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.798150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6bc38023484668bda2dc2724025351'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.798933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-24d02884-ca20-4204-a413-aa40e7c8e489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6bc38023484668bda2dc2724025351'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:03.822780 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1294/2595] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:39:03 2022] DELETE /identity/v3/users/4f6bc38023484668bda2dc2724025351 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:05.686061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:05.689364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:05.761996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835658bb-3769-48c8-b492-673eb3509580 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:05.948118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:06.004687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:06.006177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:06.006882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:06.007307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] PATH_INFO: `/v3/projects/e7c3348c390d40c0a31657f023534ba2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:06.010639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c3348c390d40c0a31657f023534ba2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:06.017057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:06.273164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c3348c390d40c0a31657f023534ba2', 'request_id': 'req-0d380cd5-9492-4b87-b3ec-1b69c533c805'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:06.293357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c3348c390d40c0a31657f023534ba2', 'request_id': 'req-0d380cd5-9492-4b87-b3ec-1b69c533c805'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:06.312600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c3348c390d40c0a31657f023534ba2', 'request_id': 'req-0d380cd5-9492-4b87-b3ec-1b69c533c805'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:06.343909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] The token cache is being invalidate because project e7c3348c390d40c0a31657f023534ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:39:06.344220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:06.348058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d380cd5-9492-4b87-b3ec-1b69c533c805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:06.356482 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1302/2596] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:39:05 2022] DELETE /identity/v3/projects/e7c3348c390d40c0a31657f023534ba2 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:06.358207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc749-845b-4ae6-86c2-c0979a687a20 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:06.358697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc749-845b-4ae6-86c2-c0979a687a20 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:06.358781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc749-845b-4ae6-86c2-c0979a687a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:06.402129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5c0cc749-845b-4ae6-86c2-c0979a687a20 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:06.412778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c0cc749-845b-4ae6-86c2-c0979a687a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:06.587905 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1295/2597] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:06.604315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f0cb-6993-4b91-be5b-8e050afad989 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:06.605022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f0cb-6993-4b91-be5b-8e050afad989 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:06.605404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f0cb-6993-4b91-be5b-8e050afad989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:06.664654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4f22f0cb-6993-4b91-be5b-8e050afad989 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:06.666042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f22f0cb-6993-4b91-be5b-8e050afad989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:06.685260 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1303/2598] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:06.695261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc749-845b-4ae6-86c2-c0979a687a20 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:06.701863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:06.709955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc749-845b-4ae6-86c2-c0979a687a20 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:06.731961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:06.735614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:06.737288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:06.738396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:06.739341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:39:06.740835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:06.747532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:06.769595 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1296/2599] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:39:06.775846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f0cb-6993-4b91-be5b-8e050afad989 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:06.791095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f0cb-6993-4b91-be5b-8e050afad989 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:06.805278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:06.806178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:06.806567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:06.806941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:06.807808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:06.809913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:06.881981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1304/2600] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:39:06 2022] POST /identity/v3/projects => generated 395 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:06.890634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:06.907370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd2f0c-3106-4017-a804-94a227ac7330 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:07.173366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:07.177893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:07.178995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:07.179633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:07.181007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:07.191795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:07.272878 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1297/2601] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:39:06 2022] POST /identity/v3/users => generated 298 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:07.279469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:07.299556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04cdfe-d039-4b72-8f38-156acb9c97ae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:07.318494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:07.319214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:07.321919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:07.322241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:07.323047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:07.326686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:07.362164 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1305/2602] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:39:07.368590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:07.391604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c3414-ff25-4cc8-8cf3-0d69f8abea1b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:07.437425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd91f7-3203-4241-80a5-33e3266f33ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:07.443093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd91f7-3203-4241-80a5-33e3266f33ff admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:07.444580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd91f7-3203-4241-80a5-33e3266f33ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:07.446772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd91f7-3203-4241-80a5-33e3266f33ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:07.460772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd91f7-3203-4241-80a5-33e3266f33ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:07.470225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd91f7-3203-4241-80a5-33e3266f33ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:07.552823 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1298/2603] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:07.554578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:07.571099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d425fc7-e20f-47f2-9a78-1ca73b4152ab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:07.597095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:07.599298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:07.599859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:07.600381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] PATH_INFO: `/v3/projects/f1dc5d177b084cfab1e0d4d9d1715fa3/users/679429de8da0408b93541374e89ce606/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:07.656323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dc5d177b084cfab1e0d4d9d1715fa3, user_id=679429de8da0408b93541374e89ce606, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:07.660361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:07.693654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1306/2604] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:07 2022] PUT /identity/v3/projects/f1dc5d177b084cfab1e0d4d9d1715fa3/users/679429de8da0408b93541374e89ce606/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:39:07.721425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6537a-fbc2-48e8-a97f-957b7100c891 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:07.725325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6537a-fbc2-48e8-a97f-957b7100c891 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:07.726628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6537a-fbc2-48e8-a97f-957b7100c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:07.889749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8fd6537a-fbc2-48e8-a97f-957b7100c891 None None] MFA Rules not processed for user `679429de8da0408b93541374e89ce606`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:07.894150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8fd6537a-fbc2-48e8-a97f-957b7100c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:08.140903 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1299/2605] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:08.141374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:08.305704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb5c83-d647-455f-9814-32b27e3894bd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:08.316971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:08.321157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:08.322315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:08.323476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:08.325515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:08.330646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:08.433901 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1307/2606] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:39:08 2022] POST /identity/v3/projects => generated 395 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:39:08.437738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6537a-fbc2-48e8-a97f-957b7100c891 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:08.470078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6537a-fbc2-48e8-a97f-957b7100c891 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:08.712760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:08.732173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:08.732895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:08.733210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:08.733488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:08.734237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:08.736443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:08.777154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1300/2607] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:39:08 2022] POST /identity/v3/users => generated 304 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:08.784167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:08.792311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:08.797803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2d8d-b5cb-4e95-aada-3419b1e20600 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:08.813978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:08.814684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:08.814971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:08.815252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:08.816664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:08.818779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:08.844174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1308/2608] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:08.847355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:08.861556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b723c-0577-47be-bec9-59cae82d4540 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:08.868621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:08.870430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:08.870804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:08.871164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] PATH_INFO: `/v3/projects/a2d51c8ca43a48418bc6d74aebce7094/users/90c7946a03d44d27941cc2a1e3e18bd3/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:08.900029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d51c8ca43a48418bc6d74aebce7094, user_id=90c7946a03d44d27941cc2a1e3e18bd3, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:08.903766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:08.936886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1301/2609] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:08 2022] PUT /identity/v3/projects/a2d51c8ca43a48418bc6d74aebce7094/users/90c7946a03d44d27941cc2a1e3e18bd3/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:39:08.943394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:08.962563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4f0c-1b96-4b9f-9990-ee7145ac7a3d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:09.181773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b396ae-f1e9-44c8-8220-e6c6846feb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:09.183460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b396ae-f1e9-44c8-8220-e6c6846feb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:09.184138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b396ae-f1e9-44c8-8220-e6c6846feb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:09.184574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b396ae-f1e9-44c8-8220-e6c6846feb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:09.185518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b396ae-f1e9-44c8-8220-e6c6846feb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:09.187783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b396ae-f1e9-44c8-8220-e6c6846feb95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:09.202281 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1309/2610] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:09.207345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:09.223069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b47e6-1f7e-4421-94a9-82501668f9e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:09.228577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ece51-e9f2-44ca-ae2e-d073337b2b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:09.229985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ece51-e9f2-44ca-ae2e-d073337b2b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:09.230473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ece51-e9f2-44ca-ae2e-d073337b2b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:09.231021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ece51-e9f2-44ca-ae2e-d073337b2b47 admin admin] PATH_INFO: `/v3/projects/a2d51c8ca43a48418bc6d74aebce7094/users/90c7946a03d44d27941cc2a1e3e18bd3/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:09.233761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ece51-e9f2-44ca-ae2e-d073337b2b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d51c8ca43a48418bc6d74aebce7094, user_id=90c7946a03d44d27941cc2a1e3e18bd3, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:09.237538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ece51-e9f2-44ca-ae2e-d073337b2b47 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:09.265866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1302/2611] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:09 2022] PUT /identity/v3/projects/a2d51c8ca43a48418bc6d74aebce7094/users/90c7946a03d44d27941cc2a1e3e18bd3/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:09.268567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:09.268865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:09.269249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:09.339828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] MFA Rules not processed for user `90c7946a03d44d27941cc2a1e3e18bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:09.343943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:09.613034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51115f-d4e1-4d65-9394-67da7f7e11b6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:09.613723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51115f-d4e1-4d65-9394-67da7f7e11b6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:09.613723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51115f-d4e1-4d65-9394-67da7f7e11b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:09.629214 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1310/2612] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:09.655158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2e51115f-d4e1-4d65-9394-67da7f7e11b6 None None] MFA Rules not processed for user `679429de8da0408b93541374e89ce606`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:09.657409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e51115f-d4e1-4d65-9394-67da7f7e11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:09.842324 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1303/2613] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:10.186796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:10.188963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:10.351060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fe5d0-6f03-4f58-9389-a044ad9ef8e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:10.360478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0d9f-5927-47c1-b6e9-92d818d274a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:10.362087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0d9f-5927-47c1-b6e9-92d818d274a8 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:10.362883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0d9f-5927-47c1-b6e9-92d818d274a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:10.363519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0d9f-5927-47c1-b6e9-92d818d274a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:10.380561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0d9f-5927-47c1-b6e9-92d818d274a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:10.384625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0d9f-5927-47c1-b6e9-92d818d274a8 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:10.389369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:10.416032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1311/2614] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:39:19.804621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=43,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:20.111763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:20.112194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:20.113060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:20.161487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] MFA Rules not processed for user `038556a90129478eb04699f574ea7e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:20.163428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:20.300655 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1304/2615] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:20.396000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:21.368126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a518e-0b94-40c9-b68c-0e62fc66b8c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:21.369206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a518e-0b94-40c9-b68c-0e62fc66b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:21.370269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a518e-0b94-40c9-b68c-0e62fc66b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:21.493889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c1a518e-0b94-40c9-b68c-0e62fc66b8c2 None None] MFA Rules not processed for user `2020ca323f8947adb35690d56979724d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:21.494922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c1a518e-0b94-40c9-b68c-0e62fc66b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:21.586263 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1312/2616] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:21.594917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:21.600182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:21.916920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a8944-c35c-4924-87a5-a2a4b9e94341 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:21.931842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:21.933220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:21.933794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:21.935943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:21.944086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:21.954465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:22.064637 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1305/2617] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:39:21 2022] POST /identity/v3/projects => generated 387 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:22.065199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a518e-0b94-40c9-b68c-0e62fc66b8c2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:22.087877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a518e-0b94-40c9-b68c-0e62fc66b8c2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:22.279243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:22.281357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:22.282466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:22.284037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:22.286856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:22.317088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:22.411833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:22.414873 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1313/2618] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:39:22 2022] POST /identity/v3/users => generated 300 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:39:22.433273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb608-86e0-4d90-b14d-e210f5306cbf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:22.456758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:22.457456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:22.457884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:22.458163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:22.462982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:22.468174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:22.544004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1306/2619] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:39:22.549037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:22.572465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5243ebe-2db6-4cd1-b7bd-70b0e0900362 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:22.583426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:22.586547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:22.587676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:22.588661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] PATH_INFO: `/v3/projects/21aa538486dc410b865e97aed2d41401/users/ff56711cd7b345788044ca9266a53ae0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:22.653010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aa538486dc410b865e97aed2d41401, user_id=ff56711cd7b345788044ca9266a53ae0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:22.666999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:22.716637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1314/2620] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:22 2022] PUT /identity/v3/projects/21aa538486dc410b865e97aed2d41401/users/ff56711cd7b345788044ca9266a53ae0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:22.721180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:22.791644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c354-97ea-4e89-8369-93c4c3d2806a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:22.922360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:23.027910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:23.029022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:23.029669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:23.030115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:23.031140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:23.033043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:23.052053 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1307/2621] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:39:23.053568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:23.071755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6162eb2-df59-42b3-af37-9620512a2c15 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:23.080164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069cde-a2fa-4bee-bb87-198c707f0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:23.082168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069cde-a2fa-4bee-bb87-198c707f0412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:23.082441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069cde-a2fa-4bee-bb87-198c707f0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:23.082906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069cde-a2fa-4bee-bb87-198c707f0412 admin admin] PATH_INFO: `/v3/projects/21aa538486dc410b865e97aed2d41401/users/ff56711cd7b345788044ca9266a53ae0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:23.086272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069cde-a2fa-4bee-bb87-198c707f0412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aa538486dc410b865e97aed2d41401, user_id=ff56711cd7b345788044ca9266a53ae0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:23.090003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069cde-a2fa-4bee-bb87-198c707f0412 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:23.110492 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1315/2622] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:23 2022] PUT /identity/v3/projects/21aa538486dc410b865e97aed2d41401/users/ff56711cd7b345788044ca9266a53ae0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:39:27.178221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:27.184368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:27.227796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272719-ebaa-42d8-9744-5603ce85b3a8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:27.403849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:27.404792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:27.405077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:27.405354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] PATH_INFO: `/v3/users/0fcd19b670624ba3afda2975aef28523` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:27.407610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcd19b670624ba3afda2975aef28523)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:27.410120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:27.612865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcd19b670624ba3afda2975aef28523'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:27.638556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcd19b670624ba3afda2975aef28523'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:27.639942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcd19b670624ba3afda2975aef28523'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:27.660075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcd19b670624ba3afda2975aef28523'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:27.661028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcd19b670624ba3afda2975aef28523'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:27.729071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1308/2623] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:39:27 2022] DELETE /identity/v3/users/0fcd19b670624ba3afda2975aef28523 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:27.735459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:27.736057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:27.736444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:27.813268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:27.821082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:27.954296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:28.024339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1316/2624] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:28.149189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:28.150834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:28.293749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:28.348924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14701-e6fd-46f5-95dc-dd1d7d4893c4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:28.375780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:28.379629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:28.380072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:28.380466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:28.420281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:28.440385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:28.486886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1309/2625] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:39:31.372281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:31.374675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:31.394747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9df888-6535-48d4-9654-f25822f7f05b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:31.401729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:31.403315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:31.403778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:31.404209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] PATH_INFO: `/v3/projects/b1c0e8ba57d34db18ed461dc962a5e83` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:31.405791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c0e8ba57d34db18ed461dc962a5e83)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:31.410564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:31.514086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c0e8ba57d34db18ed461dc962a5e83', 'request_id': 'req-5708fb32-97eb-4f81-9363-b1a62307774f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:31.562295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c0e8ba57d34db18ed461dc962a5e83', 'request_id': 'req-5708fb32-97eb-4f81-9363-b1a62307774f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:31.584539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c0e8ba57d34db18ed461dc962a5e83', 'request_id': 'req-5708fb32-97eb-4f81-9363-b1a62307774f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:31.622062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] The token cache is being invalidate because project b1c0e8ba57d34db18ed461dc962a5e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:39:31.622754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:31.623953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:31.632531 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1317/2626] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:39:31 2022] DELETE /identity/v3/projects/b1c0e8ba57d34db18ed461dc962a5e83 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:31.633446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:31.652168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41af3-4e08-4b43-ba1d-f7856b505d61 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:31.876220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:31.877069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:31.877479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:31.877906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] PATH_INFO: `/v3/users/18ad404b202d4b0ea3e30ba98aaf9960` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:31.888314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ad404b202d4b0ea3e30ba98aaf9960)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:31.890434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:31.985496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ad404b202d4b0ea3e30ba98aaf9960'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:32.011065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ad404b202d4b0ea3e30ba98aaf9960'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:32.013074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ad404b202d4b0ea3e30ba98aaf9960'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:32.028112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ad404b202d4b0ea3e30ba98aaf9960'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:32.029054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d41561b8-3d26-45d7-9792-d12c4e085890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ad404b202d4b0ea3e30ba98aaf9960'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:32.071828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1310/2627] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:39:31 2022] DELETE /identity/v3/users/18ad404b202d4b0ea3e30ba98aaf9960 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:33.968281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:33.974022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:34.048425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708fb32-97eb-4f81-9363-b1a62307774f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:34.259971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:34.260945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:34.262797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:34.262968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] PATH_INFO: `/v3/projects/d20ef74afe3748a3bdc4372b07f57c4a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:34.267419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d20ef74afe3748a3bdc4372b07f57c4a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:34.272891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:34.379078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20ef74afe3748a3bdc4372b07f57c4a', 'request_id': 'req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:34.401936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20ef74afe3748a3bdc4372b07f57c4a', 'request_id': 'req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:34.411040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20ef74afe3748a3bdc4372b07f57c4a', 'request_id': 'req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:34.420285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:34.437310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] The token cache is being invalidate because project d20ef74afe3748a3bdc4372b07f57c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:39:34.437630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:34.440422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-771f8c33-265c-47aa-a2df-dd7e3bc0dcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:34.443095 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1318/2628] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:39:33 2022] DELETE /identity/v3/projects/d20ef74afe3748a3bdc4372b07f57c4a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:34.448584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1d2bb-3ca4-4a6f-870f-9222c2474e40 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:34.449391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1d2bb-3ca4-4a6f-870f-9222c2474e40 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:34.449822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1d2bb-3ca4-4a6f-870f-9222c2474e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:34.493022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c8f1d2bb-3ca4-4a6f-870f-9222c2474e40 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:34.494449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8f1d2bb-3ca4-4a6f-870f-9222c2474e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:34.664426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1311/2629] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:34.677876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef92ce-66af-40de-8a4f-ab608fbf6d65 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:34.678215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef92ce-66af-40de-8a4f-ab608fbf6d65 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:34.678541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef92ce-66af-40de-8a4f-ab608fbf6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:34.715159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6aef92ce-66af-40de-8a4f-ab608fbf6d65 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:34.717837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6aef92ce-66af-40de-8a4f-ab608fbf6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:34.743713 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1319/2630] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:34.750277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1d2bb-3ca4-4a6f-870f-9222c2474e40 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:34.761630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:34.767099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1d2bb-3ca4-4a6f-870f-9222c2474e40 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:34.780725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:34.782051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:34.785614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:34.786271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:34.789140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:39:34.791874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:34.797808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:34.861839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1312/2631] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:39:34.868680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef92ce-66af-40de-8a4f-ab608fbf6d65 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:34.897103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef92ce-66af-40de-8a4f-ab608fbf6d65 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:34.908471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:34.910803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:34.912464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:34.913368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:34.915339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:34.921360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:34.991355 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1320/2632] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:39:34 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:34.996372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:35.007911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2abe24-bec2-4e2b-88d5-d7b47840b871 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:35.091834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:35.092266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:35.092598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:35.092911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:35.094333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:35.096579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:35.135922 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1313/2633] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:39:34 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:39:35.142235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:35.156435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b740ae-99bc-4d31-92cc-59549da7db32 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:35.164297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:35.165495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:35.166737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:35.167322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:35.181138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:35.185462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:35.221800 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1321/2634] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:35.227694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:35.244860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff52fd-f4bc-4a41-8278-ee371f430b89 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:35.259785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c948ec1-ec14-4be9-ba7f-a0bdb1ff8e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:35.260915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c948ec1-ec14-4be9-ba7f-a0bdb1ff8e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:35.261468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c948ec1-ec14-4be9-ba7f-a0bdb1ff8e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:35.262005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c948ec1-ec14-4be9-ba7f-a0bdb1ff8e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:35.263326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c948ec1-ec14-4be9-ba7f-a0bdb1ff8e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:35.265456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c948ec1-ec14-4be9-ba7f-a0bdb1ff8e05 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:35.288429 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1314/2635] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:35.292400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:35.303323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acffe79-073b-4716-bc7b-175766c44565 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:35.309072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:35.310498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:35.311014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:35.311582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] PATH_INFO: `/v3/projects/2a999d9d8991476983a97cb975c6302a/users/2deda01949ad4a5eb16842b00afe7567/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:35.340229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a999d9d8991476983a97cb975c6302a, user_id=2deda01949ad4a5eb16842b00afe7567, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:35.343552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:35.374102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1322/2636] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:35 2022] PUT /identity/v3/projects/2a999d9d8991476983a97cb975c6302a/users/2deda01949ad4a5eb16842b00afe7567/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:39:35.380190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4261cc-4036-4092-bc65-2d247373460b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:35.380906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4261cc-4036-4092-bc65-2d247373460b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:35.381440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4261cc-4036-4092-bc65-2d247373460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:35.419980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0c4261cc-4036-4092-bc65-2d247373460b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:35.422199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c4261cc-4036-4092-bc65-2d247373460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:35.579306 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1315/2637] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:35.605715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:35.608015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:35.791120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138888-4277-46dd-b600-01cd1f9e56ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:35.801008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:35.803235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:35.804099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:35.804651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:35.826685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:35.828774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:35.846059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1323/2638] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:39:41.245604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:41.246506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:41.246949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:41.303309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] MFA Rules not processed for user `ff56711cd7b345788044ca9266a53ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:41.304852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:41.437891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:41.490205 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1316/2639] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:41.497843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:41.499732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:41.660439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a6b21-2fc6-4ec3-80ea-3ad9bc9e40eb service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:41.668596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7c6a7-3f5b-4ad6-8524-feae7826e300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:41.669289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7c6a7-3f5b-4ad6-8524-feae7826e300 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:41.669588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7c6a7-3f5b-4ad6-8524-feae7826e300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:41.669880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7c6a7-3f5b-4ad6-8524-feae7826e300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:41.672213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-58a7c6a7-3f5b-4ad6-8524-feae7826e300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:41.748391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:41.885568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7c6a7-3f5b-4ad6-8524-feae7826e300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:41.888524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7c6a7-3f5b-4ad6-8524-feae7826e300 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:41.928536 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1324/2640] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:39:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:39:49.346655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:49.349146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:49.437809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8123a-8bc8-45e6-8538-1dd38f2ce4da None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:49.483968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:49.496894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:49.500160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:49.500691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] PATH_INFO: `/v3/users/679429de8da0408b93541374e89ce606` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:49.509996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679429de8da0408b93541374e89ce606)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:49.512982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:49.850891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679429de8da0408b93541374e89ce606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:49.891835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679429de8da0408b93541374e89ce606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:49.893020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679429de8da0408b93541374e89ce606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:49.954473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679429de8da0408b93541374e89ce606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:49.956747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679429de8da0408b93541374e89ce606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:50.007335 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1317/2641] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:39:49 2022] DELETE /identity/v3/users/679429de8da0408b93541374e89ce606 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:50.013897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:50.014455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:50.014455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:50.073960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:50.075331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:50.306449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1325/2642] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:50.338102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:50.339731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:50.506687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b2ac1-d7a4-4346-b1d5-6f455dc78ab0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:50.519538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:50.520817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:50.520817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:50.520817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:50.563817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:50.577217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:50.643675 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1318/2643] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:39:52.568680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:52.570874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:52.590660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfeceb-d8e0-49be-9a11-624c63177386 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:52.601267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:52.602426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:52.602888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:52.603364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] PATH_INFO: `/v3/projects/f1dc5d177b084cfab1e0d4d9d1715fa3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:52.609091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dc5d177b084cfab1e0d4d9d1715fa3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:52.611068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:52.798410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'request_id': 'req-b85e43c7-86fa-43e3-954b-9e4997ce22fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:52.814094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'request_id': 'req-b85e43c7-86fa-43e3-954b-9e4997ce22fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:52.836245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'request_id': 'req-b85e43c7-86fa-43e3-954b-9e4997ce22fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:52.873263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] The token cache is being invalidate because project f1dc5d177b084cfab1e0d4d9d1715fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:39:52.873499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:52.879881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:52.882016 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1326/2644] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:39:52 2022] DELETE /identity/v3/projects/f1dc5d177b084cfab1e0d4d9d1715fa3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:39:52.888061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:52.918850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf2b21-4fc0-44c9-8049-4d4efde13f89 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:53.122076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:53.123247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:53.123915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:53.124269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] PATH_INFO: `/v3/users/90c7946a03d44d27941cc2a1e3e18bd3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:53.126044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c7946a03d44d27941cc2a1e3e18bd3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:53.132038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:53.211756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:53.331451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c7946a03d44d27941cc2a1e3e18bd3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:53.369332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c7946a03d44d27941cc2a1e3e18bd3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:53.370177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c7946a03d44d27941cc2a1e3e18bd3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:53.396051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c7946a03d44d27941cc2a1e3e18bd3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:53.397614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-19de7c65-0849-485e-89ea-e0f9a5fa6a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c7946a03d44d27941cc2a1e3e18bd3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:53.422736 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1319/2645] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:39:52 2022] DELETE /identity/v3/users/90c7946a03d44d27941cc2a1e3e18bd3 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:56.041391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:56.045556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:56.082452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e43c7-86fa-43e3-954b-9e4997ce22fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:56.167516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:56.184426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:56.185846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:56.186387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:56.187011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] PATH_INFO: `/v3/projects/a2d51c8ca43a48418bc6d74aebce7094` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:56.192136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d51c8ca43a48418bc6d74aebce7094)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:56.201309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:56.400083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d51c8ca43a48418bc6d74aebce7094', 'request_id': 'req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:56.432517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d51c8ca43a48418bc6d74aebce7094', 'request_id': 'req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:56.461009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d51c8ca43a48418bc6d74aebce7094', 'request_id': 'req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:56.512331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] The token cache is being invalidate because project a2d51c8ca43a48418bc6d74aebce7094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:39:56.514105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:56.518148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5c6ca3a-0c85-4871-a835-2eb783ed5ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:39:56.525065 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1327/2646] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:39:56 2022] DELETE /identity/v3/projects/a2d51c8ca43a48418bc6d74aebce7094 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:56.531408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973fd7-0e15-4e2b-9af1-ba07683baf65 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:56.533235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973fd7-0e15-4e2b-9af1-ba07683baf65 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:56.534903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973fd7-0e15-4e2b-9af1-ba07683baf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:56.696233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b1973fd7-0e15-4e2b-9af1-ba07683baf65 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:56.706932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b1973fd7-0e15-4e2b-9af1-ba07683baf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:56.829825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:56.831844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:56.833312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:56.885798 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1320/2647] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:56.894261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30849-5f6b-4962-935e-156651c8cd86 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:56.894943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30849-5f6b-4962-935e-156651c8cd86 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:56.895481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30849-5f6b-4962-935e-156651c8cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:56.908302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] MFA Rules not processed for user `2deda01949ad4a5eb16842b00afe7567`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:56.910686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:56.931901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8ed30849-5f6b-4962-935e-156651c8cd86 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:56.936199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ed30849-5f6b-4962-935e-156651c8cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:56.966786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1321/2648] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:56.970383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30849-5f6b-4962-935e-156651c8cd86 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:56.993543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30849-5f6b-4962-935e-156651c8cd86 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.012014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.013161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.014819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.016723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.018083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:39:57.020670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.026780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.065749 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1322/2649] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:39:57.070115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.098228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82257f5-5d52-41ea-bd62-25fd1f4de2a3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.106380 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1328/2650] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:57.111190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.113068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:57.118843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.119900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.120244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.120566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.121255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.125952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.155368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de94da3-8d49-46fa-9485-bba0869aa886 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.169210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.170794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.172949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.173868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.176982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.184642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.210755 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1323/2651] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:39:57 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:57.210755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.284105 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1329/2652] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:39:57 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:57.285228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.353019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:57.384487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe85ba-1cfc-4d89-be82-af76b66dcbdf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.466894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:57.510339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a895fb-9428-41fd-a046-bf65a2de4600 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.526158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.528232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.528232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.528497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.531767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.536291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.570436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.572409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.572703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.574709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.575505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.582928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.597385 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1330/2653] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:39:57 2022] POST /identity/v3/users => generated 298 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:57.598953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.631332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197e663-4009-42e9-a0ee-e0ffd1bb32bd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.634567 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1324/2654] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:39:57 2022] POST /identity/v3/users => generated 289 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:57.638811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.644096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.645225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.645627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.646064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.646946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.649103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.666501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fca60-ebb0-47e2-a547-612995f313a6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.666730 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1331/2655] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:57.675454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.680066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.681169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.681681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.683573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.684667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.688615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.718158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a666-5b3e-44ba-b087-950c1fc73505 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.727141 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1325/2656] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:39:57.729697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.751883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.757635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.760639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.762470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] PATH_INFO: `/v3/projects/fce063950ebc4d3ab9e0fc06579144b8/users/c31177f742594d958cceefddea7bc399/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.763816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18373ec-b795-4d57-8f3c-5ac8ec816e13 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.786101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:57.787209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:57.787691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:57.788152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:57.789184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.809500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.832870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce063950ebc4d3ab9e0fc06579144b8, user_id=c31177f742594d958cceefddea7bc399, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:57.847455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:57.854291 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1326/2657] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:57.855706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:57.888125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2417e9-21ad-4746-8a58-efca67044b23 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:57.916545 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1332/2658] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:57 2022] PUT /identity/v3/projects/fce063950ebc4d3ab9e0fc06579144b8/users/c31177f742594d958cceefddea7bc399/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:57.920678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:58.049125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab4b36-7d1c-4ee9-94e3-e6ec08554e7a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:58.056885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:58.058052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:58.058452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:58.058847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:58.059932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:58.061810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:58.079683 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1333/2659] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:58.083953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:58.105488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141933-80d2-4a8a-800c-c8f7d5330893 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:58.123847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f1adf-07be-4ec2-8d02-7c21b0036313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:58.127051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1adf-07be-4ec2-8d02-7c21b0036313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:58.128442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1adf-07be-4ec2-8d02-7c21b0036313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:58.129103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1adf-07be-4ec2-8d02-7c21b0036313 admin admin] PATH_INFO: `/v3/projects/fce063950ebc4d3ab9e0fc06579144b8/users/c31177f742594d958cceefddea7bc399/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:58.129984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:58.133352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:58.134575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f1adf-07be-4ec2-8d02-7c21b0036313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce063950ebc4d3ab9e0fc06579144b8, user_id=c31177f742594d958cceefddea7bc399, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:58.135078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:58.135504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] PATH_INFO: `/v3/projects/db181b6ddf3f42629734e66aeb2f0e3f/users/2643b694761c4380a7a37fe64add9423/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:58.140051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f1adf-07be-4ec2-8d02-7c21b0036313 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:58.175883 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1334/2660] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:58 2022] PUT /identity/v3/projects/fce063950ebc4d3ab9e0fc06579144b8/users/c31177f742594d958cceefddea7bc399/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:58.181638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db181b6ddf3f42629734e66aeb2f0e3f, user_id=2643b694761c4380a7a37fe64add9423, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:58.186218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:58.233326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1327/2661] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:57 2022] PUT /identity/v3/projects/db181b6ddf3f42629734e66aeb2f0e3f/users/2643b694761c4380a7a37fe64add9423/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:58.247630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc883f-7fcf-479e-9664-3ddbed4b5dfc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:58.249296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc883f-7fcf-479e-9664-3ddbed4b5dfc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:58.249708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc883f-7fcf-479e-9664-3ddbed4b5dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:58.346765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2dfc883f-7fcf-479e-9664-3ddbed4b5dfc None None] MFA Rules not processed for user `2643b694761c4380a7a37fe64add9423`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:58.354929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2dfc883f-7fcf-479e-9664-3ddbed4b5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:58.546139 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1335/2662] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:58.549905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:58.685822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:58.729164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f05cfb-d89a-40d1-9de4-49cb193e3639 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:58.742398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:58.744119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:58.745011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:58.745434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:58.746289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:58.750420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:58.820428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc883f-7fcf-479e-9664-3ddbed4b5dfc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:58.821043 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1328/2663] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:39:58 2022] POST /identity/v3/projects => generated 375 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:39:58.856363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc883f-7fcf-479e-9664-3ddbed4b5dfc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:58.912027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:59.063488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:59.064724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:59.065558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:59.065861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:59.066604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:59.072011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:59.122795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1336/2664] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:39:58 2022] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:39:59.129027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:59.152288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b769f72-b701-408c-a371-ca65a2da854c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:59.172660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:59.175948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:59.177549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:59.179488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:59.182436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:59.189229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:59.232194 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1329/2665] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:59.246493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:59.298320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2081b50-b9ab-46f2-ba7c-90c62c6a5749 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:59.310119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:59.312511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:59.314318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:59.333972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] PATH_INFO: `/v3/projects/bbed583bb3d44926bfffd1be76ef5b3c/users/096d672497e14487bf59b980bce3f294/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:59.407994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbed583bb3d44926bfffd1be76ef5b3c, user_id=096d672497e14487bf59b980bce3f294, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:59.409191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:59.444621 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1337/2666] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:59 2022] PUT /identity/v3/projects/bbed583bb3d44926bfffd1be76ef5b3c/users/096d672497e14487bf59b980bce3f294/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:59.450455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:59.552601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850e43f-59d1-446f-9aff-b9784cd263ec admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:59.764185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ede4-39f7-47d6-b180-b807f7c7a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:59.765971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ede4-39f7-47d6-b180-b807f7c7a4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:59.766436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ede4-39f7-47d6-b180-b807f7c7a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:59.766891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ede4-39f7-47d6-b180-b807f7c7a4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:59.767838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ede4-39f7-47d6-b180-b807f7c7a4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:59.770261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ede4-39f7-47d6-b180-b807f7c7a4e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:59.795974 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1330/2667] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:39:59.801898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:59.820738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cd19e-b4e7-4d02-a830-afdde16c3a4d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:59.838374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d88fa-73f1-40f3-938b-c7d37b57a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:59.838374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d88fa-73f1-40f3-938b-c7d37b57a6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:59.838374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d88fa-73f1-40f3-938b-c7d37b57a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:59.838374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d88fa-73f1-40f3-938b-c7d37b57a6a8 admin admin] PATH_INFO: `/v3/projects/bbed583bb3d44926bfffd1be76ef5b3c/users/096d672497e14487bf59b980bce3f294/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:59.851060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d88fa-73f1-40f3-938b-c7d37b57a6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbed583bb3d44926bfffd1be76ef5b3c, user_id=096d672497e14487bf59b980bce3f294, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:59.851060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d88fa-73f1-40f3-938b-c7d37b57a6a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:59.876577 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1338/2668] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:39:59 2022] PUT /identity/v3/projects/bbed583bb3d44926bfffd1be76ef5b3c/users/096d672497e14487bf59b980bce3f294/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:39:59.878955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:59.879957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:59.880493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:00.010742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] MFA Rules not processed for user `096d672497e14487bf59b980bce3f294`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:00.012479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:00.381184 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1331/2669] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:39:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:00.395091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc992-f49c-498a-9363-869e4d615d3e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:00.396168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc992-f49c-498a-9363-869e4d615d3e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:00.396449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc992-f49c-498a-9363-869e4d615d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:00.454292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2b6dc992-f49c-498a-9363-869e4d615d3e None None] MFA Rules not processed for user `2643b694761c4380a7a37fe64add9423`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:00.463311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b6dc992-f49c-498a-9363-869e4d615d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:00.778746 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1339/2670] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:00.875009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:00.880376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:01.082360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:01.203013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41839aa-fc99-4bee-bcb2-f8960327e3df None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:01.209399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:01.210088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:01.210378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:01.210662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:01.222221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:01.224765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:01.257202 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1332/2671] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:02.351713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21e016-2a15-44b4-960b-c68f2528cc51 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:02.352340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21e016-2a15-44b4-960b-c68f2528cc51 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:02.352340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21e016-2a15-44b4-960b-c68f2528cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:02.423151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7e21e016-2a15-44b4-960b-c68f2528cc51 None None] MFA Rules not processed for user `2643b694761c4380a7a37fe64add9423`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:02.426066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e21e016-2a15-44b4-960b-c68f2528cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:02.441338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1340/2672] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:40:04.198695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:04.200322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:04.481804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846ad3a-960e-42f6-af4a-2c606219f1df service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:04.514390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:04.517060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:04.517977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:04.518832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] PATH_INFO: `/v3/users/cdac1d4106674c7ab0cfe39939de9d7b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:04.521939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdac1d4106674c7ab0cfe39939de9d7b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:04.527120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:04.709773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdac1d4106674c7ab0cfe39939de9d7b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:04.759666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdac1d4106674c7ab0cfe39939de9d7b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:04.762431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdac1d4106674c7ab0cfe39939de9d7b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:04.773941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdac1d4106674c7ab0cfe39939de9d7b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:04.774967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdac1d4106674c7ab0cfe39939de9d7b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:04.807477 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1333/2673] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:40:04 2022] DELETE /identity/v3/users/cdac1d4106674c7ab0cfe39939de9d7b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:04.809464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:04.810307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:04.810307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:04.860554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:04.865416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:05.188829 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1341/2674] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:05.199827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:05.204346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:05.590299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:05.629941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc5564-c5c7-4b21-8f1b-566bb0b16854 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:05.654682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:05.656110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:05.660426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:05.660563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:05.695950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:05.700738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:05.761482 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1334/2675] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:06.986548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:06.993896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:07.041835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e921c6-ae16-4561-a654-73f622e4bcd2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:07.086478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:07.091137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:07.091916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:07.094118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] PATH_INFO: `/v3/projects/c9f14b1548c547608944442a8a351e56` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:07.109538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f14b1548c547608944442a8a351e56)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:07.114957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:07.124374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:07.425961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f14b1548c547608944442a8a351e56', 'request_id': 'req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:07.457038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f14b1548c547608944442a8a351e56', 'request_id': 'req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:07.500826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f14b1548c547608944442a8a351e56', 'request_id': 'req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:07.597291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] The token cache is being invalidate because project c9f14b1548c547608944442a8a351e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:40:07.600028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:07.610456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:07.626379 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1342/2676] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:40:06 2022] DELETE /identity/v3/projects/c9f14b1548c547608944442a8a351e56 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:07.626653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:07.655994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4c05-9639-4b25-a22d-52d67406d57a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:07.996982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:07.999178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:07.999696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:08.000246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] PATH_INFO: `/v3/users/46999c33374645d5a4fd240b493788fd` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:08.002176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46999c33374645d5a4fd240b493788fd)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:08.006924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:08.139751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46999c33374645d5a4fd240b493788fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:08.188707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46999c33374645d5a4fd240b493788fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:08.201013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46999c33374645d5a4fd240b493788fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:08.239134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46999c33374645d5a4fd240b493788fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:08.240420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac3b56f1-8c87-4d34-a4a7-fef00c42fa4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46999c33374645d5a4fd240b493788fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:08.296544 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1335/2677] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:40:07 2022] DELETE /identity/v3/users/46999c33374645d5a4fd240b493788fd => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:09.537619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:09.540029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:09.614749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7fe4-1767-4fe4-aaa7-4ff10dea9b6a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:09.922181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:09.926076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:09.929579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:09.930473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] PATH_INFO: `/v3/projects/21ff6e8454654167baface1d864bff63` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:09.933195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ff6e8454654167baface1d864bff63)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:09.938267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:10.238152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ff6e8454654167baface1d864bff63', 'request_id': 'req-f4269595-ef89-4856-8653-1d7e487ac9c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:10.278057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ff6e8454654167baface1d864bff63', 'request_id': 'req-f4269595-ef89-4856-8653-1d7e487ac9c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:10.318243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ff6e8454654167baface1d864bff63', 'request_id': 'req-f4269595-ef89-4856-8653-1d7e487ac9c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:10.380424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] The token cache is being invalidate because project 21ff6e8454654167baface1d864bff63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:40:10.380917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:10.396058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4269595-ef89-4856-8653-1d7e487ac9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:10.399885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1343/2678] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:40:09 2022] DELETE /identity/v3/projects/21ff6e8454654167baface1d864bff63 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:10.411813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b68ad-2eca-404a-a16c-ff92a75939c7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:10.412422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b68ad-2eca-404a-a16c-ff92a75939c7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:10.412794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b68ad-2eca-404a-a16c-ff92a75939c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:10.571664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c83b68ad-2eca-404a-a16c-ff92a75939c7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:10.582060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c83b68ad-2eca-404a-a16c-ff92a75939c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:10.820607 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1336/2679] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:10.829754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33ae3-8543-40e3-98ad-903e7fd9fa9f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:10.830888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33ae3-8543-40e3-98ad-903e7fd9fa9f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:10.831189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33ae3-8543-40e3-98ad-903e7fd9fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:10.875723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-80f33ae3-8543-40e3-98ad-903e7fd9fa9f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:10.877444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80f33ae3-8543-40e3-98ad-903e7fd9fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:10.933215 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1344/2680] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:10.933490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b68ad-2eca-404a-a16c-ff92a75939c7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:10.947631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b68ad-2eca-404a-a16c-ff92a75939c7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:10.968886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:10.969695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:10.970155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:10.970330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:10.977930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:40:10.978571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:10.980565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:10.991212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:11.014053 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1337/2681] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:40:11.019595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f33ae3-8543-40e3-98ad-903e7fd9fa9f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:11.054134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f33ae3-8543-40e3-98ad-903e7fd9fa9f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:11.070218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:11.071018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:11.071463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:11.071920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:11.072764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:11.078241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:11.126914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:11.161693 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1345/2682] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:40:11 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:11.163599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:11.184134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c49b2-8cb5-4e3c-8e6f-b8c4496510f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:11.355437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:11.356857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:11.357762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:11.360757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:11.362350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:11.367176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:11.473024 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1338/2683] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:40:11 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:40:11.477596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:11.494769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871147-18e2-42ed-be4c-ef562b1d36ab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:11.520759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:11.520759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:11.520759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:11.521420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:11.521731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:11.523518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:11.583051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:11.587591 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1346/2684] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:11.596480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995153-c2fd-48dd-9fc9-1ff68c632396 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:11.618371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe73b9-afd1-4906-8b4a-6f5f506f5364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:11.619814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe73b9-afd1-4906-8b4a-6f5f506f5364 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:11.620286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe73b9-afd1-4906-8b4a-6f5f506f5364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:11.620760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe73b9-afd1-4906-8b4a-6f5f506f5364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:11.621711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe73b9-afd1-4906-8b4a-6f5f506f5364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:11.627039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe73b9-afd1-4906-8b4a-6f5f506f5364 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:11.661520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1339/2685] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:11.664898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:11.727966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36346d-bc13-42fa-a5f5-353fef6e8b30 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:11.757393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:11.759671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:11.763429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:11.766537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] PATH_INFO: `/v3/projects/fa03a018f3b44d6a8286a11529340630/users/b291e7139388497a92f963bcbf50ed8d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:11.852826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa03a018f3b44d6a8286a11529340630, user_id=b291e7139388497a92f963bcbf50ed8d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:11.870468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:11.941626 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1347/2686] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:11 2022] PUT /identity/v3/projects/fa03a018f3b44d6a8286a11529340630/users/b291e7139388497a92f963bcbf50ed8d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:11.952861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50065-2553-46eb-9bc7-e87ffd909f3b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:11.953174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50065-2553-46eb-9bc7-e87ffd909f3b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:11.953416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a50065-2553-46eb-9bc7-e87ffd909f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:12.031719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f2a50065-2553-46eb-9bc7-e87ffd909f3b None None] MFA Rules not processed for user `b291e7139388497a92f963bcbf50ed8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:12.034135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f2a50065-2553-46eb-9bc7-e87ffd909f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:12.292240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1340/2687] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:12.294506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:12.505794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920d64-0c8d-4c85-9faf-78b9f93c67bb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:12.522129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:12.523019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:12.523480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:12.523907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:12.532043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:12.543523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:12.614015 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1348/2688] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:40:12 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:12.616023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a50065-2553-46eb-9bc7-e87ffd909f3b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:12.647349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a50065-2553-46eb-9bc7-e87ffd909f3b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:12.906283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:12.906893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:12.908583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:12.914922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:12.917106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:12.922729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:12.944452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:12.992621 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1341/2689] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:40:12 2022] POST /identity/v3/users => generated 295 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:12.997346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:13.066666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bfa0-7496-4908-8879-baa5b6071494 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:13.111220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:13.116485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:13.117028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:13.119790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:13.129738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:13.133030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:13.204878 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1349/2690] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:40:13.206794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:13.255851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe25d4-023f-404c-94fa-e1058fca1302 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:13.281880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:13.288711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:13.289278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:13.289751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] PATH_INFO: `/v3/projects/f3759faaeb4d4ebf8acbb73a76897cac/users/551701625f564ba8afd3fb1ef4b826cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:13.344693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3759faaeb4d4ebf8acbb73a76897cac, user_id=551701625f564ba8afd3fb1ef4b826cb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:13.351816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:13.425958 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1342/2691] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:13 2022] PUT /identity/v3/projects/f3759faaeb4d4ebf8acbb73a76897cac/users/551701625f564ba8afd3fb1ef4b826cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:13.434206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:13.471061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125fb2b-4a26-4a17-a5c8-38732ec2dedf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:13.628328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fda20-bad0-4e0d-b5fa-98fa589b551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:13.629374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fda20-bad0-4e0d-b5fa-98fa589b551b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:13.629841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fda20-bad0-4e0d-b5fa-98fa589b551b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:13.630433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fda20-bad0-4e0d-b5fa-98fa589b551b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:13.631571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fda20-bad0-4e0d-b5fa-98fa589b551b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:13.634127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fda20-bad0-4e0d-b5fa-98fa589b551b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:13.653412 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1350/2692] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:13.654056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:13.683536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba878b5-a2ca-488a-b145-e7d6205235ce admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:13.696198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:13.697602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:13.698133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:13.698628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] PATH_INFO: `/v3/projects/f3759faaeb4d4ebf8acbb73a76897cac/users/551701625f564ba8afd3fb1ef4b826cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:13.701374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3759faaeb4d4ebf8acbb73a76897cac, user_id=551701625f564ba8afd3fb1ef4b826cb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:13.704677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:13.732267 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1343/2693] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:13 2022] PUT /identity/v3/projects/f3759faaeb4d4ebf8acbb73a76897cac/users/551701625f564ba8afd3fb1ef4b826cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:40:13.744728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0af1b-ef17-4ee8-9a88-4fcf2973c300 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:13.745146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0af1b-ef17-4ee8-9a88-4fcf2973c300 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:13.745427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0af1b-ef17-4ee8-9a88-4fcf2973c300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:13.840402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-85d0af1b-ef17-4ee8-9a88-4fcf2973c300 None None] MFA Rules not processed for user `551701625f564ba8afd3fb1ef4b826cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:13.842236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85d0af1b-ef17-4ee8-9a88-4fcf2973c300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:13.878856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:14.023840 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1351/2694] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:14.031020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:14.033097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:14.245988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426719f-0bf0-41cc-be1f-feffeae8749a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:14.266746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd9ba0-50a1-4644-a417-03af251fe897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:14.266746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9ba0-50a1-4644-a417-03af251fe897 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:14.266746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9ba0-50a1-4644-a417-03af251fe897 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:14.266746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd9ba0-50a1-4644-a417-03af251fe897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:14.293683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9ba0-50a1-4644-a417-03af251fe897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:14.302543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd9ba0-50a1-4644-a417-03af251fe897 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:14.325296 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1344/2695] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:14.887359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0af1b-ef17-4ee8-9a88-4fcf2973c300 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:15.001790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0af1b-ef17-4ee8-9a88-4fcf2973c300 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:15.008721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:15.013576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:15.014310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:15.014830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] PATH_INFO: `/v3/users/b291e7139388497a92f963bcbf50ed8d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:15.020260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b291e7139388497a92f963bcbf50ed8d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:15.023217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:15.116365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b291e7139388497a92f963bcbf50ed8d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:15.162503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b291e7139388497a92f963bcbf50ed8d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:15.192670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b291e7139388497a92f963bcbf50ed8d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:15.194587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b291e7139388497a92f963bcbf50ed8d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:15.235938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b291e7139388497a92f963bcbf50ed8d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:15.262299 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1352/2696] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:40:14 2022] DELETE /identity/v3/users/b291e7139388497a92f963bcbf50ed8d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:15.268991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:15.270218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:15.270748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:15.319063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:15.328129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:15.532801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1345/2697] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:40:15.549648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:15.551577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:15.630873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:15.712777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3ca1-d633-426a-a6ba-efc65bd833c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:15.725428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:15.726129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:15.726416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:15.730879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:15.769505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:15.773433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:15.813866 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1353/2698] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:40:17.464213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:17.465663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:17.487263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113838d-481e-4151-a06b-db1cef7e6167 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:17.505977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:17.506930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:17.507432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:17.507886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:17.515113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:17.748006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:17.884161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:17.888334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:17.934553 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1346/2699] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:19.298072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:19.300946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:19.362291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133810-a290-4235-819d-25fb6933b184 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:19.415326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:19.416383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:19.417331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:19.417331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] PATH_INFO: `/v3/projects/fa03a018f3b44d6a8286a11529340630` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:19.428415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa03a018f3b44d6a8286a11529340630)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:19.456954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:19.612154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa03a018f3b44d6a8286a11529340630', 'request_id': 'req-69285eff-b532-42e8-a3b6-4fcc99983551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:19.623098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa03a018f3b44d6a8286a11529340630', 'request_id': 'req-69285eff-b532-42e8-a3b6-4fcc99983551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:19.643359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa03a018f3b44d6a8286a11529340630', 'request_id': 'req-69285eff-b532-42e8-a3b6-4fcc99983551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:19.691782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] The token cache is being invalidate because project fa03a018f3b44d6a8286a11529340630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:40:19.692085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:19.700034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:19.703362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1354/2700] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:40:19 2022] DELETE /identity/v3/projects/fa03a018f3b44d6a8286a11529340630 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:19.708574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:19.734621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d772f-41bf-498a-bb6f-a1ed36aa5467 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:19.866486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:19.869224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:19.870185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:19.871016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] PATH_INFO: `/v3/users/551701625f564ba8afd3fb1ef4b826cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:19.874666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] RBAC: Authorizing `identity:delete_user(user_id=551701625f564ba8afd3fb1ef4b826cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:19.880154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:20.055708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551701625f564ba8afd3fb1ef4b826cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:20.095145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551701625f564ba8afd3fb1ef4b826cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:20.103891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551701625f564ba8afd3fb1ef4b826cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:20.132492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551701625f564ba8afd3fb1ef4b826cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:20.134808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551701625f564ba8afd3fb1ef4b826cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:20.229003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1347/2701] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:40:19 2022] DELETE /identity/v3/users/551701625f564ba8afd3fb1ef4b826cb => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:21.054236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:21.057810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:21.396182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285eff-b532-42e8-a3b6-4fcc99983551 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:21.576938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466506-73e6-499e-841f-1bf1bfca6527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:21.580497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466506-73e6-499e-841f-1bf1bfca6527 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:21.581595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466506-73e6-499e-841f-1bf1bfca6527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:21.582329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466506-73e6-499e-841f-1bf1bfca6527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:21.586430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a466506-73e6-499e-841f-1bf1bfca6527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:21.688863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:21.815584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466506-73e6-499e-841f-1bf1bfca6527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:21.821136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466506-73e6-499e-841f-1bf1bfca6527 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:21.854457 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1355/2702] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:40:22.272856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:22.275193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:22.449497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:22.485963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a93cf-90f0-4ca5-aa20-2585c939146a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:22.493125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:22.494580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:22.495051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:22.495547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] PATH_INFO: `/v3/projects/f3759faaeb4d4ebf8acbb73a76897cac` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:22.497102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3759faaeb4d4ebf8acbb73a76897cac)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:22.501610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:22.627033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3759faaeb4d4ebf8acbb73a76897cac', 'request_id': 'req-235823ef-36ef-4b52-aa2c-313198636b05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:22.651751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3759faaeb4d4ebf8acbb73a76897cac', 'request_id': 'req-235823ef-36ef-4b52-aa2c-313198636b05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:22.677370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3759faaeb4d4ebf8acbb73a76897cac', 'request_id': 'req-235823ef-36ef-4b52-aa2c-313198636b05'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:22.694157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] The token cache is being invalidate because project f3759faaeb4d4ebf8acbb73a76897cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:40:22.694759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:22.696169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-235823ef-36ef-4b52-aa2c-313198636b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:22.703977 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1348/2703] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:40:22 2022] DELETE /identity/v3/projects/f3759faaeb4d4ebf8acbb73a76897cac => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:22.705809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83ca6-f9d2-44e9-b700-b43f8606e8db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:22.712060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83ca6-f9d2-44e9-b700-b43f8606e8db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:22.712377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83ca6-f9d2-44e9-b700-b43f8606e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:22.740964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-30d83ca6-f9d2-44e9-b700-b43f8606e8db None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:22.742571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30d83ca6-f9d2-44e9-b700-b43f8606e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:22.990659 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1356/2704] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:23.008367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08b50-152a-4acf-a552-e724e2ca429a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:23.008677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08b50-152a-4acf-a552-e724e2ca429a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:23.008955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08b50-152a-4acf-a552-e724e2ca429a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:23.039195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c8d08b50-152a-4acf-a552-e724e2ca429a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:23.040831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8d08b50-152a-4acf-a552-e724e2ca429a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:23.059332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1349/2705] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:23.062947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d83ca6-f9d2-44e9-b700-b43f8606e8db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:23.088474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d83ca6-f9d2-44e9-b700-b43f8606e8db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:23.096033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:23.097341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:23.097833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:23.098309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:23.100353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:40:23.100985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:23.103059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:23.156730 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1357/2706] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:40:23.173341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d08b50-152a-4acf-a552-e724e2ca429a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:23.235125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d08b50-152a-4acf-a552-e724e2ca429a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:23.261265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:23.262338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:23.264227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:23.264737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:23.265673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:23.268476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:23.341325 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1350/2707] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:40:23 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:23.342544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:23.364761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34a673-6dd7-4e2e-921a-2a2965981bc0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:23.652059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:23.654581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:23.654581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:23.654581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:23.656658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:23.664961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:23.740721 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1358/2708] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:40:23 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:40:23.742393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:23.793804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a732-1315-4566-8d3e-c32e926b292e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:23.810735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:23.813152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:23.813152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:23.813572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:23.820394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:23.826584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:23.853819 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1351/2709] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:40:23.862516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:23.876340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433ed47-a0db-4e44-85e0-678807c1ee4d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:23.883365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a926-c70c-4c92-a16c-601dd7d05484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:23.884496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a926-c70c-4c92-a16c-601dd7d05484 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:23.884967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a926-c70c-4c92-a16c-601dd7d05484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:23.885418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a926-c70c-4c92-a16c-601dd7d05484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:23.886577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a926-c70c-4c92-a16c-601dd7d05484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:23.888869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a926-c70c-4c92-a16c-601dd7d05484 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:23.907894 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1359/2710] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:23.909387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:23.941522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99610-5572-4315-871a-8272f307300d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:23.964198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:23.966041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:23.966215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:23.966712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] PATH_INFO: `/v3/projects/d42c6a91fbc440a6a4e4f9a4cf6caaf7/users/a900db43445e48a5a09451a909a074d1/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:24.041883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42c6a91fbc440a6a4e4f9a4cf6caaf7, user_id=a900db43445e48a5a09451a909a074d1, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:24.058263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:24.104214 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1352/2711] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:23 2022] PUT /identity/v3/projects/d42c6a91fbc440a6a4e4f9a4cf6caaf7/users/a900db43445e48a5a09451a909a074d1/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:24.110315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f8e13-e12f-4533-9033-77e77bd83674 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:24.110640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f8e13-e12f-4533-9033-77e77bd83674 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:24.110930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f8e13-e12f-4533-9033-77e77bd83674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:24.171715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0a0f8e13-e12f-4533-9033-77e77bd83674 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:24.181073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a0f8e13-e12f-4533-9033-77e77bd83674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:24.232748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:24.341637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1360/2712] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:24.366688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:24.368579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:24.513228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee8b3-d7bb-4255-816a-0a10fa320f75 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:24.513541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee8b3-d7bb-4255-816a-0a10fa320f75 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:24.513788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee8b3-d7bb-4255-816a-0a10fa320f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:24.540336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9dd6-d7b3-4d72-93ec-3ddec59cc89c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:24.553048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:24.553751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:24.554044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:24.554331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:24.572603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-171ee8b3-d7bb-4255-816a-0a10fa320f75 None None] MFA Rules not processed for user `c31177f742594d958cceefddea7bc399`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:24.573886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-171ee8b3-d7bb-4255-816a-0a10fa320f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:24.574248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:24.575776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:24.603376 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1353/2713] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:24.793572 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1361/2714] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:40:24.803325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:24.805302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:24.852209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:24.965471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9e58-2ef3-47b5-8121-5cd7d0209c7b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:24.972856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:24.974197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:24.974487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:24.974775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:24.976806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:25.188422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:25.192153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:25.232868 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1354/2715] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:26.594393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ee8b3-d7bb-4255-816a-0a10fa320f75 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:26.632060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ee8b3-d7bb-4255-816a-0a10fa320f75 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:26.672921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:26.680695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:26.681520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:26.682388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:26.688851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:26.725791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:26.729325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:26.746403 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1362/2716] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:31.063897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:31.067518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:31.108759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cb99-0e56-4aac-a8e7-f100ac13da52 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:31.115329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:31.116724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:31.117306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:31.117818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] PATH_INFO: `/v3/users/2cd356b55fa24209a77907ca05fc0315` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:31.120888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd356b55fa24209a77907ca05fc0315)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:31.124214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:31.244967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd356b55fa24209a77907ca05fc0315'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:31.276326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd356b55fa24209a77907ca05fc0315'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:31.277291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd356b55fa24209a77907ca05fc0315'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:31.298082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd356b55fa24209a77907ca05fc0315'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:31.300544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7ba79c0-c2bd-44ba-aef0-4d152bbaf68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd356b55fa24209a77907ca05fc0315'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:31.356234 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1355/2717] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:40:31 2022] DELETE /identity/v3/users/2cd356b55fa24209a77907ca05fc0315 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:40:31.794568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:31.877822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180afb2-a37f-43b0-923b-a5a490527c95 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:32.148778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:32.151657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:32.152711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:32.153488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] PATH_INFO: `/v3/projects/597ba1a6e8624db1841a02a6f544039d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:32.156975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597ba1a6e8624db1841a02a6f544039d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:32.168696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:32.201647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83add89-22ce-4f96-9673-617fa2afe1c1 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:32.203845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83add89-22ce-4f96-9673-617fa2afe1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:32.204852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83add89-22ce-4f96-9673-617fa2afe1c1 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:32.221124 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1356/2718] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:40:32 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:40:32.235105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:32.235105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:32.235504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:32.279621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:32.280702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:32.347434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:32.370233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:32.395780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597ba1a6e8624db1841a02a6f544039d', 'request_id': 'req-1c506e28-65b8-4005-b86a-c8fb22a26a54'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:32.425421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597ba1a6e8624db1841a02a6f544039d', 'request_id': 'req-1c506e28-65b8-4005-b86a-c8fb22a26a54'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:32.447726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597ba1a6e8624db1841a02a6f544039d', 'request_id': 'req-1c506e28-65b8-4005-b86a-c8fb22a26a54'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:32.493727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] The token cache is being invalidate because project 597ba1a6e8624db1841a02a6f544039d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:40:32.494215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:32.497762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c506e28-65b8-4005-b86a-c8fb22a26a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:32.504060 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1363/2719] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:40:31 2022] DELETE /identity/v3/projects/597ba1a6e8624db1841a02a6f544039d => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:32.511500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9754-cf55-4f59-ac4c-e89085a95f6c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:32.511801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9754-cf55-4f59-ac4c-e89085a95f6c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:32.512096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9754-cf55-4f59-ac4c-e89085a95f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:32.528798 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1357/2720] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:40:32.560969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d7ed9754-cf55-4f59-ac4c-e89085a95f6c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:32.562776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7ed9754-cf55-4f59-ac4c-e89085a95f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:32.572069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:32.575702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:32.607159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c30f-eae7-45c1-80e2-9ac6f6617b77 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:32.807101 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1364/2721] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:40:32.810408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1fc4-2952-44b4-939e-6134fc04a7ac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:32.815958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1fc4-2952-44b4-939e-6134fc04a7ac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:32.817061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1fc4-2952-44b4-939e-6134fc04a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:32.865550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:32.866268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:32.866768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:32.866986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:32.882299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-541d1fc4-2952-44b4-939e-6134fc04a7ac None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:32.886051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:32.888194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:32.889505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-541d1fc4-2952-44b4-939e-6134fc04a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:32.927306 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1358/2723] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:40:32.928325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:32.928565 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1365/2723] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:32.971084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627d55c-3b6b-4615-8bc9-5666ff65b8a8 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:33.001745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:33.003134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:33.003833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:33.004453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:33.006022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:40:33.006743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:33.010480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:33.096869 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1359/2724] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:40:33.098712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1fc4-2952-44b4-939e-6134fc04a7ac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:33.129427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1fc4-2952-44b4-939e-6134fc04a7ac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:33.138932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:33.140856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:33.141804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:33.143135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:33.145108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:33.149616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:33.242307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:33.252690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1366/2725] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:40:33 2022] POST /identity/v3/projects => generated 397 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:33.281330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46767d0e-b4dd-4ebc-81a4-7852bed08ffb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:33.594601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:33.601659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:33.602650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:33.606903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:33.611318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:33.623800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:33.697627 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1360/2726] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:40:33 2022] POST /identity/v3/users => generated 299 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:33.712558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:33.744985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d3b1-3c6e-481b-9305-ed57842d7e23 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:33.769568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:33.776098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:33.777832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:33.778669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:33.780656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:33.789479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:33.854802 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1367/2727] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:33.858228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:33.921202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb114a6-dc13-4f8e-8057-9d75f1bcbccb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:33.981277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fecd4-ba5e-4eb4-b2e4-c493052a7443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:33.989531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fecd4-ba5e-4eb4-b2e4-c493052a7443 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:33.990269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fecd4-ba5e-4eb4-b2e4-c493052a7443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:33.990754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fecd4-ba5e-4eb4-b2e4-c493052a7443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:34.007883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fecd4-ba5e-4eb4-b2e4-c493052a7443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:34.015523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fecd4-ba5e-4eb4-b2e4-c493052a7443 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:34.058825 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1361/2728] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:34.064880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:34.131106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b565e0-8d5c-4592-a0ec-fdd86f738071 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:34.203231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30bdb2-1565-4fe7-82df-576b17a0cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:34.206147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30bdb2-1565-4fe7-82df-576b17a0cb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:34.206941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30bdb2-1565-4fe7-82df-576b17a0cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:34.207702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30bdb2-1565-4fe7-82df-576b17a0cb45 admin admin] PATH_INFO: `/v3/projects/570505c27a6f4e83a9cdfe10a497a1ae/users/6661091c8dd84d48b029940abd8b76c3/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:34.296264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30bdb2-1565-4fe7-82df-576b17a0cb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570505c27a6f4e83a9cdfe10a497a1ae, user_id=6661091c8dd84d48b029940abd8b76c3, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:34.303320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30bdb2-1565-4fe7-82df-576b17a0cb45 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:34.377749 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1368/2729] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:34 2022] PUT /identity/v3/projects/570505c27a6f4e83a9cdfe10a497a1ae/users/6661091c8dd84d48b029940abd8b76c3/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:34.405572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:34.405572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:34.405572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:34.488402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] MFA Rules not processed for user `6661091c8dd84d48b029940abd8b76c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:34.489832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:34.514370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:34.865586 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1362/2730] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:35.414264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:35.415124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:35.415766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:35.465064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:35.467260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:35.492951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] MFA Rules not processed for user `2deda01949ad4a5eb16842b00afe7567`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:35.512542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:35.816527 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1369/2731] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:35.820717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62837a7a-2db1-4c2f-b224-323a6a1155a7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:35.847055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee6ab5-df4b-4f15-9d19-db91082eee0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:35.855017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6ab5-df4b-4f15-9d19-db91082eee0d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:35.855751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6ab5-df4b-4f15-9d19-db91082eee0d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:35.856348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee6ab5-df4b-4f15-9d19-db91082eee0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:35.893961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee6ab5-df4b-4f15-9d19-db91082eee0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:35.902794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee6ab5-df4b-4f15-9d19-db91082eee0d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:35.918527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1363/2732] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:40:39.406252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:39.409299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:39.440210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:39.543450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e77ea-1d85-40d1-9abc-99f62632e0ed None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:39.544018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e77ea-1d85-40d1-9abc-99f62632e0ed None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:39.544381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e77ea-1d85-40d1-9abc-99f62632e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:39.582140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b99634-2295-4445-b37e-3f8a0eee0645 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:39.614564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c53e77ea-1d85-40d1-9abc-99f62632e0ed None None] MFA Rules not processed for user `2643b694761c4380a7a37fe64add9423`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:39.620077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:39.621188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:39.621685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:39.622185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:39.623823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c53e77ea-1d85-40d1-9abc-99f62632e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:39.629865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:39.675386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:39.677377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:39.703509 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1370/2733] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:39.705762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:39.882616 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1364/2734] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:40.078304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49387e12-0de6-4256-af77-ef7941dda13b service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:40.099380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:40.101425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:40.106340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:40.107016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] PATH_INFO: `/v3/users/6661091c8dd84d48b029940abd8b76c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:40.115658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6661091c8dd84d48b029940abd8b76c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:40.128785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:40.350816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6661091c8dd84d48b029940abd8b76c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:40.403935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6661091c8dd84d48b029940abd8b76c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:40.428464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6661091c8dd84d48b029940abd8b76c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:40.429927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6661091c8dd84d48b029940abd8b76c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:40.461422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6661091c8dd84d48b029940abd8b76c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:40.498250 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1371/2735] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:40:39 2022] DELETE /identity/v3/users/6661091c8dd84d48b029940abd8b76c3 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:40.501682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:40.502419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:40.503236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:40.615187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:40.625153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:40.788118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:40.902979 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1365/2736] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:41.027464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:41.029913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:41.099316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:41.276651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d8570-379a-4391-bf18-c95b11ee7c9e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:41.286924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbfe4c-460b-4877-9413-cfffca35f33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:41.287738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbfe4c-460b-4877-9413-cfffca35f33f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:41.288035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbfe4c-460b-4877-9413-cfffca35f33f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:41.288326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbfe4c-460b-4877-9413-cfffca35f33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:41.313359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbfe4c-460b-4877-9413-cfffca35f33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:41.322919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbfe4c-460b-4877-9413-cfffca35f33f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:41.347788 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1372/2737] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:43.610687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:43.617878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:43.735650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627476bd-354d-4cde-abf0-7f2669cbabbb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:43.761061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:43.763974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:43.764539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:43.765151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] PATH_INFO: `/v3/projects/570505c27a6f4e83a9cdfe10a497a1ae` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:43.768157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570505c27a6f4e83a9cdfe10a497a1ae)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:43.779232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:43.923901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570505c27a6f4e83a9cdfe10a497a1ae', 'request_id': 'req-c1dfa897-556d-499c-9038-12975e529743'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:43.945579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570505c27a6f4e83a9cdfe10a497a1ae', 'request_id': 'req-c1dfa897-556d-499c-9038-12975e529743'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:43.963840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570505c27a6f4e83a9cdfe10a497a1ae', 'request_id': 'req-c1dfa897-556d-499c-9038-12975e529743'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:44.007765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] The token cache is being invalidate because project 570505c27a6f4e83a9cdfe10a497a1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:40:44.008028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:44.015973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1dfa897-556d-499c-9038-12975e529743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:40:44.022939 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1366/2738] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:40:43 2022] DELETE /identity/v3/projects/570505c27a6f4e83a9cdfe10a497a1ae => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:44.027988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4caea-2611-4d62-a361-c9b6b6ba65e5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:44.028805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4caea-2611-4d62-a361-c9b6b6ba65e5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:44.028805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4caea-2611-4d62-a361-c9b6b6ba65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:44.088308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6bc4caea-2611-4d62-a361-c9b6b6ba65e5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:44.102918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bc4caea-2611-4d62-a361-c9b6b6ba65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:44.361874 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1373/2739] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:44.373855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08349bb-e99d-4b34-9faf-5c63a552ecd7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:44.374223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08349bb-e99d-4b34-9faf-5c63a552ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:44.374509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08349bb-e99d-4b34-9faf-5c63a552ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:44.435747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b08349bb-e99d-4b34-9faf-5c63a552ecd7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:44.437515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b08349bb-e99d-4b34-9faf-5c63a552ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:44.475260 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1367/2740] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:44.476041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4caea-2611-4d62-a361-c9b6b6ba65e5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:44.487783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4caea-2611-4d62-a361-c9b6b6ba65e5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:44.510185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:44.515471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:44.516117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:44.516594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:44.519831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:40:44.520434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:44.532060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:44.567534 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1374/2741] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:40:44.582723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08349bb-e99d-4b34-9faf-5c63a552ecd7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:44.652572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08349bb-e99d-4b34-9faf-5c63a552ecd7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:44.662533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:44.663743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:44.664521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:44.665104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:44.666677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:44.672071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:44.764532 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1368/2742] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:40:44 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:44.771081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:44.809176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73f79-b5be-426f-814f-c9e0b950d504 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:45.148691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:45.153757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:45.154888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:45.167433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:45.172168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:45.190889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:45.346535 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1375/2743] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:40:44 2022] POST /identity/v3/users => generated 291 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:45.350893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:45.377075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90265-13e6-4793-aab1-b8eb281623da admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:45.414326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:45.416131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:45.417017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:45.418604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:45.421300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:45.432071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:45.476777 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1369/2744] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:45.481838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:45.515391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489a08c-a85d-4cbb-8f7e-07da3633ba70 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:45.540458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4686-a23b-4b7e-8285-d00139b80b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:45.544292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4686-a23b-4b7e-8285-d00139b80b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:45.546799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4686-a23b-4b7e-8285-d00139b80b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:45.547482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4686-a23b-4b7e-8285-d00139b80b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:45.554103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4686-a23b-4b7e-8285-d00139b80b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:45.562639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4686-a23b-4b7e-8285-d00139b80b98 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:45.644504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:45.653847 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1376/2745] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:45.670218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de40d-06e3-4f57-97d1-5795a31f8763 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:45.677982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:45.679204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:45.679678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:45.680207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] PATH_INFO: `/v3/projects/75041b3d85ea40d4a5525c6c62f91ec2/users/9802f1cfe8d54628a7ccf4aa0d3cc19e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:45.724249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75041b3d85ea40d4a5525c6c62f91ec2, user_id=9802f1cfe8d54628a7ccf4aa0d3cc19e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:45.727547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:45.781262 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1370/2746] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:45 2022] PUT /identity/v3/projects/75041b3d85ea40d4a5525c6c62f91ec2/users/9802f1cfe8d54628a7ccf4aa0d3cc19e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:45.793028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:45.793534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:45.794115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:45.832171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:45.834473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:45.938351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] MFA Rules not processed for user `9802f1cfe8d54628a7ccf4aa0d3cc19e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:45.941066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:46.015710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:46.026945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0bd1e-2419-49d1-952f-e8b9ae24000e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:46.044824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458a00-2595-458c-9cd3-b74d44eb1325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:46.047742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458a00-2595-458c-9cd3-b74d44eb1325 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:46.048742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458a00-2595-458c-9cd3-b74d44eb1325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:46.055989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458a00-2595-458c-9cd3-b74d44eb1325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:46.062037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5458a00-2595-458c-9cd3-b74d44eb1325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:46.118851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458a00-2595-458c-9cd3-b74d44eb1325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:46.126856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458a00-2595-458c-9cd3-b74d44eb1325 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:46.139813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:46.163828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1371/2747] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:46.275345 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1377/2748] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:46.286193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ddfd0-4ebd-4724-a0f4-df946cc5fc00 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:46.286642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ddfd0-4ebd-4724-a0f4-df946cc5fc00 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:46.287033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ddfd0-4ebd-4724-a0f4-df946cc5fc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:46.319190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ff8ddfd0-4ebd-4724-a0f4-df946cc5fc00 None None] MFA Rules not processed for user `9802f1cfe8d54628a7ccf4aa0d3cc19e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:46.324090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff8ddfd0-4ebd-4724-a0f4-df946cc5fc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:46.342772 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1372/2749] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:46.357947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:46.361293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:46.605208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659061d6-aff8-4cd5-a94e-b4fc61830462 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:46.616110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:46.617286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:46.617794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:46.618369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:46.637471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:46.641255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:46.743411 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1378/2750] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:53.349169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:53.350433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:53.351335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:53.510913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] MFA Rules not processed for user `a900db43445e48a5a09451a909a074d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:53.517344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:53.623027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:53.691673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24723d2f-4c96-480d-87e8-f50da4e10c65 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:53.820538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:53.824753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:53.840356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:53.841078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:53.844472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:53.952842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:53.956743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:53.962510 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1373/2751] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:40:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 615 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:53.963558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:53.966817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:54.032615 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1379/2752] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:40:54.259321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16208354-de21-4ba2-91b8-7f9f6c9e865b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:54.300933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:54.302201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:54.302743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:54.303301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:54.305934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:54.316899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:54.421000 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1374/2753] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:40:53 2022] POST /identity/v3/projects => generated 383 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:40:54.428051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:54.469670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046f7c5-233c-412c-b716-c75309c791da service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:54.748082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:54.749126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:54.749126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:54.749455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:54.750086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:54.753050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:54.841597 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1380/2754] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:40:54 2022] POST /identity/v3/users => generated 298 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:40:54.843778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:54.873163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccabfd-cb2e-404b-b870-c7bdde99aafd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:54.895418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:54.896720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:54.899701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:54.900217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:54.904172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:54.910349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:54.962046 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1375/2755] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:54.966314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:54.996794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e90c0-2d98-4b2a-b26e-e730775ab6b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:55.019936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:55.029859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:55.030515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:55.031023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] PATH_INFO: `/v3/projects/ccf8dc5a673540cbb249d88dbdca0775/users/14d5c7190f4d4a53affd6da5b8ca05a5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:55.078288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:55.104614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf8dc5a673540cbb249d88dbdca0775, user_id=14d5c7190f4d4a53affd6da5b8ca05a5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:55.119862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:55.178645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1381/2756] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:54 2022] PUT /identity/v3/projects/ccf8dc5a673540cbb249d88dbdca0775/users/14d5c7190f4d4a53affd6da5b8ca05a5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:55.183346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:55.214965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2eb0-ee6c-49b4-8dca-650d16ba3b2b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:55.369548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:55.391447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:55.392786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:55.393334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:55.393783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:55.394966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:55.399162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:55.430495 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1376/2757] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:40:55.433183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:55.450412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ab33-fd37-4265-86c7-2cb20022234a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:55.466654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d754-12af-43f4-8267-6fe023148281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:55.467906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d754-12af-43f4-8267-6fe023148281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:55.468369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d754-12af-43f4-8267-6fe023148281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:55.468812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d754-12af-43f4-8267-6fe023148281 admin admin] PATH_INFO: `/v3/projects/ccf8dc5a673540cbb249d88dbdca0775/users/14d5c7190f4d4a53affd6da5b8ca05a5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:55.480565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d754-12af-43f4-8267-6fe023148281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf8dc5a673540cbb249d88dbdca0775, user_id=14d5c7190f4d4a53affd6da5b8ca05a5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:55.484444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d754-12af-43f4-8267-6fe023148281 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:55.535376 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1382/2758] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:40:55 2022] PUT /identity/v3/projects/ccf8dc5a673540cbb249d88dbdca0775/users/14d5c7190f4d4a53affd6da5b8ca05a5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:40:58.651812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:58.785407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f095b-53c1-4ca8-b8e9-760975e5e8ca admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:58.908143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781068f-fb79-4d7b-a0a3-660a2d88c5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:58.909357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781068f-fb79-4d7b-a0a3-660a2d88c5cb service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:58.910117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781068f-fb79-4d7b-a0a3-660a2d88c5cb service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:58.910518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781068f-fb79-4d7b-a0a3-660a2d88c5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:58.913145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5781068f-fb79-4d7b-a0a3-660a2d88c5cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:58.928882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781068f-fb79-4d7b-a0a3-660a2d88c5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:58.931491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781068f-fb79-4d7b-a0a3-660a2d88c5cb service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:58.947538 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1377/2759] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:59.463662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870ec7-a7f8-478d-bb37-99c71c0ae0ab None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:59.465480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870ec7-a7f8-478d-bb37-99c71c0ae0ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:59.466255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870ec7-a7f8-478d-bb37-99c71c0ae0ab None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:59.471056 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1383/2760] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:40:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:40:59.479386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:59.479722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:59.479722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:59.519093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:59.520585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:59.698187 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1378/2761] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:59.728948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da870ec7-a7f8-478d-bb37-99c71c0ae0ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:59.729445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da870ec7-a7f8-478d-bb37-99c71c0ae0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:59.738197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:40:59.742352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:59.765038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:59.766224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da870ec7-a7f8-478d-bb37-99c71c0ae0ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:59.780935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:59.781816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:59.782825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:59.783324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:59.803110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:59.805086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:59.837819 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1384/2762] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:59.860346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08672472-4a77-4a76-a089-70d99ede72e7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:40:59.869265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:40:59.870393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:59.870976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:59.871390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] PATH_INFO: `/v3/users/160fe1ec6b2d45e48990558af381a0ef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:59.873037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=160fe1ec6b2d45e48990558af381a0ef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:40:59.875676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:40:59.986947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160fe1ec6b2d45e48990558af381a0ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:00.011079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160fe1ec6b2d45e48990558af381a0ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:00.012186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160fe1ec6b2d45e48990558af381a0ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:00.032857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160fe1ec6b2d45e48990558af381a0ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:00.033976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160fe1ec6b2d45e48990558af381a0ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:00.065230 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1379/2763] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:40:59 2022] DELETE /identity/v3/users/160fe1ec6b2d45e48990558af381a0ef => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:00.870182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:00.902751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f20-c7f9-464b-af92-00c41f62e3f0 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:01.109784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:01.112104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:01.112619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:01.113360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] PATH_INFO: `/v3/projects/ab3c7bb172ef49c6a5154aee18c8a1bd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:01.117071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3c7bb172ef49c6a5154aee18c8a1bd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:01.125372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:01.259789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'request_id': 'req-8dff4cb7-42d9-4675-a628-f5664a87ed39'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.283607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'request_id': 'req-8dff4cb7-42d9-4675-a628-f5664a87ed39'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.309219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'request_id': 'req-8dff4cb7-42d9-4675-a628-f5664a87ed39'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.354431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] The token cache is being invalidate because project ab3c7bb172ef49c6a5154aee18c8a1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:41:01.357768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.361935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.368409 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1385/2764] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:00 2022] DELETE /identity/v3/projects/ab3c7bb172ef49c6a5154aee18c8a1bd => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:01.372942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:01.375094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:01.408585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018badd6-b583-4c1e-98d9-b7adf5d68eeb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:01.571812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:01.574176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:01.574472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:01.574758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] PATH_INFO: `/v3/users/35ce03a26c00427186bb40ca3702ab57` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:01.576940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ce03a26c00427186bb40ca3702ab57)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:01.580300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:01.695189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:01.738057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ce03a26c00427186bb40ca3702ab57'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.764083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ce03a26c00427186bb40ca3702ab57'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.764894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ce03a26c00427186bb40ca3702ab57'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.789204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ce03a26c00427186bb40ca3702ab57'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.790221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6e5fd593-b3d4-480e-a789-f876d3d3ae92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ce03a26c00427186bb40ca3702ab57'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:01.817411 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1380/2765] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:41:01 2022] DELETE /identity/v3/users/35ce03a26c00427186bb40ca3702ab57 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:02.983466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:02.985268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:03.008933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff4cb7-42d9-4675-a628-f5664a87ed39 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:03.122315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:03.135181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:03.139408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:03.140556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:03.141680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] PATH_INFO: `/v3/projects/acc8515302ea49fc8741ea90168af96e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:03.145204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc8515302ea49fc8741ea90168af96e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:03.150390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:03.299484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc8515302ea49fc8741ea90168af96e', 'request_id': 'req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:03.321722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc8515302ea49fc8741ea90168af96e', 'request_id': 'req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:03.340024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc8515302ea49fc8741ea90168af96e', 'request_id': 'req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:03.377082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] The token cache is being invalidate because project acc8515302ea49fc8741ea90168af96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:41:03.378086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:03.380793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93f63b71-9d3f-4a54-bb86-e8d1e6e53123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:03.386054 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1386/2766] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:02 2022] DELETE /identity/v3/projects/acc8515302ea49fc8741ea90168af96e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:03.396335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb058c5-e574-462d-9c73-733ece4667f2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:03.397826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb058c5-e574-462d-9c73-733ece4667f2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:03.399343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb058c5-e574-462d-9c73-733ece4667f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:03.481229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3cb058c5-e574-462d-9c73-733ece4667f2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:03.484014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3cb058c5-e574-462d-9c73-733ece4667f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:03.730339 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1381/2767] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:03.741190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537af17-58b6-49c8-9848-0240f31f0979 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:03.742880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537af17-58b6-49c8-9848-0240f31f0979 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:03.743778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537af17-58b6-49c8-9848-0240f31f0979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:03.789691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0537af17-58b6-49c8-9848-0240f31f0979 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:03.792664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0537af17-58b6-49c8-9848-0240f31f0979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:03.816981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1387/2768] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:03.821729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb058c5-e574-462d-9c73-733ece4667f2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:03.834725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb058c5-e574-462d-9c73-733ece4667f2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:03.854361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:03.855218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:03.855540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:03.855830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:03.856757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:41:03.857089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:03.860090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:03.903190 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1382/2769] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:41:03.904937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537af17-58b6-49c8-9848-0240f31f0979 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:03.941887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537af17-58b6-49c8-9848-0240f31f0979 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:03.956160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:03.957509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:03.958394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:03.959026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:03.961190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:03.967722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:04.081377 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1388/2770] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:41:03 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:04.087321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:04.098600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac0f5-6acf-4947-9fe5-7e19a8429923 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:04.223823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:04.224572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:04.224865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:04.225150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:04.225898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:04.228332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:04.284227 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1383/2771] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:41:04 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:04.288425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:04.304328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc0ab-0323-4a97-85f3-ed8f1a34c901 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:04.312394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:04.314458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:04.315141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:04.315757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:04.316811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:04.318946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:04.402716 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1389/2772] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:04.403089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:04.433232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67694d97-c1c4-4dd1-ad94-21feeb71fe6f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:04.442028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef53a-cc54-4570-aa17-8153be0b1c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:04.442728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef53a-cc54-4570-aa17-8153be0b1c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:04.443012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef53a-cc54-4570-aa17-8153be0b1c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:04.443423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef53a-cc54-4570-aa17-8153be0b1c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:04.444237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ef53a-cc54-4570-aa17-8153be0b1c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:04.446785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ef53a-cc54-4570-aa17-8153be0b1c21 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:04.462388 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1384/2773] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:41:04.467417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:04.481728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e914bc-4958-44f2-8937-9c3caee52dff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:04.492464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:04.494699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:04.495074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:04.495481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] PATH_INFO: `/v3/projects/e8e8a949f5fc4660a90577621995b412/users/c6c8f8bb1ded4a77b13ec0e566772321/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:04.520879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e8a949f5fc4660a90577621995b412, user_id=c6c8f8bb1ded4a77b13ec0e566772321, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:04.530877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:04.569541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2fbc-d3d2-482f-bb82-2f622863650c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:04.569963 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1390/2774] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:04 2022] PUT /identity/v3/projects/e8e8a949f5fc4660a90577621995b412/users/c6c8f8bb1ded4a77b13ec0e566772321/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:04.570325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2fbc-d3d2-482f-bb82-2f622863650c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:04.570793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2fbc-d3d2-482f-bb82-2f622863650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:04.618473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0fda2fbc-d3d2-482f-bb82-2f622863650c None None] MFA Rules not processed for user `c6c8f8bb1ded4a77b13ec0e566772321`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:04.620647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0fda2fbc-d3d2-482f-bb82-2f622863650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:04.625925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:04.846713 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1385/2775] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:04.848041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:04.976633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfb605-413d-4456-aed9-37e3e1b4515e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:04.986338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:05.002550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721591bf-a921-4b12-9a4a-4cd8f373d095 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:05.002869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721591bf-a921-4b12-9a4a-4cd8f373d095 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:05.003762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721591bf-a921-4b12-9a4a-4cd8f373d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:05.004511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:05.016346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:05.018763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:05.022308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:05.026175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:05.047425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-721591bf-a921-4b12-9a4a-4cd8f373d095 None None] MFA Rules not processed for user `2020ca323f8947adb35690d56979724d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:05.049675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-721591bf-a921-4b12-9a4a-4cd8f373d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:05.156621 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1391/2776] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:41:04 2022] POST /identity/v3/projects => generated 381 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:05.160705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:05.192760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:05.265169 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1386/2777] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:05.275715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5142f-fa6a-47c1-8000-c3315e73b322 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:05.276009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5142f-fa6a-47c1-8000-c3315e73b322 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:05.281232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5142f-fa6a-47c1-8000-c3315e73b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:05.331302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-63d5142f-fa6a-47c1-8000-c3315e73b322 None None] MFA Rules not processed for user `2020ca323f8947adb35690d56979724d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:05.340125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63d5142f-fa6a-47c1-8000-c3315e73b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:05.349016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61afa-b262-4e53-8388-1d0277d38df0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:05.362249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:05.363109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:05.363623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:05.364004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:05.364856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:05.367183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:05.426206 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1392/2778] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:41:05 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:05.430638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:05.456106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c277002-26ca-436e-b931-7733de5cfe18 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:05.466982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:05.468166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:05.468701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:05.469195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:05.470233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:05.474555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:05.497419 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1387/2779] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:05.509988 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1393/2780] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:41:05.515151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5142f-fa6a-47c1-8000-c3315e73b322 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:05.532703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5142f-fa6a-47c1-8000-c3315e73b322 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:05.539761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:05.541138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:05.542349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:05.542723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] PATH_INFO: `/v3/projects/c4a3f5dfd4264e43a710de6330f6f91f/users/5302aa4b71eb41128b2f0147cbdeb5d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:05.586812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3f5dfd4264e43a710de6330f6f91f, user_id=5302aa4b71eb41128b2f0147cbdeb5d0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:05.599443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:05.632268 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1388/2781] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:05 2022] PUT /identity/v3/projects/c4a3f5dfd4264e43a710de6330f6f91f/users/5302aa4b71eb41128b2f0147cbdeb5d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:05.635701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:05.730798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981917-6cd6-4569-af82-651bc6ef74cf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:05.986791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be488a-db92-4f5a-a676-14e78fdd74b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:06.004148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be488a-db92-4f5a-a676-14e78fdd74b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:06.004480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be488a-db92-4f5a-a676-14e78fdd74b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:06.004721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be488a-db92-4f5a-a676-14e78fdd74b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:06.006534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be488a-db92-4f5a-a676-14e78fdd74b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:06.007258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be488a-db92-4f5a-a676-14e78fdd74b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:06.034423 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1394/2782] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:06.034754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:06.045912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32f2d4-74e2-471e-b7b3-3f6d5c1bd094 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:06.062167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:06.062869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:06.063542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:06.063542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] PATH_INFO: `/v3/projects/c4a3f5dfd4264e43a710de6330f6f91f/users/5302aa4b71eb41128b2f0147cbdeb5d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:06.070592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3f5dfd4264e43a710de6330f6f91f, user_id=5302aa4b71eb41128b2f0147cbdeb5d0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:06.073965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:06.108186 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1389/2783] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:06 2022] PUT /identity/v3/projects/c4a3f5dfd4264e43a710de6330f6f91f/users/5302aa4b71eb41128b2f0147cbdeb5d0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:06.121591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e766b2a-e441-4c94-9e52-f4845c62cb38 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:06.121928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e766b2a-e441-4c94-9e52-f4845c62cb38 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:06.122241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e766b2a-e441-4c94-9e52-f4845c62cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:06.184027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e766b2a-e441-4c94-9e52-f4845c62cb38 None None] MFA Rules not processed for user `5302aa4b71eb41128b2f0147cbdeb5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:06.186266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e766b2a-e441-4c94-9e52-f4845c62cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:06.371891 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1395/2784] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:06.472934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:06.475069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:06.519133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:06.675609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967f92-f698-4ab6-81ff-391cc8f46318 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:06.692123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:06.693248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:06.696525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:06.702098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:06.713108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:06.758290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:06.760591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:06.777333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1390/2785] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:07.193238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e766b2a-e441-4c94-9e52-f4845c62cb38 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:07.226111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e766b2a-e441-4c94-9e52-f4845c62cb38 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:07.237304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce648fd-2344-4833-9fd2-65f50619f103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:07.251876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce648fd-2344-4833-9fd2-65f50619f103 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:07.252922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce648fd-2344-4833-9fd2-65f50619f103 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:07.253420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce648fd-2344-4833-9fd2-65f50619f103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:07.277396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:07.286769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce648fd-2344-4833-9fd2-65f50619f103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:07.289918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce648fd-2344-4833-9fd2-65f50619f103 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:07.310568 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1396/2786] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:09.270257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:09.431727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957500e4-14fe-497c-8593-cfb87bd88f39 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:09.447650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:09.448574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:09.448863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:09.449182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] PATH_INFO: `/v3/users/c6c8f8bb1ded4a77b13ec0e566772321` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:09.450595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c8f8bb1ded4a77b13ec0e566772321)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:09.453225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:09.573741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c8f8bb1ded4a77b13ec0e566772321'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:09.603427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c8f8bb1ded4a77b13ec0e566772321'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:09.604556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c8f8bb1ded4a77b13ec0e566772321'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:09.623239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c8f8bb1ded4a77b13ec0e566772321'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:09.624925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c8f8bb1ded4a77b13ec0e566772321'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:09.677258 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1391/2787] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:41:09 2022] DELETE /identity/v3/users/c6c8f8bb1ded4a77b13ec0e566772321 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:09.682789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:09.683718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:09.683882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:09.754563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:09.761148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:09.937357 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1397/2788] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:09.970924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:09.973521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:10.018143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:10.067327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4efed5-b7f1-4b9b-afa9-5aaa58de867e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:10.077349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:10.080102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:10.080656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:10.081281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:10.106622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:10.110673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:10.167894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1392/2789] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:11.614858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:11.618226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:11.659772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9815e-6efc-4251-9733-5ce442ff6e65 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:11.677511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:11.683927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:11.684325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:11.685829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] PATH_INFO: `/v3/projects/e8e8a949f5fc4660a90577621995b412` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:11.688377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e8a949f5fc4660a90577621995b412)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:11.692486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:11.842164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e8a949f5fc4660a90577621995b412', 'request_id': 'req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:11.890748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e8a949f5fc4660a90577621995b412', 'request_id': 'req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:11.906069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e8a949f5fc4660a90577621995b412', 'request_id': 'req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:11.953999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] The token cache is being invalidate because project e8e8a949f5fc4660a90577621995b412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:41:11.954529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:11.958240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ea46062-cf42-4ea1-8fbc-7d5b8f7a976a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:11.969010 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1398/2790] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:11 2022] DELETE /identity/v3/projects/e8e8a949f5fc4660a90577621995b412 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:11.976058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:11.995032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa31fb2-1f6d-4186-8693-0fd04cbfaf4a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:12.009990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:12.011155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:12.014379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:12.097370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] MFA Rules not processed for user `14d5c7190f4d4a53affd6da5b8ca05a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:12.099792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:12.187598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:12.192448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:12.193022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:12.193490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] PATH_INFO: `/v3/users/5302aa4b71eb41128b2f0147cbdeb5d0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:12.197448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5302aa4b71eb41128b2f0147cbdeb5d0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:12.203220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:12.355171 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1399/2791] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:12.372348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5302aa4b71eb41128b2f0147cbdeb5d0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:12.377038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:12.380352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:12.399541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5302aa4b71eb41128b2f0147cbdeb5d0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:12.401014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5302aa4b71eb41128b2f0147cbdeb5d0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:12.410151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:12.421593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5302aa4b71eb41128b2f0147cbdeb5d0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:12.423045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5302aa4b71eb41128b2f0147cbdeb5d0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:12.453111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1393/2792] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:41:11 2022] DELETE /identity/v3/users/5302aa4b71eb41128b2f0147cbdeb5d0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:12.515030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06041d5f-f2d2-43c4-ac79-752cce079543 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:12.632757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f2b88-9188-42d5-bbe5-0a3f29af20e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:12.635160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2b88-9188-42d5-bbe5-0a3f29af20e5 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:12.635858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2b88-9188-42d5-bbe5-0a3f29af20e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:12.636352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2b88-9188-42d5-bbe5-0a3f29af20e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:12.638886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a84f2b88-9188-42d5-bbe5-0a3f29af20e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:12.759885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f2b88-9188-42d5-bbe5-0a3f29af20e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:12.772235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f2b88-9188-42d5-bbe5-0a3f29af20e5 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:12.801728 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1400/2793] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:41:14.048651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:14.052153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:14.379703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:14.408314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24debc0-6833-49bb-aacf-3d698cacebe3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:14.443005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:14.451517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:14.463684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:14.463684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] PATH_INFO: `/v3/projects/c4a3f5dfd4264e43a710de6330f6f91f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:14.484562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a3f5dfd4264e43a710de6330f6f91f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:14.490416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:14.708668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a3f5dfd4264e43a710de6330f6f91f', 'request_id': 'req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:14.725424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a3f5dfd4264e43a710de6330f6f91f', 'request_id': 'req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:14.743256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a3f5dfd4264e43a710de6330f6f91f', 'request_id': 'req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:14.777499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] The token cache is being invalidate because project c4a3f5dfd4264e43a710de6330f6f91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:41:14.779800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:14.784357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7bd06a-1fee-4d7a-b848-3596d03d78e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:14.790893 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1394/2794] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:14 2022] DELETE /identity/v3/projects/c4a3f5dfd4264e43a710de6330f6f91f => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:14.793580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473d98-d20d-4463-ab11-3072cf1dc3db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:14.794123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473d98-d20d-4463-ab11-3072cf1dc3db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:14.794858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473d98-d20d-4463-ab11-3072cf1dc3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:14.882991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8c473d98-d20d-4463-ab11-3072cf1dc3db None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:14.886680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8c473d98-d20d-4463-ab11-3072cf1dc3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:15.222130 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1401/2795] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:15.224712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bfc9d-e5c3-44e5-8f00-51196fcb82d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:15.225562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bfc9d-e5c3-44e5-8f00-51196fcb82d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:15.225724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bfc9d-e5c3-44e5-8f00-51196fcb82d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:15.266543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f63bfc9d-e5c3-44e5-8f00-51196fcb82d0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:15.272887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f63bfc9d-e5c3-44e5-8f00-51196fcb82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:15.327774 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1395/2796] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:15.331194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c473d98-d20d-4463-ab11-3072cf1dc3db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:15.383079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c473d98-d20d-4463-ab11-3072cf1dc3db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:15.434058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:15.435303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:15.435783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:15.436254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:15.437368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:41:15.437890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:15.450765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:15.472984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:15.527617 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1402/2797] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:41:15.560989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bfc9d-e5c3-44e5-8f00-51196fcb82d0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:15.601020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bfc9d-e5c3-44e5-8f00-51196fcb82d0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:15.618030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:15.619678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:15.620472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:15.621408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:15.622895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:15.625604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:15.739437 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1396/2798] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:41:15 2022] POST /identity/v3/projects => generated 409 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:15.744612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:15.765246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b485b99-ddfe-4684-a085-6f1973fe959e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:16.055581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:16.056783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:16.056783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:16.057073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:16.057761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:16.073987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:16.165960 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1403/2799] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:41:15 2022] POST /identity/v3/users => generated 305 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:16.167662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:16.237569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e25d7-55f1-49e0-aa07-18f78e4f0a82 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:16.263632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:16.265566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:16.267310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:16.268158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:16.287183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:16.296190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:16.352101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1397/2800] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:16.357414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:16.377399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0eb92-be48-4fc8-bca3-ccf9fb1dcf97 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:16.393999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735a90d-5796-440a-b6cd-d86207171cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:16.394808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735a90d-5796-440a-b6cd-d86207171cad admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:16.395102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735a90d-5796-440a-b6cd-d86207171cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:16.395440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735a90d-5796-440a-b6cd-d86207171cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:16.396214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735a90d-5796-440a-b6cd-d86207171cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:16.398007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735a90d-5796-440a-b6cd-d86207171cad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:16.423450 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1404/2801] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:41:16.429411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:16.445752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6e605-06a4-4c80-94c1-20776913b9a4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:16.468282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:16.470078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:16.470549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:16.470912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] PATH_INFO: `/v3/projects/3b10d5c92e084da0b25f64a061521a4a/users/eff77aea2c8f4c2cac7726b7e142a4df/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:16.505578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b10d5c92e084da0b25f64a061521a4a, user_id=eff77aea2c8f4c2cac7726b7e142a4df, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:16.509016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:16.543204 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1398/2802] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:16 2022] PUT /identity/v3/projects/3b10d5c92e084da0b25f64a061521a4a/users/eff77aea2c8f4c2cac7726b7e142a4df/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:16.564197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2425c2-d9e7-48a6-b64f-2a3f61f8e64d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:16.564664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2425c2-d9e7-48a6-b64f-2a3f61f8e64d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:16.564857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2425c2-d9e7-48a6-b64f-2a3f61f8e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:16.629412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4b2425c2-d9e7-48a6-b64f-2a3f61f8e64d None None] MFA Rules not processed for user `eff77aea2c8f4c2cac7726b7e142a4df`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:16.635253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b2425c2-d9e7-48a6-b64f-2a3f61f8e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:16.990214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:16.991052 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1405/2803] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:17.393683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28744-9f50-4676-a634-e59a48a14ca3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:17.404536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:17.405938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:17.406532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:17.407218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:17.408823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:17.413031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:17.448202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:17.481626 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1399/2804] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:41:16 2022] POST /identity/v3/projects => generated 407 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:17.486107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2425c2-d9e7-48a6-b64f-2a3f61f8e64d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:17.517607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2425c2-d9e7-48a6-b64f-2a3f61f8e64d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:17.660806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:17.661828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:17.662737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:17.663431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:17.664825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:17.669059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:17.688070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:17.728875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:17.729657 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1406/2805] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:41:17 2022] POST /identity/v3/users => generated 310 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:17.758726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912852fb-6988-4e39-be86-ce216b81df63 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:17.768166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:17.769569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:17.770570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:17.771216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:17.772966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:17.785438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:17.812457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:17.821930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1400/2806] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:17.827979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09579998-78c5-4166-a14e-81bca815ec76 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:17.835443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:17.836702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:17.837249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:17.837764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] PATH_INFO: `/v3/projects/381949dbe47d4cb3bcb31a94f7afe74b/users/ae1c7d97bb1e49cbb24aaa62cbfdb78e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:17.879029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=381949dbe47d4cb3bcb31a94f7afe74b, user_id=ae1c7d97bb1e49cbb24aaa62cbfdb78e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:17.896863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:17.953361 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1407/2807] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:17 2022] PUT /identity/v3/projects/381949dbe47d4cb3bcb31a94f7afe74b/users/ae1c7d97bb1e49cbb24aaa62cbfdb78e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:17.958713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:18.002974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9315748-7826-4d14-90aa-8c94ce67b703 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:18.230006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b4c9-9d67-4643-81f1-65e46127ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:18.230623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b4c9-9d67-4643-81f1-65e46127ccf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:18.231107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b4c9-9d67-4643-81f1-65e46127ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:18.231891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b4c9-9d67-4643-81f1-65e46127ccf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:18.233526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12b4c9-9d67-4643-81f1-65e46127ccf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:18.238107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12b4c9-9d67-4643-81f1-65e46127ccf6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:18.285879 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1401/2808] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:18.292976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:18.340288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e105f0-4163-45cd-8ee1-5ba4488cf47b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:18.358491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:18.359970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:18.360407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:18.360827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] PATH_INFO: `/v3/projects/381949dbe47d4cb3bcb31a94f7afe74b/users/ae1c7d97bb1e49cbb24aaa62cbfdb78e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:18.374054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381949dbe47d4cb3bcb31a94f7afe74b, user_id=ae1c7d97bb1e49cbb24aaa62cbfdb78e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:18.388904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:18.443392 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1408/2809] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:18 2022] PUT /identity/v3/projects/381949dbe47d4cb3bcb31a94f7afe74b/users/ae1c7d97bb1e49cbb24aaa62cbfdb78e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:18.460670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38f66c-0e35-4e14-8efa-0e4197965b34 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:18.462580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38f66c-0e35-4e14-8efa-0e4197965b34 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:18.463212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38f66c-0e35-4e14-8efa-0e4197965b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:18.564796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bc38f66c-0e35-4e14-8efa-0e4197965b34 None None] MFA Rules not processed for user `ae1c7d97bb1e49cbb24aaa62cbfdb78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:18.566701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bc38f66c-0e35-4e14-8efa-0e4197965b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:18.901900 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1402/2810] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:19.889047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:19.893162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:20.155185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a350e-dee9-43b4-a507-7fc248dc6ed6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:20.162435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:20.163536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:20.164015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:20.164455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:20.166668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:20.318063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:20.319846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:20.335011 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1409/2811] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:20.521891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38f66c-0e35-4e14-8efa-0e4197965b34 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:20.572448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38f66c-0e35-4e14-8efa-0e4197965b34 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:20.597745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d01412-3b31-46b5-aaa3-923dad9e4438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:20.598241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d01412-3b31-46b5-aaa3-923dad9e4438 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:20.598713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d01412-3b31-46b5-aaa3-923dad9e4438 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:20.599226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d01412-3b31-46b5-aaa3-923dad9e4438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:20.632935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d01412-3b31-46b5-aaa3-923dad9e4438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:20.651356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d01412-3b31-46b5-aaa3-923dad9e4438 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:20.694080 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1403/2812] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:20 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:23.044760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:23.100827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a217-2201-42fa-8306-b3e5b39a3717 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:23.122366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aa221-03cd-4034-956f-0c0205c167e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:23.126702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa221-03cd-4034-956f-0c0205c167e2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:23.127681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa221-03cd-4034-956f-0c0205c167e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:23.129190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa221-03cd-4034-956f-0c0205c167e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:23.260391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:23.307172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aa221-03cd-4034-956f-0c0205c167e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:23.311688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aa221-03cd-4034-956f-0c0205c167e2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:23.333316 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1410/2813] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:23.876433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dd9da-6948-4994-8a74-7b62c1c48961 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:23.877371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dd9da-6948-4994-8a74-7b62c1c48961 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:23.877371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dd9da-6948-4994-8a74-7b62c1c48961 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:23.879661 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1404/2814] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:41:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:41:23.901177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78687787-aef7-40af-b022-2921d071379f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:23.902249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78687787-aef7-40af-b022-2921d071379f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:23.902707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78687787-aef7-40af-b022-2921d071379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:23.971460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-78687787-aef7-40af-b022-2921d071379f None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:23.972855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78687787-aef7-40af-b022-2921d071379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:24.022762 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1411/2815] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:41:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:24.036949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dd9da-6948-4994-8a74-7b62c1c48961 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:24.039624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f6dd9da-6948-4994-8a74-7b62c1c48961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:24.273432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dd9da-6948-4994-8a74-7b62c1c48961 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:24.280453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea247a-dbe7-4153-b05d-40d6fd179c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:24.281146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea247a-dbe7-4153-b05d-40d6fd179c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:24.281435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea247a-dbe7-4153-b05d-40d6fd179c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:24.282239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea247a-dbe7-4153-b05d-40d6fd179c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:24.302110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:24.309850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea247a-dbe7-4153-b05d-40d6fd179c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:24.309850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea247a-dbe7-4153-b05d-40d6fd179c5e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:24.352457 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1405/2816] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:26.390936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78687787-aef7-40af-b022-2921d071379f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:26.698219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78687787-aef7-40af-b022-2921d071379f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:26.719808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:26.721969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:26.735375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:26.735375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] PATH_INFO: `/v3/users/eff77aea2c8f4c2cac7726b7e142a4df` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:26.735375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff77aea2c8f4c2cac7726b7e142a4df)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:26.747339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:26.943054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff77aea2c8f4c2cac7726b7e142a4df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:26.977603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff77aea2c8f4c2cac7726b7e142a4df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:27.001618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff77aea2c8f4c2cac7726b7e142a4df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:27.003881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff77aea2c8f4c2cac7726b7e142a4df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:27.025405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff77aea2c8f4c2cac7726b7e142a4df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:27.046292 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1412/2817] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:41:26 2022] DELETE /identity/v3/users/eff77aea2c8f4c2cac7726b7e142a4df => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:27.050373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:27.051128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:27.051676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:27.091041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:27.094633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:27.331821 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1406/2818] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:27.530010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:27.533082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:27.894655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bac54-9090-4328-95c7-9d65c21c187b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:27.924864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:27.925692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:27.926156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:27.926512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:27.952162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:27.955012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:28.012087 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1413/2819] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:28.885058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:28.896210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:28.928590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2941d-b9ab-4d9e-b001-a1d453ec703b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:28.950867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:28.952015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:28.952302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:28.952792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] PATH_INFO: `/v3/projects/3b10d5c92e084da0b25f64a061521a4a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:28.954453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b10d5c92e084da0b25f64a061521a4a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:28.957211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:29.252978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b10d5c92e084da0b25f64a061521a4a', 'request_id': 'req-0e399c0f-57e4-442e-aa9b-6dd950ad3438'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:29.284964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b10d5c92e084da0b25f64a061521a4a', 'request_id': 'req-0e399c0f-57e4-442e-aa9b-6dd950ad3438'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:29.380801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b10d5c92e084da0b25f64a061521a4a', 'request_id': 'req-0e399c0f-57e4-442e-aa9b-6dd950ad3438'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:29.432345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] The token cache is being invalidate because project 3b10d5c92e084da0b25f64a061521a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:41:29.439626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:29.442903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e399c0f-57e4-442e-aa9b-6dd950ad3438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:29.468840 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1407/2820] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:28 2022] DELETE /identity/v3/projects/3b10d5c92e084da0b25f64a061521a4a => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:29.474884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:29.486051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:29.526099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060fbdd-c160-4194-b06d-0644c40d78b7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:29.558010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:29.558997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:29.559875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:29.745171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:29.749966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:29.768314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:29.769252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:29.769662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:29.769953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] PATH_INFO: `/v3/users/ae1c7d97bb1e49cbb24aaa62cbfdb78e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:29.772187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1c7d97bb1e49cbb24aaa62cbfdb78e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:29.776494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:29.968660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1c7d97bb1e49cbb24aaa62cbfdb78e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:30.003649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1c7d97bb1e49cbb24aaa62cbfdb78e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:30.008188 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1408/2821] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:41:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:30.035408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1c7d97bb1e49cbb24aaa62cbfdb78e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:30.036536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1c7d97bb1e49cbb24aaa62cbfdb78e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:30.053809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-763b6464-ebb1-461b-a131-917f67dd3303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1c7d97bb1e49cbb24aaa62cbfdb78e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:30.071632 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1414/2822] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:41:29 2022] DELETE /identity/v3/users/ae1c7d97bb1e49cbb24aaa62cbfdb78e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:30.163601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:30.166887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:30.197230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:30.197745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:30.198149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:30.243206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:30.245570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:30.301833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.383926 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1415/2823] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:41:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:41:30.399714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:30.406007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:30.429574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289d0f8-15fa-4285-b4b9-583ac7c3e7ae None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:30.487756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.608971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9b64-e3c2-49e2-b89b-df65c2e93c2a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:30.619044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545f253-b54a-456e-acea-d22b5d1c1077 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:30.620231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f253-b54a-456e-acea-d22b5d1c1077 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:30.626375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f253-b54a-456e-acea-d22b5d1c1077 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:30.628228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f253-b54a-456e-acea-d22b5d1c1077 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:30.635982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8545f253-b54a-456e-acea-d22b5d1c1077 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:30.637033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:30.639537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:30.640091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:30.640403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:30.690052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:30.700617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:30.705505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545f253-b54a-456e-acea-d22b5d1c1077 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:30.714719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545f253-b54a-456e-acea-d22b5d1c1077 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:30.726795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1416/2824] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:41:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:30.741455 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1409/2825] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:41:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:32.161109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:32.167860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:32.523424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520d0d-d336-49cb-b115-c7ed695f17a1 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:32.535593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:32.536840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:32.537302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:32.538502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] PATH_INFO: `/v3/projects/381949dbe47d4cb3bcb31a94f7afe74b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:32.540825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] RBAC: Authorizing `identity:delete_project(project_id=381949dbe47d4cb3bcb31a94f7afe74b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:32.543300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:32.730888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381949dbe47d4cb3bcb31a94f7afe74b', 'request_id': 'req-5c2346b3-1aea-4a72-b24c-3f705b00868a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:32.749315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381949dbe47d4cb3bcb31a94f7afe74b', 'request_id': 'req-5c2346b3-1aea-4a72-b24c-3f705b00868a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:32.763880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381949dbe47d4cb3bcb31a94f7afe74b', 'request_id': 'req-5c2346b3-1aea-4a72-b24c-3f705b00868a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:32.827589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] The token cache is being invalidate because project 381949dbe47d4cb3bcb31a94f7afe74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:41:32.828836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:32.835038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c2346b3-1aea-4a72-b24c-3f705b00868a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:32.843634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1417/2826] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:32 2022] DELETE /identity/v3/projects/381949dbe47d4cb3bcb31a94f7afe74b => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:32.845908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c55d9-4b25-444a-b470-08e14314c4be None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:32.846408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c55d9-4b25-444a-b470-08e14314c4be None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:32.846698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c55d9-4b25-444a-b470-08e14314c4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:32.896546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c24c55d9-4b25-444a-b470-08e14314c4be None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:32.898041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c24c55d9-4b25-444a-b470-08e14314c4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:33.084592 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1410/2827] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:33.098905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a609f-254b-4025-a8b9-690bd40851e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:33.099483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a609f-254b-4025-a8b9-690bd40851e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:33.099867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a609f-254b-4025-a8b9-690bd40851e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:33.173843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-908a609f-254b-4025-a8b9-690bd40851e4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:33.176184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-908a609f-254b-4025-a8b9-690bd40851e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:33.298022 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1418/2828] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:33.298529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c55d9-4b25-444a-b470-08e14314c4be None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:33.318075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c55d9-4b25-444a-b470-08e14314c4be None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:33.352191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:33.354011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:33.354011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:33.354011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:33.363751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:41:33.365759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:33.366170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:33.419543 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1411/2829] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:41:33.421746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a609f-254b-4025-a8b9-690bd40851e4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:33.454963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a609f-254b-4025-a8b9-690bd40851e4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:33.472119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:33.472845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:33.473127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:33.473407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:33.474117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:33.476660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:33.568454 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1419/2830] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:41:33 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:33.571435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:33.602179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d19d6-fcc2-479a-bedc-ad9bdb936518 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:33.779126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:33.847390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:33.849407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:33.850065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:33.851874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:33.857163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:33.865787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:33.941842 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1412/2831] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:41:33 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:41:33.946301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:33.991554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07e91-7a5d-4bc3-95f4-92b1a7135f74 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:34.005572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:34.006462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:34.006852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:34.007251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:34.008186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:34.021269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:34.061291 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1420/2832] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:34.063169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:34.080904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8ffd-ccdd-46f3-a16b-8e546cee3359 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:34.106937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfabbae-360a-4559-b8f6-6d0edc5ca464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:34.107894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfabbae-360a-4559-b8f6-6d0edc5ca464 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:34.108300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfabbae-360a-4559-b8f6-6d0edc5ca464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:34.108692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfabbae-360a-4559-b8f6-6d0edc5ca464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:34.110110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfabbae-360a-4559-b8f6-6d0edc5ca464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:34.115529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfabbae-360a-4559-b8f6-6d0edc5ca464 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:34.156917 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1413/2833] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:41:34.158731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:34.178974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76a827-390c-489e-82e6-bacc7db6d413 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:34.188184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:34.189291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:34.189711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:34.190101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] PATH_INFO: `/v3/projects/2afeb4c55144453b90adf1750595ad43/users/4e608c73f7d04d519cd89fe6c9189759/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:34.193232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:34.217766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afeb4c55144453b90adf1750595ad43, user_id=4e608c73f7d04d519cd89fe6c9189759, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:34.221521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:34.263326 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1421/2834] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:34 2022] PUT /identity/v3/projects/2afeb4c55144453b90adf1750595ad43/users/4e608c73f7d04d519cd89fe6c9189759/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:34.273871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75525f7a-ed0b-4147-bfec-d356aa26dba4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:34.274424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75525f7a-ed0b-4147-bfec-d356aa26dba4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:34.274959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75525f7a-ed0b-4147-bfec-d356aa26dba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:34.337156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-75525f7a-ed0b-4147-bfec-d356aa26dba4 None None] MFA Rules not processed for user `4e608c73f7d04d519cd89fe6c9189759`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:34.345831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75525f7a-ed0b-4147-bfec-d356aa26dba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:34.537876 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1414/2835] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:41:34.546085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:34.745628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bc83b-5c7e-438c-bfc3-859c14a9de2b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:34.760755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:34.761645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:34.762050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:34.762486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:34.763388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:34.766113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:34.815324 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1422/2836] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:41:34 2022] POST /identity/v3/projects => generated 375 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:34.821444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75525f7a-ed0b-4147-bfec-d356aa26dba4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:34.841479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75525f7a-ed0b-4147-bfec-d356aa26dba4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:34.957688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:34.960818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:34.961497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:34.962079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:34.963228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:34.965614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:35.003072 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1415/2837] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:41:34 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:35.008348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:35.028068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea0a40-588b-45d1-89d1-f9efc5f90b31 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:35.040776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:35.043752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:35.046709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:35.047490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:35.048604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:35.052704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:35.084593 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1423/2838] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:35.090371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:35.111807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702eff-b483-423e-9eb8-40781f34c4e4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:35.129068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:35.130723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:35.131462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:35.132208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] PATH_INFO: `/v3/projects/33b22ec303e44998a678c7eb21e03115/users/bc00699ac3c7497da755dd013fc2cb9c/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:35.182543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b22ec303e44998a678c7eb21e03115, user_id=bc00699ac3c7497da755dd013fc2cb9c, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:35.190763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:35.228326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1416/2839] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:35 2022] PUT /identity/v3/projects/33b22ec303e44998a678c7eb21e03115/users/bc00699ac3c7497da755dd013fc2cb9c/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:35.234006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:35.250895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c004aec-78b6-4274-9dbd-0facb9fe2d6e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:35.429917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a3624-4d76-4d59-9181-8a25f7f29955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:35.431291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a3624-4d76-4d59-9181-8a25f7f29955 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:35.431893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a3624-4d76-4d59-9181-8a25f7f29955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:35.432564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a3624-4d76-4d59-9181-8a25f7f29955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:35.433619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a3624-4d76-4d59-9181-8a25f7f29955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:35.438110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a3624-4d76-4d59-9181-8a25f7f29955 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:35.478617 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1424/2840] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:41:35.486761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:35.507087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75fd8c-1f61-40c5-9eb2-dc039ff06726 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:35.521918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:35.523672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:35.524318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:35.524841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] PATH_INFO: `/v3/projects/33b22ec303e44998a678c7eb21e03115/users/bc00699ac3c7497da755dd013fc2cb9c/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:35.533295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b22ec303e44998a678c7eb21e03115, user_id=bc00699ac3c7497da755dd013fc2cb9c, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:35.543648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:35.568806 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1417/2841] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:41:35 2022] PUT /identity/v3/projects/33b22ec303e44998a678c7eb21e03115/users/bc00699ac3c7497da755dd013fc2cb9c/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:35.593105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406c3e-e5cb-4008-9279-b233928eafb1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:35.593981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406c3e-e5cb-4008-9279-b233928eafb1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:35.595405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406c3e-e5cb-4008-9279-b233928eafb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:35.663910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-15406c3e-e5cb-4008-9279-b233928eafb1 None None] MFA Rules not processed for user `bc00699ac3c7497da755dd013fc2cb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:35.668234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15406c3e-e5cb-4008-9279-b233928eafb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:35.996825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:36.149277 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1425/2842] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 557 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:41:36.149678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:36.161468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:36.177217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f94e-e54b-4b02-80a6-f72d0ab07148 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:36.220354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:36.221288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:36.221697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:36.222125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:36.230741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:41:36.231879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:36.233771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:36.296410 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1418/2843] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:41:36.298842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406c3e-e5cb-4008-9279-b233928eafb1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:36.323374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406c3e-e5cb-4008-9279-b233928eafb1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:36.361278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:36.362971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:36.369895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:36.370888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:36.372471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:36.386885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:36.526379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:36.527767 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1426/2844] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:41:36 2022] POST /identity/v3/projects => generated 371 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:36.536859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46d65-558d-42d8-837b-cb2f848580d5 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:36.747865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:36.748960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:36.749482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:36.750766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:36.751868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:41:36.752442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:36.754464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:36.798930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1419/2845] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:41:46.489896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=19,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:46.778809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=34 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:53.173636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:53.177546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:53.453069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c99bb-23f3-4868-aba1-20f1ed8eb48f tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:53.465698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c52d3d-f32a-434a-b44e-ded42546cd41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:53.467241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52d3d-f32a-434a-b44e-ded42546cd41 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:53.468273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52d3d-f32a-434a-b44e-ded42546cd41 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:53.469851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52d3d-f32a-434a-b44e-ded42546cd41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:53.473810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1c52d3d-f32a-434a-b44e-ded42546cd41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:53.674337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52d3d-f32a-434a-b44e-ded42546cd41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:53.697089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52d3d-f32a-434a-b44e-ded42546cd41 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:53.723371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1427/2846] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:41:54.650495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:54.716202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87d7c-69aa-4999-81e1-6d6e1efd58a0 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:54.732162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:54.735305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:54.735794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:54.736707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:54.769595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:54.771817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:54.798332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1420/2847] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:54.833468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420aa6-865b-49fa-8f3d-e9067b98cd68 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:54.834383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420aa6-865b-49fa-8f3d-e9067b98cd68 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:54.834628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420aa6-865b-49fa-8f3d-e9067b98cd68 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:54.837714 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1428/2848] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:41:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:41:54.854394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:41:54.877023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:54.911704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a905d-d0b5-4416-bc43-c4cc39f98d00 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:54.929435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdcf2a-f0af-4ea8-863e-eb0ca3e1a5b3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:54.931086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdcf2a-f0af-4ea8-863e-eb0ca3e1a5b3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:54.931407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdcf2a-f0af-4ea8-863e-eb0ca3e1a5b3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:54.935878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdcf2a-f0af-4ea8-863e-eb0ca3e1a5b3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/projects/53c8758d63b748a69cf16ae629597572` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:54.942215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdcf2a-f0af-4ea8-863e-eb0ca3e1a5b3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:get_project(project_id=53c8758d63b748a69cf16ae629597572)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:54.945081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdcf2a-f0af-4ea8-863e-eb0ca3e1a5b3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:54.951864 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1421/2849] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:41:54 2022] GET /identity/v3/projects/53c8758d63b748a69cf16ae629597572 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:41:55.003144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02420aa6-865b-49fa-8f3d-e9067b98cd68 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:55.006004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02420aa6-865b-49fa-8f3d-e9067b98cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:55.056398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02420aa6-865b-49fa-8f3d-e9067b98cd68 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:55.069392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:55.070523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:55.070811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:55.071095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:55.078106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:55.262574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:55.265872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:55.302540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1429/2850] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:56.214752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932051a-3fc8-40ee-b68d-61b7449c28f7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:56.215722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932051a-3fc8-40ee-b68d-61b7449c28f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:56.216166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932051a-3fc8-40ee-b68d-61b7449c28f7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:56.219785 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1422/2851] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:41:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:41:56.227854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:41:56.246791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:56.262215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1446-cb53-4a5e-bea4-2be032f89206 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:56.275792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:56.277961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:56.278247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:56.282298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/projects/53c8758d63b748a69cf16ae629597572` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:56.286899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:get_project(project_id=53c8758d63b748a69cf16ae629597572)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:56.298464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:56.306593 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1430/2852] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:41:56 2022] GET /identity/v3/projects/53c8758d63b748a69cf16ae629597572 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:41:56.417437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932051a-3fc8-40ee-b68d-61b7449c28f7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:56.468981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932051a-3fc8-40ee-b68d-61b7449c28f7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:56.492526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:56.493836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:56.494475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:56.495363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:56.512171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:41:56.513977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:56.518253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:56.585671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:56.594904 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1423/2853] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:41:56.617462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067428d-2e9e-438a-93b4-d278a1052bbc tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:56.655347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91e3bb-5429-4fb3-bccd-3e492534a32a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:56.657149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91e3bb-5429-4fb3-bccd-3e492534a32a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:56.658329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91e3bb-5429-4fb3-bccd-3e492534a32a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:56.659117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91e3bb-5429-4fb3-bccd-3e492534a32a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:56.660752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91e3bb-5429-4fb3-bccd-3e492534a32a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:56.666959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91e3bb-5429-4fb3-bccd-3e492534a32a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:56.746851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:56.759311 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1431/2854] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:41:56 2022] POST /identity/v3/users => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:41:56.780276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe556b5-2750-45bd-a48e-643af3474608 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:56.805516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:56.807055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:56.807933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:56.808733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:56.810463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:41:56.816205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:56.830365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:56.880479 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1424/2855] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:41:57.385940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9192b-1d5c-4860-a319-1d342d012e5a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:57.387891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9192b-1d5c-4860-a319-1d342d012e5a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:57.388596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9192b-1d5c-4860-a319-1d342d012e5a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:57.391480 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1432/2856] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:41:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:41:57.403970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:41:57.424475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:57.441086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6465859-c321-4645-b713-70acda9ce107 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:57.448493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:57.450484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:57.451415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:57.452334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/projects/53c8758d63b748a69cf16ae629597572` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:57.454920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:get_project(project_id=53c8758d63b748a69cf16ae629597572)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:57.458999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:57.463004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1425/2857] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:41:57 2022] GET /identity/v3/projects/53c8758d63b748a69cf16ae629597572 => generated 371 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:41:58.232948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9dcfb-bad2-45eb-8ee5-a2960bb2ff18 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:58.233234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9dcfb-bad2-45eb-8ee5-a2960bb2ff18 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:58.233717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9dcfb-bad2-45eb-8ee5-a2960bb2ff18 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:58.235190 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1433/2858] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:41:58.245717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:41:58.271660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:58.285684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2e18-c215-484b-b9ae-752f7b6b82e4 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:58.291375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:58.292928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:58.293402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:58.294128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/projects/53c8758d63b748a69cf16ae629597572` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:58.295984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:get_project(project_id=53c8758d63b748a69cf16ae629597572)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:58.299322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:58.317856 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1426/2859] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:41:58 2022] GET /identity/v3/projects/53c8758d63b748a69cf16ae629597572 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:41:58.351400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9dcfb-bad2-45eb-8ee5-a2960bb2ff18 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:58.375411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9dcfb-bad2-45eb-8ee5-a2960bb2ff18 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:58.392956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:58.400523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:58.403509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:58.404095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/users/eb31060e50db4c3b860671f89bea3b13` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:58.414092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:58.454881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb31060e50db4c3b860671f89bea3b13)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:58.461758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:58.568573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb31060e50db4c3b860671f89bea3b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:58.586455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb31060e50db4c3b860671f89bea3b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:58.597356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb31060e50db4c3b860671f89bea3b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:58.598483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb31060e50db4c3b860671f89bea3b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:58.616957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb31060e50db4c3b860671f89bea3b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:58.629786 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1434/2860] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:41:58 2022] DELETE /identity/v3/users/eb31060e50db4c3b860671f89bea3b13 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:41:58.631814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:58.634037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:58.659937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6655-8a29-4058-a4f2-38f074dabb59 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:58.814902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc00699ac3c7497da755dd013fc2cb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33b22ec303e44998a678c7eb21e03115', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:58.816018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:58.816425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:58.816817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] PATH_INFO: `/v3/projects/53c8758d63b748a69cf16ae629597572` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:58.818608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=53c8758d63b748a69cf16ae629597572)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:58.822310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:58.967006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c8758d63b748a69cf16ae629597572', 'request_id': 'req-e6467077-907b-4f72-b717-541505d76594'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.001603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c8758d63b748a69cf16ae629597572', 'request_id': 'req-e6467077-907b-4f72-b717-541505d76594'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.017905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c8758d63b748a69cf16ae629597572', 'request_id': 'req-e6467077-907b-4f72-b717-541505d76594'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.059654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] The token cache is being invalidate because project 53c8758d63b748a69cf16ae629597572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:41:59.060172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.061130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6467077-907b-4f72-b717-541505d76594 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.065715 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1427/2861] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:58 2022] DELETE /identity/v3/projects/53c8758d63b748a69cf16ae629597572 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:59.074996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:59.077496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:59.191554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80ae4-ad7a-4b62-9e45-266fa1d20c6a tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:59.401565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:59.402616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:59.402909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:59.403322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] PATH_INFO: `/v3/users/4e608c73f7d04d519cd89fe6c9189759` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:59.411973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e608c73f7d04d519cd89fe6c9189759)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:59.413968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:59.448217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:59.511567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e608c73f7d04d519cd89fe6c9189759'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.545203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e608c73f7d04d519cd89fe6c9189759'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.562327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e608c73f7d04d519cd89fe6c9189759'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.563113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e608c73f7d04d519cd89fe6c9189759'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.574819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e608c73f7d04d519cd89fe6c9189759'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:41:59.583662 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1435/2862] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:41:59 2022] DELETE /identity/v3/users/4e608c73f7d04d519cd89fe6c9189759 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:41:59.588272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d430-1585-42b1-aebe-ff4f2367d150 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:59.588611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d430-1585-42b1-aebe-ff4f2367d150 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:59.588911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d430-1585-42b1-aebe-ff4f2367d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:59.616692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9c43d430-1585-42b1-aebe-ff4f2367d150 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:59.618182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9c43d430-1585-42b1-aebe-ff4f2367d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:59.646432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:59.761111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1428/2863] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:41:59.804400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:59.807072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:00.045094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8998-90a4-4dfc-854f-063e4d5a92ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:00.064448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:00.065643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:00.066188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:00.066684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:00.084277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:00.086413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:00.100899 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1436/2864] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:00.304572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1796-b20f-4ff5-b599-ec5754e72df1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:00.305952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1796-b20f-4ff5-b599-ec5754e72df1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:00.306455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1796-b20f-4ff5-b599-ec5754e72df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:00.335203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8c2c1796-b20f-4ff5-b599-ec5754e72df1 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:00.337822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c2c1796-b20f-4ff5-b599-ec5754e72df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:00.485297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1429/2865] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:42:00.486234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:00.489491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:00.604940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb45c6-6d00-4d87-82a6-72d8d70c6c47 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:00.613374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:00.614230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:00.614530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:00.614818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:00.626976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:00.629708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:00.651690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1437/2866] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:42:01.518686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e29a1-0523-4ecd-a3d1-4e84727ec98c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:01.519312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e29a1-0523-4ecd-a3d1-4e84727ec98c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:01.519512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e29a1-0523-4ecd-a3d1-4e84727ec98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:01.566407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-931e29a1-0523-4ecd-a3d1-4e84727ec98c None None] MFA Rules not processed for user `a900db43445e48a5a09451a909a074d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:01.570420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-931e29a1-0523-4ecd-a3d1-4e84727ec98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:01.700573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1430/2867] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:01.734469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:01.737785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:01.789287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27bcb-916b-4bcd-98af-369e3517a1fb service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:01.821015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:01.832298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:01.833015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:01.833315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] PATH_INFO: `/v3/projects/2afeb4c55144453b90adf1750595ad43` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:01.837864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afeb4c55144453b90adf1750595ad43)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:01.839878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:01.938816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:01.996641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afeb4c55144453b90adf1750595ad43', 'request_id': 'req-33b097bf-41d1-4045-9a40-21e5fe8053dc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.006605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afeb4c55144453b90adf1750595ad43', 'request_id': 'req-33b097bf-41d1-4045-9a40-21e5fe8053dc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.021060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afeb4c55144453b90adf1750595ad43', 'request_id': 'req-33b097bf-41d1-4045-9a40-21e5fe8053dc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.075995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] The token cache is being invalidate because project 2afeb4c55144453b90adf1750595ad43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:42:02.077009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.078718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.082328 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1438/2868] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:01 2022] DELETE /identity/v3/projects/2afeb4c55144453b90adf1750595ad43 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:02.086540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e29a1-0523-4ecd-a3d1-4e84727ec98c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:02.103004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e29a1-0523-4ecd-a3d1-4e84727ec98c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:02.319725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:02.320595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:02.321003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:02.321405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] PATH_INFO: `/v3/users/bc00699ac3c7497da755dd013fc2cb9c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:02.325219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc00699ac3c7497da755dd013fc2cb9c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:02.327815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:02.368440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:02.438437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc00699ac3c7497da755dd013fc2cb9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.461134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc00699ac3c7497da755dd013fc2cb9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.462234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc00699ac3c7497da755dd013fc2cb9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.489974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc00699ac3c7497da755dd013fc2cb9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.495955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-be20f9ae-58b9-47e5-a56d-f8ab1ba6b149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc00699ac3c7497da755dd013fc2cb9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:02.541072 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1431/2869] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:42:02 2022] DELETE /identity/v3/users/bc00699ac3c7497da755dd013fc2cb9c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:03.755576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:03.759771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:03.799564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b097bf-41d1-4045-9a40-21e5fe8053dc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:03.973207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:03.974874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:03.975394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:03.975765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] PATH_INFO: `/v3/projects/33b22ec303e44998a678c7eb21e03115` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:03.978030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b22ec303e44998a678c7eb21e03115)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:03.980253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:04.130923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b22ec303e44998a678c7eb21e03115', 'request_id': 'req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:04.139167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b22ec303e44998a678c7eb21e03115', 'request_id': 'req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:04.188235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b22ec303e44998a678c7eb21e03115', 'request_id': 'req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:04.219708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] The token cache is being invalidate because project 33b22ec303e44998a678c7eb21e03115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:42:04.221431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:04.224299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c9322bf-69a9-4bc3-9ed2-99d4d96c7c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:04.227247 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1439/2870] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:03 2022] DELETE /identity/v3/projects/33b22ec303e44998a678c7eb21e03115 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:04.237969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95656406-1488-4ca8-8979-c62464ef8997 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:04.238545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95656406-1488-4ca8-8979-c62464ef8997 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:04.238886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95656406-1488-4ca8-8979-c62464ef8997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:04.294544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-95656406-1488-4ca8-8979-c62464ef8997 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:04.300046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-95656406-1488-4ca8-8979-c62464ef8997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:04.473325 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1432/2871] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:04.481751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123529f0-8ebb-4647-86e7-fd0104c973a1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:04.482265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123529f0-8ebb-4647-86e7-fd0104c973a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:04.482660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123529f0-8ebb-4647-86e7-fd0104c973a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:04.537274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-123529f0-8ebb-4647-86e7-fd0104c973a1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:04.538760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-123529f0-8ebb-4647-86e7-fd0104c973a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:04.580355 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1440/2872] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:04.585287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95656406-1488-4ca8-8979-c62464ef8997 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:04.622386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95656406-1488-4ca8-8979-c62464ef8997 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:04.643704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:04.644951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:04.645493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:04.646008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:04.647981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:42:04.648210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:04.660887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:04.716970 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1433/2873] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:42:04.724439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123529f0-8ebb-4647-86e7-fd0104c973a1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:04.735815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123529f0-8ebb-4647-86e7-fd0104c973a1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:04.751905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:04.752774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:04.753170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:04.753581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:04.755866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:04.759354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:04.851744 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1441/2874] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:42:04 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:04.858027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:04.896042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd8dca-85da-47b2-941c-2a7ad59e3ba1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:05.006879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:05.008399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:05.008730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:05.009298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:05.019117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:05.022379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:05.083204 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1434/2875] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:42:04 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:05.089782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:05.117744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a6b9-23ff-4ea5-8e28-cf3ecea8cdfa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:05.130253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:05.136420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:05.137633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:05.139181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:05.142610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:05.147910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:05.190344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:05.198993 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1442/2876] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:42:05.212800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bccc0d-b253-4240-9857-c95bc55b1b83 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:05.224821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c301f3-d3bf-4290-9093-03ed1abb68a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:05.226051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c301f3-d3bf-4290-9093-03ed1abb68a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:05.226549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c301f3-d3bf-4290-9093-03ed1abb68a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:05.227133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c301f3-d3bf-4290-9093-03ed1abb68a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:05.232998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c301f3-d3bf-4290-9093-03ed1abb68a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:05.237668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c301f3-d3bf-4290-9093-03ed1abb68a4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:05.251199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:05.271353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:05.283870 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1435/2877] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:42:05.285742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:05.302880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cae14-af21-4822-9cd3-cf0e72d3b827 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:05.319618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:05.322315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:05.325748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:05.326582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] PATH_INFO: `/v3/projects/df3bf8e3cc1f4ead9fd86cee504d9b7e/users/4455db034a8c44dc84452b1ece326f09/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:05.377188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3bf8e3cc1f4ead9fd86cee504d9b7e, user_id=4455db034a8c44dc84452b1ece326f09, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:05.383697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:05.424617 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1443/2878] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:42:05 2022] PUT /identity/v3/projects/df3bf8e3cc1f4ead9fd86cee504d9b7e/users/4455db034a8c44dc84452b1ece326f09/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:05.450022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b13ade-7293-4406-b120-55319f9dc8fb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:05.451163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b13ade-7293-4406-b120-55319f9dc8fb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:05.451829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b13ade-7293-4406-b120-55319f9dc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:05.526715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e1b13ade-7293-4406-b120-55319f9dc8fb None None] MFA Rules not processed for user `4455db034a8c44dc84452b1ece326f09`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:05.534687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e1b13ade-7293-4406-b120-55319f9dc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:05.744412 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1436/2879] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:42:05.751717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:05.955972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fac13-3830-4715-a6ea-311227f63fa3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:05.969940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:05.972177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:05.973257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:05.974836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:05.977340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:05.989157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:06.073535 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1444/2880] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:42:05 2022] POST /identity/v3/projects => generated 395 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:06.074036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b13ade-7293-4406-b120-55319f9dc8fb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:06.104867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b13ade-7293-4406-b120-55319f9dc8fb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:06.328486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:06.334685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:06.335404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:06.335879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:06.336829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:06.349571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:06.393908 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1437/2881] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:42:06 2022] POST /identity/v3/users => generated 304 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:06.399664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:06.419089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6db11-2a6b-4a1c-a4e1-65358d861bc5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:06.444189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:06.444994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:06.445361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:06.445719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:06.446572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:06.448393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:06.465093 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1445/2882] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:42:06.472232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:06.486001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837f7ec-479c-4350-8f59-7142604da2ce admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:06.496433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc314b17-cb3f-49fb-a769-e3ac649693ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:06.501488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc314b17-cb3f-49fb-a769-e3ac649693ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:06.501890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc314b17-cb3f-49fb-a769-e3ac649693ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:06.502189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc314b17-cb3f-49fb-a769-e3ac649693ba admin admin] PATH_INFO: `/v3/projects/4975049f34cb480caaf4bfce33fdc931/users/6e1a795998d549fba3a5ff28067fdab3/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:06.556519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc314b17-cb3f-49fb-a769-e3ac649693ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4975049f34cb480caaf4bfce33fdc931, user_id=6e1a795998d549fba3a5ff28067fdab3, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:06.556519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc314b17-cb3f-49fb-a769-e3ac649693ba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:06.574095 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1438/2883] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:42:06 2022] PUT /identity/v3/projects/4975049f34cb480caaf4bfce33fdc931/users/6e1a795998d549fba3a5ff28067fdab3/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:06.580269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:06.601651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d3392-1657-47e0-83a9-cd9c54a39494 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:06.616021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84aae1-18fb-4d22-892a-d9645d48d2aa None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:06.616958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84aae1-18fb-4d22-892a-d9645d48d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:06.617465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84aae1-18fb-4d22-892a-d9645d48d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:06.651528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cb84aae1-18fb-4d22-892a-d9645d48d2aa None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:06.662893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb84aae1-18fb-4d22-892a-d9645d48d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:06.798616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:06.799767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:06.800417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:06.800951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:06.802332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:06.805182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:06.836232 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1446/2884] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:42:06.842322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:06.865308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb68f2f-29fc-4dd9-96bc-7e67e95b0f7e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:06.878813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:06.881065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:06.881065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:06.881065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] PATH_INFO: `/v3/projects/4975049f34cb480caaf4bfce33fdc931/users/6e1a795998d549fba3a5ff28067fdab3/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:06.885319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4975049f34cb480caaf4bfce33fdc931, user_id=6e1a795998d549fba3a5ff28067fdab3, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:06.896752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:06.943351 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1447/2885] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:42:06 2022] PUT /identity/v3/projects/4975049f34cb480caaf4bfce33fdc931/users/6e1a795998d549fba3a5ff28067fdab3/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:06.969911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:06.995025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1439/2886] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:42:07.019552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:07.023585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:07.075047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af08b-a1ea-4688-bbc8-74f060e32285 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:07.075592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af08b-a1ea-4688-bbc8-74f060e32285 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:07.076232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af08b-a1ea-4688-bbc8-74f060e32285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:07.166564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-329af08b-a1ea-4688-bbc8-74f060e32285 None None] MFA Rules not processed for user `6e1a795998d549fba3a5ff28067fdab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:07.167962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-329af08b-a1ea-4688-bbc8-74f060e32285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:07.229310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:07.356641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853de20-9b26-40fa-a416-6ed16abe1bf5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:07.373903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:07.375813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:07.376227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:07.376653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:07.416454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1440/2887] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:42:07.517490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:07.521414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:07.550373 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1448/2888] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:42:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:07.703679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc466-3369-42b2-9e69-9fcbc1695153 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:07.704527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc466-3369-42b2-9e69-9fcbc1695153 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:07.705271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc466-3369-42b2-9e69-9fcbc1695153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:07.768578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9f1cc466-3369-42b2-9e69-9fcbc1695153 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:07.774618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9f1cc466-3369-42b2-9e69-9fcbc1695153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:07.803074 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1441/2889] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:07.859838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:07.882280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4609e-ac5b-41c4-80a5-7ef99f7cd46d service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:07.901040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:07.901749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:07.902040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:07.902308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:07.937930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:07.939728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:07.969979 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1449/2890] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:42:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:17.752956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=37 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:17.958966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=44 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:20.132967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:20.133859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:20.133859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:20.169643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] MFA Rules not processed for user `aeb3928894284b77b4aea925a38470ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:20.179373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:20.254706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:20.256476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:20.337431 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1442/2891] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:42:20.409140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6449-bac4-46f7-8ae2-f3b28221e4e3 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:20.422103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4910-e782-459b-9d8d-a6fb5cfac1ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:20.422758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4910-e782-459b-9d8d-a6fb5cfac1ea service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:20.423095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4910-e782-459b-9d8d-a6fb5cfac1ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:20.423391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4910-e782-459b-9d8d-a6fb5cfac1ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:20.427865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d9f4910-e782-459b-9d8d-a6fb5cfac1ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:20.588262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f4910-e782-459b-9d8d-a6fb5cfac1ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:20.590624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f4910-e782-459b-9d8d-a6fb5cfac1ea service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:20.618776 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1450/2892] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 14:42:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3236 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:21.102729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:21.104968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:21.297744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd7b53-71bb-4e7e-8adc-aa77a1883ea7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:21.321798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:21.323561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:21.324252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:21.324797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:21.368326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:21.378057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:21.402312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1443/2893] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:42:24.746118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7133697-7d98-4315-90d8-38b145643b48 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:24.747676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7133697-7d98-4315-90d8-38b145643b48 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:24.748891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7133697-7d98-4315-90d8-38b145643b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:24.826241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b7133697-7d98-4315-90d8-38b145643b48 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:24.829178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7133697-7d98-4315-90d8-38b145643b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:24.845140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1451/2894] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:24.887423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:24.909593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7133697-7d98-4315-90d8-38b145643b48 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:24.914618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590def1-d323-4a44-966e-9ca9fefeeb95 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:24.924879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:24.925674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:24.926236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:24.926720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:24.941782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7133697-7d98-4315-90d8-38b145643b48 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:24.965691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc73eeb-a53a-46ab-ab04-4f58a1145d3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:24.967087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73eeb-a53a-46ab-ab04-4f58a1145d3c service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:24.969445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73eeb-a53a-46ab-ab04-4f58a1145d3c service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:24.971106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73eeb-a53a-46ab-ab04-4f58a1145d3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:25.017238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc73eeb-a53a-46ab-ab04-4f58a1145d3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:25.018816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:25.021715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:25.026258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc73eeb-a53a-46ab-ab04-4f58a1145d3c service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:25.034721 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1444/2895] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:25.061053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:25.065507 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1452/2896] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:42:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:25.130995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:25.209706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9194117-d94d-4f57-be27-c6af7eac2964 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:25.215720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:25.216857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:25.217163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:25.217450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] PATH_INFO: `/v3/users/4455db034a8c44dc84452b1ece326f09` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:25.220150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4455db034a8c44dc84452b1ece326f09)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:25.224593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:25.427751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4455db034a8c44dc84452b1ece326f09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:25.488010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4455db034a8c44dc84452b1ece326f09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:25.490640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4455db034a8c44dc84452b1ece326f09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:25.529211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4455db034a8c44dc84452b1ece326f09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:25.530024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4455db034a8c44dc84452b1ece326f09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:25.559172 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1445/2897] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:42:25 2022] DELETE /identity/v3/users/4455db034a8c44dc84452b1ece326f09 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:42:25.564936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:25.565228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:25.565736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:25.599976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:25.601602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:25.854855 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1453/2898] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:25.859159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:25.862475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:26.064931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73735ee-7fcf-4350-8cbf-97695fe6fe20 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:26.077195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:26.077195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:26.077195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:26.077195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:26.090023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:26.091747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:26.106722 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1446/2899] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:26.743087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:26.745479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:26.761186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd2b4b-53b2-44b0-bc14-2b032bf4e990 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:26.770878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:26.771991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:26.772803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:26.773312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] PATH_INFO: `/v3/projects/df3bf8e3cc1f4ead9fd86cee504d9b7e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:26.774959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3bf8e3cc1f4ead9fd86cee504d9b7e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:26.778377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:26.837654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:26.870166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3bf8e3cc1f4ead9fd86cee504d9b7e', 'request_id': 'req-001dc609-b6f1-4266-b9f2-3411ce0f9392'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:26.880125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3bf8e3cc1f4ead9fd86cee504d9b7e', 'request_id': 'req-001dc609-b6f1-4266-b9f2-3411ce0f9392'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:26.901506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3bf8e3cc1f4ead9fd86cee504d9b7e', 'request_id': 'req-001dc609-b6f1-4266-b9f2-3411ce0f9392'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:26.923082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] The token cache is being invalidate because project df3bf8e3cc1f4ead9fd86cee504d9b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:42:26.923432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:26.924151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:26.928713 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1454/2900] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:26 2022] DELETE /identity/v3/projects/df3bf8e3cc1f4ead9fd86cee504d9b7e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:26.929996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:26.946943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2076e-9404-4770-b1b9-7636fee48bdf service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:27.062386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:27.082112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:27.083540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:27.083893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:27.084115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] PATH_INFO: `/v3/users/6e1a795998d549fba3a5ff28067fdab3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:27.085517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1a795998d549fba3a5ff28067fdab3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:27.087566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:27.180909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1a795998d549fba3a5ff28067fdab3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:27.203922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1a795998d549fba3a5ff28067fdab3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:27.205120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1a795998d549fba3a5ff28067fdab3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:27.217110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1a795998d549fba3a5ff28067fdab3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:27.219917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3e96f68-d705-4933-8ee7-6747674351b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1a795998d549fba3a5ff28067fdab3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:27.268959 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1447/2901] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:42:26 2022] DELETE /identity/v3/users/6e1a795998d549fba3a5ff28067fdab3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:28.396982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:28.399851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:28.430798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc609-b6f1-4266-b9f2-3411ce0f9392 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:28.521673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:28.522765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:28.525419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:28.525902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] PATH_INFO: `/v3/projects/4975049f34cb480caaf4bfce33fdc931` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:28.527783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4975049f34cb480caaf4bfce33fdc931)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:28.529990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:28.601188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4975049f34cb480caaf4bfce33fdc931', 'request_id': 'req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:28.616044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4975049f34cb480caaf4bfce33fdc931', 'request_id': 'req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:28.627419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4975049f34cb480caaf4bfce33fdc931', 'request_id': 'req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:28.651493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] The token cache is being invalidate because project 4975049f34cb480caaf4bfce33fdc931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:42:28.652179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:28.653148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-194ff44c-ce6b-4fc0-9bff-3f2cc5b527bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:28.655763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1455/2902] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:28 2022] DELETE /identity/v3/projects/4975049f34cb480caaf4bfce33fdc931 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:28.663970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfbc2-6f92-4ca3-924a-12b381c5c29d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:28.664840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfbc2-6f92-4ca3-924a-12b381c5c29d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:28.664840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfbc2-6f92-4ca3-924a-12b381c5c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:28.690344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-308bfbc2-6f92-4ca3-924a-12b381c5c29d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:28.691695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-308bfbc2-6f92-4ca3-924a-12b381c5c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:28.787202 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1448/2903] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:28.802913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061af92b-c886-4fcc-9b06-b1597af46065 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:28.803806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061af92b-c886-4fcc-9b06-b1597af46065 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:28.806871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061af92b-c886-4fcc-9b06-b1597af46065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:28.851178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-061af92b-c886-4fcc-9b06-b1597af46065 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:28.854408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-061af92b-c886-4fcc-9b06-b1597af46065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:28.887496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bfbc2-6f92-4ca3-924a-12b381c5c29d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:28.895586 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1456/2904] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:28.924301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bfbc2-6f92-4ca3-924a-12b381c5c29d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:28.933707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:28.935230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:28.936056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:28.937106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:28.940748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:42:28.941599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:28.946649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:28.991946 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1449/2905] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:42:28.993456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061af92b-c886-4fcc-9b06-b1597af46065 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:29.020461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061af92b-c886-4fcc-9b06-b1597af46065 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:29.037936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:29.040778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:29.041528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:29.043096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:29.047201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:29.050643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:29.188874 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1457/2906] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:42:28 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:29.193488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:29.240333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef557d3f-9692-475b-a3d6-19868bc382c8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:29.424340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:29.449015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:29.449815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:29.450092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:29.450642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:29.451414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:29.456839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:29.523734 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1450/2907] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:42:29 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:29.528396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:29.570956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cccd9-4237-4fc1-a49d-a0356645fc2a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:29.600257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:29.601807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:29.602546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:29.604321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:29.608705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:29.616767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:29.651602 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1458/2908] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:42:29.655614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:29.673091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156263d-9a28-466b-b4dd-99eb0b58776e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:29.682320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5a2a-702d-4a46-ac81-fef7ec1bfc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:29.684680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5a2a-702d-4a46-ac81-fef7ec1bfc4a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:29.685933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5a2a-702d-4a46-ac81-fef7ec1bfc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:29.690996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5a2a-702d-4a46-ac81-fef7ec1bfc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:29.693093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5a2a-702d-4a46-ac81-fef7ec1bfc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:29.694993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5a2a-702d-4a46-ac81-fef7ec1bfc4a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:29.724131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:29.727763 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1451/2909] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:42:29.746863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba9f7e-d24c-4751-b822-90ebee9070e6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:29.767143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:29.770277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:29.770569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:29.770858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] PATH_INFO: `/v3/projects/d846e5e1ebe248389fbc14971ccc2bd7/users/b59bb3ae079d4e9a989d3309f9e7b34e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:29.778202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:29.812471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d846e5e1ebe248389fbc14971ccc2bd7, user_id=b59bb3ae079d4e9a989d3309f9e7b34e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:29.817231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:29.854715 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1459/2910] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:42:29 2022] PUT /identity/v3/projects/d846e5e1ebe248389fbc14971ccc2bd7/users/b59bb3ae079d4e9a989d3309f9e7b34e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:29.860882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:29.861150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:29.861352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:29.914464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:29.920049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:30.074631 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1452/2911] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:30.110546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:30.115595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:30.304244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8e8b6-cd93-4087-9b9d-75f482369e96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:30.310862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:30.311132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:30.311601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:30.312005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:30.337000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:30.340861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:30.373382 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1460/2912] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:30.835945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:30.839152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:31.063396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b3d3-af6b-4870-bac5-2831dfbdeee5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:31.105430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767fb14-82fc-42f7-b853-9e5a0d36fc3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:31.106525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767fb14-82fc-42f7-b853-9e5a0d36fc3e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:31.107028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767fb14-82fc-42f7-b853-9e5a0d36fc3e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:31.107471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767fb14-82fc-42f7-b853-9e5a0d36fc3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:31.117156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9767fb14-82fc-42f7-b853-9e5a0d36fc3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:31.479038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767fb14-82fc-42f7-b853-9e5a0d36fc3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:31.483284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767fb14-82fc-42f7-b853-9e5a0d36fc3e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:31.500211 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1453/2913] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:42:32.578329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:32.580010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:32.616815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39108f-7073-438b-aac2-f7fd507b453d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:32.646031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:32.648779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:32.649067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:32.653867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] PATH_INFO: `/v3/users/9802f1cfe8d54628a7ccf4aa0d3cc19e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:32.665392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9802f1cfe8d54628a7ccf4aa0d3cc19e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:32.674885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:32.818630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9802f1cfe8d54628a7ccf4aa0d3cc19e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:32.856233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9802f1cfe8d54628a7ccf4aa0d3cc19e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:32.875079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9802f1cfe8d54628a7ccf4aa0d3cc19e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:32.879351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9802f1cfe8d54628a7ccf4aa0d3cc19e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:32.913193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9802f1cfe8d54628a7ccf4aa0d3cc19e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:32.938004 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1461/2914] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:42:32 2022] DELETE /identity/v3/users/9802f1cfe8d54628a7ccf4aa0d3cc19e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:32.940452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44627ba-440c-4b50-8657-d0cc0633025f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:32.941083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44627ba-440c-4b50-8657-d0cc0633025f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:32.941348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44627ba-440c-4b50-8657-d0cc0633025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:33.015199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d44627ba-440c-4b50-8657-d0cc0633025f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:33.016695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d44627ba-440c-4b50-8657-d0cc0633025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:33.046264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:33.199544 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1454/2915] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:42:33.207429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:33.210511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:33.468728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef26a0-d8e0-40a4-94db-09946e0a9bdb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:33.510840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:33.515076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:33.515609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:33.516029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:33.553649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:33.556488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:33.604339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1462/2916] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:34.533660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3186a-6fd9-48a6-8164-f71db291a899 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:34.534361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3186a-6fd9-48a6-8164-f71db291a899 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:34.534474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3186a-6fd9-48a6-8164-f71db291a899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:34.618020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-47a3186a-6fd9-48a6-8164-f71db291a899 None None] MFA Rules not processed for user `038556a90129478eb04699f574ea7e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:34.622361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47a3186a-6fd9-48a6-8164-f71db291a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:34.866547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:34.869161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:34.914458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:34.920063 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1455/2917] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:34.958111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7880f-9813-47a0-9849-e68e44a143b1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:34.986690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:34.988616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:34.992119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:34.992864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] PATH_INFO: `/v3/projects/75041b3d85ea40d4a5525c6c62f91ec2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:34.995792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=75041b3d85ea40d4a5525c6c62f91ec2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:35.004394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:35.270477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75041b3d85ea40d4a5525c6c62f91ec2', 'request_id': 'req-187a56b6-b13f-41c3-b461-b801098abecd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:35.288071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75041b3d85ea40d4a5525c6c62f91ec2', 'request_id': 'req-187a56b6-b13f-41c3-b461-b801098abecd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:35.301922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75041b3d85ea40d4a5525c6c62f91ec2', 'request_id': 'req-187a56b6-b13f-41c3-b461-b801098abecd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:35.331611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] The token cache is being invalidate because project 75041b3d85ea40d4a5525c6c62f91ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:42:35.331945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:35.336265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187a56b6-b13f-41c3-b461-b801098abecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:35.343516 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1463/2918] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:34 2022] DELETE /identity/v3/projects/75041b3d85ea40d4a5525c6c62f91ec2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:42:35.345825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d868-209a-4d6a-bb3d-c81c2e0c7092 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:35.347820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d868-209a-4d6a-bb3d-c81c2e0c7092 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:35.348584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d868-209a-4d6a-bb3d-c81c2e0c7092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:35.404799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9dc8d868-209a-4d6a-bb3d-c81c2e0c7092 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:35.408515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9dc8d868-209a-4d6a-bb3d-c81c2e0c7092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:35.663175 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1456/2919] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:35.744460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b888-480e-48d7-a807-e43ff4d5cdd5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:35.744755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b888-480e-48d7-a807-e43ff4d5cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:35.745044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b888-480e-48d7-a807-e43ff4d5cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:35.793305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e01b888-480e-48d7-a807-e43ff4d5cdd5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:35.797836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e01b888-480e-48d7-a807-e43ff4d5cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:35.821871 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1464/2920] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:42:35.826542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8d868-209a-4d6a-bb3d-c81c2e0c7092 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:35.840559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8d868-209a-4d6a-bb3d-c81c2e0c7092 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:35.854436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:35.855094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:35.856433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:35.856758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:35.857701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:42:35.858052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:35.860793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:35.915863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b888-480e-48d7-a807-e43ff4d5cdd5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:35.926477 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1457/2921] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:42:35.927518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b888-480e-48d7-a807-e43ff4d5cdd5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:35.927518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:35.927518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:35.932392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:35.932392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:35.932392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:35.932392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:36.025048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:36.039311 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1465/2922] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:42:35 2022] POST /identity/v3/projects => generated 401 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:36.040885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb760-1801-46f0-9807-fe0d44a02927 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:36.191891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:36.293977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:36.294699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:36.294986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:36.295289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:36.296588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:36.299322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:36.354448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:36.356436 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1458/2923] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:42:36 2022] POST /identity/v3/users => generated 301 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:36.380049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b639546-0969-4e4e-81d9-43edf28a419e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:36.386097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:36.392496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:36.393076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:36.394024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:36.395047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:36.397028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:36.414297 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1466/2924] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:42:36.418083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:36.439792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc83b-0e83-4603-9816-74b566d3e479 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:36.464072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeed61-50e6-4835-af42-b04a72393c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:36.469950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeed61-50e6-4835-af42-b04a72393c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:36.470226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeed61-50e6-4835-af42-b04a72393c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:36.470524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeed61-50e6-4835-af42-b04a72393c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:36.477498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeed61-50e6-4835-af42-b04a72393c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:36.481035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeed61-50e6-4835-af42-b04a72393c4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:36.519549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1459/2925] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:42:36.524066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:36.542012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd84650-960a-4a45-9d56-76a6ed1fb6f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:36.556929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:36.558214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:36.558640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:36.559471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] PATH_INFO: `/v3/projects/064698e5699446feb41a72106863062b/users/f6d13082d682457baea50ada61fc0f9d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:36.625519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] RBAC: Authorizing `identity:create_grant(project_id=064698e5699446feb41a72106863062b, user_id=f6d13082d682457baea50ada61fc0f9d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:36.628648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:36.666309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb021-37c1-4960-b870-2cd523f58276 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:36.667299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb021-37c1-4960-b870-2cd523f58276 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:36.667751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb021-37c1-4960-b870-2cd523f58276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:36.669528 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1467/2926] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:42:36 2022] PUT /identity/v3/projects/064698e5699446feb41a72106863062b/users/f6d13082d682457baea50ada61fc0f9d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:42:36.729211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6a0eb021-37c1-4960-b870-2cd523f58276 None None] MFA Rules not processed for user `f6d13082d682457baea50ada61fc0f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:36.732676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a0eb021-37c1-4960-b870-2cd523f58276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:36.875079 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1460/2927] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:36.897310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:36.899364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:37.052487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8888-0f26-413f-a40d-5a1ad0dc545d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:37.073614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:37.074548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:37.074953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:37.075381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:37.093554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:37.100064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:37.152209 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1468/2928] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:45.093271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926d14a-ba9a-403d-923c-b6cdbeae0f02 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:45.094420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926d14a-ba9a-403d-923c-b6cdbeae0f02 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:45.094713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926d14a-ba9a-403d-923c-b6cdbeae0f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:45.149824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6926d14a-ba9a-403d-923c-b6cdbeae0f02 None None] MFA Rules not processed for user `b59bb3ae079d4e9a989d3309f9e7b34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:45.151512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6926d14a-ba9a-403d-923c-b6cdbeae0f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:45.292904 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1461/2929] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:45.462384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:45.463825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:45.485706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f17ce4-d932-488c-9dd3-f66dbe22ff5b service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:45.494895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:45.497075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:45.497882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:45.498969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:45.517606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:45.525757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:45.530827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:45.571650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1469/2930] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:42:45.593821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:45.594782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:45.594782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:45.657831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] MFA Rules not processed for user `2deda01949ad4a5eb16842b00afe7567`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:45.659423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:45.707888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:45.793391 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1462/2931] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:52.301160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:52.463327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368b5f3-666d-411c-bc7d-e3fc28e86259 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:52.474352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:52.479611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:52.480397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:52.481033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] PATH_INFO: `/v3/users/f6d13082d682457baea50ada61fc0f9d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:52.484397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d13082d682457baea50ada61fc0f9d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:52.499234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:52.634833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d13082d682457baea50ada61fc0f9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:52.654648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d13082d682457baea50ada61fc0f9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:52.666359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d13082d682457baea50ada61fc0f9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:52.668349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d13082d682457baea50ada61fc0f9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:52.681398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ae66b97-5dec-47d1-a99d-0e0c91281ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d13082d682457baea50ada61fc0f9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:52.699852 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1470/2932] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:42:52 2022] DELETE /identity/v3/users/f6d13082d682457baea50ada61fc0f9d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:42:52.700163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:52.701796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:52.702015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:52.702217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:52.702587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:52.723127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:52.725099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:52.843677 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1471/2933] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:52.849724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:52.851488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:52.858697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a23ee-2fc4-4688-a966-3231b2035681 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:52.869932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:52.940438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8fed-a5dd-4e74-a077-9b9862e19200 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:52.952251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7b708-d7da-49af-9852-5d287b94af34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:52.955082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b708-d7da-49af-9852-5d287b94af34 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:52.956918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:52.957161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b708-d7da-49af-9852-5d287b94af34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:52.958012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7b708-d7da-49af-9852-5d287b94af34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:52.958141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:52.958731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:52.959078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:52.961471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:52.977317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:52.979093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:52.980702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7b708-d7da-49af-9852-5d287b94af34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:52.983744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7b708-d7da-49af-9852-5d287b94af34 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:53.007732 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1463/2934] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:42:53.015925 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1472/2935] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:42:53.885704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:53.887605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:53.947879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bde61-a2d5-4e28-b94f-b52ca98a1770 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:53.982096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:53.985357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:53.987622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:53.988397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] PATH_INFO: `/v3/projects/064698e5699446feb41a72106863062b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:54.005200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] RBAC: Authorizing `identity:delete_project(project_id=064698e5699446feb41a72106863062b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:54.012577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:54.165103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064698e5699446feb41a72106863062b', 'request_id': 'req-e3753c9c-f79b-42f7-9539-241a50c4272a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:54.198290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064698e5699446feb41a72106863062b', 'request_id': 'req-e3753c9c-f79b-42f7-9539-241a50c4272a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:54.218290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064698e5699446feb41a72106863062b', 'request_id': 'req-e3753c9c-f79b-42f7-9539-241a50c4272a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:54.274193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] The token cache is being invalidate because project 064698e5699446feb41a72106863062b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:42:54.275502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:54.277118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3753c9c-f79b-42f7-9539-241a50c4272a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:54.284252 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1464/2936] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:53 2022] DELETE /identity/v3/projects/064698e5699446feb41a72106863062b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:54.292309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb6655-ca2d-463c-8ea8-580ddddab88b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:54.293811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb6655-ca2d-463c-8ea8-580ddddab88b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:54.294564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb6655-ca2d-463c-8ea8-580ddddab88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:54.387543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4bdb6655-ca2d-463c-8ea8-580ddddab88b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:54.391171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4bdb6655-ca2d-463c-8ea8-580ddddab88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:54.651475 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1473/2937] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:54.661045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8b98-aa9a-4f01-9b5c-bef85970e719 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:54.662090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8b98-aa9a-4f01-9b5c-bef85970e719 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:54.662738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8b98-aa9a-4f01-9b5c-bef85970e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:54.682290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:54.714266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-04be8b98-aa9a-4f01-9b5c-bef85970e719 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:54.718251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-04be8b98-aa9a-4f01-9b5c-bef85970e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:54.747990 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1465/2938] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:54.749314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb6655-ca2d-463c-8ea8-580ddddab88b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:54.780312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb6655-ca2d-463c-8ea8-580ddddab88b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:54.800709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:54.802520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:54.804339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:54.805467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:54.809166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:42:54.809828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:54.815551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:54.849857 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1474/2939] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:42:54.851658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8b98-aa9a-4f01-9b5c-bef85970e719 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:54.866304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8b98-aa9a-4f01-9b5c-bef85970e719 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:54.879302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:54.879555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:54.879718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:54.880125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:54.880857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:54.883518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:54.991647 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1466/2940] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:42:54 2022] POST /identity/v3/projects => generated 397 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:54.992945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:55.009407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baae886-12e0-4856-a398-1b531d8b6158 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:55.160990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:55.170822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:55.171446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:55.171767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:55.172541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:55.178612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:55.223559 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1475/2941] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:42:54 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:42:55.230206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:55.243970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e3f8-621b-41af-ae73-f38ad27d4a11 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:55.254030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:55.255127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:55.255897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:55.256207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:55.257160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:55.260298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:55.277438 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1467/2942] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:42:55.282208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:55.297786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9632d8e-ad3b-49f2-86c2-5657ae8b4d42 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:55.316934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949c649-ed35-4877-9b60-6b2a46df65dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:55.328793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949c649-ed35-4877-9b60-6b2a46df65dc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:55.331467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949c649-ed35-4877-9b60-6b2a46df65dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:55.332395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949c649-ed35-4877-9b60-6b2a46df65dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:55.333464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949c649-ed35-4877-9b60-6b2a46df65dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:55.338276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949c649-ed35-4877-9b60-6b2a46df65dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:55.358588 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1476/2943] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:42:55.360020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:55.376912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78456-49e2-4fb1-988f-f34d470e823a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:55.396039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:55.398362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:55.399039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:55.399474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] PATH_INFO: `/v3/projects/7c0704801516448cb0a2d64dabf184cf/users/e1ea594c233d409dba82caa49b62f7b8/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:55.431988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0704801516448cb0a2d64dabf184cf, user_id=e1ea594c233d409dba82caa49b62f7b8, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:55.435997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:55.462187 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1468/2944] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:42:55 2022] PUT /identity/v3/projects/7c0704801516448cb0a2d64dabf184cf/users/e1ea594c233d409dba82caa49b62f7b8/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:55.475148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2a1b-be78-428c-b309-20ef93b77eea None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:55.475608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2a1b-be78-428c-b309-20ef93b77eea None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:55.475886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2a1b-be78-428c-b309-20ef93b77eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:55.519417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:55.525500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ba4a2a1b-be78-428c-b309-20ef93b77eea None None] MFA Rules not processed for user `e1ea594c233d409dba82caa49b62f7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:55.542363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba4a2a1b-be78-428c-b309-20ef93b77eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:55.791689 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1477/2945] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:55.800630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:55.806621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:56.053780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cb3ce-768d-4ccf-af1e-88bfaa0637f2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:56.070332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:56.072036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:56.073142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:56.073922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:56.095324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:56.098931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:56.122551 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1469/2946] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:42:56.216867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20f708-5b23-47c0-ae52-acf75e3588ba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:56.217172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20f708-5b23-47c0-ae52-acf75e3588ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:56.217463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20f708-5b23-47c0-ae52-acf75e3588ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:56.262915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f20f708-5b23-47c0-ae52-acf75e3588ba None None] MFA Rules not processed for user `e1ea594c233d409dba82caa49b62f7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:56.267395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f20f708-5b23-47c0-ae52-acf75e3588ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:56.306623 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1478/2947] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:57.306045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:57.490724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbb256-2957-4959-9c48-38965d2142cc service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:57.497092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:57.499971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:57.500309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:57.500539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] PATH_INFO: `/v3/users/e1ea594c233d409dba82caa49b62f7b8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:57.501970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ea594c233d409dba82caa49b62f7b8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:57.504277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:57.641936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:57.715906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ea594c233d409dba82caa49b62f7b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:57.766043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ea594c233d409dba82caa49b62f7b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:57.772621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ea594c233d409dba82caa49b62f7b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:57.804967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ea594c233d409dba82caa49b62f7b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:57.809763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ea594c233d409dba82caa49b62f7b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:57.890953 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1470/2948] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:42:57 2022] DELETE /identity/v3/users/e1ea594c233d409dba82caa49b62f7b8 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:57.896513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258db8-76db-41dc-b262-41834894810c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:57.897124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258db8-76db-41dc-b262-41834894810c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:57.897124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258db8-76db-41dc-b262-41834894810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:57.974564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0258db8-76db-41dc-b262-41834894810c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:57.975890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0258db8-76db-41dc-b262-41834894810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:58.119506 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1479/2949] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:42:58.179960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:58.182445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:58.502139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3af62-3335-4377-8e11-4c3328ed6adc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:58.516748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bb56b-6846-40d8-b31b-d02243d53d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:58.520345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bb56b-6846-40d8-b31b-d02243d53d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:58.521594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bb56b-6846-40d8-b31b-d02243d53d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:58.522762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bb56b-6846-40d8-b31b-d02243d53d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:58.553450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bb56b-6846-40d8-b31b-d02243d53d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:58.557089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bb56b-6846-40d8-b31b-d02243d53d4d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:58.585493 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1471/2950] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:42:59.583480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0258db8-76db-41dc-b262-41834894810c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:42:59.588033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0258db8-76db-41dc-b262-41834894810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:42:59.618730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0258db8-76db-41dc-b262-41834894810c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:42:59.637277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:42:59.638491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:59.639103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:59.639867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] PATH_INFO: `/v3/projects/7c0704801516448cb0a2d64dabf184cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:59.641819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0704801516448cb0a2d64dabf184cf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:42:59.644448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:42:59.772787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0704801516448cb0a2d64dabf184cf', 'request_id': 'req-89a943e4-24b2-477b-b1f3-be544e799a03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:59.804269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0704801516448cb0a2d64dabf184cf', 'request_id': 'req-89a943e4-24b2-477b-b1f3-be544e799a03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:59.824609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0704801516448cb0a2d64dabf184cf', 'request_id': 'req-89a943e4-24b2-477b-b1f3-be544e799a03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:59.857334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] The token cache is being invalidate because project 7c0704801516448cb0a2d64dabf184cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:42:59.858650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:59.861538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89a943e4-24b2-477b-b1f3-be544e799a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:42:59.865231 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1480/2951] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:59 2022] DELETE /identity/v3/projects/7c0704801516448cb0a2d64dabf184cf => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:42:59.871661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80a8bf-c658-4789-93b0-3416717f6046 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:42:59.872244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80a8bf-c658-4789-93b0-3416717f6046 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:42:59.872796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80a8bf-c658-4789-93b0-3416717f6046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:42:59.912027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7b80a8bf-c658-4789-93b0-3416717f6046 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:42:59.916580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7b80a8bf-c658-4789-93b0-3416717f6046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:00.254591 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1472/2952] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:00.274513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813de197-b73a-4f82-aa28-b88d633bd112 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:00.277577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813de197-b73a-4f82-aa28-b88d633bd112 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:00.277961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813de197-b73a-4f82-aa28-b88d633bd112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:00.350407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-813de197-b73a-4f82-aa28-b88d633bd112 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:00.354091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-813de197-b73a-4f82-aa28-b88d633bd112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:00.390765 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1481/2953] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:00.391259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80a8bf-c658-4789-93b0-3416717f6046 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:00.427047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80a8bf-c658-4789-93b0-3416717f6046 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:00.428204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:00.429067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:00.429364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:00.429644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:00.430420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:43:00.430791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:00.432592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:00.477953 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1473/2954] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:43:00.479157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813de197-b73a-4f82-aa28-b88d633bd112 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:00.492270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813de197-b73a-4f82-aa28-b88d633bd112 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:00.500126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:00.500872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:00.501156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:00.501436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:00.502222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:00.506187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:00.531596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:00.592822 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1482/2955] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:43:00 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:00.595519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:00.611291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905d10-6bf6-4207-a8d2-eabe38010c58 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:00.731591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:00.837111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:00.838737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:00.839301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:00.839846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:00.844066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:00.848662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:00.890867 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1474/2956] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:43:00 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:00.896503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:00.922036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb499f33-2bf2-4571-ae3b-fc4b757c372c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:00.936279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:00.937503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:00.938339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:00.939527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:00.940732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:00.942586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:00.973770 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1483/2957] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:43:00.978705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:00.999014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9497cc-7b4b-4ef3-b6d4-72ce82c35740 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:01.006700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432090c-45ac-4f99-a2ee-33a636c671d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:01.008102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432090c-45ac-4f99-a2ee-33a636c671d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:01.008604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432090c-45ac-4f99-a2ee-33a636c671d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:01.009065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432090c-45ac-4f99-a2ee-33a636c671d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:01.010240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432090c-45ac-4f99-a2ee-33a636c671d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:01.012274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432090c-45ac-4f99-a2ee-33a636c671d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:01.036322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1475/2958] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:01.037014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:01.052940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c55b5-8941-430f-a920-3a0a716b4719 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:01.079886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:01.083314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:01.086212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:01.088007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] PATH_INFO: `/v3/projects/a21758c8c2ee4fd3bc58344c4948f503/users/b04aa0fbcacd45bdadeb9bde761d4def/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:01.140158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21758c8c2ee4fd3bc58344c4948f503, user_id=b04aa0fbcacd45bdadeb9bde761d4def, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:01.145403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:01.180071 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1484/2959] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:01 2022] PUT /identity/v3/projects/a21758c8c2ee4fd3bc58344c4948f503/users/b04aa0fbcacd45bdadeb9bde761d4def/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:43:01.185996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:01.186427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:01.186991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:01.258179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:01.276342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:01.462463 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1476/2960] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:01.499565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:01.501723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:01.683585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5ea0-01b6-499d-b92d-555467a47bc2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:01.701125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:01.701885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:01.702181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:01.702463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:01.743519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:01.745165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:01.789558 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1485/2961] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:02.087432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:02.093007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:02.562590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6099-4cb9-4122-8918-632d8631d614 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:02.582554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:02.583252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:02.583576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:02.583862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:02.592423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:02.628769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:02.645488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:02.683218 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1477/2962] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:43:07.598531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:07.614558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a29fa-26cb-491a-bc7c-f180ca6c950d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:07.619672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6c2ad-0ca2-4652-a1bb-85439908e447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:07.624826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6c2ad-0ca2-4652-a1bb-85439908e447 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:07.625125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6c2ad-0ca2-4652-a1bb-85439908e447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:07.625662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6c2ad-0ca2-4652-a1bb-85439908e447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:07.630337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59c6c2ad-0ca2-4652-a1bb-85439908e447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:07.651529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6c2ad-0ca2-4652-a1bb-85439908e447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:07.654864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6c2ad-0ca2-4652-a1bb-85439908e447 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:07.666810 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1486/2963] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:10.048592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:10.119574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a78dd5-e6e6-45bd-8d28-35f8e4b7f9b7 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:10.141148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0ac1c-449f-4220-b1b3-07d5b7822a01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:10.143764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0ac1c-449f-4220-b1b3-07d5b7822a01 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:10.144736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0ac1c-449f-4220-b1b3-07d5b7822a01 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:10.145580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0ac1c-449f-4220-b1b3-07d5b7822a01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:10.150262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ca0ac1c-449f-4220-b1b3-07d5b7822a01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:10.187206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0ac1c-449f-4220-b1b3-07d5b7822a01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:10.191492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0ac1c-449f-4220-b1b3-07d5b7822a01 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:10.256516 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1478/2964] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:43:17.663019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:20.204761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:20.948176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:20.948770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:20.951055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:21.018820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] MFA Rules not processed for user `b04aa0fbcacd45bdadeb9bde761d4def`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:21.020720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:21.185830 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1487/2965] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:21.192471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:21.192471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:21.194229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:21.269803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] MFA Rules not processed for user `b04aa0fbcacd45bdadeb9bde761d4def`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:21.274620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:21.299539 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1479/2966] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:21.444395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:21.448044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:21.745193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd4da-4843-4002-b62a-30fae10d12bd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:21.760819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9993a9-b008-4d44-adcd-9615983cab4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:21.761532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9993a9-b008-4d44-adcd-9615983cab4e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:21.761822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9993a9-b008-4d44-adcd-9615983cab4e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:21.762105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9993a9-b008-4d44-adcd-9615983cab4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:21.788371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9993a9-b008-4d44-adcd-9615983cab4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:21.791575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9993a9-b008-4d44-adcd-9615983cab4e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:21.820586 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1488/2967] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:30.534494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:30.536315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:30.585099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170465e-4047-45dc-aec9-77af94ca9ffd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:30.608286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:30.616966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:30.617698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:30.619653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] PATH_INFO: `/v3/users/2643b694761c4380a7a37fe64add9423` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:30.629617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2643b694761c4380a7a37fe64add9423)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:30.633103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:30.806939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2643b694761c4380a7a37fe64add9423'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:30.837207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2643b694761c4380a7a37fe64add9423'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:30.839868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2643b694761c4380a7a37fe64add9423'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:30.851643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2643b694761c4380a7a37fe64add9423'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:30.852977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2643b694761c4380a7a37fe64add9423'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:30.876291 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1480/2968] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:43:30 2022] DELETE /identity/v3/users/2643b694761c4380a7a37fe64add9423 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:30.885418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:30.887226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:30.888714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:30.958950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:30.962082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:31.116911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:31.223644 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1489/2969] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:31.276343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:31.279420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:31.647143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c408-a0e6-47d3-8307-bff747715dcb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:31.664650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:31.665836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:31.666344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:31.666855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:31.692187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:31.694108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:31.710556 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1481/2970] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:43:33.265737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:33.268110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:33.295616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab87ce-310f-4881-809a-d542a5f5e94d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:33.341640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:33.341640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:33.341640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:33.341640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] PATH_INFO: `/v3/projects/db181b6ddf3f42629734e66aeb2f0e3f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:33.347387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=db181b6ddf3f42629734e66aeb2f0e3f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:33.359168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:33.585756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db181b6ddf3f42629734e66aeb2f0e3f', 'request_id': 'req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:33.594776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db181b6ddf3f42629734e66aeb2f0e3f', 'request_id': 'req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:33.603839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db181b6ddf3f42629734e66aeb2f0e3f', 'request_id': 'req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:33.628670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] The token cache is being invalidate because project db181b6ddf3f42629734e66aeb2f0e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:43:33.629247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:33.632708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:33.639527 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1490/2971] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:43:33 2022] DELETE /identity/v3/projects/db181b6ddf3f42629734e66aeb2f0e3f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:33.645147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:33.658360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180564-f035-4a10-97a7-c8704570f76c service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:33.851430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:33.921473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:33.926849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:33.928143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:33.943177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] PATH_INFO: `/v3/users/096d672497e14487bf59b980bce3f294` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:33.949370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=096d672497e14487bf59b980bce3f294)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:33.962745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:34.177659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096d672497e14487bf59b980bce3f294'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:34.246502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096d672497e14487bf59b980bce3f294'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:34.259173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096d672497e14487bf59b980bce3f294'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:34.304718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096d672497e14487bf59b980bce3f294'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:34.305742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-944419dd-8f88-4ab0-a728-bb1557efd37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096d672497e14487bf59b980bce3f294'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:34.351603 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1482/2972] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:43:33 2022] DELETE /identity/v3/users/096d672497e14487bf59b980bce3f294 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:35.377732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:35.380394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:35.440531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df95e7a-8666-4e2d-aceb-47c0f13f0b0b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:35.659425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:35.660972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:35.661440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:35.662583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] PATH_INFO: `/v3/projects/bbed583bb3d44926bfffd1be76ef5b3c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:35.665062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbed583bb3d44926bfffd1be76ef5b3c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:35.669158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:35.828791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbed583bb3d44926bfffd1be76ef5b3c', 'request_id': 'req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:35.838933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbed583bb3d44926bfffd1be76ef5b3c', 'request_id': 'req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:35.852696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbed583bb3d44926bfffd1be76ef5b3c', 'request_id': 'req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:35.861512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:35.907020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] The token cache is being invalidate because project bbed583bb3d44926bfffd1be76ef5b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:43:35.907578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:35.909356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-107138ab-c0c3-4f37-bc3d-5b2a674a9ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:35.926049 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1491/2973] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:43:35 2022] DELETE /identity/v3/projects/bbed583bb3d44926bfffd1be76ef5b3c => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:35.928778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965cba5-57aa-4bf7-be68-fbc56e09ce99 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:35.929809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965cba5-57aa-4bf7-be68-fbc56e09ce99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:35.929809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965cba5-57aa-4bf7-be68-fbc56e09ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:36.056731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9965cba5-57aa-4bf7-be68-fbc56e09ce99 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:36.059382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9965cba5-57aa-4bf7-be68-fbc56e09ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:36.226502 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1483/2974] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:36.245087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630542-92b2-4e90-9fba-fba78f7dedb7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:36.245087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630542-92b2-4e90-9fba-fba78f7dedb7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:36.245087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630542-92b2-4e90-9fba-fba78f7dedb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:36.326737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-30630542-92b2-4e90-9fba-fba78f7dedb7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:36.328770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30630542-92b2-4e90-9fba-fba78f7dedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:36.373240 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1492/2975] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:36.374705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965cba5-57aa-4bf7-be68-fbc56e09ce99 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:36.402456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965cba5-57aa-4bf7-be68-fbc56e09ce99 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:36.415395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:36.433207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:36.435237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:36.435840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:36.442253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:43:36.442866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:36.454617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:36.507194 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1484/2976] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:43:36.516194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30630542-92b2-4e90-9fba-fba78f7dedb7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:36.548769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30630542-92b2-4e90-9fba-fba78f7dedb7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:36.570844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:36.572413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:36.573118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:36.573362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:36.574769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:36.579808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:36.585004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:36.592564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:36.718008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1493/2977] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:43:36 2022] POST /identity/v3/projects => generated 401 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:36.728861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:36.834688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:36.971652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce3cb9-59ee-49e9-9306-d4d9aa1b8055 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:37.052140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49ca7-0aef-49ff-86af-0a2dc15725d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:37.077930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:37.079594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.080355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.081336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.083295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:37.087465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:37.144617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:37.145348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.145948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.146254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.150210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:37.166781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:37.169761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:37.177906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1494/2978] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:43:36 2022] POST /identity/v3/users => generated 301 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:37.181316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:37.183862 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1485/2979] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:43:37.184542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:37.184780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:37.196461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ca6bf-0292-40aa-b2f6-d1b2aa065fb3 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:37.205260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:37.206434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.206434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.207046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.208488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:37.210747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:37.217596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a655ff-91e7-47b4-aaee-3bd9149256de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:37.243579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:37.244942 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1486/2980] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:37.250767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.251342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.251592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:37.251931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] PATH_INFO: `/v3/users/b59bb3ae079d4e9a989d3309f9e7b34e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.255228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59bb3ae079d4e9a989d3309f9e7b34e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:37.259146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:37.273108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d931-eefe-45d4-9307-f97e3ccf5371 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:37.285658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:37.286427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.288110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.289630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.292034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:37.299148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:37.333334 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1487/2981] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:37.339530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:37.373184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c73a-1511-42eb-a78d-da37ffae7f4c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:37.389414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb095c2-e014-412e-a864-ef353f1da1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:37.390838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb095c2-e014-412e-a864-ef353f1da1de admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.392186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb095c2-e014-412e-a864-ef353f1da1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.395538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb095c2-e014-412e-a864-ef353f1da1de admin admin] PATH_INFO: `/v3/projects/01a0e85ed66f4cc38e7fb3ce7d76cc96/users/8ed3d7a4c74f4be789ded3830c8e988f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.436861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb095c2-e014-412e-a864-ef353f1da1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a0e85ed66f4cc38e7fb3ce7d76cc96, user_id=8ed3d7a4c74f4be789ded3830c8e988f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:37.441026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb095c2-e014-412e-a864-ef353f1da1de admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:37.451621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59bb3ae079d4e9a989d3309f9e7b34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:37.469141 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1488/2982] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:37 2022] PUT /identity/v3/projects/01a0e85ed66f4cc38e7fb3ce7d76cc96/users/8ed3d7a4c74f4be789ded3830c8e988f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:43:37.488743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e636-fdbb-44d6-9426-176dca9bc36d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.489659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e636-fdbb-44d6-9426-176dca9bc36d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.490183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e636-fdbb-44d6-9426-176dca9bc36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.515186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59bb3ae079d4e9a989d3309f9e7b34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:37.534972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59bb3ae079d4e9a989d3309f9e7b34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:37.538077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59bb3ae079d4e9a989d3309f9e7b34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:37.573435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59bb3ae079d4e9a989d3309f9e7b34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:37.580880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-64e4e636-fdbb-44d6-9426-176dca9bc36d None None] MFA Rules not processed for user `8ed3d7a4c74f4be789ded3830c8e988f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:37.589238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-64e4e636-fdbb-44d6-9426-176dca9bc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:37.594767 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1495/2983] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:43:37 2022] DELETE /identity/v3/users/b59bb3ae079d4e9a989d3309f9e7b34e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:37.758861 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1489/2984] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:37.763357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:37.765010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:37.836806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:37.927648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f207e6-0c41-46c0-b337-09e0de708c57 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:37.946995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:37.947755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:37.948044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:37.948325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:37.949112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:37.956877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:38.033670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1496/2985] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:43:37 2022] POST /identity/v3/projects => generated 401 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:38.038025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e636-fdbb-44d6-9426-176dca9bc36d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:38.055782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e636-fdbb-44d6-9426-176dca9bc36d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:38.095460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:38.236691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:38.238047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:38.239151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:38.240627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:38.241714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:38.244103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:38.303662 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1490/2986] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:43:38 2022] POST /identity/v3/users => generated 307 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:38.308711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:38.326575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7986e-9204-4893-a10a-88a141147b3d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:38.333770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:38.335010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:38.335412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:38.336020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:38.338522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:38.341921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:38.369823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1497/2987] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:43:38.377809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:38.409140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f9a1-2280-4823-981c-08d7054218db admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:38.418422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:38.419931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:38.420640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:38.421307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] PATH_INFO: `/v3/projects/8b775d65376f417cb942bb2d65d5f3f3/users/a5fadff37edb42daa7257f7a47f814f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:38.455723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b775d65376f417cb942bb2d65d5f3f3, user_id=a5fadff37edb42daa7257f7a47f814f6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:38.471531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:38.509056 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1491/2988] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:38 2022] PUT /identity/v3/projects/8b775d65376f417cb942bb2d65d5f3f3/users/a5fadff37edb42daa7257f7a47f814f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:38.516239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:38.570635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d2a5f-c270-4543-a026-20258671abd7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:38.703228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:38.707808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:38.791623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:38.799490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:38.799900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:38.800402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:38.806798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:38.829182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:38.927540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1498/2989] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:38.935123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:38.943251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcd4ea-e834-4a48-a10d-74e2d0d1c12d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:38.954447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:38.955895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:38.957100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:38.957100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] PATH_INFO: `/v3/projects/d846e5e1ebe248389fbc14971ccc2bd7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:38.960682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d846e5e1ebe248389fbc14971ccc2bd7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:38.969161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:39.006615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0f558-b7ff-417e-a89e-1f8d51f3c0ae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:39.016258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2601af9-c040-4932-91ba-c5b6557d9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:39.017519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2601af9-c040-4932-91ba-c5b6557d9282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:39.018139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2601af9-c040-4932-91ba-c5b6557d9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:39.018481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2601af9-c040-4932-91ba-c5b6557d9282 admin admin] PATH_INFO: `/v3/projects/8b775d65376f417cb942bb2d65d5f3f3/users/a5fadff37edb42daa7257f7a47f814f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:39.021500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2601af9-c040-4932-91ba-c5b6557d9282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b775d65376f417cb942bb2d65d5f3f3, user_id=a5fadff37edb42daa7257f7a47f814f6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:39.025585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2601af9-c040-4932-91ba-c5b6557d9282 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:39.056434 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1499/2990] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:38 2022] PUT /identity/v3/projects/8b775d65376f417cb942bb2d65d5f3f3/users/a5fadff37edb42daa7257f7a47f814f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:39.079678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b55c0-5d31-4b84-bc3e-8873b979a473 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:39.080716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b55c0-5d31-4b84-bc3e-8873b979a473 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:39.084686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b55c0-5d31-4b84-bc3e-8873b979a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:39.140480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd846e5e1ebe248389fbc14971ccc2bd7', 'request_id': 'req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:39.159023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd846e5e1ebe248389fbc14971ccc2bd7', 'request_id': 'req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:39.173813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd846e5e1ebe248389fbc14971ccc2bd7', 'request_id': 'req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:39.196282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-160b55c0-5d31-4b84-bc3e-8873b979a473 None None] MFA Rules not processed for user `a5fadff37edb42daa7257f7a47f814f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:39.196628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] The token cache is being invalidate because project d846e5e1ebe248389fbc14971ccc2bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:43:39.197168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:39.197559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-160b55c0-5d31-4b84-bc3e-8873b979a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:39.201901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ca7e907-d1de-4945-9a85-18fb1ccb82b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:39.208567 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1492/2991] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:43:38 2022] DELETE /identity/v3/projects/d846e5e1ebe248389fbc14971ccc2bd7 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:43:39.215139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a2b7-b44a-42fd-834b-a46cf14271fe None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:39.216341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a2b7-b44a-42fd-834b-a46cf14271fe None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:39.216854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a2b7-b44a-42fd-834b-a46cf14271fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:39.248399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-09f5a2b7-b44a-42fd-834b-a46cf14271fe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:39.250287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-09f5a2b7-b44a-42fd-834b-a46cf14271fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:39.265519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:39.422001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1493/2992] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:39.431129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6665b2-701b-4cc2-871e-d44c9c0a0dcd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:39.431850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6665b2-701b-4cc2-871e-d44c9c0a0dcd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:39.432304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6665b2-701b-4cc2-871e-d44c9c0a0dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:39.500048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1c6665b2-701b-4cc2-871e-d44c9c0a0dcd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:39.503641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c6665b2-701b-4cc2-871e-d44c9c0a0dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:39.548664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1494/2993] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:39.552115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6665b2-701b-4cc2-871e-d44c9c0a0dcd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:39.578748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6665b2-701b-4cc2-871e-d44c9c0a0dcd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:39.594180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:39.596178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:39.597057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:39.597613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:39.598826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:43:39.599567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:39.604192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:39.647396 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1495/2994] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:43:39.649324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:39.693627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ffb6b-3ffd-472a-91b7-71694135b1d4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:39.710458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:39.714555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:39.716300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:39.717173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:39.724132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:39.732098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:39.768125 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1500/2995] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 681 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:39.838236 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1496/2996] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:39.840158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b55c0-5d31-4b84-bc3e-8873b979a473 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:39.888155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b55c0-5d31-4b84-bc3e-8873b979a473 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:39.956122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:40.311322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:40.314955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:40.319812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:40.320291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:40.321441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:40.326083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:40.424652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:40.425500 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1501/2997] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:43:39 2022] POST /identity/v3/users => generated 292 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:40.445599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6870b-e403-443c-9dfe-5ccb3ea024b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:40.472390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:40.474768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:40.474768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:40.474768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:40.474768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:40.480167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:40.558421 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1497/2998] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:40.563625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:40.585881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a212-81cd-449d-965e-b6dc40999403 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:40.601218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:40.601772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:40.602069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:40.602348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:40.603111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:40.605013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:40.643096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:40.644971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:40.676311 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1502/2999] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:40.677451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:40.732522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72578da-9387-437b-abe4-99a14ce9ad50 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:40.750478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdcf96-da24-424b-a936-b285f0607ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:40.750478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdcf96-da24-424b-a936-b285f0607ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:40.755589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdcf96-da24-424b-a936-b285f0607ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:40.756036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdcf96-da24-424b-a936-b285f0607ed4 admin admin] PATH_INFO: `/v3/projects/cdff374d01764239b8f35f469216115c/users/5ffc53165a0b4a6992fea0dd8325c343/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:40.817108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdcf96-da24-424b-a936-b285f0607ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdff374d01764239b8f35f469216115c, user_id=5ffc53165a0b4a6992fea0dd8325c343, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:40.820113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdcf96-da24-424b-a936-b285f0607ed4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:40.857614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1503/3000] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:40 2022] PUT /identity/v3/projects/cdff374d01764239b8f35f469216115c/users/5ffc53165a0b4a6992fea0dd8325c343/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:40.889950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:40.890736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:40.891294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:40.970455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] MFA Rules not processed for user `5ffc53165a0b4a6992fea0dd8325c343`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:40.972207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:40.976554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb2f1-11c9-4546-9427-4e91308d653d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:41.196330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:41.212324 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1504/3001] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:41.244132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:41.244984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:41.245378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:41.245768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:41.502763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:41.504790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:41.550493 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1498/3002] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 908 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:43:41.822049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:41.824586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:41.887939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630b5ac-f96d-4630-ac7c-71224fd5f08b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:41.938962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:41.945008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:41.947333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:41.947860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:41.969428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:41.972665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:41.993797 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1505/3003] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:43.840232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:43.873282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41efb50-eac8-47ab-a75f-871dc37e2436 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:43.891622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:43.892338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:43.892664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:43.892974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:43.903694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:43.908828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:44.014329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:44.067770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dc09d-d169-4c95-bacb-0c99f73a691a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:44.071904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:44.073538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:44.074229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:44.077127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:44.078072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:44.078943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] PATH_INFO: `/v3/users/5ffc53165a0b4a6992fea0dd8325c343` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:44.082029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffc53165a0b4a6992fea0dd8325c343)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:44.087110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:44.098629 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1499/3004] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:44.135029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:44.135029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:44.183026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b83a-3eed-4fd8-8d91-235f9866f44d service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:44.201840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:44.202762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:44.203048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:44.205775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] PATH_INFO: `/v3/users/8ed3d7a4c74f4be789ded3830c8e988f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:44.210956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed3d7a4c74f4be789ded3830c8e988f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:44.218676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:44.341628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffc53165a0b4a6992fea0dd8325c343'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.369321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed3d7a4c74f4be789ded3830c8e988f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.408750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffc53165a0b4a6992fea0dd8325c343'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.422403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffc53165a0b4a6992fea0dd8325c343'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.424028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffc53165a0b4a6992fea0dd8325c343'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.437993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed3d7a4c74f4be789ded3830c8e988f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.440044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed3d7a4c74f4be789ded3830c8e988f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.461957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664a09d5-ad5e-4c1f-9e79-2ea329b3f4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffc53165a0b4a6992fea0dd8325c343'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.484977 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1506/3005] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:43:43 2022] DELETE /identity/v3/users/5ffc53165a0b4a6992fea0dd8325c343 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:44.500058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed3d7a4c74f4be789ded3830c8e988f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.501186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30dba04b-fa4b-416a-a15d-8aacb518c950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed3d7a4c74f4be789ded3830c8e988f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:44.506641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:44.507950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:44.508510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:44.530111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:44.550251 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1500/3006] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:43:44 2022] DELETE /identity/v3/users/8ed3d7a4c74f4be789ded3830c8e988f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:44.553869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:44.554362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:44.554855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:44.565126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:44.566563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:44.601081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:44.602507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:44.722554 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1507/3007] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:44.733115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:44.738901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:44.790169 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1501/3008] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:44.797480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:44.799953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:44.994990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d74e9-2aa4-4ebd-8ccf-daeeea0481b6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:45.003249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:45.005107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:45.005990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:45.006732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:45.016321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca607-b127-4131-8b74-c9d56661745a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:45.024036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:45.025065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:45.032860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:45.033824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:45.035560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:45.043362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:45.055528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:45.060564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:45.069210 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1508/3009] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:45.097527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1502/3010] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:43:46.057201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:46.059489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:46.072363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:46.074080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:46.086505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:46.095599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c406653-bf7e-448e-bd0f-3648a542b60c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:46.100643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b0d7a-a4ef-45f4-bef4-1967feb48568 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:46.108468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:46.109698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.110737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.112244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] PATH_INFO: `/v3/projects/01a0e85ed66f4cc38e7fb3ce7d76cc96` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.115674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:46.116244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a0e85ed66f4cc38e7fb3ce7d76cc96)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:46.118338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.120117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:46.120530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.121113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] PATH_INFO: `/v3/projects/cdff374d01764239b8f35f469216115c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.125478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdff374d01764239b8f35f469216115c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:46.127982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:46.227318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdff374d01764239b8f35f469216115c', 'request_id': 'req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.243016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a0e85ed66f4cc38e7fb3ce7d76cc96', 'request_id': 'req-b693d8c0-548e-427a-9033-3f225812ca9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.248174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdff374d01764239b8f35f469216115c', 'request_id': 'req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.259530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdff374d01764239b8f35f469216115c', 'request_id': 'req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.266369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a0e85ed66f4cc38e7fb3ce7d76cc96', 'request_id': 'req-b693d8c0-548e-427a-9033-3f225812ca9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.278429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a0e85ed66f4cc38e7fb3ce7d76cc96', 'request_id': 'req-b693d8c0-548e-427a-9033-3f225812ca9f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.283051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] The token cache is being invalidate because project cdff374d01764239b8f35f469216115c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:43:46.283531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.284096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b5a6a17-5ea6-435a-8d9f-e90f9e9bf1bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.286153 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1503/3011] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:43:46 2022] DELETE /identity/v3/projects/cdff374d01764239b8f35f469216115c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:43:46.297117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef52a7f-1dc4-4909-b8d2-f4de0af4b6f8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.297662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef52a7f-1dc4-4909-b8d2-f4de0af4b6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.298180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef52a7f-1dc4-4909-b8d2-f4de0af4b6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.311069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] The token cache is being invalidate because project 01a0e85ed66f4cc38e7fb3ce7d76cc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:43:46.311435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.314632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.321085 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1509/3012] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:43:46 2022] DELETE /identity/v3/projects/01a0e85ed66f4cc38e7fb3ce7d76cc96 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:46.324298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:46.324612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:46.325908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9ef52a7f-1dc4-4909-b8d2-f4de0af4b6f8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:46.327463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9ef52a7f-1dc4-4909-b8d2-f4de0af4b6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:46.358583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:46.419376 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1504/3013] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:46.435359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124947ff-4255-4289-b8c0-8c18c8dbbfc2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.437109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124947ff-4255-4289-b8c0-8c18c8dbbfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.437769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124947ff-4255-4289-b8c0-8c18c8dbbfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.485040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-124947ff-4255-4289-b8c0-8c18c8dbbfc2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:46.488406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-124947ff-4255-4289-b8c0-8c18c8dbbfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:46.497738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693d8c0-548e-427a-9033-3f225812ca9f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:46.510942 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1505/3014] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:46.514509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:46.515879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.516207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.516495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] PATH_INFO: `/v3/users/a5fadff37edb42daa7257f7a47f814f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.517516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124947ff-4255-4289-b8c0-8c18c8dbbfc2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:46.518540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fadff37edb42daa7257f7a47f814f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:46.521336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:46.539638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124947ff-4255-4289-b8c0-8c18c8dbbfc2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:46.561833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:46.565948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.567531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.568861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.575189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:43:46.576753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:46.582456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:46.611345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1506/3015] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:43:46.614055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:46.621127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fadff37edb42daa7257f7a47f814f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.635195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2efeae-38e4-463a-8d0f-df21c9422f2d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:46.643878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:46.644870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.645223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.645652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.646694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:46.647856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fadff37edb42daa7257f7a47f814f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.650288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:46.661277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fadff37edb42daa7257f7a47f814f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.662218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fadff37edb42daa7257f7a47f814f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.698174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fadff37edb42daa7257f7a47f814f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:46.721942 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1510/3016] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:43:46 2022] DELETE /identity/v3/users/a5fadff37edb42daa7257f7a47f814f6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:46.741221 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1507/3017] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:43:46 2022] POST /identity/v3/projects => generated 359 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:43:46.741541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:46.745937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:46.790392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:46.905825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e98c65-d2a7-4f4f-9e49-26f2d1831a65 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:46.991309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:46.992036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:46.992344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:46.992625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:46.994248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:46.997508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:47.050249 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1511/3018] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:43:46 2022] POST /identity/v3/users => generated 280 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:43:47.057501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:47.092927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac29421-034f-4262-b787-b4950a335f9e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:47.131586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:47.132941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.133542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.135921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.144739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:47.148528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:47.205043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:47.211373 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1508/3019] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:47.226763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129010-4908-49bc-a5b5-a2dc45e4b4c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:47.238589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:47.243865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.244533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.245767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.253085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:47.255736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:47.296144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:47.309658 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1512/3020] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:47.330612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b30ff-0430-429d-9c5d-2704fdf60ab6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:47.343224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0dc85-3530-4b38-ac84-1825a5b96df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:47.345404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0dc85-3530-4b38-ac84-1825a5b96df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.345904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0dc85-3530-4b38-ac84-1825a5b96df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.346892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0dc85-3530-4b38-ac84-1825a5b96df2 admin admin] PATH_INFO: `/v3/projects/03019aa36dea4bbaa9e4ba0dcacad39e/users/504c51583d4b4470bbacd4377fb8803a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.357829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:47.361376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:47.407412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0dc85-3530-4b38-ac84-1825a5b96df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03019aa36dea4bbaa9e4ba0dcacad39e, user_id=504c51583d4b4470bbacd4377fb8803a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:47.408000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0bd1f-885a-4c01-9e9b-c10ad626b90b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:47.410841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0dc85-3530-4b38-ac84-1825a5b96df2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:47.417793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:47.419854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.420478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.421238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] PATH_INFO: `/v3/projects/8b775d65376f417cb942bb2d65d5f3f3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.424107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b775d65376f417cb942bb2d65d5f3f3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:47.428441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:47.429440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1509/3021] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:47 2022] PUT /identity/v3/projects/03019aa36dea4bbaa9e4ba0dcacad39e/users/504c51583d4b4470bbacd4377fb8803a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:47.454689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.454976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.455355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.496387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] MFA Rules not processed for user `504c51583d4b4470bbacd4377fb8803a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:47.498227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:47.582645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b775d65376f417cb942bb2d65d5f3f3', 'request_id': 'req-2258adbf-17a3-4123-aea2-4f2f657721d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:47.590886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b775d65376f417cb942bb2d65d5f3f3', 'request_id': 'req-2258adbf-17a3-4123-aea2-4f2f657721d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:47.599829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b775d65376f417cb942bb2d65d5f3f3', 'request_id': 'req-2258adbf-17a3-4123-aea2-4f2f657721d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:47.603382 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1510/3022] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:47.617309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:47.617775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] The token cache is being invalidate because project 8b775d65376f417cb942bb2d65d5f3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:43:47.618208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:47.619514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2258adbf-17a3-4123-aea2-4f2f657721d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:47.620303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:47.625690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1513/3023] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:43:47 2022] DELETE /identity/v3/projects/8b775d65376f417cb942bb2d65d5f3f3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:47.628931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0c07-d585-41d7-a91a-3fc78343c70c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.629435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0c07-d585-41d7-a91a-3fc78343c70c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.629794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0c07-d585-41d7-a91a-3fc78343c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.678201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b7ec0c07-d585-41d7-a91a-3fc78343c70c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:47.682629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7ec0c07-d585-41d7-a91a-3fc78343c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:47.702695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:47.720100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:47.761451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea759b-04f2-433c-a7bb-f77c09121218 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:47.843482 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1514/3024] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:47.845769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c0122-2c0a-4c4a-90a8-6043aefb0f96 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.846397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c0122-2c0a-4c4a-90a8-6043aefb0f96 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.846716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c0122-2c0a-4c4a-90a8-6043aefb0f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.897623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-234c0122-2c0a-4c4a-90a8-6043aefb0f96 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:47.902182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-234c0122-2c0a-4c4a-90a8-6043aefb0f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:47.905463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:47.907520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.908203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.908840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.911370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:47.932870 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1515/3025] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:47.936988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c0122-2c0a-4c4a-90a8-6043aefb0f96 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:47.956963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c0122-2c0a-4c4a-90a8-6043aefb0f96 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:47.968027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:47.969108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:47.969612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:47.970412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:47.971094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:43:47.971567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:47.973567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:47.995318 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1516/3026] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:43:47.999032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.015793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65599ad-5438-4a06-bbe0-2934c366caf1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.024375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.025253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.025704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.026097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.026999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.030632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.036771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.039672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.063906 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1511/3027] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:48.094975 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1517/3028] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:43:47 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:48.095825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.117373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479ef3-3b01-4c45-9d03-16dbd5ca5ce4 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.139018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.141743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:48.230397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.231173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.231522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.231807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.232714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.234937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.270132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1512/3029] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:43:48 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:48.274153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.283995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:48.289070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747fe32-6fa4-4ab2-9517-a27b2ffce34b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.298149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.298868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.299161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.299700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.300554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.304221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.313123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382f12-dc8b-46c4-a29c-eaf1087442f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.319341 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1513/3030] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:48.320513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.321430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.321719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.322297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] PATH_INFO: `/v3/users/504c51583d4b4470bbacd4377fb8803a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.323646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504c51583d4b4470bbacd4377fb8803a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.325656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.328034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.338326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ac41c-f327-40f8-85ed-e6c94a045fdd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.353011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.353639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.353935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.354226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.355239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.357138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.404624 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1514/3031] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:43:48.404624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.418301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504c51583d4b4470bbacd4377fb8803a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:48.418728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3c30c-012c-4cac-861e-b96583f5e1a3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.436725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e0adb-b074-439a-a684-ddb161ee1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.437694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e0adb-b074-439a-a684-ddb161ee1866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.437984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e0adb-b074-439a-a684-ddb161ee1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.438271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e0adb-b074-439a-a684-ddb161ee1866 admin admin] PATH_INFO: `/v3/projects/ce7cf1e8497849e7ad92895c0d5a98ae/users/c27fb61960bd4f2799a99406923a518b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.447696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504c51583d4b4470bbacd4377fb8803a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:48.463560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e0adb-b074-439a-a684-ddb161ee1866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7cf1e8497849e7ad92895c0d5a98ae, user_id=c27fb61960bd4f2799a99406923a518b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.467803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e0adb-b074-439a-a684-ddb161ee1866 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.477685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504c51583d4b4470bbacd4377fb8803a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:48.478412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504c51583d4b4470bbacd4377fb8803a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:48.490036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:48.494183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0ebbbbd-3ed8-4789-b19e-65fa45542ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504c51583d4b4470bbacd4377fb8803a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:48.500447 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1515/3032] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:48 2022] PUT /identity/v3/projects/ce7cf1e8497849e7ad92895c0d5a98ae/users/c27fb61960bd4f2799a99406923a518b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:48.508219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.516960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.520365 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1518/3033] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:43:48 2022] DELETE /identity/v3/users/504c51583d4b4470bbacd4377fb8803a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:43:48.520572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.523766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.523766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.523766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.533643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:48.535188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:48.555788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:48.557199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:48.683908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1519/3034] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:48.704848 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1516/3035] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:48.709205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.712576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:48.729383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.733362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:48.895238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a55ea-5ca0-4ce5-96db-d6eb6a8dc327 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.901167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.904456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.905204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.905680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.913719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e291c36-22ec-4ad1-9b2b-408fe2438fd9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:48.920397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:48.921578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:48.922034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:48.922550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:48.924782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.928619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.939954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:48.942499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:48.950663 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1520/3036] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:48.954320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:48.957257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:48.971546 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1517/3037] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:49.183606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87c178-555e-4275-b1f8-c084f2bf15d9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:49.204283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23e928-ef52-49da-8919-3a587dbbfc95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:49.204853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e928-ef52-49da-8919-3a587dbbfc95 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:49.205891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e928-ef52-49da-8919-3a587dbbfc95 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:49.205891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e928-ef52-49da-8919-3a587dbbfc95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:49.217515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b23e928-ef52-49da-8919-3a587dbbfc95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:49.353954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:49.469890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23e928-ef52-49da-8919-3a587dbbfc95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:49.472849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23e928-ef52-49da-8919-3a587dbbfc95 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:49.508923 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1521/3038] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:49.875735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:49.878784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:49.915577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7706937-610c-4254-877c-58e27e68612c service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:49.940062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:49.942052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:49.945031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:49.945510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] PATH_INFO: `/v3/projects/03019aa36dea4bbaa9e4ba0dcacad39e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:49.951164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03019aa36dea4bbaa9e4ba0dcacad39e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:49.953449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:50.101550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03019aa36dea4bbaa9e4ba0dcacad39e', 'request_id': 'req-2d9a5f21-59dc-49c9-adc9-80695da4c171'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:50.119793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03019aa36dea4bbaa9e4ba0dcacad39e', 'request_id': 'req-2d9a5f21-59dc-49c9-adc9-80695da4c171'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:50.122651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:50.143879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03019aa36dea4bbaa9e4ba0dcacad39e', 'request_id': 'req-2d9a5f21-59dc-49c9-adc9-80695da4c171'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:50.175036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] The token cache is being invalidate because project 03019aa36dea4bbaa9e4ba0dcacad39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:43:50.179651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:50.181468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d9a5f21-59dc-49c9-adc9-80695da4c171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:43:50.185779 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1518/3039] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:43:49 2022] DELETE /identity/v3/projects/03019aa36dea4bbaa9e4ba0dcacad39e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:50.194316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37baa57-d385-4aa0-8ce6-a762bdc51339 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:50.195239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37baa57-d385-4aa0-8ce6-a762bdc51339 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:50.196313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37baa57-d385-4aa0-8ce6-a762bdc51339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:50.310758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c37baa57-d385-4aa0-8ce6-a762bdc51339 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:50.313196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c37baa57-d385-4aa0-8ce6-a762bdc51339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:50.539393 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1522/3040] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:50.541178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddead-df96-4921-8cca-a70c0e62c703 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:50.541783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddead-df96-4921-8cca-a70c0e62c703 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:50.542464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddead-df96-4921-8cca-a70c0e62c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:50.591993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7e8ddead-df96-4921-8cca-a70c0e62c703 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:50.594017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e8ddead-df96-4921-8cca-a70c0e62c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:50.625252 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1519/3041] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:50.633608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37baa57-d385-4aa0-8ce6-a762bdc51339 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:50.673667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37baa57-d385-4aa0-8ce6-a762bdc51339 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:50.693302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:50.694473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:50.694964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:50.695520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:50.696589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:43:50.697058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:50.700274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:50.731624 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1523/3042] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:43:50.738139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ddead-df96-4921-8cca-a70c0e62c703 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:50.754631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ddead-df96-4921-8cca-a70c0e62c703 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:50.771080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:50.771751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:50.772074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:50.774862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:50.775955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:50.782400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:50.847830 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1520/3043] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:43:50 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:43:50.853611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:50.869689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7048eb7-1bcf-40ed-96f7-a4b1b1823a46 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:51.043974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:51.044686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.044971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.045307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.046023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:51.048053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:51.100880 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1524/3044] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:43:50 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:43:51.106025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:51.123544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07453565-6fef-4ae7-8863-448c0bb5522a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:51.133449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:51.134432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.134957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.135570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.136872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:51.139430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:51.154488 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1521/3045] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:51.162175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:51.186758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9056e96-1b12-4892-b916-724671cd71f5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:51.197491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c57f6-3124-44e2-aeb3-4e644652e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:51.199088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c57f6-3124-44e2-aeb3-4e644652e793 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.200459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c57f6-3124-44e2-aeb3-4e644652e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.201090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c57f6-3124-44e2-aeb3-4e644652e793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.202625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c57f6-3124-44e2-aeb3-4e644652e793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:51.207689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c57f6-3124-44e2-aeb3-4e644652e793 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:51.240349 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1525/3046] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:43:51.248324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:51.270736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442553c-6b07-480f-a988-bc2fc2654cf1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:51.276708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711ea92-119b-4369-a58e-609c1e18d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:51.277697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711ea92-119b-4369-a58e-609c1e18d233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.278623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711ea92-119b-4369-a58e-609c1e18d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.278977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711ea92-119b-4369-a58e-609c1e18d233 admin admin] PATH_INFO: `/v3/projects/33d5773713f8495c9018a5aaed6fd744/users/c2e85acbfcdc4b3a813830d6723b006f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.299593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711ea92-119b-4369-a58e-609c1e18d233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d5773713f8495c9018a5aaed6fd744, user_id=c2e85acbfcdc4b3a813830d6723b006f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:51.303030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711ea92-119b-4369-a58e-609c1e18d233 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:51.349699 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1522/3047] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:43:51 2022] PUT /identity/v3/projects/33d5773713f8495c9018a5aaed6fd744/users/c2e85acbfcdc4b3a813830d6723b006f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:43:51.352105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.352741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.353279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.381726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e1b2-1717-4304-a423-5306ddd8ca41 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.382455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e1b2-1717-4304-a423-5306ddd8ca41 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.382934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e1b2-1717-4304-a423-5306ddd8ca41 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.385415 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1523/3048] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:43:51.391950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.392793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.393438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.408299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:51.410021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:51.455302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:51.474929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:51.477815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:51.504815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1526/3049] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:51.514420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:51.519158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:51.615628 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1524/3050] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:43:51.642664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:51.645053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:51.661221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab1e4-7260-4443-b09d-42b5e04e230c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:51.666797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49ce86-f88a-421c-b6c9-970be5339fc3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:51.667719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:51.667943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.668371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.668657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.674533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:51.675428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:51.675828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:51.676216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:51.682051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:51.684802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:51.689601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:51.692055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:51.698019 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1525/3051] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:51.705643 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1527/3052] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:52.109823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:52.129692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de81bca-63e3-4795-af43-10c5eff21619 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:52.149194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:52.150523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:52.150999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:52.151580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:52.157280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:52.174449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:52.177227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:52.194015 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1526/3053] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:52.857778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:52.870629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e991f-b0d4-4e19-a714-3bbf6493451a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:52.885147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672db3b-6db9-4aea-9816-c48dcd3ab22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:52.885147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672db3b-6db9-4aea-9816-c48dcd3ab22e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:52.885147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672db3b-6db9-4aea-9816-c48dcd3ab22e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:52.889346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672db3b-6db9-4aea-9816-c48dcd3ab22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:52.899028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3672db3b-6db9-4aea-9816-c48dcd3ab22e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:53.188548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672db3b-6db9-4aea-9816-c48dcd3ab22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:53.190038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672db3b-6db9-4aea-9816-c48dcd3ab22e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:53.222079 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1528/3054] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:53.376700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:53.395207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67dccb-c5aa-4047-8493-8a01b04b10d6 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:53.405530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf55c-91a8-441b-87cd-2c65200c5c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:53.406741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf55c-91a8-441b-87cd-2c65200c5c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:53.407335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf55c-91a8-441b-87cd-2c65200c5c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:53.408053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf55c-91a8-441b-87cd-2c65200c5c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:53.414327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-669cf55c-91a8-441b-87cd-2c65200c5c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:53.432986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf55c-91a8-441b-87cd-2c65200c5c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:53.436120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf55c-91a8-441b-87cd-2c65200c5c32 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:53.454032 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1527/3055] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:01.979076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfdebc-bf5f-470d-a4d3-9ecb4a8cd297 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:01.979608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfdebc-bf5f-470d-a4d3-9ecb4a8cd297 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:01.980026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfdebc-bf5f-470d-a4d3-9ecb4a8cd297 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:01.982446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1529/3056] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:44:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:44:02.001704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78ede-2a09-4e64-bc8d-03e17d346db3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:02.002696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78ede-2a09-4e64-bc8d-03e17d346db3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:02.003178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78ede-2a09-4e64-bc8d-03e17d346db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:02.036609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9bc78ede-2a09-4e64-bc8d-03e17d346db3 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:02.038802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9bc78ede-2a09-4e64-bc8d-03e17d346db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:02.062571 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1528/3057] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:44:02.091089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfdebc-bf5f-470d-a4d3-9ecb4a8cd297 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:02.114463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfdebc-bf5f-470d-a4d3-9ecb4a8cd297 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:02.118475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c630316-24dc-41b3-ac0e-9b07eaebee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:02.119162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630316-24dc-41b3-ac0e-9b07eaebee6f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:02.119515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630316-24dc-41b3-ac0e-9b07eaebee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:02.119803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630316-24dc-41b3-ac0e-9b07eaebee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:02.141053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c630316-24dc-41b3-ac0e-9b07eaebee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:02.142711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c630316-24dc-41b3-ac0e-9b07eaebee6f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:02.157953 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1530/3058] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:05.389236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:05.390782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:05.391463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:05.481188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:05.512842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] MFA Rules not processed for user `c2e85acbfcdc4b3a813830d6723b006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:05.516343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:05.686778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1529/3059] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:05.688687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae55cb-852d-4b60-a3a1-68c6e7c70bdb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:05.689622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae55cb-852d-4b60-a3a1-68c6e7c70bdb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:05.690025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae55cb-852d-4b60-a3a1-68c6e7c70bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:05.739754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-18ae55cb-852d-4b60-a3a1-68c6e7c70bdb None None] MFA Rules not processed for user `c2e85acbfcdc4b3a813830d6723b006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:05.741710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18ae55cb-852d-4b60-a3a1-68c6e7c70bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:05.757909 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1531/3060] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:05.769767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:05.771993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:05.793840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a323-dbc9-468d-9a98-018229dddd37 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:05.801012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:05.802242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:05.802704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:05.803163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:05.815406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:05.817838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:05.832758 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1530/3061] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:10.759716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e750d-a3b8-4c89-b10d-33ba34c79474 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:10.762586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e750d-a3b8-4c89-b10d-33ba34c79474 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:10.764523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e750d-a3b8-4c89-b10d-33ba34c79474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:10.863029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f48e750d-a3b8-4c89-b10d-33ba34c79474 None None] MFA Rules not processed for user `c27fb61960bd4f2799a99406923a518b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:10.865818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f48e750d-a3b8-4c89-b10d-33ba34c79474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:11.025586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:11.082682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1532/3062] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:12.057294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:12.058997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:12.095340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db5051-acf4-4f8e-9c4d-79277fdcacb3 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:12.120247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ec929-abe8-40de-868d-6d1b8cf2bb62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:12.128321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ec929-abe8-40de-868d-6d1b8cf2bb62 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:12.129515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ec929-abe8-40de-868d-6d1b8cf2bb62 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:12.133660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ec929-abe8-40de-868d-6d1b8cf2bb62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:12.184044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ec929-abe8-40de-868d-6d1b8cf2bb62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:12.193389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ec929-abe8-40de-868d-6d1b8cf2bb62 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:12.245963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1531/3063] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:12.457589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e750d-a3b8-4c89-b10d-33ba34c79474 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:12.485543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e750d-a3b8-4c89-b10d-33ba34c79474 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:12.507943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:12.512172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:12.512474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:12.512768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:12.520882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:12.630921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69289ff1-603c-4a0f-94fa-1894e86b8d8c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:12.631491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69289ff1-603c-4a0f-94fa-1894e86b8d8c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:12.632157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69289ff1-603c-4a0f-94fa-1894e86b8d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:12.712179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-69289ff1-603c-4a0f-94fa-1894e86b8d8c None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:12.715642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69289ff1-603c-4a0f-94fa-1894e86b8d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:12.785837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:12.793308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:12.836754 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1533/3064] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:12.929278 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1532/3065] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:13.071261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:13.075567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:13.260712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42bcdc-05bf-4936-9645-aa7b5dd370af service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:13.272286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97b9de-c40f-43d9-9ec1-f0fecacacb57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:13.273769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97b9de-c40f-43d9-9ec1-f0fecacacb57 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:13.274840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97b9de-c40f-43d9-9ec1-f0fecacacb57 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:13.275134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97b9de-c40f-43d9-9ec1-f0fecacacb57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:13.309270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97b9de-c40f-43d9-9ec1-f0fecacacb57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:13.322661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97b9de-c40f-43d9-9ec1-f0fecacacb57 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:13.364227 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1534/3066] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:44:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:15.757857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaab328-9a7b-4c91-bc95-b680d39a3299 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:15.759031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaab328-9a7b-4c91-bc95-b680d39a3299 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:15.759565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaab328-9a7b-4c91-bc95-b680d39a3299 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:15.763372 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1533/3067] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:44:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:44:15.772682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:15.773752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:15.774221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:15.796670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:15.798252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:15.818417 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1535/3068] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:44:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:15.853873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaab328-9a7b-4c91-bc95-b680d39a3299 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:15.855909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0eaab328-9a7b-4c91-bc95-b680d39a3299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:15.911181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaab328-9a7b-4c91-bc95-b680d39a3299 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:15.930547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:15.932326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:15.932647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:15.938397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:15.971997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:15.973652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:16.019124 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1534/3069] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:21.082372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:21.085617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:21.174743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef877b4-2c34-4293-8dea-4878be33cddd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:21.207971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:21.218588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:21.242587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:21.242988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] PATH_INFO: `/v3/users/b04aa0fbcacd45bdadeb9bde761d4def` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:21.245621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04aa0fbcacd45bdadeb9bde761d4def)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:21.257496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:21.458225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:21.465079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04aa0fbcacd45bdadeb9bde761d4def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:21.549999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04aa0fbcacd45bdadeb9bde761d4def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:21.566631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04aa0fbcacd45bdadeb9bde761d4def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:21.567853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04aa0fbcacd45bdadeb9bde761d4def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:21.587000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9d6ccf6-dd77-4f15-a7c4-180c1da1be3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04aa0fbcacd45bdadeb9bde761d4def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:21.616785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1536/3070] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:44:21 2022] DELETE /identity/v3/users/b04aa0fbcacd45bdadeb9bde761d4def => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:44:23.972674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:24.059245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34062d1d-84a7-40ce-923e-93f12e2ea4b9 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:24.416692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:24.420117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:24.420676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:24.426149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] PATH_INFO: `/v3/projects/a21758c8c2ee4fd3bc58344c4948f503` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:24.440083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21758c8c2ee4fd3bc58344c4948f503)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:24.442453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:24.454770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:24.593793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21758c8c2ee4fd3bc58344c4948f503', 'request_id': 'req-9be07f0d-9e4e-4bf4-98d3-210a55975df3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:24.618229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21758c8c2ee4fd3bc58344c4948f503', 'request_id': 'req-9be07f0d-9e4e-4bf4-98d3-210a55975df3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:24.641261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21758c8c2ee4fd3bc58344c4948f503', 'request_id': 'req-9be07f0d-9e4e-4bf4-98d3-210a55975df3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:24.685120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] The token cache is being invalidate because project a21758c8c2ee4fd3bc58344c4948f503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:44:24.685913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:24.687561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9be07f0d-9e4e-4bf4-98d3-210a55975df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:24.693951 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1535/3071] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:44:23 2022] DELETE /identity/v3/projects/a21758c8c2ee4fd3bc58344c4948f503 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:44:24.699183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4d1da-5fd1-4d67-a40d-e34f48880d0e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:24.699819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4d1da-5fd1-4d67-a40d-e34f48880d0e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:24.699819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4d1da-5fd1-4d67-a40d-e34f48880d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:24.739120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fdf4d1da-5fd1-4d67-a40d-e34f48880d0e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:24.742817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fdf4d1da-5fd1-4d67-a40d-e34f48880d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:24.903005 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1537/3072] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:24.916841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364b4e-1b5f-40e5-9667-dfae8dec414f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:24.917144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364b4e-1b5f-40e5-9667-dfae8dec414f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:24.917458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364b4e-1b5f-40e5-9667-dfae8dec414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:24.954447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bf364b4e-1b5f-40e5-9667-dfae8dec414f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:24.955838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bf364b4e-1b5f-40e5-9667-dfae8dec414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:24.986993 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1536/3073] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:44:24.999811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4d1da-5fd1-4d67-a40d-e34f48880d0e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:25.034704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4d1da-5fd1-4d67-a40d-e34f48880d0e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:25.052958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:25.054743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:25.055671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:25.056558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:25.062215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:44:25.065488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:25.070690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:25.117018 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1538/3074] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:44:25.118517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364b4e-1b5f-40e5-9667-dfae8dec414f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:25.137443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364b4e-1b5f-40e5-9667-dfae8dec414f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:25.146195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:25.147918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:25.148672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:25.149565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:25.151330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:25.156032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:25.216725 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1537/3075] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:44:25 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:44:25.220979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:25.258914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4ccf-7444-4132-9053-b4d3eb068026 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:25.454920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:25.456632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:25.458674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:25.462055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:25.466154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:25.474613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:25.579422 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1539/3076] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:44:25 2022] POST /identity/v3/users => generated 291 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:44:25.581769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:25.598763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de30b-708c-41aa-86d3-87e21d75a760 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:25.613314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:25.614033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:25.614545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:25.614997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:25.616094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:25.618293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:25.653412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:25.665149 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1538/3077] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:44:25.668311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193de76-f27a-4374-886a-0b6f621c4a31 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:25.686426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7aa3e-b96c-409f-8d83-af76b1e2b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:25.687395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7aa3e-b96c-409f-8d83-af76b1e2b18c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:25.687859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7aa3e-b96c-409f-8d83-af76b1e2b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:25.688402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7aa3e-b96c-409f-8d83-af76b1e2b18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:25.689427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7aa3e-b96c-409f-8d83-af76b1e2b18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:25.691389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7aa3e-b96c-409f-8d83-af76b1e2b18c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:25.745035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:25.752796 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1540/3078] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:44:25.763584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983342a-e710-47e8-9f69-3ff4b4e1eb07 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:25.781477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:25.782649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:25.783130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:25.783367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] PATH_INFO: `/v3/projects/9aea3a0d9920482abbbcb6c186504ed2/users/8413b54e750c4f178c419c2b4f31d38e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:25.825099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aea3a0d9920482abbbcb6c186504ed2, user_id=8413b54e750c4f178c419c2b4f31d38e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:25.828387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:25.864975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1539/3079] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:44:25 2022] PUT /identity/v3/projects/9aea3a0d9920482abbbcb6c186504ed2/users/8413b54e750c4f178c419c2b4f31d38e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:44:25.869344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:25.869628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:25.870031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:25.903362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:25.904709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:25.972848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:26.118560 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1541/3080] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:26.232097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:26.235533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:26.572744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ec8f-0de4-4660-a143-501d1b21b88d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:26.609510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:26.611514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:26.612372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:26.613220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:26.700010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:26.703004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:26.741980 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1540/3081] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:31.545840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:31.547809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:31.709375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413acf5a-32cf-4ee5-9cbb-64df1b564d5a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:31.725639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:31.726639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:31.727100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:31.727568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:31.738352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:31.763544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:31.765555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:31.787578 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1542/3082] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:32.031003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:32.032632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:32.061155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de785ca-10b9-40f7-8894-52c71f4558f1 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:32.078790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:32.080480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:32.081183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:32.081620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] PATH_INFO: `/v3/users/c27fb61960bd4f2799a99406923a518b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:32.085357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27fb61960bd4f2799a99406923a518b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:32.087579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:32.188504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:32.266913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27fb61960bd4f2799a99406923a518b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:32.338869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27fb61960bd4f2799a99406923a518b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:32.341597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27fb61960bd4f2799a99406923a518b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:32.376558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27fb61960bd4f2799a99406923a518b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:32.384175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f229b0e-9d27-4c02-9293-6b55b968a0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27fb61960bd4f2799a99406923a518b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:32.440728 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1541/3083] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:44:32 2022] DELETE /identity/v3/users/c27fb61960bd4f2799a99406923a518b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:44:33.801176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:33.851347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7a32-1d8b-4345-b92a-4bc8854e80cb service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:34.145042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:34.146642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:34.147164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:34.147683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] PATH_INFO: `/v3/projects/ce7cf1e8497849e7ad92895c0d5a98ae` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:34.152483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7cf1e8497849e7ad92895c0d5a98ae)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:34.154598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:34.284238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7cf1e8497849e7ad92895c0d5a98ae', 'request_id': 'req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:34.294770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7cf1e8497849e7ad92895c0d5a98ae', 'request_id': 'req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:34.300488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:34.309523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7cf1e8497849e7ad92895c0d5a98ae', 'request_id': 'req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:34.335485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] The token cache is being invalidate because project ce7cf1e8497849e7ad92895c0d5a98ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:44:34.335822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:34.341366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd9087b-1ac3-46d8-a1da-aa4a195164e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:34.342523 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1543/3084] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:44:33 2022] DELETE /identity/v3/projects/ce7cf1e8497849e7ad92895c0d5a98ae => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:44:34.350560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc79f5-627d-4742-a067-8aafa7d8f001 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:34.351617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc79f5-627d-4742-a067-8aafa7d8f001 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:34.352317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc79f5-627d-4742-a067-8aafa7d8f001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:34.411861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b7fc79f5-627d-4742-a067-8aafa7d8f001 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:34.416028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7fc79f5-627d-4742-a067-8aafa7d8f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:34.633589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852c815-693e-45b9-a25c-207a6c83a637 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:34.633866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852c815-693e-45b9-a25c-207a6c83a637 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:34.634144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852c815-693e-45b9-a25c-207a6c83a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:34.634379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1542/3085] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:44:34.667773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e852c815-693e-45b9-a25c-207a6c83a637 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:34.676092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e852c815-693e-45b9-a25c-207a6c83a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:34.693349 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1544/3086] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:44:34.704244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc79f5-627d-4742-a067-8aafa7d8f001 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:34.752124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc79f5-627d-4742-a067-8aafa7d8f001 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:34.785288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:34.787555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:34.789330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:34.790298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:34.805312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:44:34.805915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:34.818195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:34.889122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852c815-693e-45b9-a25c-207a6c83a637 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:34.898831 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1543/3087] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:44:34.931412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852c815-693e-45b9-a25c-207a6c83a637 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:34.959820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:34.961081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:34.961589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:34.962469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:34.963520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:34.968724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:35.084971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:35.092789 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1545/3088] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:44:34 2022] POST /identity/v3/projects => generated 363 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:44:35.127642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab07f-4ba7-4314-9526-750294c6e167 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:35.361298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:35.362758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:35.363402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:35.364104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:35.367484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:35.383323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:35.455326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1544/3089] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:44:35 2022] POST /identity/v3/users => generated 282 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:44:35.463005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:35.492132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4f7e-e53a-4e85-a24c-200e0162b049 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:35.503955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:35.505841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:35.506492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:35.507187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:35.528888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:35.542285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:35.576757 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1546/3090] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:44:35.581675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:35.604282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3a380-4bd1-46ae-83d5-189da08da81b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:35.618896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a1145-da0a-48c0-b4a2-c784f4ab33ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:35.621299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1145-da0a-48c0-b4a2-c784f4ab33ea admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:35.621920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1145-da0a-48c0-b4a2-c784f4ab33ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:35.622525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1145-da0a-48c0-b4a2-c784f4ab33ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:35.624238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a1145-da0a-48c0-b4a2-c784f4ab33ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:35.630064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a1145-da0a-48c0-b4a2-c784f4ab33ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:35.674482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:35.687409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1545/3091] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:44:35.702706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dde74-a328-44ff-8337-f3b79803124c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:35.713132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:35.715652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:35.716770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:35.717556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] PATH_INFO: `/v3/projects/52b2ada3fd2842f0a04fdedaf4bd908e/users/331a222a893c4f84a08abf11333c7449/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:35.791795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b2ada3fd2842f0a04fdedaf4bd908e, user_id=331a222a893c4f84a08abf11333c7449, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:35.806686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:35.870989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a7122-4120-49cb-b818-7bc580c71068 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:35.871912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a7122-4120-49cb-b818-7bc580c71068 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:35.872810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a7122-4120-49cb-b818-7bc580c71068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:35.878592 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1547/3092] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:44:35 2022] PUT /identity/v3/projects/52b2ada3fd2842f0a04fdedaf4bd908e/users/331a222a893c4f84a08abf11333c7449/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:44:35.914950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-481a7122-4120-49cb-b818-7bc580c71068 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:35.918904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-481a7122-4120-49cb-b818-7bc580c71068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:35.933747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:36.184215 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1546/3093] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:36.382428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:36.385627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:36.766174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4fcc3-5b09-45ca-954b-9601fa239ad0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:36.794090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572acfe3-94c0-497c-86a0-786c6ab21962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:36.795740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572acfe3-94c0-497c-86a0-786c6ab21962 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:36.796360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572acfe3-94c0-497c-86a0-786c6ab21962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:36.796964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572acfe3-94c0-497c-86a0-786c6ab21962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:36.849646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572acfe3-94c0-497c-86a0-786c6ab21962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:36.861208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572acfe3-94c0-497c-86a0-786c6ab21962 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:36.922593 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1548/3094] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:46.149901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=22 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:46.608433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a7122-4120-49cb-b818-7bc580c71068 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:46.621786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a7122-4120-49cb-b818-7bc580c71068 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:46.643651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669050-388e-409c-a690-91576b78454b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:46.645707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669050-388e-409c-a690-91576b78454b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:46.646052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669050-388e-409c-a690-91576b78454b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:46.646338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669050-388e-409c-a690-91576b78454b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:46.652175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad669050-388e-409c-a690-91576b78454b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:46.692080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad669050-388e-409c-a690-91576b78454b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:46.694294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad669050-388e-409c-a690-91576b78454b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:46.750775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1547/3095] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:46.908862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=56,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:53.591054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:53.591821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:53.592467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:53.733849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] MFA Rules not processed for user `8413b54e750c4f178c419c2b4f31d38e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:53.736980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:54.064696 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1549/3096] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:44:54.082878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:54.085323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:54.086751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:54.150883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] MFA Rules not processed for user `8413b54e750c4f178c419c2b4f31d38e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:54.153707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:54.210052 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1548/3097] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:54.451378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:54.453604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:54.612996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb9e45-7c2a-4cb9-9d30-1332832ba3a0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:54.633106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:54.633847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:54.634132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:54.637612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:54.669570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:54.676635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:54.715843 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1550/3098] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:58.861540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:58.863671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:58.895239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535237f8-bb40-4075-bdc9-d8d0fc65c9e9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:58.909362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:58.913770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:58.915076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:58.920206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] PATH_INFO: `/v3/users/2deda01949ad4a5eb16842b00afe7567` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:58.926220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2deda01949ad4a5eb16842b00afe7567)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:58.945842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:59.121815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2deda01949ad4a5eb16842b00afe7567'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:59.162550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2deda01949ad4a5eb16842b00afe7567'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:59.164385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2deda01949ad4a5eb16842b00afe7567'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:59.186589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2deda01949ad4a5eb16842b00afe7567'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:59.188111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2deda01949ad4a5eb16842b00afe7567'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:44:59.218297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1549/3099] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:44:58 2022] DELETE /identity/v3/users/2deda01949ad4a5eb16842b00afe7567 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:44:59.803054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:59.805212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:59.839230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2463-f58b-453b-a296-8bdc37fca7a5 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:00.044042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:00.044806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:00.045095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:00.045374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] PATH_INFO: `/v3/users/a900db43445e48a5a09451a909a074d1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:00.053105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a900db43445e48a5a09451a909a074d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:00.068981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:00.106949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:00.188550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:00.190995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:00.221031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c4155-a832-4227-9603-1af14e9c0ae4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:00.228241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a900db43445e48a5a09451a909a074d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.232214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:00.233890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:00.234454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:00.235765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] PATH_INFO: `/v3/projects/2a999d9d8991476983a97cb975c6302a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:00.243513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a999d9d8991476983a97cb975c6302a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:00.256933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:00.286941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a900db43445e48a5a09451a909a074d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.317368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a900db43445e48a5a09451a909a074d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.326210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a900db43445e48a5a09451a909a074d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.356016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a900db43445e48a5a09451a909a074d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.376967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1551/3100] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:44:59 2022] DELETE /identity/v3/users/a900db43445e48a5a09451a909a074d1 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:00.426877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a999d9d8991476983a97cb975c6302a', 'request_id': 'req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.456043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a999d9d8991476983a97cb975c6302a', 'request_id': 'req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.473231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a999d9d8991476983a97cb975c6302a', 'request_id': 'req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.493670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] The token cache is being invalidate because project 2a999d9d8991476983a97cb975c6302a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:45:00.493972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.498301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7cff8d7-8bd9-4784-b476-5da4cdc307b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:00.503041 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1550/3101] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:00 2022] DELETE /identity/v3/projects/2a999d9d8991476983a97cb975c6302a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:00.507441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:00.509130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:00.742167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12a877-3478-4df9-9e72-3e55fcb42d08 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:00.764176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:00.766480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:00.766999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:00.767550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] PATH_INFO: `/v3/users/c31177f742594d958cceefddea7bc399` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:00.769959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31177f742594d958cceefddea7bc399)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:00.781381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:00.950687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31177f742594d958cceefddea7bc399'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:01.029849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31177f742594d958cceefddea7bc399'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:01.062725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31177f742594d958cceefddea7bc399'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:01.064140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31177f742594d958cceefddea7bc399'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:01.085373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84d26cf3-9e7c-4788-97dc-61a2bb0e6437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31177f742594d958cceefddea7bc399'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:01.101606 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1552/3102] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:45:00 2022] DELETE /identity/v3/users/c31177f742594d958cceefddea7bc399 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:01.946002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:01.947145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:01.948314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:02.054068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] MFA Rules not processed for user `331a222a893c4f84a08abf11333c7449`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:02.056227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:02.165388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:02.296705 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1551/3103] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:02.296941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:02.296941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:02.296941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:02.334376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] MFA Rules not processed for user `331a222a893c4f84a08abf11333c7449`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:02.337016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:02.351452 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1553/3104] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:02.433286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:02.435251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:02.498251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:02.500899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:02.598959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:02.648047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00e6b-0b3c-4a90-aab0-b6cb735c38f3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:02.660276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:02.661980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:02.662530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:02.663895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] PATH_INFO: `/v3/projects/d42c6a91fbc440a6a4e4f9a4cf6caaf7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:02.667469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42c6a91fbc440a6a4e4f9a4cf6caaf7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:02.673744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:02.789649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed860c-c2af-4567-ab44-e60770c07ee8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:02.812665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'request_id': 'req-62350831-6e29-485e-a4b8-0be67426517c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:02.828866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'request_id': 'req-62350831-6e29-485e-a4b8-0be67426517c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:02.846142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'request_id': 'req-62350831-6e29-485e-a4b8-0be67426517c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:02.877041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] The token cache is being invalidate because project d42c6a91fbc440a6a4e4f9a4cf6caaf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:45:02.877438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:02.879950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:02.888132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1552/3105] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:02 2022] DELETE /identity/v3/projects/d42c6a91fbc440a6a4e4f9a4cf6caaf7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:02.888501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:02.894740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:02.973532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:02.974630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:02.974922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:02.975196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:02.981531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:03.056423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:03.075574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62350831-6e29-485e-a4b8-0be67426517c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:03.100529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:03.102020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:03.102509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:03.103000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] PATH_INFO: `/v3/users/14d5c7190f4d4a53affd6da5b8ca05a5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:03.105688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d5c7190f4d4a53affd6da5b8ca05a5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:03.110228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:03.162442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:03.168181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:03.194215 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1554/3106] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:03.196095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:03.200338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:03.263541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748ba2-3cf2-40fa-9b7a-099b239cead9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:03.294156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:03.295694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:03.296201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:03.296701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] PATH_INFO: `/v3/projects/fce063950ebc4d3ab9e0fc06579144b8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:03.299174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce063950ebc4d3ab9e0fc06579144b8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:03.303155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:03.337129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d5c7190f4d4a53affd6da5b8ca05a5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.391990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d5c7190f4d4a53affd6da5b8ca05a5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.393337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d5c7190f4d4a53affd6da5b8ca05a5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.419134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d5c7190f4d4a53affd6da5b8ca05a5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.420776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-561d6713-4d0b-4bac-962b-71093dc4b0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d5c7190f4d4a53affd6da5b8ca05a5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.468020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:03.470349 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1553/3107] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:45:02 2022] DELETE /identity/v3/users/14d5c7190f4d4a53affd6da5b8ca05a5 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:03.516968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce063950ebc4d3ab9e0fc06579144b8', 'request_id': 'req-c7153dd2-93cc-492c-a942-14c63b3aff0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.548908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce063950ebc4d3ab9e0fc06579144b8', 'request_id': 'req-c7153dd2-93cc-492c-a942-14c63b3aff0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.576808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce063950ebc4d3ab9e0fc06579144b8', 'request_id': 'req-c7153dd2-93cc-492c-a942-14c63b3aff0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.634327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] The token cache is being invalidate because project fce063950ebc4d3ab9e0fc06579144b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:45:03.637752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.640211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7153dd2-93cc-492c-a942-14c63b3aff0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:03.644626 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1555/3108] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:03 2022] DELETE /identity/v3/projects/fce063950ebc4d3ab9e0fc06579144b8 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:03.658121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6780-1c77-4d40-b78e-c7f34bb74de4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:03.658801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6780-1c77-4d40-b78e-c7f34bb74de4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:03.659622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6780-1c77-4d40-b78e-c7f34bb74de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:03.714573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1f8f6780-1c77-4d40-b78e-c7f34bb74de4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:03.720265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1f8f6780-1c77-4d40-b78e-c7f34bb74de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:04.016163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f09fc-3991-45d4-8094-ff59b3b04bb4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.017259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f09fc-3991-45d4-8094-ff59b3b04bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.017434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1554/3109] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:04.017626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f09fc-3991-45d4-8094-ff59b3b04bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.083812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-058f09fc-3991-45d4-8094-ff59b3b04bb4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:04.085989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-058f09fc-3991-45d4-8094-ff59b3b04bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:04.131116 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1556/3110] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:04.132604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6780-1c77-4d40-b78e-c7f34bb74de4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.150193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6780-1c77-4d40-b78e-c7f34bb74de4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:04.164635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:04.164988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.165385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.165746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.167540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:45:04.170477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:04.172363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:04.210610 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1555/3111] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:45:04.212675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f09fc-3991-45d4-8094-ff59b3b04bb4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.243849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f09fc-3991-45d4-8094-ff59b3b04bb4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:04.304359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:04.307524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.308490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.309494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.311462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:04.315047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:04.384871 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1557/3112] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:45:04 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:45:04.386233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.435254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3bd40-a62b-4a79-9b16-e795d49ce913 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:04.612788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:04.614217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.614782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.615312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.616276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:04.619407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:04.631430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:04.667647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.676072 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1556/3113] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:45:04 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:45:04.683572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a7764-d8d5-43b1-90f4-afaac269daf7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:04.697426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:04.697716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.697825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.698090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.701601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:04.711300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:04.796805 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1558/3114] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:45:04.804293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.825098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb6cc-faa6-4f8f-8a56-f0d0ffc0ba53 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:04.834681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:04.836482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.836875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.837252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.848146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:04.851428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:04.890112 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1557/3115] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:45:04.895960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.927373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69b3e-92e8-4d48-8cef-4d4da25781b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:04.943576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a1685-9fb5-4d1e-9f5b-ea05a04814e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:04.945489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a1685-9fb5-4d1e-9f5b-ea05a04814e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.946442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a1685-9fb5-4d1e-9f5b-ea05a04814e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.946973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a1685-9fb5-4d1e-9f5b-ea05a04814e8 admin admin] PATH_INFO: `/v3/projects/60b320e0b7ce431785574f9a5adb0c68/users/af4ad52fb5b64c1cae79cc8758f9b406/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.960493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.967496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:04.999160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a1685-9fb5-4d1e-9f5b-ea05a04814e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b320e0b7ce431785574f9a5adb0c68, user_id=af4ad52fb5b64c1cae79cc8758f9b406, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:05.007092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a1685-9fb5-4d1e-9f5b-ea05a04814e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:05.036994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6676-e9ba-4e15-98b8-9db74a5ee3ba admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:05.096672 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1559/3116] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:45:04 2022] PUT /identity/v3/projects/60b320e0b7ce431785574f9a5adb0c68/users/af4ad52fb5b64c1cae79cc8758f9b406/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:05.103117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df507e-388d-4331-8887-a24b0e231223 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:05.104315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df507e-388d-4331-8887-a24b0e231223 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:05.104841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df507e-388d-4331-8887-a24b0e231223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:05.186189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-80df507e-388d-4331-8887-a24b0e231223 None None] MFA Rules not processed for user `af4ad52fb5b64c1cae79cc8758f9b406`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:05.191778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80df507e-388d-4331-8887-a24b0e231223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:05.257853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:05.258766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:05.259057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:05.259367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] PATH_INFO: `/v3/projects/ccf8dc5a673540cbb249d88dbdca0775` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:05.272313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf8dc5a673540cbb249d88dbdca0775)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:05.274679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:05.416156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf8dc5a673540cbb249d88dbdca0775', 'request_id': 'req-73085db6-1dae-49a7-a5df-a2e802a762ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:05.435711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf8dc5a673540cbb249d88dbdca0775', 'request_id': 'req-73085db6-1dae-49a7-a5df-a2e802a762ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:05.446665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf8dc5a673540cbb249d88dbdca0775', 'request_id': 'req-73085db6-1dae-49a7-a5df-a2e802a762ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:05.475974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] The token cache is being invalidate because project ccf8dc5a673540cbb249d88dbdca0775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:45:05.476696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:05.478197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73085db6-1dae-49a7-a5df-a2e802a762ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:05.483689 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1558/3117] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:04 2022] DELETE /identity/v3/projects/ccf8dc5a673540cbb249d88dbdca0775 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:45:05.492593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5d5f-b5ae-4969-aa6f-6123499198d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:05.493385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5d5f-b5ae-4969-aa6f-6123499198d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:05.493909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5d5f-b5ae-4969-aa6f-6123499198d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:05.536575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f96a5d5f-b5ae-4969-aa6f-6123499198d0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:05.540675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f96a5d5f-b5ae-4969-aa6f-6123499198d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:05.694220 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1560/3118] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 592 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:05.731724 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1559/3119] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:45:05.741568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af0523-2f40-4229-bdc5-03bc69717589 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:05.742133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af0523-2f40-4229-bdc5-03bc69717589 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:05.742628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af0523-2f40-4229-bdc5-03bc69717589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:05.859672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3af0523-2f40-4229-bdc5-03bc69717589 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:05.861878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3af0523-2f40-4229-bdc5-03bc69717589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:05.926222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5d5f-b5ae-4969-aa6f-6123499198d0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:05.926496 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1561/3120] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:05.946886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5d5f-b5ae-4969-aa6f-6123499198d0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:05.972162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:05.974157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:05.974754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:05.975416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:05.976766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:45:05.977431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:05.981041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:05.998319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:06.020395 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1560/3121] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:45:06.025797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af0523-2f40-4229-bdc5-03bc69717589 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:06.048914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af0523-2f40-4229-bdc5-03bc69717589 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:06.066332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:06.073018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:06.073583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:06.079716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:06.081072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:06.085007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:06.123692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:06.126455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:06.203054 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1562/3122] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:45:06 2022] POST /identity/v3/projects => generated 395 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:45:06.206265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:06.262248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:06.465436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c0fb7-358d-4db4-a35d-f1955d963bbc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:06.481026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8af464-7c49-4e92-bc19-d5cd41e68a99 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:06.501579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:06.505383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:06.505967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:06.508912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:06.512828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:06.522669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:06.645067 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1563/3123] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:45:06 2022] POST /identity/v3/users => generated 298 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:45:06.647172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:06.716838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743775ac-78ef-474b-bcaa-cd553bd15c73 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:06.744031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:06.745264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:06.745772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:06.746277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:06.755242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:06.763901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548648-6976-4202-b323-0f1e82b1989c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:06.765685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548648-6976-4202-b323-0f1e82b1989c service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:06.768402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548648-6976-4202-b323-0f1e82b1989c service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:06.768959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548648-6976-4202-b323-0f1e82b1989c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:06.778429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:06.803318 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1564/3124] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:45:06.808036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:06.829478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872db076-38a5-448b-b1f2-61c3b25eee0e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:06.847715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:06.849103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:06.849766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:06.850412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:06.852349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:06.857239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:06.919238 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1565/3125] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:45:06.921304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:06.950874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548648-6976-4202-b323-0f1e82b1989c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:06.958011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548648-6976-4202-b323-0f1e82b1989c service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:06.982672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad369c0-bb42-4e7a-ba0c-28e17e36a81c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:06.992589 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1561/3126] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:07.034560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a00af-7292-4d19-9345-05df6548a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:07.036879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a00af-7292-4d19-9345-05df6548a6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:07.037177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a00af-7292-4d19-9345-05df6548a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:07.037466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a00af-7292-4d19-9345-05df6548a6c5 admin admin] PATH_INFO: `/v3/projects/a22f9857a34e48f7bc5d2bd97ef02b14/users/f1d8ca06f8d2469382275fd2e36c538c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:07.109840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a00af-7292-4d19-9345-05df6548a6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22f9857a34e48f7bc5d2bd97ef02b14, user_id=f1d8ca06f8d2469382275fd2e36c538c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:07.113399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a00af-7292-4d19-9345-05df6548a6c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:07.154257 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1566/3127] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:45:06 2022] PUT /identity/v3/projects/a22f9857a34e48f7bc5d2bd97ef02b14/users/f1d8ca06f8d2469382275fd2e36c538c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:45:07.162500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:07.162924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:07.163249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:07.211294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:07.214630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:07.326150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:07.431403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1562/3128] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:07.477081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:07.477531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:07.477928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:07.506938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:07.511582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:07.571228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:07.573116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:07.772164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf282-c63c-445e-9233-7da2f266091e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:07.783328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b054d7-787b-4f69-a12d-2085e2fa53d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:07.785014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b054d7-787b-4f69-a12d-2085e2fa53d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:07.793147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b054d7-787b-4f69-a12d-2085e2fa53d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:07.793644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b054d7-787b-4f69-a12d-2085e2fa53d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:07.809526 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1567/3129] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:07.820911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b054d7-787b-4f69-a12d-2085e2fa53d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:07.824218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b054d7-787b-4f69-a12d-2085e2fa53d8 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:07.831185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:07.840292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:07.852138 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1563/3130] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:08.210913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:08.237636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845939f-2664-4a72-888c-78ff15401f99 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:08.266731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f5303-9967-4c89-b93b-91bcc2d15826 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:08.267973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5303-9967-4c89-b93b-91bcc2d15826 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:08.268483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5303-9967-4c89-b93b-91bcc2d15826 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:08.268981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5303-9967-4c89-b93b-91bcc2d15826 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:08.297121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f5303-9967-4c89-b93b-91bcc2d15826 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:08.305274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f5303-9967-4c89-b93b-91bcc2d15826 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:08.345850 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1568/3131] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:08.717306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729733d9-2b7b-4a45-9fc1-fcb2ebc48d25 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:08.718756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729733d9-2b7b-4a45-9fc1-fcb2ebc48d25 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:08.719748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729733d9-2b7b-4a45-9fc1-fcb2ebc48d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:08.761586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-729733d9-2b7b-4a45-9fc1-fcb2ebc48d25 None None] MFA Rules not processed for user `af4ad52fb5b64c1cae79cc8758f9b406`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:08.763912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-729733d9-2b7b-4a45-9fc1-fcb2ebc48d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:08.920920 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1564/3132] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:11.138163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:11.139515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:11.140078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:11.176467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:11.178542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:11.218564 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1569/3133] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:45:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:11.246352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729733d9-2b7b-4a45-9fc1-fcb2ebc48d25 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:11.286579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729733d9-2b7b-4a45-9fc1-fcb2ebc48d25 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:11.299005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3d87c-22b5-481a-ab37-498f60248e57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:11.301417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3d87c-22b5-481a-ab37-498f60248e57 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:11.302050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3d87c-22b5-481a-ab37-498f60248e57 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:11.302496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3d87c-22b5-481a-ab37-498f60248e57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:11.322669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3d87c-22b5-481a-ab37-498f60248e57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:11.324848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3d87c-22b5-481a-ab37-498f60248e57 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:11.353491 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1565/3134] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:45:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:11.614683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:11.617494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:11.661184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66659bf1-2451-4861-90aa-71e0b89d8c53 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:11.684342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:11.686906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:11.688570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:11.689950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] PATH_INFO: `/v3/users/af4ad52fb5b64c1cae79cc8758f9b406` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:11.694275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4ad52fb5b64c1cae79cc8758f9b406)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:11.700098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:11.872973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4ad52fb5b64c1cae79cc8758f9b406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:11.895378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4ad52fb5b64c1cae79cc8758f9b406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:11.924943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4ad52fb5b64c1cae79cc8758f9b406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:11.925919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4ad52fb5b64c1cae79cc8758f9b406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:11.944818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4ad52fb5b64c1cae79cc8758f9b406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:11.997950 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1570/3135] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:45:11 2022] DELETE /identity/v3/users/af4ad52fb5b64c1cae79cc8758f9b406 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:12.002552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:12.003263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:12.003586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:12.034448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:12.036085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:12.189845 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1566/3136] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:45:12.227758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:12.229645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:12.478913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c826fa-10a9-467f-81bc-9281d9688716 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:12.497971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e20ce-2d67-4317-bb5f-10aef248479e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:12.500727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e20ce-2d67-4317-bb5f-10aef248479e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:12.501037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e20ce-2d67-4317-bb5f-10aef248479e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:12.503732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e20ce-2d67-4317-bb5f-10aef248479e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:12.572125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e20ce-2d67-4317-bb5f-10aef248479e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:12.581071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e20ce-2d67-4317-bb5f-10aef248479e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:12.662538 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1571/3137] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:15.375150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:15.377557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:15.432899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db49ae-5f0e-41ef-a469-a8ffa856af60 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:15.456334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:15.457845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:15.458333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:15.458818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] PATH_INFO: `/v3/projects/60b320e0b7ce431785574f9a5adb0c68` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:15.473074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b320e0b7ce431785574f9a5adb0c68)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:15.484882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:15.493263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:15.747613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b320e0b7ce431785574f9a5adb0c68', 'request_id': 'req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:15.780587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b320e0b7ce431785574f9a5adb0c68', 'request_id': 'req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:15.811682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b320e0b7ce431785574f9a5adb0c68', 'request_id': 'req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:15.846869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] The token cache is being invalidate because project 60b320e0b7ce431785574f9a5adb0c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:45:15.847168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:15.850792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ce8cd32-d1e2-4c55-93ee-902857ff1ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:15.864496 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1567/3138] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:15 2022] DELETE /identity/v3/projects/60b320e0b7ce431785574f9a5adb0c68 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:15.867138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a288-edee-4dc5-94b2-537e6d41b837 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:15.868012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a288-edee-4dc5-94b2-537e6d41b837 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:15.868216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a288-edee-4dc5-94b2-537e6d41b837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:15.948581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-14e8a288-edee-4dc5-94b2-537e6d41b837 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:15.950678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-14e8a288-edee-4dc5-94b2-537e6d41b837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:16.199590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:16.251822 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1572/3139] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:16.264177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf49af-3fdc-4b5e-98e5-dfedc3fd4651 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:16.264549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf49af-3fdc-4b5e-98e5-dfedc3fd4651 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:16.264890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf49af-3fdc-4b5e-98e5-dfedc3fd4651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:16.316596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2ecf49af-3fdc-4b5e-98e5-dfedc3fd4651 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:16.323988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ecf49af-3fdc-4b5e-98e5-dfedc3fd4651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:16.348105 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1568/3140] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:16.354517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8a288-edee-4dc5-94b2-537e6d41b837 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:16.369655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8a288-edee-4dc5-94b2-537e6d41b837 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:16.387007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:16.389205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:16.389649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:16.389944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:16.391761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:45:16.392079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:16.397334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:16.433161 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1573/3141] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:45:16.435366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf49af-3fdc-4b5e-98e5-dfedc3fd4651 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:16.462262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf49af-3fdc-4b5e-98e5-dfedc3fd4651 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:16.503234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:16.506398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:16.507769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:16.508239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:16.510180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:16.519130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:16.608111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1569/3142] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:45:16 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:45:16.613775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:16.645608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f24c82-7f43-406c-86f3-a02de838ea9f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:17.041329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:17.042396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:17.042575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:17.048090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:17.048982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:17.065248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:17.151255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1574/3143] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:45:16 2022] POST /identity/v3/users => generated 288 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:45:17.154175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:17.176570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313260b-9870-4841-b578-bea9da80b363 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:17.225296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:17.231768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:17.234230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:17.245190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:17.245190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:17.251300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:17.323309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:17.325693 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1570/3144] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:45:17.342143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeec2a-4b1b-4ec8-9c02-0650d210c009 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:17.360225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5e89b-6723-4315-a847-d27a3bf1216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:17.362982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e89b-6723-4315-a847-d27a3bf1216f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:17.363600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e89b-6723-4315-a847-d27a3bf1216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:17.364127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e89b-6723-4315-a847-d27a3bf1216f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:17.365459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5e89b-6723-4315-a847-d27a3bf1216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:17.370324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5e89b-6723-4315-a847-d27a3bf1216f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:17.393545 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1575/3145] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:45:17.401295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:17.439980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324e56b-7e87-4ce5-9e05-c73ca0c0a120 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:17.484568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:17.486159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:17.492693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:17.493291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] PATH_INFO: `/v3/projects/31fb1cd55dab4d8da62307c0cf3b202d/users/d10ce7ab4eb844f790a7c66bbdf69c20/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:17.585499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fb1cd55dab4d8da62307c0cf3b202d, user_id=d10ce7ab4eb844f790a7c66bbdf69c20, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:17.592401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:17.655162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:17.656014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:17.660450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:17.663334 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1571/3146] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:45:17 2022] PUT /identity/v3/projects/31fb1cd55dab4d8da62307c0cf3b202d/users/d10ce7ab4eb844f790a7c66bbdf69c20/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:17.726939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:17.734350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:18.038450 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1576/3147] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:18.201784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:18.206503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:18.283573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:18.287024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:18.569031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5af695-401b-47a0-8e4a-424f08d38a02 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:18.570926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfcb0-8160-449a-a6f9-53e47fc4f03d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:18.591354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:18.591729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9290e0-9cdf-4904-92e1-eaa5e278efe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:18.592747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:18.593331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9290e0-9cdf-4904-92e1-eaa5e278efe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:18.593531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:18.594013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:18.594423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9290e0-9cdf-4904-92e1-eaa5e278efe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:18.595126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9290e0-9cdf-4904-92e1-eaa5e278efe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:18.605799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e9290e0-9cdf-4904-92e1-eaa5e278efe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:18.656321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:18.659071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:18.735039 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1577/3148] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:18.819280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:18.957894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9290e0-9cdf-4904-92e1-eaa5e278efe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:18.962833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9290e0-9cdf-4904-92e1-eaa5e278efe0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:18.998791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1572/3149] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:45:22.286786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:22.290447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:22.332021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da562f-7696-4ce8-b827-7d8c8841474d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:22.355104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd93979-e440-4de5-b970-c4c7293c7f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:22.359699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd93979-e440-4de5-b970-c4c7293c7f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:22.362073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd93979-e440-4de5-b970-c4c7293c7f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:22.363752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd93979-e440-4de5-b970-c4c7293c7f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:22.377347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1cd93979-e440-4de5-b970-c4c7293c7f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:22.436307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:22.451558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd93979-e440-4de5-b970-c4c7293c7f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:22.456012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd93979-e440-4de5-b970-c4c7293c7f7f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:22.485535 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1578/3150] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:23.312854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb443-028b-460b-a6af-02181acfc751 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:23.313470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb443-028b-460b-a6af-02181acfc751 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:23.313860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb443-028b-460b-a6af-02181acfc751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:23.388411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-451eb443-028b-460b-a6af-02181acfc751 None None] MFA Rules not processed for user `c2e85acbfcdc4b3a813830d6723b006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:23.390014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-451eb443-028b-460b-a6af-02181acfc751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:23.595699 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1573/3151] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:27.913456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:27.914314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:27.914490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:28.103944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] MFA Rules not processed for user `f1d8ca06f8d2469382275fd2e36c538c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:28.111545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:28.441002 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1579/3152] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:28.591184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897a2ed-0a35-40df-b4a8-c7c79da16037 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:28.591184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897a2ed-0a35-40df-b4a8-c7c79da16037 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:28.591184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897a2ed-0a35-40df-b4a8-c7c79da16037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:28.664267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f897a2ed-0a35-40df-b4a8-c7c79da16037 None None] MFA Rules not processed for user `f1d8ca06f8d2469382275fd2e36c538c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:28.676113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f897a2ed-0a35-40df-b4a8-c7c79da16037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:28.725505 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1574/3153] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:29.308518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:29.310884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:29.327707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897a2ed-0a35-40df-b4a8-c7c79da16037 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:29.343260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897a2ed-0a35-40df-b4a8-c7c79da16037 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:29.352983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34714e-4902-4156-ad3a-6d7630ee2cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:29.353971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34714e-4902-4156-ad3a-6d7630ee2cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:29.354492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34714e-4902-4156-ad3a-6d7630ee2cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:29.354945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34714e-4902-4156-ad3a-6d7630ee2cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:29.356468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc123f4-9141-4f16-9e97-ea384ceaa58e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:29.360045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c34714e-4902-4156-ad3a-6d7630ee2cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:29.376145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:29.378307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:29.378883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:29.380137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:29.389442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34714e-4902-4156-ad3a-6d7630ee2cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:29.393857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34714e-4902-4156-ad3a-6d7630ee2cf4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:29.406287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:29.411356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:29.417396 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1575/3154] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:29.441516 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1580/3155] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:33.758755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fc065-4cc2-4945-a581-4c30d88ffc06 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:33.761193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fc065-4cc2-4945-a581-4c30d88ffc06 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:33.761896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fc065-4cc2-4945-a581-4c30d88ffc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:33.852545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-379fc065-4cc2-4945-a581-4c30d88ffc06 None None] MFA Rules not processed for user `8413b54e750c4f178c419c2b4f31d38e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:33.853847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-379fc065-4cc2-4945-a581-4c30d88ffc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:33.989245 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1576/3156] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:39.110043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:39.114157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:39.398409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e99ef-c71d-4ae7-a98a-265cf15684d5 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:39.424253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81107a90-cdc7-477e-90df-9bed998ce26a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:39.425804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107a90-cdc7-477e-90df-9bed998ce26a service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:39.428629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107a90-cdc7-477e-90df-9bed998ce26a service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:39.434282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107a90-cdc7-477e-90df-9bed998ce26a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:39.440502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81107a90-cdc7-477e-90df-9bed998ce26a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:39.506963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81107a90-cdc7-477e-90df-9bed998ce26a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:39.511409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81107a90-cdc7-477e-90df-9bed998ce26a service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:39.535212 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1581/3157] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:43.973062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=73 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:46.604171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fc065-4cc2-4945-a581-4c30d88ffc06 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:46.644297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4028-bc89-4604-9b76-9ebb3ead3f9f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:46.646258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4028-bc89-4604-9b76-9ebb3ead3f9f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:46.647086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4028-bc89-4604-9b76-9ebb3ead3f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:46.665890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fc065-4cc2-4945-a581-4c30d88ffc06 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:46.690107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:46.693216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:46.698215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:46.700130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:46.707685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:46.764817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:46.771915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:46.855192 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1577/3158] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:46.922277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e9fd4028-bc89-4604-9b76-9ebb3ead3f9f None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:46.924072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9fd4028-bc89-4604-9b76-9ebb3ead3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:47.024281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:47.103041 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1582/3159] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:45:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:45:47.143612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:47.151003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:47.567996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f0627-c316-404a-8ff4-fb16d0874d31 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:47.579554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9e25a-11f6-49ad-a59b-b7248460c59c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:47.581024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9e25a-11f6-49ad-a59b-b7248460c59c service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:47.581528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9e25a-11f6-49ad-a59b-b7248460c59c service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:47.582025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9e25a-11f6-49ad-a59b-b7248460c59c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:47.604432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9e25a-11f6-49ad-a59b-b7248460c59c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:47.610641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9e25a-11f6-49ad-a59b-b7248460c59c service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:47.635218 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1578/3160] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:45:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:54.367049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4028-bc89-4604-9b76-9ebb3ead3f9f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:54.392593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4028-bc89-4604-9b76-9ebb3ead3f9f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:54.402875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:54.403598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:54.403884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:54.404170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:54.412417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:54.481844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:54.486086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:54.570416 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1583/3161] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:45:55.026070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:55.027713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:55.028464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:55.184825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] MFA Rules not processed for user `d10ce7ab4eb844f790a7c66bbdf69c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:55.187076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:55.493310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1579/3162] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:45:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:56.237841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:56.281192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef9e1-f50f-4962-a8a2-3ccc6e91965e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:56.301458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:56.302641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:56.303152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:56.303646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:56.316847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:56.318866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:56.334190 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1584/3163] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:01.328675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:01.334372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:01.403141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26f1ed-d3e3-45c3-aeed-169040243745 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:01.437752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006ee8c-f59f-4a79-9a3a-7b14a30af984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:01.438951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006ee8c-f59f-4a79-9a3a-7b14a30af984 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:01.439510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006ee8c-f59f-4a79-9a3a-7b14a30af984 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:01.440023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006ee8c-f59f-4a79-9a3a-7b14a30af984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:01.465809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d006ee8c-f59f-4a79-9a3a-7b14a30af984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:01.516926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006ee8c-f59f-4a79-9a3a-7b14a30af984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:01.520355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006ee8c-f59f-4a79-9a3a-7b14a30af984 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:01.569425 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1580/3164] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:05.023216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:05.038640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf9ace-5a33-4fe2-80c8-8f764cf769cc service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:05.068361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:05.069238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:05.070079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:05.072781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:05.078491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:05.301179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:05.304039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:05.330828 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1585/3165] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:46:09.952884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859e56-aa41-4bb2-9822-5f0361e140a1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:09.953494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859e56-aa41-4bb2-9822-5f0361e140a1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:09.953925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859e56-aa41-4bb2-9822-5f0361e140a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:09.993081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4b859e56-aa41-4bb2-9822-5f0361e140a1 None None] MFA Rules not processed for user `f1d8ca06f8d2469382275fd2e36c538c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:09.995742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b859e56-aa41-4bb2-9822-5f0361e140a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:10.016019 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1581/3166] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:10.869301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:10.906366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e447c-ed56-4771-8c79-f03bc3ce2af9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:10.933613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:10.934840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:10.935417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:10.935883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:10.940267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:10.969452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:10.971552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:11.000265 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1586/3167] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:12.118589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859e56-aa41-4bb2-9822-5f0361e140a1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:12.151167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859e56-aa41-4bb2-9822-5f0361e140a1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:12.172574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5da00-1ffd-4e91-831a-4870c0baebae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:12.174244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5da00-1ffd-4e91-831a-4870c0baebae service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:12.175924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5da00-1ffd-4e91-831a-4870c0baebae service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:12.176862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5da00-1ffd-4e91-831a-4870c0baebae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:12.182487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-78a5da00-1ffd-4e91-831a-4870c0baebae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:12.306681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5da00-1ffd-4e91-831a-4870c0baebae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:12.308598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5da00-1ffd-4e91-831a-4870c0baebae service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:12.331739 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1582/3168] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:14.320118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:14.338222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5343bb3-7ee7-45df-aa77-6bd4973b7dc2 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:14.351169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:14.352264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:14.352735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:14.353392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:14.359259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:14.405513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:14.409443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:14.447639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1587/3169] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:17.371326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:17.372833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:17.373348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:17.394606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:17.423924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:17.426141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:17.467613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:17.480138 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1583/3170] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:17.482240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=65 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:17.501132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0b1bb-ffa8-4f7c-bac6-5fd822fe0b04 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:17.514390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:17.516773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:17.517728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:17.518992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:17.545896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:17.550265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:17.571106 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1588/3171] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:18.421209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:18.424591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:18.476505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07d8e-e8b9-4006-b630-bfda414a71c1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:18.498414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:18.500057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:18.500554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:18.501052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] PATH_INFO: `/v3/users/aeb3928894284b77b4aea925a38470ba` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:18.575814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb3928894284b77b4aea925a38470ba)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:18.582800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:18.845026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb3928894284b77b4aea925a38470ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:18.904669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb3928894284b77b4aea925a38470ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:18.906244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb3928894284b77b4aea925a38470ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:18.922791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb3928894284b77b4aea925a38470ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:18.924109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c1a3890-4d29-43c2-9be5-522cd4e5461e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb3928894284b77b4aea925a38470ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:18.968107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1584/3172] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:46:18 2022] DELETE /identity/v3/users/aeb3928894284b77b4aea925a38470ba => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:20.044788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:20.065450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:20.067163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:20.067671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:20.095678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef63ac3-8605-4374-bf42-8081fc73733a service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:20.143451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] MFA Rules not processed for user `331a222a893c4f84a08abf11333c7449`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:20.151573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:20.329387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:20.330973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:20.331652 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1585/3173] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:20.332466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:20.332765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] PATH_INFO: `/v3/projects/6e033f599b294c1f9a66eb4703aba0e6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:20.356377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e033f599b294c1f9a66eb4703aba0e6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:20.358251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:20.470442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e033f599b294c1f9a66eb4703aba0e6', 'request_id': 'req-212620f3-b84e-44b7-84b0-07d44280bea3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.486820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e033f599b294c1f9a66eb4703aba0e6', 'request_id': 'req-212620f3-b84e-44b7-84b0-07d44280bea3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.508906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e033f599b294c1f9a66eb4703aba0e6', 'request_id': 'req-212620f3-b84e-44b7-84b0-07d44280bea3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.540015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] The token cache is being invalidate because project 6e033f599b294c1f9a66eb4703aba0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:46:20.540338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.541230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.547941 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1589/3174] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:20 2022] DELETE /identity/v3/projects/6e033f599b294c1f9a66eb4703aba0e6 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:20.549384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:20.551040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:20.572091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a59d-2841-4a50-8d58-967741a4759f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:20.668167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:20.669741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:20.670262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:20.670748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] PATH_INFO: `/v3/users/21fcf956ceb74a1db7802d7b3fac5322` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:20.675052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:20.702263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21fcf956ceb74a1db7802d7b3fac5322)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:20.706708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:20.851714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21fcf956ceb74a1db7802d7b3fac5322'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.873459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21fcf956ceb74a1db7802d7b3fac5322'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.875666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21fcf956ceb74a1db7802d7b3fac5322'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.887034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21fcf956ceb74a1db7802d7b3fac5322'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.888304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9226ee9-a875-4761-ad38-4067438c7330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21fcf956ceb74a1db7802d7b3fac5322'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:20.919379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1586/3175] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:46:20 2022] DELETE /identity/v3/users/21fcf956ceb74a1db7802d7b3fac5322 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:21.396957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:21.401486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:21.416211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212620f3-b84e-44b7-84b0-07d44280bea3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:21.502840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:21.505457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:21.505992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:21.506665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] PATH_INFO: `/v3/projects/d77ab24584e7456483cd2853f9759081` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:21.521385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77ab24584e7456483cd2853f9759081)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:21.523322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:21.528444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:21.597785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77ab24584e7456483cd2853f9759081', 'request_id': 'req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:21.605666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77ab24584e7456483cd2853f9759081', 'request_id': 'req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:21.615259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77ab24584e7456483cd2853f9759081', 'request_id': 'req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:21.635402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] The token cache is being invalidate because project d77ab24584e7456483cd2853f9759081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:46:21.635907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:21.636762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-312c6256-3dc1-4da9-a77c-fcfdfa2b8e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:21.638935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1590/3176] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:21 2022] DELETE /identity/v3/projects/d77ab24584e7456483cd2853f9759081 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:21.647697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff28b-870b-499a-935e-4ffb9df77c30 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:21.651110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff28b-870b-499a-935e-4ffb9df77c30 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:21.652022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff28b-870b-499a-935e-4ffb9df77c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:21.689193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b8bff28b-870b-499a-935e-4ffb9df77c30 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:21.692188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8bff28b-870b-499a-935e-4ffb9df77c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:21.969619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43478a-7b85-4628-877d-193656bb3928 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:21.970480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43478a-7b85-4628-877d-193656bb3928 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:21.970931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43478a-7b85-4628-877d-193656bb3928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:21.974632 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1587/3177] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:22.003131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e43478a-7b85-4628-877d-193656bb3928 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:22.003531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e43478a-7b85-4628-877d-193656bb3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:22.021695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bff28b-870b-499a-935e-4ffb9df77c30 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:22.028221 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1591/3178] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:46:22.033173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bff28b-870b-499a-935e-4ffb9df77c30 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:22.038792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:22.040377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:22.041138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:22.041524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:22.042981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:46:22.043429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:22.045356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:22.079423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43478a-7b85-4628-877d-193656bb3928 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:22.100347 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1588/3179] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:46:22.104616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43478a-7b85-4628-877d-193656bb3928 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:22.123047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:22.123047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:22.123047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:22.123047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:22.123923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:22.126292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:22.207506 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1592/3180] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:46:22 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:46:22.212963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:22.241275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad50b9-0294-47e2-bf49-9bd4acce9455 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:22.452131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:22.473838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:22.476391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:22.482821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:22.483501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:22.484942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:22.492911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:22.554405 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1589/3181] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:46:22 2022] POST /identity/v3/users => generated 294 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:22.561801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:22.590279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593d36-33ed-487c-ad3f-eb3aaaeeb78f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:22.598734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:22.599623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:22.599989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:22.600346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:22.602757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:22.606374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:22.622514 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1593/3182] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:22.629592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:22.662149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c18f4-8cfa-442c-a783-e07860f99de8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:22.685551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cafe1-218c-4714-9a53-cfd9fc80165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:22.686680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cafe1-218c-4714-9a53-cfd9fc80165c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:22.687178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cafe1-218c-4714-9a53-cfd9fc80165c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:22.687725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cafe1-218c-4714-9a53-cfd9fc80165c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:22.689390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cafe1-218c-4714-9a53-cfd9fc80165c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:22.697295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cafe1-218c-4714-9a53-cfd9fc80165c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:22.741232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:22.741521 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1590/3183] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:22.767510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72704099-2ba4-409d-b718-28bba7338be8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:22.777032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:22.778609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:22.779121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:22.779698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] PATH_INFO: `/v3/projects/1c56ef362cf84d91bb841ab512e3665e/users/df11930b59684df585c3b90e0300aeb3/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:22.813438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c56ef362cf84d91bb841ab512e3665e, user_id=df11930b59684df585c3b90e0300aeb3, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:22.819815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:22.870940 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1594/3184] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:22 2022] PUT /identity/v3/projects/1c56ef362cf84d91bb841ab512e3665e/users/df11930b59684df585c3b90e0300aeb3/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:46:22.875584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2654e-58b8-4741-b275-a1df4e979b61 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:22.876520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2654e-58b8-4741-b275-a1df4e979b61 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:22.877664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2654e-58b8-4741-b275-a1df4e979b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:22.927906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-88b2654e-58b8-4741-b275-a1df4e979b61 None None] MFA Rules not processed for user `df11930b59684df585c3b90e0300aeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:22.929400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-88b2654e-58b8-4741-b275-a1df4e979b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:23.104102 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1591/3185] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:23.106268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:23.311574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6f6fd-d41d-4324-b8e8-ec13f15337aa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:23.331040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:23.332961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:23.334311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:23.337039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:23.340871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:23.345617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:23.433460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2654e-58b8-4741-b275-a1df4e979b61 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:23.434563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1595/3186] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:46:23 2022] POST /identity/v3/projects => generated 387 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:23.468789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2654e-58b8-4741-b275-a1df4e979b61 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:23.545659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:23.546972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:23.547620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:23.548389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:23.549434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:23.552117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:23.580918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1592/3187] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:46:23 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:23.587491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:23.621303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d104e-cbe2-411a-b5b3-fbbc737f504e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:23.630109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:23.631448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:23.631890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:23.632392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:23.636692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:23.651996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:23.682906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:23.691069 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1596/3188] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:23.700744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8851938-3622-44dc-b530-70085125ed95 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:23.709540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:23.711971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:23.712785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:23.713286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] PATH_INFO: `/v3/projects/b31d622e4c4441f1a96a35d8f0fe1591/users/5bf9508bcf2745e689b69f42d54ea483/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:23.746457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d622e4c4441f1a96a35d8f0fe1591, user_id=5bf9508bcf2745e689b69f42d54ea483, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:23.750327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:23.770125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1593/3189] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:23 2022] PUT /identity/v3/projects/b31d622e4c4441f1a96a35d8f0fe1591/users/5bf9508bcf2745e689b69f42d54ea483/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:23.776690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:23.792468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:23.805827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd2f00-5440-4c38-b78c-15f5b29b67ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:23.985091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54c87-5549-467c-a975-a1dbbe6bbc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:23.987828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54c87-5549-467c-a975-a1dbbe6bbc29 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:23.988420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54c87-5549-467c-a975-a1dbbe6bbc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:23.988912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54c87-5549-467c-a975-a1dbbe6bbc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:23.990216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54c87-5549-467c-a975-a1dbbe6bbc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:23.992768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54c87-5549-467c-a975-a1dbbe6bbc29 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:24.012180 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1597/3190] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:24.014666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:24.053616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd392e8-3dfa-48bc-92b2-4e1864c1146b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:24.087414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331a593-e71d-4913-8094-993c102020f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:24.089949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a593-e71d-4913-8094-993c102020f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:24.091028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a593-e71d-4913-8094-993c102020f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:24.091943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a593-e71d-4913-8094-993c102020f8 admin admin] PATH_INFO: `/v3/projects/b31d622e4c4441f1a96a35d8f0fe1591/users/5bf9508bcf2745e689b69f42d54ea483/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:24.106814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331a593-e71d-4913-8094-993c102020f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d622e4c4441f1a96a35d8f0fe1591, user_id=5bf9508bcf2745e689b69f42d54ea483, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:24.122899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331a593-e71d-4913-8094-993c102020f8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:24.170414 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1594/3191] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:24 2022] PUT /identity/v3/projects/b31d622e4c4441f1a96a35d8f0fe1591/users/5bf9508bcf2745e689b69f42d54ea483/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:46:24.180368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:24.180710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:24.181175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:24.255617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] MFA Rules not processed for user `5bf9508bcf2745e689b69f42d54ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:24.257037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:24.415856 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1598/3192] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:24.422158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:24.422690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:24.423221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:24.474192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] MFA Rules not processed for user `df11930b59684df585c3b90e0300aeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:24.476961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:24.516803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:24.616155 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1595/3193] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:25.561289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:25.563891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:26.001339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb792-cb79-4f30-ae46-51a74cc680d0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:26.050545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:26.051779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:26.052292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:26.052793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:26.107598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:26.124130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:26.181508 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1599/3194] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:34.601920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=17 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:36.146630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:38.407358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:38.413457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:38.607681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b439d3f-0f8e-42a2-8469-53f17cebe2c6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:38.648483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:38.649636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:38.654766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:38.662594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] PATH_INFO: `/v3/users/d10ce7ab4eb844f790a7c66bbdf69c20` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:38.665282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10ce7ab4eb844f790a7c66bbdf69c20)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:38.673989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:38.849726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10ce7ab4eb844f790a7c66bbdf69c20'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:38.888479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10ce7ab4eb844f790a7c66bbdf69c20'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:38.888990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10ce7ab4eb844f790a7c66bbdf69c20'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:38.907394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10ce7ab4eb844f790a7c66bbdf69c20'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:38.908551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7a09d892-e8f0-4238-8b22-2d9ce2e1cf48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10ce7ab4eb844f790a7c66bbdf69c20'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:38.938610 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1596/3195] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:46:38 2022] DELETE /identity/v3/users/d10ce7ab4eb844f790a7c66bbdf69c20 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:40.206725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:40.224839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66b123-73f2-467c-98da-6815bb6fbec9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:40.455042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:40.456643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:40.458523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:40.459317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] PATH_INFO: `/v3/projects/31fb1cd55dab4d8da62307c0cf3b202d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:40.463024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fb1cd55dab4d8da62307c0cf3b202d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:40.470494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:40.592142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fb1cd55dab4d8da62307c0cf3b202d', 'request_id': 'req-06864551-21ab-41fd-a94e-aee0f1dd1765'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:40.602318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fb1cd55dab4d8da62307c0cf3b202d', 'request_id': 'req-06864551-21ab-41fd-a94e-aee0f1dd1765'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:40.623624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fb1cd55dab4d8da62307c0cf3b202d', 'request_id': 'req-06864551-21ab-41fd-a94e-aee0f1dd1765'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:40.642186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] The token cache is being invalidate because project 31fb1cd55dab4d8da62307c0cf3b202d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:46:40.642503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:40.643522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06864551-21ab-41fd-a94e-aee0f1dd1765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:40.645528 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1600/3196] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:40 2022] DELETE /identity/v3/projects/31fb1cd55dab4d8da62307c0cf3b202d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:40.653277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52888-bb55-4505-93ef-676caa358d36 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:40.655902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52888-bb55-4505-93ef-676caa358d36 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:40.656287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52888-bb55-4505-93ef-676caa358d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:40.687445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-63c52888-bb55-4505-93ef-676caa358d36 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:40.688739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63c52888-bb55-4505-93ef-676caa358d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:40.873446 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1597/3197] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:40.875826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452458-fb1c-4b84-b08c-848dddfafbab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:40.876320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452458-fb1c-4b84-b08c-848dddfafbab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:40.876745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452458-fb1c-4b84-b08c-848dddfafbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:40.902198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-32452458-fb1c-4b84-b08c-848dddfafbab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:40.903860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32452458-fb1c-4b84-b08c-848dddfafbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:40.922163 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1601/3198] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:40.924030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52888-bb55-4505-93ef-676caa358d36 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:40.938284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52888-bb55-4505-93ef-676caa358d36 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:40.948665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:40.949589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:40.950024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:40.950448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:40.951393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:46:40.951834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:40.954229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:40.998617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1598/3199] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:46:41.000569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32452458-fb1c-4b84-b08c-848dddfafbab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:41.033495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32452458-fb1c-4b84-b08c-848dddfafbab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:41.046580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:41.048902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:41.049768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:41.050362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:41.052822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:41.058416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:41.127866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:41.128824 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1602/3200] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:46:40 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:41.167788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640c60e-ebaa-4509-81b4-8135436025ca admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:41.178020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:41.296279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:41.297270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:41.297731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:41.298158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:41.299028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:41.301807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:41.337620 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1599/3201] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:46:41 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:41.343856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:41.365483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841cb1-0af9-4d13-95a0-ee30c9c678c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:41.381148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:41.383261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:41.383472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:41.383988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:41.385572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:41.390364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:41.429424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:41.429917 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1603/3202] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:41.454983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df839b-c119-4450-ad9f-a2f8cb5ff30f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:41.461536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a6988-df23-4bed-bbfe-5fba505e115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:41.462429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6988-df23-4bed-bbfe-5fba505e115c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:41.462862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6988-df23-4bed-bbfe-5fba505e115c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:41.463302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6988-df23-4bed-bbfe-5fba505e115c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:41.464531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a6988-df23-4bed-bbfe-5fba505e115c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:41.466384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a6988-df23-4bed-bbfe-5fba505e115c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:41.480049 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1600/3203] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:46:41.488796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:41.514580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3707dc-0b8a-4413-b448-c496b3cf4dbb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:41.526711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1a160-f295-4219-a8bf-de4400ebb721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:41.528725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a160-f295-4219-a8bf-de4400ebb721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:41.529359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a160-f295-4219-a8bf-de4400ebb721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:41.530360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a160-f295-4219-a8bf-de4400ebb721 admin admin] PATH_INFO: `/v3/projects/78242c6301c94132a739c3390dfcbe99/users/7be704e59540422f94bae37a4d36dbdb/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:41.571603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1a160-f295-4219-a8bf-de4400ebb721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78242c6301c94132a739c3390dfcbe99, user_id=7be704e59540422f94bae37a4d36dbdb, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:41.578881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1a160-f295-4219-a8bf-de4400ebb721 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:41.635949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1604/3204] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:41 2022] PUT /identity/v3/projects/78242c6301c94132a739c3390dfcbe99/users/7be704e59540422f94bae37a4d36dbdb/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:41.641784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:41.642527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:41.642987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:41.686459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] MFA Rules not processed for user `7be704e59540422f94bae37a4d36dbdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:41.687114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e007bb-a88c-4699-aac0-b11db8d16cf2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:41.687457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e007bb-a88c-4699-aac0-b11db8d16cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:41.688118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e007bb-a88c-4699-aac0-b11db8d16cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:41.689251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:41.777615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c6e007bb-a88c-4699-aac0-b11db8d16cf2 None None] MFA Rules not processed for user `c2e85acbfcdc4b3a813830d6723b006f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:41.780230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c6e007bb-a88c-4699-aac0-b11db8d16cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:41.840434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:41.874096 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1601/3205] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:41.888562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:41.890034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:41.933124 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1605/3206] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:42.098901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913fb93-39d4-4a28-84ad-1c22fff3049e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:42.110223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:42.111234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:42.111931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:42.112408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:42.157706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:42.159727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:42.169050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:42.206815 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1602/3207] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:46:42.367567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:42.371147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:42.371784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:42.437839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:42.439168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:42.534175 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1606/3208] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:46:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:42.547801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:42.550094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:42.800956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd28a79-6380-49e1-acdf-4fc214378eb5 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:42.814670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:42.815782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:42.816276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:42.816875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:42.842088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:42.844358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:42.866566 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1603/3209] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:46:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:46:49.455616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:49.458229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:49.647256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22abf-a53e-4e75-abb0-f12dc8916c76 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:49.661653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:49.662205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:49.662543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:49.662832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] PATH_INFO: `/v3/users/8413b54e750c4f178c419c2b4f31d38e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:49.673200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=8413b54e750c4f178c419c2b4f31d38e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:49.676006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:49.781983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8413b54e750c4f178c419c2b4f31d38e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:49.839082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8413b54e750c4f178c419c2b4f31d38e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:49.853068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8413b54e750c4f178c419c2b4f31d38e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:49.854036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8413b54e750c4f178c419c2b4f31d38e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:49.867552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:49.870878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-15e5cd7f-e8eb-47c9-b2fc-90902a752fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8413b54e750c4f178c419c2b4f31d38e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:49.889911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1607/3210] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:46:49 2022] DELETE /identity/v3/users/8413b54e750c4f178c419c2b4f31d38e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:50.298423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:50.330606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13ad45-c325-462a-8317-98ec8416bad7 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:50.524285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:50.525653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:50.526161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:50.528493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] PATH_INFO: `/v3/projects/9aea3a0d9920482abbbcb6c186504ed2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:50.536353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aea3a0d9920482abbbcb6c186504ed2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:50.556101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:50.702990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aea3a0d9920482abbbcb6c186504ed2', 'request_id': 'req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:50.716330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aea3a0d9920482abbbcb6c186504ed2', 'request_id': 'req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:50.732166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aea3a0d9920482abbbcb6c186504ed2', 'request_id': 'req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:50.765299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] The token cache is being invalidate because project 9aea3a0d9920482abbbcb6c186504ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:46:50.765811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:50.771302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74f5cc01-92f9-452f-b820-4ce5ac8c85ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:50.775457 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1604/3211] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:50 2022] DELETE /identity/v3/projects/9aea3a0d9920482abbbcb6c186504ed2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:50.780397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86395f-08b6-4d9b-a807-be69b0873942 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:50.781348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86395f-08b6-4d9b-a807-be69b0873942 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:50.781775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86395f-08b6-4d9b-a807-be69b0873942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:50.806220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6e86395f-08b6-4d9b-a807-be69b0873942 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:50.808645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e86395f-08b6-4d9b-a807-be69b0873942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:50.953245 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1608/3212] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:50.962244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca4cf-d62e-4bfe-a2dd-acf7c348b420 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:50.962769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca4cf-d62e-4bfe-a2dd-acf7c348b420 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:50.963227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca4cf-d62e-4bfe-a2dd-acf7c348b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.001147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-eb4ca4cf-d62e-4bfe-a2dd-acf7c348b420 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:51.003032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb4ca4cf-d62e-4bfe-a2dd-acf7c348b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:51.032674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1605/3213] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:46:51.033734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86395f-08b6-4d9b-a807-be69b0873942 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:51.046558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86395f-08b6-4d9b-a807-be69b0873942 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:51.070179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:51.070905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:51.071189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:51.071498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.072317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:46:51.072922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:51.074878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:51.097528 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1609/3214] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:46:51.099098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca4cf-d62e-4bfe-a2dd-acf7c348b420 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:51.124064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca4cf-d62e-4bfe-a2dd-acf7c348b420 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:51.157403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:51.158786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:51.160070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:51.160720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.165725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:51.173689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:51.212061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:51.325302 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1606/3215] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:46:51 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:46:51.331475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:51.346983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971fe4-8742-4d8b-87d6-83bef55db533 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:51.484268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:51.484970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:51.485258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:51.485541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.486253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:51.488485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:51.525807 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1610/3216] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:46:51 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:51.531912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:51.558682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00840a6f-335f-43c4-b4ec-5779cd91a692 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:51.577959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:51.579074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:51.579808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:51.580263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.584219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:51.586628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:51.604968 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1607/3217] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:51.610445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:51.635797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7987f27-8a91-4dd9-91a0-2560bc7645f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:51.646362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bb631-d682-4d56-8203-f4f401c2e55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:51.648044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb631-d682-4d56-8203-f4f401c2e55d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:51.648955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb631-d682-4d56-8203-f4f401c2e55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:51.649558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb631-d682-4d56-8203-f4f401c2e55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.651004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bb631-d682-4d56-8203-f4f401c2e55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:51.654909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bb631-d682-4d56-8203-f4f401c2e55d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:51.696361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:51.703558 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1611/3218] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:46:51.713184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37fce9-cbeb-4711-9981-c3d06c47d272 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:51.719495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f80a9-3263-4071-80a1-1c64371eb4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:51.720522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f80a9-3263-4071-80a1-1c64371eb4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:51.720805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f80a9-3263-4071-80a1-1c64371eb4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:51.721092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f80a9-3263-4071-80a1-1c64371eb4e5 admin admin] PATH_INFO: `/v3/projects/8367f06d1b2b4cd4a95a8bcbd5036287/users/6d8f172412334ae48bc109a50ee084fd/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.744541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f80a9-3263-4071-80a1-1c64371eb4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8367f06d1b2b4cd4a95a8bcbd5036287, user_id=6d8f172412334ae48bc109a50ee084fd, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:51.747534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f80a9-3263-4071-80a1-1c64371eb4e5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:51.768579 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1608/3219] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:51 2022] PUT /identity/v3/projects/8367f06d1b2b4cd4a95a8bcbd5036287/users/6d8f172412334ae48bc109a50ee084fd/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:51.791003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:51.791770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:51.791991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:51.852629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] MFA Rules not processed for user `6d8f172412334ae48bc109a50ee084fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:51.854903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:51.966637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:51.994116 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1612/3220] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:52.013180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:52.014074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:52.014726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:52.038846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] MFA Rules not processed for user `6d8f172412334ae48bc109a50ee084fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:52.040410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:52.069910 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1609/3221] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:52.823460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:52.826511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:52.953223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d506376-6507-42e8-bf1d-6af074e60daa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:52.964159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:52.965094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:52.965388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:52.965679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] PATH_INFO: `/v3/users/038556a90129478eb04699f574ea7e1b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:52.984725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038556a90129478eb04699f574ea7e1b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:52.986980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:53.092324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038556a90129478eb04699f574ea7e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:53.141455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038556a90129478eb04699f574ea7e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:53.156129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:53.157836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:53.185756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038556a90129478eb04699f574ea7e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:53.191685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038556a90129478eb04699f574ea7e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:53.218202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038556a90129478eb04699f574ea7e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:53.235333 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1613/3222] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:46:52 2022] DELETE /identity/v3/users/038556a90129478eb04699f574ea7e1b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:53.349664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b340d-9fe9-4cc7-ae99-075c2a9bb92d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:53.441885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:53.442584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:53.442869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:53.443172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:53.446265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:53.566684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:53.614221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:53.621052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:53.686780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:53.688470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:53.688979 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1610/3223] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:53.848254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7f638-1f06-41c0-8bb3-4fc052daca40 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:53.874405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:53.875630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:53.876020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:53.876397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] PATH_INFO: `/v3/projects/c46a694ba42e4d1ba55d161224195378` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:53.882177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:53.896293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46a694ba42e4d1ba55d161224195378)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:53.900229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:53.994767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46a694ba42e4d1ba55d161224195378', 'request_id': 'req-d55af282-90d3-4e20-b62c-db584420c02a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.014859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:54.015793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:54.020447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46a694ba42e4d1ba55d161224195378', 'request_id': 'req-d55af282-90d3-4e20-b62c-db584420c02a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.031872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46a694ba42e4d1ba55d161224195378', 'request_id': 'req-d55af282-90d3-4e20-b62c-db584420c02a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.047534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c9ee8-2439-43a9-b4e8-0867a0d6965b service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:54.071729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] The token cache is being invalidate because project c46a694ba42e4d1ba55d161224195378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:46:54.072054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.074284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.079788 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1614/3224] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:53 2022] DELETE /identity/v3/projects/c46a694ba42e4d1ba55d161224195378 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:46:54.085912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:54.090066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:54.169623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724750-2107-4661-8fde-82414405b736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:54.171188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724750-2107-4661-8fde-82414405b736 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:54.171573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724750-2107-4661-8fde-82414405b736 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:54.171856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724750-2107-4661-8fde-82414405b736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:54.178166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a5724750-2107-4661-8fde-82414405b736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:54.291644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af282-90d3-4e20-b62c-db584420c02a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:54.302750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:54.303852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:54.304109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:54.304595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] PATH_INFO: `/v3/users/e50d4c0db2134001bddd5695d79cc66e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:54.308717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50d4c0db2134001bddd5695d79cc66e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:54.311893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:54.333163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5724750-2107-4661-8fde-82414405b736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:54.335651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5724750-2107-4661-8fde-82414405b736 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:54.378241 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1611/3225] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:46:54.422723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50d4c0db2134001bddd5695d79cc66e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.456658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50d4c0db2134001bddd5695d79cc66e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.475029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50d4c0db2134001bddd5695d79cc66e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.476177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50d4c0db2134001bddd5695d79cc66e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.487947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f357d96d-aff1-458e-bcae-c6c76c991e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50d4c0db2134001bddd5695d79cc66e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:54.492400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:54.524774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1615/3226] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:46:54 2022] DELETE /identity/v3/users/e50d4c0db2134001bddd5695d79cc66e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:55.136549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724750-2107-4661-8fde-82414405b736 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:55.156920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724750-2107-4661-8fde-82414405b736 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:55.346966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:55.349952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:55.350260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:55.350579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] PATH_INFO: `/v3/projects/2b48d3eab3d74e5991ae923626a4766d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:55.367242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b48d3eab3d74e5991ae923626a4766d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:55.369853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:55.383337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:55.490268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b48d3eab3d74e5991ae923626a4766d', 'request_id': 'req-00ce8a71-98be-4e30-8220-5810d51d9334'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:55.513740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b48d3eab3d74e5991ae923626a4766d', 'request_id': 'req-00ce8a71-98be-4e30-8220-5810d51d9334'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:55.545808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b48d3eab3d74e5991ae923626a4766d', 'request_id': 'req-00ce8a71-98be-4e30-8220-5810d51d9334'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:55.569263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] The token cache is being invalidate because project 2b48d3eab3d74e5991ae923626a4766d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:46:55.571795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:55.574471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00ce8a71-98be-4e30-8220-5810d51d9334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:46:55.579791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1612/3227] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:55 2022] DELETE /identity/v3/projects/2b48d3eab3d74e5991ae923626a4766d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:55.585179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a97e7-b955-481b-8b6c-294f2e734a7c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:55.586387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a97e7-b955-481b-8b6c-294f2e734a7c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:55.587028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a97e7-b955-481b-8b6c-294f2e734a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:55.613371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e51a97e7-b955-481b-8b6c-294f2e734a7c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:55.615125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e51a97e7-b955-481b-8b6c-294f2e734a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:55.722212 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1616/3228] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:46:55.728759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c2cd-65b0-477e-9526-dd843d20f255 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:55.729188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c2cd-65b0-477e-9526-dd843d20f255 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:55.729578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c2cd-65b0-477e-9526-dd843d20f255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:55.774059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9734c2cd-65b0-477e-9526-dd843d20f255 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:55.775500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9734c2cd-65b0-477e-9526-dd843d20f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:55.806152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a97e7-b955-481b-8b6c-294f2e734a7c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:55.806940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1613/3229] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:55.821207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a97e7-b955-481b-8b6c-294f2e734a7c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:55.838163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:55.839214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:55.839640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:55.840125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:55.841396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:46:55.846315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:55.848233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:55.879789 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1617/3230] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:46:55.885032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c2cd-65b0-477e-9526-dd843d20f255 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:55.903184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c2cd-65b0-477e-9526-dd843d20f255 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:55.914897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:55.915821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:55.916451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:55.916881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:55.918015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:55.922881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:56.005094 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1614/3231] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:46:55 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:56.010312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:56.024849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbda93-1d79-4447-ad25-7005166a6cab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:56.203438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:56.204413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:56.204710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:56.204995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:56.205720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:56.214589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:56.286000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:56.298368 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1618/3232] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:46:56 2022] POST /identity/v3/users => generated 281 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:56.301476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d81d7-a7d3-4824-8b48-4e96e89ade08 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:56.307838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:56.308548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:56.309519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:56.309819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:56.310619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:56.312527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:56.331469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:56.332718 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1615/3233] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:46:56.346437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87164a-00c4-460d-907a-d29eff04a2e9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:56.370343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9641d-5ee7-49f5-899c-8ace6242970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:56.371100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9641d-5ee7-49f5-899c-8ace6242970d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:56.371442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9641d-5ee7-49f5-899c-8ace6242970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:56.371884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9641d-5ee7-49f5-899c-8ace6242970d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:56.372729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9641d-5ee7-49f5-899c-8ace6242970d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:56.374461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9641d-5ee7-49f5-899c-8ace6242970d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:56.405654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1619/3234] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:56.409421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:56.437932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ebf54-4f20-4f55-b4fd-b48de5266586 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:56.466928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f67931-56f6-4c78-b57c-a4b8c20e9575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:56.468902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f67931-56f6-4c78-b57c-a4b8c20e9575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:56.469549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f67931-56f6-4c78-b57c-a4b8c20e9575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:56.470360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f67931-56f6-4c78-b57c-a4b8c20e9575 admin admin] PATH_INFO: `/v3/projects/b7da111040094e239ef48448a81a7eb9/users/327faf643a2c4e42a27e8f91f5dc77b5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:56.474820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd9c2-56d6-4168-a462-0971bcdf078b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:56.475309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd9c2-56d6-4168-a462-0971bcdf078b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:56.475581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd9c2-56d6-4168-a462-0971bcdf078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:56.507968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f67931-56f6-4c78-b57c-a4b8c20e9575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7da111040094e239ef48448a81a7eb9, user_id=327faf643a2c4e42a27e8f91f5dc77b5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:56.513103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f67931-56f6-4c78-b57c-a4b8c20e9575 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:56.513527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-282bd9c2-56d6-4168-a462-0971bcdf078b None None] MFA Rules not processed for user `6d8f172412334ae48bc109a50ee084fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:56.514771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-282bd9c2-56d6-4168-a462-0971bcdf078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:56.560187 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1616/3235] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:56 2022] PUT /identity/v3/projects/b7da111040094e239ef48448a81a7eb9/users/327faf643a2c4e42a27e8f91f5dc77b5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:46:56.677478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d05d-cd28-4f85-a2cb-1650463e216e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:56.677955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d05d-cd28-4f85-a2cb-1650463e216e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:56.678463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d05d-cd28-4f85-a2cb-1650463e216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:56.692164 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1620/3236] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:56.734296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b0f0d05d-cd28-4f85-a2cb-1650463e216e None None] MFA Rules not processed for user `327faf643a2c4e42a27e8f91f5dc77b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:56.736812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b0f0d05d-cd28-4f85-a2cb-1650463e216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:56.913742 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1617/3237] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:46:56.920778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bd9c2-56d6-4168-a462-0971bcdf078b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:56.963412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bd9c2-56d6-4168-a462-0971bcdf078b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:56.998186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:57.255667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faae2e4-c6fa-43d4-a761-9250e412df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:57.264279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae2e4-c6fa-43d4-a761-9250e412df12 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:57.265385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae2e4-c6fa-43d4-a761-9250e412df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:57.265904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae2e4-c6fa-43d4-a761-9250e412df12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:57.268888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faae2e4-c6fa-43d4-a761-9250e412df12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:57.278166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faae2e4-c6fa-43d4-a761-9250e412df12 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:57.408602 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1621/3238] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:46:56 2022] POST /identity/v3/projects => generated 359 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:57.414393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0d05d-cd28-4f85-a2cb-1650463e216e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:57.432260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0d05d-cd28-4f85-a2cb-1650463e216e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:57.484672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:57.637095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536b0db-8637-40f0-b798-9a280710c1e2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:57.637508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536b0db-8637-40f0-b798-9a280710c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:57.637646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536b0db-8637-40f0-b798-9a280710c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:57.639907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:57.640629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:57.641027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:57.641319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:57.642088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:57.644180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:57.676427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8536b0db-8637-40f0-b798-9a280710c1e2 None None] MFA Rules not processed for user `df11930b59684df585c3b90e0300aeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:57.682487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1618/3239] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:46:57 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:46:57.682711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8536b0db-8637-40f0-b798-9a280710c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:57.683421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:57.702222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b8906-46f8-42a3-a7e6-ca4eea27472e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:57.716865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:57.717562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:57.717844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:57.718310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:57.719067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:57.722484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:57.750340 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1619/3240] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:57.756618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:57.778244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68051d-2e43-4f31-a044-41e6a7ef8a24 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:57.795885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:57.796816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:57.797104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:57.797383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] PATH_INFO: `/v3/projects/58fefcc76b5d4caf866b356be8992445/users/0b7a339d24d2458caa23c704dd96c46c/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:57.834088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fefcc76b5d4caf866b356be8992445, user_id=0b7a339d24d2458caa23c704dd96c46c, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:57.837457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:57.857943 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1620/3241] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:57 2022] PUT /identity/v3/projects/58fefcc76b5d4caf866b356be8992445/users/0b7a339d24d2458caa23c704dd96c46c/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:46:57.858370 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1622/3242] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:57.871495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:58.045474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ffed-edb1-488b-b8b3-565d15ded5df admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:58.057596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e033ce0-a63d-498e-a434-41d33c4a79f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:58.058820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033ce0-a63d-498e-a434-41d33c4a79f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:58.059556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033ce0-a63d-498e-a434-41d33c4a79f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:58.059866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033ce0-a63d-498e-a434-41d33c4a79f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:58.063316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e033ce0-a63d-498e-a434-41d33c4a79f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:58.065004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e033ce0-a63d-498e-a434-41d33c4a79f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:58.095652 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1621/3243] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:46:58.096783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536b0db-8637-40f0-b798-9a280710c1e2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:58.148614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536b0db-8637-40f0-b798-9a280710c1e2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:58.184814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:58.186594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:58.187129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:58.187701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] PATH_INFO: `/v3/projects/58fefcc76b5d4caf866b356be8992445/users/0b7a339d24d2458caa23c704dd96c46c/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:58.217895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fefcc76b5d4caf866b356be8992445, user_id=0b7a339d24d2458caa23c704dd96c46c, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:58.241581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:58.330710 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1623/3244] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:46:58 2022] PUT /identity/v3/projects/58fefcc76b5d4caf866b356be8992445/users/0b7a339d24d2458caa23c704dd96c46c/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:46:58.355953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58d32-34b9-4dea-98d1-7f892c07cd7f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:58.356251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58d32-34b9-4dea-98d1-7f892c07cd7f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:58.356550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58d32-34b9-4dea-98d1-7f892c07cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:58.448435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4dc58d32-34b9-4dea-98d1-7f892c07cd7f None None] MFA Rules not processed for user `0b7a339d24d2458caa23c704dd96c46c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:58.449765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4dc58d32-34b9-4dea-98d1-7f892c07cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:58.642811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:58.659599 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1622/3245] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:46:58 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:59.870420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:59.872898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:00.090828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ec31-55e6-4f50-8231-9be0c307e60b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:00.099356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ebb1-dec2-4aaf-b098-18bf5bd5ca46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:00.101174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ebb1-dec2-4aaf-b098-18bf5bd5ca46 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:00.101470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ebb1-dec2-4aaf-b098-18bf5bd5ca46 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:00.101759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ebb1-dec2-4aaf-b098-18bf5bd5ca46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:00.160784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ebb1-dec2-4aaf-b098-18bf5bd5ca46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:00.164435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ebb1-dec2-4aaf-b098-18bf5bd5ca46 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:00.186694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1624/3246] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:59 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:02.330254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc58d32-34b9-4dea-98d1-7f892c07cd7f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:02.463627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc58d32-34b9-4dea-98d1-7f892c07cd7f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:02.469134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:02.470413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:02.471222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:02.472228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] PATH_INFO: `/v3/users/327faf643a2c4e42a27e8f91f5dc77b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:02.476438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327faf643a2c4e42a27e8f91f5dc77b5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:02.478988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:02.564540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327faf643a2c4e42a27e8f91f5dc77b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:02.586603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327faf643a2c4e42a27e8f91f5dc77b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:02.587568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327faf643a2c4e42a27e8f91f5dc77b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:02.598962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327faf643a2c4e42a27e8f91f5dc77b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:02.600022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327faf643a2c4e42a27e8f91f5dc77b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:02.632274 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1623/3247] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:02 2022] DELETE /identity/v3/users/327faf643a2c4e42a27e8f91f5dc77b5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:02.634791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:02.635686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:02.636200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:02.672047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:02.674410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:02.693506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:02.872635 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1625/3248] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:02.894288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:02.896224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:03.063442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841acb45-0391-4106-b09b-63352f929ba6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:03.068514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:03.069498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:03.077480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:03.078183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:03.122936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:03.128985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:03.153118 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1624/3249] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:04.197383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:04.198949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:04.235185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45817144-0d4e-4b35-98ec-0b7a85cf1b9c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:04.251316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:04.253916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:04.255006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:04.255971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] PATH_INFO: `/v3/projects/b7da111040094e239ef48448a81a7eb9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:04.275974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7da111040094e239ef48448a81a7eb9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:04.286374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:04.416130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7da111040094e239ef48448a81a7eb9', 'request_id': 'req-3fa41feb-0b46-43bd-8d7b-01b905629af7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.430759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7da111040094e239ef48448a81a7eb9', 'request_id': 'req-3fa41feb-0b46-43bd-8d7b-01b905629af7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.443437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7da111040094e239ef48448a81a7eb9', 'request_id': 'req-3fa41feb-0b46-43bd-8d7b-01b905629af7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.472527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] The token cache is being invalidate because project b7da111040094e239ef48448a81a7eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:04.473598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.475868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.484708 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1626/3250] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:04 2022] DELETE /identity/v3/projects/b7da111040094e239ef48448a81a7eb9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:04.485989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:04.501982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbac50-6d79-449e-b514-a010d95f8e0a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:04.561555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:04.698063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:04.698697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:04.698978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:04.699293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] PATH_INFO: `/v3/users/0b7a339d24d2458caa23c704dd96c46c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:04.712312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7a339d24d2458caa23c704dd96c46c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:04.714640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:04.887930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7a339d24d2458caa23c704dd96c46c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.928054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7a339d24d2458caa23c704dd96c46c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.929360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7a339d24d2458caa23c704dd96c46c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.946133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7a339d24d2458caa23c704dd96c46c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.947959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2143764d-ade7-494b-8fa7-394d254820bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7a339d24d2458caa23c704dd96c46c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:04.977503 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1625/3251] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:04 2022] DELETE /identity/v3/users/0b7a339d24d2458caa23c704dd96c46c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:06.431155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:06.433045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:06.458105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41feb-0b46-43bd-8d7b-01b905629af7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:06.625496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:06.626524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:06.626896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:06.627200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] PATH_INFO: `/v3/projects/58fefcc76b5d4caf866b356be8992445` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:06.628532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fefcc76b5d4caf866b356be8992445)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:06.631471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:06.721262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:06.743332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fefcc76b5d4caf866b356be8992445', 'request_id': 'req-0a6bc45e-137b-41ce-aece-b30c7e684730'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:06.754278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fefcc76b5d4caf866b356be8992445', 'request_id': 'req-0a6bc45e-137b-41ce-aece-b30c7e684730'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:06.768180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fefcc76b5d4caf866b356be8992445', 'request_id': 'req-0a6bc45e-137b-41ce-aece-b30c7e684730'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:06.793241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] The token cache is being invalidate because project 58fefcc76b5d4caf866b356be8992445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:06.793602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:06.809459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a6bc45e-137b-41ce-aece-b30c7e684730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:06.822332 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1627/3252] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:06 2022] DELETE /identity/v3/projects/58fefcc76b5d4caf866b356be8992445 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:06.824090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4d7ed-4b8b-4594-b48e-5d3a060faee0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:06.824635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4d7ed-4b8b-4594-b48e-5d3a060faee0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:06.825290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4d7ed-4b8b-4594-b48e-5d3a060faee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:06.909949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-03f4d7ed-4b8b-4594-b48e-5d3a060faee0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:06.911701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-03f4d7ed-4b8b-4594-b48e-5d3a060faee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:07.127444 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1626/3253] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:07.139890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7c04e-4184-4701-ada6-476d57d9f70f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.140361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7c04e-4184-4701-ada6-476d57d9f70f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.140874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7c04e-4184-4701-ada6-476d57d9f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.174251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bbc7c04e-4184-4701-ada6-476d57d9f70f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:07.175641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bbc7c04e-4184-4701-ada6-476d57d9f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:07.200718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4d7ed-4b8b-4594-b48e-5d3a060faee0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:07.207761 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1628/3254] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:07.216144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4d7ed-4b8b-4594-b48e-5d3a060faee0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:07.227096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:07.229601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.230756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.231422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.233194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:47:07.233790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:07.238093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:07.277170 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1627/3255] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:47:07.281658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7c04e-4184-4701-ada6-476d57d9f70f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:07.294369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7c04e-4184-4701-ada6-476d57d9f70f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:07.299813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:07.300505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.300797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.301082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.301994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:07.304612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:07.347140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1629/3256] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:07 2022] POST /identity/v3/projects => generated 407 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:47:07.351744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:07.366551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc4399-fd1c-4ebc-921e-2a74dd95b357 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:07.403710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:07.455992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:07.457829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.457829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.457829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.458375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:07.463331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:07.533940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1628/3257] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:07 2022] POST /identity/v3/users => generated 304 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:47:07.535458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:07.552888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f892b6-3f68-454a-bff4-21a2954dbc4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:07.561194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:07.562587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.563093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.563681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.564725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:07.567324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:07.591336 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1630/3258] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:07.597322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:07.624080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13d6e-d20d-46fe-aa7b-67bb6f80e55c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:07.634989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b463-7e6d-47d8-94b2-0dcd71558afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:07.636285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b463-7e6d-47d8-94b2-0dcd71558afc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.636802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b463-7e6d-47d8-94b2-0dcd71558afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.637297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b463-7e6d-47d8-94b2-0dcd71558afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.639019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b463-7e6d-47d8-94b2-0dcd71558afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:07.644223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b463-7e6d-47d8-94b2-0dcd71558afc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:07.672578 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1629/3259] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:07.677390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:07.696789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad29d1-f1ba-482e-a343-594d11a5eb63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:07.706302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:07.707712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.708110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.708632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] PATH_INFO: `/v3/projects/a7012a5c5f3046fdb4e00b80dfc2eb61/users/dd01c8f356834a82b836d2e290186262/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.745632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7012a5c5f3046fdb4e00b80dfc2eb61, user_id=dd01c8f356834a82b836d2e290186262, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:07.753828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:07.809108 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1631/3260] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:07 2022] PUT /identity/v3/projects/a7012a5c5f3046fdb4e00b80dfc2eb61/users/dd01c8f356834a82b836d2e290186262/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:07.829799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2e5a1-c6b4-4d4c-bd10-22ef406186a3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:07.830597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2e5a1-c6b4-4d4c-bd10-22ef406186a3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:07.830825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2e5a1-c6b4-4d4c-bd10-22ef406186a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:07.898376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d0b2e5a1-c6b4-4d4c-bd10-22ef406186a3 None None] MFA Rules not processed for user `dd01c8f356834a82b836d2e290186262`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:07.901527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d0b2e5a1-c6b4-4d4c-bd10-22ef406186a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:08.075329 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1630/3261] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:08.080277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:08.228414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2f2a5-4eb5-4dce-bf68-c9821f68b164 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:08.239300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:08.241936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:08.241936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:08.241936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:08.242929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:08.247980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:08.303139 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1632/3262] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:08 2022] POST /identity/v3/projects => generated 407 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:47:08.310485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2e5a1-c6b4-4d4c-bd10-22ef406186a3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:08.425573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2e5a1-c6b4-4d4c-bd10-22ef406186a3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:08.577865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:08.583319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:08.584380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:08.585379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:08.588013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:08.590119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:08.621347 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1631/3263] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:08 2022] POST /identity/v3/users => generated 310 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:08.627286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:08.648575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b4de-0238-4038-a1e0-0fcd621b9140 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:08.659924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:08.661530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:08.662406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:08.663399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:08.664968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:08.668357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:08.695004 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1633/3264] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:08.700300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:08.714980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e7d49-fe2e-41ba-90a9-ec97ec1ef055 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:08.722815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:08.723974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:08.724411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:08.724696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] PATH_INFO: `/v3/projects/c68fc8ed22bb4012967d8a6c3b4dd49a/users/78db82fc7ae34bd49d5a1465fd86fc66/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:08.755397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68fc8ed22bb4012967d8a6c3b4dd49a, user_id=78db82fc7ae34bd49d5a1465fd86fc66, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:08.759909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:08.777532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:08.792978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:08.797688 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1632/3265] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:08 2022] PUT /identity/v3/projects/c68fc8ed22bb4012967d8a6c3b4dd49a/users/78db82fc7ae34bd49d5a1465fd86fc66/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:08.814551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514215-c3cf-44b9-be0f-5a79b7aa641b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:08.913157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:09.033976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f76d5-f74d-4d40-b4db-81bd31c0686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:09.035569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f76d5-f74d-4d40-b4db-81bd31c0686b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:09.036275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f76d5-f74d-4d40-b4db-81bd31c0686b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:09.038484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f76d5-f74d-4d40-b4db-81bd31c0686b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:09.042713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f76d5-f74d-4d40-b4db-81bd31c0686b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:09.064496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f76d5-f74d-4d40-b4db-81bd31c0686b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:09.106530 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1634/3266] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:47:09.107965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:09.127677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c0b79-9f5b-4430-a2e8-bf94059b8ad4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:09.143003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:09.144342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:09.144608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:09.146348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] PATH_INFO: `/v3/projects/c68fc8ed22bb4012967d8a6c3b4dd49a/users/78db82fc7ae34bd49d5a1465fd86fc66/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:09.153165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68fc8ed22bb4012967d8a6c3b4dd49a, user_id=78db82fc7ae34bd49d5a1465fd86fc66, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:09.163855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:09.202508 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1633/3267] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:09 2022] PUT /identity/v3/projects/c68fc8ed22bb4012967d8a6c3b4dd49a/users/78db82fc7ae34bd49d5a1465fd86fc66/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:47:09.226187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812e47-b195-4e60-b5be-d66212303b46 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:09.226914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812e47-b195-4e60-b5be-d66212303b46 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:09.227441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812e47-b195-4e60-b5be-d66212303b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:09.391963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3b812e47-b195-4e60-b5be-d66212303b46 None None] MFA Rules not processed for user `78db82fc7ae34bd49d5a1465fd86fc66`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:09.394198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b812e47-b195-4e60-b5be-d66212303b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:09.696596 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1635/3268] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:09.708537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:09.933749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064afe-a336-4bf9-bc5d-55b2d0ecf322 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:09.939840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:09.941144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:09.941630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:09.942147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] PATH_INFO: `/v3/users/dd01c8f356834a82b836d2e290186262` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:09.944635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd01c8f356834a82b836d2e290186262)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:09.946958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:10.085573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd01c8f356834a82b836d2e290186262'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:10.116721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd01c8f356834a82b836d2e290186262'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:10.122106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd01c8f356834a82b836d2e290186262'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:10.143763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd01c8f356834a82b836d2e290186262'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:10.152435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd01c8f356834a82b836d2e290186262'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:10.199874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1634/3269] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:09 2022] DELETE /identity/v3/users/dd01c8f356834a82b836d2e290186262 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:10.201944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:10.202336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:10.202707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:10.233886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:10.236180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:10.388788 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1636/3270] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:10.466479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:10.470398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:10.702254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd140b6-85f1-4629-b53d-b8d51e0f0904 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:10.711321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0efef6-3b4a-44d4-a10c-f3e5cd242d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:10.712817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0efef6-3b4a-44d4-a10c-f3e5cd242d6b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:10.713427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0efef6-3b4a-44d4-a10c-f3e5cd242d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:10.713916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0efef6-3b4a-44d4-a10c-f3e5cd242d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:10.753351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0efef6-3b4a-44d4-a10c-f3e5cd242d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:10.756364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0efef6-3b4a-44d4-a10c-f3e5cd242d6b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:10.799775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1635/3271] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:11.869115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:11.871024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:11.886892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:11.889709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:11.891260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:11.891756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceed71-c167-42ee-99ae-71e0694cd8fc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:11.907962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:11.909215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:11.909668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:11.910112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] PATH_INFO: `/v3/projects/a7012a5c5f3046fdb4e00b80dfc2eb61` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:11.912105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7012a5c5f3046fdb4e00b80dfc2eb61)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:11.915501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:11.985955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:11.988694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:12.002692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:12.083794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7012a5c5f3046fdb4e00b80dfc2eb61', 'request_id': 'req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.095096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:12.104370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7012a5c5f3046fdb4e00b80dfc2eb61', 'request_id': 'req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.119606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7012a5c5f3046fdb4e00b80dfc2eb61', 'request_id': 'req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.147774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] The token cache is being invalidate because project a7012a5c5f3046fdb4e00b80dfc2eb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:12.148144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.149035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.153727 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1637/3272] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:11 2022] DELETE /identity/v3/projects/a7012a5c5f3046fdb4e00b80dfc2eb61 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:47:12.157653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:12.160929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:12.260032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb0b6-6a16-4b21-a139-5887294fe7d5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:12.265514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:12.267014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:12.267461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:12.268186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] PATH_INFO: `/v3/users/78db82fc7ae34bd49d5a1465fd86fc66` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:12.270276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78db82fc7ae34bd49d5a1465fd86fc66)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:12.273262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:12.288034 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1636/3273] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:12.341636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:12.344098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:12.414239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78db82fc7ae34bd49d5a1465fd86fc66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.460140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78db82fc7ae34bd49d5a1465fd86fc66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.502064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78db82fc7ae34bd49d5a1465fd86fc66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.503476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78db82fc7ae34bd49d5a1465fd86fc66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.522921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78db82fc7ae34bd49d5a1465fd86fc66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:12.544035 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1638/3274] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:12 2022] DELETE /identity/v3/users/78db82fc7ae34bd49d5a1465fd86fc66 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:12.645993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557be44-643d-4446-9cca-59176e1f6f5e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:12.810207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:12.811452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:12.812184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:12.812696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:12.818623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:13.017790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:13.022632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:13.031161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:13.043729 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1637/3275] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:47:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:47:13.350208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:13.363590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:13.594832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5e5a1-0ba7-48bc-a324-dc863828f281 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:13.605697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:13.606947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:13.607311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:13.609258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] PATH_INFO: `/v3/users/7be704e59540422f94bae37a4d36dbdb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:13.611195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be704e59540422f94bae37a4d36dbdb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:13.615104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:13.621652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:13.723672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be704e59540422f94bae37a4d36dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:13.743011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be704e59540422f94bae37a4d36dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:13.752710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be704e59540422f94bae37a4d36dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:13.753911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be704e59540422f94bae37a4d36dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:13.759519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:13.761970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:13.783821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-054a2e5b-58c8-4228-bddc-87f820d1ae74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be704e59540422f94bae37a4d36dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:13.790901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9bf90-92f8-4552-b9e7-2e50f4339099 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:13.797961 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1639/3276] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:13 2022] DELETE /identity/v3/users/7be704e59540422f94bae37a4d36dbdb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:13.800841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:13.802689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:13.803892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:13.804306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:13.804564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] PATH_INFO: `/v3/projects/c68fc8ed22bb4012967d8a6c3b4dd49a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:13.806494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:13.807358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:13.807462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68fc8ed22bb4012967d8a6c3b4dd49a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:13.813380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:13.887988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:13.890613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:14.010556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68fc8ed22bb4012967d8a6c3b4dd49a', 'request_id': 'req-113b40e9-510b-4cd4-af01-0743ff3fc283'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:14.029226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68fc8ed22bb4012967d8a6c3b4dd49a', 'request_id': 'req-113b40e9-510b-4cd4-af01-0743ff3fc283'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:14.044733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68fc8ed22bb4012967d8a6c3b4dd49a', 'request_id': 'req-113b40e9-510b-4cd4-af01-0743ff3fc283'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:14.081213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] The token cache is being invalidate because project c68fc8ed22bb4012967d8a6c3b4dd49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:14.082792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:14.086556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-113b40e9-510b-4cd4-af01-0743ff3fc283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:14.091664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1638/3277] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:13 2022] DELETE /identity/v3/projects/c68fc8ed22bb4012967d8a6c3b4dd49a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:14.098313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8adc6f-785b-439f-9a42-9258ae792323 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:14.101051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8adc6f-785b-439f-9a42-9258ae792323 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:14.101581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8adc6f-785b-439f-9a42-9258ae792323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:14.108016 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1640/3278] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:14.130980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ba8adc6f-785b-439f-9a42-9258ae792323 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:14.132409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba8adc6f-785b-439f-9a42-9258ae792323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:14.139943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:14.146255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:14.270894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1639/3279] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:14.274388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551c7b-14ab-4db2-86af-f2f5b99c9619 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:14.274954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551c7b-14ab-4db2-86af-f2f5b99c9619 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:14.275534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551c7b-14ab-4db2-86af-f2f5b99c9619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:14.363829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a2551c7b-14ab-4db2-86af-f2f5b99c9619 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:14.366879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2551c7b-14ab-4db2-86af-f2f5b99c9619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:14.432510 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1640/3280] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:14.435752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2551c7b-14ab-4db2-86af-f2f5b99c9619 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:14.484689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2551c7b-14ab-4db2-86af-f2f5b99c9619 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:14.495201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64111-f294-412c-887a-2b4b0ccf8c5d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:14.521359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:14.526012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:14.528887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:14.529883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:14.532703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:47:14.536168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:14.541845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:14.581873 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1641/3281] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:47:14.588161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:14.661243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba2641-69bb-4c4d-9c81-8cdba20155b4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:14.719400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:14.720480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:14.720889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:14.721285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:14.728070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:14.733451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:14.760024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:14.808151 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1642/3282] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:14 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:14.809896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:14.854757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:14.856187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:14.856698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:14.857220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:14.913374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:14.915951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:14.945935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1641/3283] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:14.950236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:15.002288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bc0f-afad-4b31-9a83-42f6952c4c58 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:15.011798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:15.012692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:15.013081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:15.013600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:15.022622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:15.027939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:15.082310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1643/3284] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:14 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:15.083313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:15.098607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccd2f8-232b-4163-8c67-c4c5102b19d1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:15.114755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:15.116415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:15.116832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:15.116993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:15.120206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:15.126393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:15.164834 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1642/3285] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:47:15.165304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:15.185564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8c99c-ce2f-446f-8667-4d88d3e439c7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:15.199974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a875b4-bf08-464a-92cf-3b6258969440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:15.202407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a875b4-bf08-464a-92cf-3b6258969440 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:15.203528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a875b4-bf08-464a-92cf-3b6258969440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:15.204555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a875b4-bf08-464a-92cf-3b6258969440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:15.206156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a875b4-bf08-464a-92cf-3b6258969440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:15.214014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a875b4-bf08-464a-92cf-3b6258969440 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:15.248140 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1644/3286] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:47:15.251122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:15.304070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a206-24fe-4340-97a5-2212939d8d63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:15.322152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:15.323132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:15.323460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:15.323751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] PATH_INFO: `/v3/projects/294ea301498240ec8101929ae3f9e4e4/users/ba43227f00d04dccac9ebe6c38aae925/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:15.362761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294ea301498240ec8101929ae3f9e4e4, user_id=ba43227f00d04dccac9ebe6c38aae925, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:15.369118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:15.399541 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1643/3287] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:15 2022] PUT /identity/v3/projects/294ea301498240ec8101929ae3f9e4e4/users/ba43227f00d04dccac9ebe6c38aae925/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:15.411772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f53f2d-bbb8-435f-a30a-b7efca0831be None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:15.415409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f53f2d-bbb8-435f-a30a-b7efca0831be None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:15.416408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f53f2d-bbb8-435f-a30a-b7efca0831be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:15.475149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c7f53f2d-bbb8-435f-a30a-b7efca0831be None None] MFA Rules not processed for user `ba43227f00d04dccac9ebe6c38aae925`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:15.479765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c7f53f2d-bbb8-435f-a30a-b7efca0831be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:15.629454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1645/3288] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:15.637659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:15.794162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11cce-9d78-417a-9998-571b21b56c78 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:15.803773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:15.808474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:15.808976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:15.809341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:15.810235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:15.821242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:15.868899 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1644/3289] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:15 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:15.870689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f53f2d-bbb8-435f-a30a-b7efca0831be None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:15.902658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f53f2d-bbb8-435f-a30a-b7efca0831be None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:16.040132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:16.040851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.041142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.041429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.042163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:16.044316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:16.078028 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1646/3290] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:15 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:47:16.080864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:16.102014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1d678-cd80-4202-b1d2-c77a1392b111 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:16.116851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:16.118152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.118152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.118152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.118894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:16.120669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:16.153263 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1645/3291] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:16.155508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:16.172132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b39b6-8bb6-4ff8-afcf-e271a0be8335 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:16.183066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:16.185896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.186290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.186701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] PATH_INFO: `/v3/projects/a76716a10ce841bb99fe7ddd8925a416/users/515d6e6ea58145a7a7d8625bd663e78a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.229547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76716a10ce841bb99fe7ddd8925a416, user_id=515d6e6ea58145a7a7d8625bd663e78a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:16.232698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:16.254222 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1647/3292] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:16 2022] PUT /identity/v3/projects/a76716a10ce841bb99fe7ddd8925a416/users/515d6e6ea58145a7a7d8625bd663e78a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:16.258258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:16.273879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af2b3a-e511-40cd-987b-e4aa654ecd8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:16.390195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:16.391316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.391485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.391866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.392701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:16.394944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:16.416608 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1646/3293] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:16.417163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:16.450073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c36ee-700b-4029-92c7-08857ca2d914 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:16.460914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cebfcd-d608-41df-aad6-f0355215c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:16.462927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:16.464293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cebfcd-d608-41df-aad6-f0355215c710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.465429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cebfcd-d608-41df-aad6-f0355215c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.465947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cebfcd-d608-41df-aad6-f0355215c710 admin admin] PATH_INFO: `/v3/projects/a76716a10ce841bb99fe7ddd8925a416/users/515d6e6ea58145a7a7d8625bd663e78a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.467796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:16.484330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cebfcd-d608-41df-aad6-f0355215c710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76716a10ce841bb99fe7ddd8925a416, user_id=515d6e6ea58145a7a7d8625bd663e78a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:16.495030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cebfcd-d608-41df-aad6-f0355215c710 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:16.499407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf57a5b-f0de-40e0-83a7-b72f6f5d41c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:16.505687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:16.507605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.507896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.508237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:16.508541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] PATH_INFO: `/v3/projects/78242c6301c94132a739c3390dfcbe99` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.509919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78242c6301c94132a739c3390dfcbe99)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:16.512944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:16.519704 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1648/3294] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:16 2022] PUT /identity/v3/projects/a76716a10ce841bb99fe7ddd8925a416/users/515d6e6ea58145a7a7d8625bd663e78a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:16.534694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57fab-0572-4ace-b1fe-58b37277fb7e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.536942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57fab-0572-4ace-b1fe-58b37277fb7e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.537968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57fab-0572-4ace-b1fe-58b37277fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.544963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:16.612604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e6f57fab-0572-4ace-b1fe-58b37277fb7e None None] MFA Rules not processed for user `515d6e6ea58145a7a7d8625bd663e78a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:16.613864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6f57fab-0572-4ace-b1fe-58b37277fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:16.629079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78242c6301c94132a739c3390dfcbe99', 'request_id': 'req-a9c94564-d107-469f-99d0-01529ccc70c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:16.637691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78242c6301c94132a739c3390dfcbe99', 'request_id': 'req-a9c94564-d107-469f-99d0-01529ccc70c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:16.648372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78242c6301c94132a739c3390dfcbe99', 'request_id': 'req-a9c94564-d107-469f-99d0-01529ccc70c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:16.682970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] The token cache is being invalidate because project 78242c6301c94132a739c3390dfcbe99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:16.683890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:16.685979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9c94564-d107-469f-99d0-01529ccc70c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:16.694272 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1647/3295] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:16 2022] DELETE /identity/v3/projects/78242c6301c94132a739c3390dfcbe99 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:16.699664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a133b8-a9a1-405d-8bb0-c64a127ea84f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.699961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a133b8-a9a1-405d-8bb0-c64a127ea84f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.700558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a133b8-a9a1-405d-8bb0-c64a127ea84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.726033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-12a133b8-a9a1-405d-8bb0-c64a127ea84f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:16.727368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12a133b8-a9a1-405d-8bb0-c64a127ea84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:16.802827 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1649/3296] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:16.816536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11bdb-11c2-48d0-a7b8-dcf281c26256 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.816834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11bdb-11c2-48d0-a7b8-dcf281c26256 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.817118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11bdb-11c2-48d0-a7b8-dcf281c26256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.847548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d2f11bdb-11c2-48d0-a7b8-dcf281c26256 None None] MFA Rules not processed for user `ba43227f00d04dccac9ebe6c38aae925`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:16.851522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2f11bdb-11c2-48d0-a7b8-dcf281c26256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:16.864891 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1648/3297] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:16.874671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e721e-60ff-4d3e-ba5e-c1ba75d4b089 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:16.875074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e721e-60ff-4d3e-ba5e-c1ba75d4b089 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:16.876823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e721e-60ff-4d3e-ba5e-c1ba75d4b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:16.967232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-604e721e-60ff-4d3e-ba5e-c1ba75d4b089 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:16.968617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-604e721e-60ff-4d3e-ba5e-c1ba75d4b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:16.981912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1649/3298] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:16.985929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e721e-60ff-4d3e-ba5e-c1ba75d4b089 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:17.010682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e721e-60ff-4d3e-ba5e-c1ba75d4b089 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:17.029127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:17.029955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:17.030311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:17.030695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:17.031567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:47:17.031964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:17.033897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:17.064354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1650/3299] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:47:17.069197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:17.088502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc01b61-0670-4b51-b141-178c0b035da3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:17.091892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1650/3300] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:17.106613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:17.109710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:17.109923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:17.110213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:17.111184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:17.113298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:17.181315 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1651/3301] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:17 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:47:17.185763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f11bdb-11c2-48d0-a7b8-dcf281c26256 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:17.223517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f11bdb-11c2-48d0-a7b8-dcf281c26256 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:17.406713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:17.407857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:17.408553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:17.408940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:17.409868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:17.412209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:17.444646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:17.449459 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1651/3302] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:17 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:17.463759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820b286-b0eb-45e2-b10b-1445e9deed9f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:17.470626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:17.471488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:17.471846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:17.472199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:17.473060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:17.474910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:17.499048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:17.511051 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1652/3303] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:17.513983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce4e2b-c562-4c97-93bd-de92d72adae1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:17.519204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b604a-6325-4cfa-b350-72c7f7e5de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:17.519959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b604a-6325-4cfa-b350-72c7f7e5de14 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:17.520252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b604a-6325-4cfa-b350-72c7f7e5de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:17.520542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b604a-6325-4cfa-b350-72c7f7e5de14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:17.521309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b604a-6325-4cfa-b350-72c7f7e5de14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:17.524021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b604a-6325-4cfa-b350-72c7f7e5de14 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:17.545767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1652/3304] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:17.551540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:17.571055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aba3b-50b2-40b9-b482-376b82a94e01 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:17.580912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:17.582057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:17.582584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:17.583942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] PATH_INFO: `/v3/projects/47959e88148b44629bb66b4e53004b44/users/8d0cfcf1405940568d9c8fd72d679f2b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:17.621691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47959e88148b44629bb66b4e53004b44, user_id=8d0cfcf1405940568d9c8fd72d679f2b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:17.628225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:17.681253 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1653/3305] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:17 2022] PUT /identity/v3/projects/47959e88148b44629bb66b4e53004b44/users/8d0cfcf1405940568d9c8fd72d679f2b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:17.684683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688daf-29a1-4bb0-8245-e8e253e8465a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:17.684683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688daf-29a1-4bb0-8245-e8e253e8465a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:17.685028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688daf-29a1-4bb0-8245-e8e253e8465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:17.737214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:17.738464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:17.741670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:17.757976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f9688daf-29a1-4bb0-8245-e8e253e8465a None None] MFA Rules not processed for user `8d0cfcf1405940568d9c8fd72d679f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:17.762061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f9688daf-29a1-4bb0-8245-e8e253e8465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:17.852585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:17.940439 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1653/3306] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:18.003530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676643-b79e-44fe-b2a2-0a96b8bb5114 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:18.016201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:18.017293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:18.018181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:18.018181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:18.021565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:18.128842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:18.131864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:18.146613 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1654/3307] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:47:18.695785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9688daf-29a1-4bb0-8245-e8e253e8465a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:18.740643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9688daf-29a1-4bb0-8245-e8e253e8465a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:18.756817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fea74f-7b4f-4389-8eb2-7ef8b4708945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:18.758753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fea74f-7b4f-4389-8eb2-7ef8b4708945 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:18.759127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fea74f-7b4f-4389-8eb2-7ef8b4708945 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:18.759540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fea74f-7b4f-4389-8eb2-7ef8b4708945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:18.795086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fea74f-7b4f-4389-8eb2-7ef8b4708945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:18.799172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fea74f-7b4f-4389-8eb2-7ef8b4708945 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:18.823374 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1654/3308] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:20.456883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:20.628176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e8c8-5fba-468b-a4d3-fe4d63f83964 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:20.636485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:20.637874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:20.638393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:20.639205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] PATH_INFO: `/v3/users/8d0cfcf1405940568d9c8fd72d679f2b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:20.641252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0cfcf1405940568d9c8fd72d679f2b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:20.644464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:20.750598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0cfcf1405940568d9c8fd72d679f2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:20.769132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:20.773021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0cfcf1405940568d9c8fd72d679f2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:20.788940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0cfcf1405940568d9c8fd72d679f2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:20.790168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0cfcf1405940568d9c8fd72d679f2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:20.800572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0cfcf1405940568d9c8fd72d679f2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:20.810359 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1655/3309] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:20 2022] DELETE /identity/v3/users/8d0cfcf1405940568d9c8fd72d679f2b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:20.815259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:20.815832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:20.815917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:20.840325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:20.842230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:20.922735 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1655/3310] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:20.933221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:20.936887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:21.013356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3e6f-7d08-4749-a5fa-d9f34b218595 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:21.033537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11f024-d0b6-409a-8498-3a6d30a59a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:21.034373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11f024-d0b6-409a-8498-3a6d30a59a3d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:21.034728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11f024-d0b6-409a-8498-3a6d30a59a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:21.035076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11f024-d0b6-409a-8498-3a6d30a59a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:21.052518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11f024-d0b6-409a-8498-3a6d30a59a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:21.055014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11f024-d0b6-409a-8498-3a6d30a59a3d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:21.070764 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1656/3311] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:21.768521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:21.776397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:21.810834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb67c3-234e-4fd7-9ad7-fa7c1a6c0f78 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:21.818520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:21.820484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:21.820780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:21.821213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] PATH_INFO: `/v3/projects/47959e88148b44629bb66b4e53004b44` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:21.825171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47959e88148b44629bb66b4e53004b44)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:21.828445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:21.956868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47959e88148b44629bb66b4e53004b44', 'request_id': 'req-612323e9-653f-4509-ab3d-0689e237b7f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:21.971895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47959e88148b44629bb66b4e53004b44', 'request_id': 'req-612323e9-653f-4509-ab3d-0689e237b7f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:21.983431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47959e88148b44629bb66b4e53004b44', 'request_id': 'req-612323e9-653f-4509-ab3d-0689e237b7f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:22.023394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] The token cache is being invalidate because project 47959e88148b44629bb66b4e53004b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:22.025131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:22.026788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-612323e9-653f-4509-ab3d-0689e237b7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:22.031692 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1656/3312] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:21 2022] DELETE /identity/v3/projects/47959e88148b44629bb66b4e53004b44 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:22.036977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98093ef-fe4f-4a01-9277-60f892c25ac6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:22.038531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98093ef-fe4f-4a01-9277-60f892c25ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:22.038991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98093ef-fe4f-4a01-9277-60f892c25ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:22.080832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c98093ef-fe4f-4a01-9277-60f892c25ac6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:22.084545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c98093ef-fe4f-4a01-9277-60f892c25ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:22.289831 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1657/3313] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:22.298676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8fb1-185c-4f6b-9855-62b663fe31d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:22.299337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8fb1-185c-4f6b-9855-62b663fe31d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:22.299819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8fb1-185c-4f6b-9855-62b663fe31d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:22.346379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d22b8fb1-185c-4f6b-9855-62b663fe31d0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:22.350051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d22b8fb1-185c-4f6b-9855-62b663fe31d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:22.378563 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1657/3314] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:22.383726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98093ef-fe4f-4a01-9277-60f892c25ac6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:22.410728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98093ef-fe4f-4a01-9277-60f892c25ac6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:22.427302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:22.428723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:22.429073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:22.429419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:22.430275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:47:22.430662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:22.433679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:22.449579 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1658/3315] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:47:22.454342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b8fb1-185c-4f6b-9855-62b663fe31d0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:22.460853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:22.470663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b8fb1-185c-4f6b-9855-62b663fe31d0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:22.490154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:22.507735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:22.508204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:22.508380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:22.509174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:22.511410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:22.613882 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1658/3316] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:22 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:22.614539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:22.636139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c79ce-b54b-43c5-8364-000d204b32f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:23.018197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:23.019503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:23.020124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:23.020657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:23.022468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:23.036041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:23.112288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:23.138874 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1659/3317] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:22 2022] POST /identity/v3/users => generated 292 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:23.139185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:23.178407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a10b7f-b652-4352-ba6e-65ee66dd2e0f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:23.223403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:23.224912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:23.225354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:23.225816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:23.227123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:23.230079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:23.319678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:23.326996 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1659/3318] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:23.381734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cc591-f45d-4a93-bf02-e666a1256ecf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:23.433133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99e8b-555c-4a9c-a3f9-f335c2319ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:23.434926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99e8b-555c-4a9c-a3f9-f335c2319ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:23.435690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99e8b-555c-4a9c-a3f9-f335c2319ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:23.436394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99e8b-555c-4a9c-a3f9-f335c2319ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:23.443345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e99e8b-555c-4a9c-a3f9-f335c2319ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:23.451216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e99e8b-555c-4a9c-a3f9-f335c2319ba8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:23.499562 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1660/3319] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:47:23.504782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:23.542496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280f62-e5b2-4219-b438-2e61f9e9eeab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:23.556757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:23.558200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:23.558961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:23.559488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] PATH_INFO: `/v3/projects/accf60fb4fd44f6fa6f8cf9302662d68/users/9ac47e12cd544be0bb7a6c7616e1aaed/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:23.614610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accf60fb4fd44f6fa6f8cf9302662d68, user_id=9ac47e12cd544be0bb7a6c7616e1aaed, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:23.632802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:23.670792 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1660/3320] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:23 2022] PUT /identity/v3/projects/accf60fb4fd44f6fa6f8cf9302662d68/users/9ac47e12cd544be0bb7a6c7616e1aaed/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:23.692357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e155f1c-3785-4118-b55b-e8a0a74be019 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:23.693058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e155f1c-3785-4118-b55b-e8a0a74be019 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:23.694707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e155f1c-3785-4118-b55b-e8a0a74be019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:23.776845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e155f1c-3785-4118-b55b-e8a0a74be019 None None] MFA Rules not processed for user `9ac47e12cd544be0bb7a6c7616e1aaed`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:23.780014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e155f1c-3785-4118-b55b-e8a0a74be019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:24.055423 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1661/3321] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:24.074585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:24.077490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:24.185660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fcf93-20b0-4d69-8822-0811d152d220 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:24.195398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a104c-c849-45b5-8fb4-50e319180d20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:24.196392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a104c-c849-45b5-8fb4-50e319180d20 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:24.196830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a104c-c849-45b5-8fb4-50e319180d20 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:24.197741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a104c-c849-45b5-8fb4-50e319180d20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:24.229472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a104c-c849-45b5-8fb4-50e319180d20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:24.232893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a104c-c849-45b5-8fb4-50e319180d20 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:24.297611 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1661/3322] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:47:25.621611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:25.624722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:25.626738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:25.760560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:25.774698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:25.794374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:25.795120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:25.795120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:25.862288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:25.869291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:26.085010 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1662/3323] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:26.122746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:26.124463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:26.127469 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1662/3324] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:26.167085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:26.170011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:26.305124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:26.381488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d453a4-a047-4abe-bfea-b792a789aa71 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:26.405007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971bf6f-338d-46ce-9e03-4aa60434979e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:26.406560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971bf6f-338d-46ce-9e03-4aa60434979e service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:26.407621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971bf6f-338d-46ce-9e03-4aa60434979e service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:26.410674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971bf6f-338d-46ce-9e03-4aa60434979e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:26.451297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971bf6f-338d-46ce-9e03-4aa60434979e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:26.455169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971bf6f-338d-46ce-9e03-4aa60434979e service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:26.478743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128213a8-af3b-430d-a85f-a53cab6c3e70 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:26.507051 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1663/3325] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:47:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:47:26.510024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:26.511658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:26.512485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:26.513274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:26.567544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:26.576168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:26.622218 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1663/3326] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:47:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:47:28.319496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab350-b0df-45fd-9f95-2413d7231e26 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:28.320048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab350-b0df-45fd-9f95-2413d7231e26 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:28.320463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab350-b0df-45fd-9f95-2413d7231e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:28.389100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f37ab350-b0df-45fd-9f95-2413d7231e26 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:28.391322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f37ab350-b0df-45fd-9f95-2413d7231e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:28.412901 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1664/3327] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:28.488409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:28.519225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffcf5e-bfc1-43f8-8013-739ccf5bfa73 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:28.548486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:28.549631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:28.550129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:28.550635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:28.601480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:28.604966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:28.612173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:28.640286 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1664/3328] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:47:30.769559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798551-1163-4e46-8661-cb431890df42 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:30.773654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798551-1163-4e46-8661-cb431890df42 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:30.774809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798551-1163-4e46-8661-cb431890df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:30.893061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fb798551-1163-4e46-8661-cb431890df42 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:30.894861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb798551-1163-4e46-8661-cb431890df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:30.924846 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1665/3329] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:30.934408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:30.950864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2fede-1dae-4a52-8f99-556101b307a1 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:30.968733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706bea8-f62d-4b8b-9948-03d6c0c8f462 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:30.969846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bea8-f62d-4b8b-9948-03d6c0c8f462 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:30.970355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bea8-f62d-4b8b-9948-03d6c0c8f462 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:30.970850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bea8-f62d-4b8b-9948-03d6c0c8f462 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:30.998842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706bea8-f62d-4b8b-9948-03d6c0c8f462 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:31.006261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706bea8-f62d-4b8b-9948-03d6c0c8f462 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:31.038839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1665/3330] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:47:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:31.909764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:31.910320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:31.910670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:31.974124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] MFA Rules not processed for user `9ac47e12cd544be0bb7a6c7616e1aaed`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:31.977393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:32.004998 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1666/3331] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:32.942837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996d21d-9ad4-44ae-8318-ab24c6e6dc77 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:32.943852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996d21d-9ad4-44ae-8318-ab24c6e6dc77 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:32.944647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996d21d-9ad4-44ae-8318-ab24c6e6dc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:33.076640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d996d21d-9ad4-44ae-8318-ab24c6e6dc77 None None] MFA Rules not processed for user `9ac47e12cd544be0bb7a6c7616e1aaed`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:33.085003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d996d21d-9ad4-44ae-8318-ab24c6e6dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:33.149868 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1666/3332] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:37.077408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:37.082152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:37.384235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8389-dfa2-43fa-a390-2eb1c30d7431 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:37.396683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:37.401188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:37.403904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:37.406849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] PATH_INFO: `/v3/users/df11930b59684df585c3b90e0300aeb3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:37.412505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df11930b59684df585c3b90e0300aeb3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:37.420202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:37.671508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df11930b59684df585c3b90e0300aeb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:37.772146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df11930b59684df585c3b90e0300aeb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:37.777354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df11930b59684df585c3b90e0300aeb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:37.812332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df11930b59684df585c3b90e0300aeb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:37.814314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df11930b59684df585c3b90e0300aeb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:37.887984 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1667/3333] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:37 2022] DELETE /identity/v3/users/df11930b59684df585c3b90e0300aeb3 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:47:37.895242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:37.897299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:37.898403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:37.963210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:37.966271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:38.231591 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1667/3334] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:38.432302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:38.435316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:38.723771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:38.774445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18fc40-6cb2-4e11-aaa7-94ad1b57ed85 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:38.789740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:38.790881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:38.793943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:38.794576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:38.856690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:38.862405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:38.916293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1668/3335] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:39.592113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:39.596111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:39.670700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192840e-c744-40f2-a0b9-ee1f4fb9ee4c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:39.735059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:39.736714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:39.737221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:39.737737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] PATH_INFO: `/v3/projects/1c56ef362cf84d91bb841ab512e3665e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:39.740551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c56ef362cf84d91bb841ab512e3665e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:39.744834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:39.950530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c56ef362cf84d91bb841ab512e3665e', 'request_id': 'req-72fce645-fbe3-4325-aeb6-9236758a5e5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:39.965802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c56ef362cf84d91bb841ab512e3665e', 'request_id': 'req-72fce645-fbe3-4325-aeb6-9236758a5e5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:39.981194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c56ef362cf84d91bb841ab512e3665e', 'request_id': 'req-72fce645-fbe3-4325-aeb6-9236758a5e5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.008496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] The token cache is being invalidate because project 1c56ef362cf84d91bb841ab512e3665e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:40.009389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.010747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.013964 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1668/3336] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:39 2022] DELETE /identity/v3/projects/1c56ef362cf84d91bb841ab512e3665e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:40.020018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:40.050293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5d6d-f0fd-472f-9774-a516009580f0 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:40.277817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:40.279444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:40.279916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:40.280408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] PATH_INFO: `/v3/users/5bf9508bcf2745e689b69f42d54ea483` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:40.289838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf9508bcf2745e689b69f42d54ea483)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:40.298638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:40.541888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf9508bcf2745e689b69f42d54ea483'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.559440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf9508bcf2745e689b69f42d54ea483'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.562550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf9508bcf2745e689b69f42d54ea483'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.573202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf9508bcf2745e689b69f42d54ea483'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.578556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83b3b63c-59b9-4cdc-9db8-39a61a283c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf9508bcf2745e689b69f42d54ea483'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:40.607928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1669/3337] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:40 2022] DELETE /identity/v3/users/5bf9508bcf2745e689b69f42d54ea483 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:47:41.120784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:41.122263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:41.152958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fce645-fbe3-4325-aeb6-9236758a5e5e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:41.362034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:41.363035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:41.363386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:41.363694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] PATH_INFO: `/v3/projects/b31d622e4c4441f1a96a35d8f0fe1591` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:41.366357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31d622e4c4441f1a96a35d8f0fe1591)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:41.368418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:41.378239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:41.480749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31d622e4c4441f1a96a35d8f0fe1591', 'request_id': 'req-0eaebc36-5500-4619-9d51-29b87399ca77'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:41.490706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31d622e4c4441f1a96a35d8f0fe1591', 'request_id': 'req-0eaebc36-5500-4619-9d51-29b87399ca77'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:41.511929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31d622e4c4441f1a96a35d8f0fe1591', 'request_id': 'req-0eaebc36-5500-4619-9d51-29b87399ca77'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:41.538459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] The token cache is being invalidate because project b31d622e4c4441f1a96a35d8f0fe1591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:41.538741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:41.539411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eaebc36-5500-4619-9d51-29b87399ca77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:41.557969 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1669/3338] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:41 2022] DELETE /identity/v3/projects/b31d622e4c4441f1a96a35d8f0fe1591 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:47:41.559545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e198ac4-7588-46cb-ae5a-e3ff384033b2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:41.560281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e198ac4-7588-46cb-ae5a-e3ff384033b2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:41.560281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e198ac4-7588-46cb-ae5a-e3ff384033b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:41.596648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3e198ac4-7588-46cb-ae5a-e3ff384033b2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:41.598125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e198ac4-7588-46cb-ae5a-e3ff384033b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:41.769401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1670/3339] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:41.785854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e2f5-8963-45e0-abcf-0d83fd79e998 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:41.786175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e2f5-8963-45e0-abcf-0d83fd79e998 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:41.787567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e2f5-8963-45e0-abcf-0d83fd79e998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:41.830391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a683e2f5-8963-45e0-abcf-0d83fd79e998 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:41.831755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a683e2f5-8963-45e0-abcf-0d83fd79e998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:41.841618 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1670/3340] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:41.845869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e198ac4-7588-46cb-ae5a-e3ff384033b2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:41.853544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:41.866226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e198ac4-7588-46cb-ae5a-e3ff384033b2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:41.873136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:41.873744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:41.874067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:41.874362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:41.875059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:47:41.879767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:41.886645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:41.939007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e2f5-8963-45e0-abcf-0d83fd79e998 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:41.944809 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1671/3341] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:47:41.992008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e2f5-8963-45e0-abcf-0d83fd79e998 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:42.014117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:42.015997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:42.016686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:42.017327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:42.019561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:42.025273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:42.114616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:42.115499 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1671/3342] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:41 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:42.126901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26142fe-3a29-439c-b9b4-ad4dd369d8be admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:42.280876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:42.283219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:42.284253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:42.285152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:42.286482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:42.309426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:42.411950 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1672/3343] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:42 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:47:42.415140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:42.488053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e37e42-7557-4752-b325-8b1bd801b28b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:42.531554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:42.534450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:42.538172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:42.538868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:42.542753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:42.546065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:42.617744 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1672/3344] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:42.619125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:42.663227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24febdb9-20b5-463c-8d0e-674abf2a6026 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:42.696642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69480e-796a-4b3f-9790-06be009e67e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:42.697861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69480e-796a-4b3f-9790-06be009e67e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:42.705023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69480e-796a-4b3f-9790-06be009e67e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:42.705836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69480e-796a-4b3f-9790-06be009e67e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:42.707401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69480e-796a-4b3f-9790-06be009e67e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:42.712759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69480e-796a-4b3f-9790-06be009e67e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:42.793051 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1673/3345] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:42.799951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:42.835361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56c78e-ed2d-4f8a-9f1a-75ed26adcd59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:42.862354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:42.864507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:42.865163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:42.865743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] PATH_INFO: `/v3/projects/e29ad9c0a3664715b0a8384bc9840b7b/users/a185fa24374c417aa2bb9302a608cbcd/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:42.908851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29ad9c0a3664715b0a8384bc9840b7b, user_id=a185fa24374c417aa2bb9302a608cbcd, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:42.929067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:42.989428 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1673/3346] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:42 2022] PUT /identity/v3/projects/e29ad9c0a3664715b0a8384bc9840b7b/users/a185fa24374c417aa2bb9302a608cbcd/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:43.007073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:43.007474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:43.008116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:43.249510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] MFA Rules not processed for user `a185fa24374c417aa2bb9302a608cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:43.254618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:43.669375 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1674/3347] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 659 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:43.673857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:43.971001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:43.973618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:43.979669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771fc2c-006d-4a6e-9542-825789646721 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:44.002087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:44.003963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:44.004792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:44.005588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:44.007249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:44.013493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:44.029092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875dca5-bf8e-4938-b79c-9fe48ee20391 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:44.047147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:44.051673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:44.051673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:44.052080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] PATH_INFO: `/v3/users/f1d8ca06f8d2469382275fd2e36c538c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:44.055093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d8ca06f8d2469382275fd2e36c538c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:44.059304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:44.114848 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1674/3348] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:43 2022] POST /identity/v3/projects => generated 375 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:44.117024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:44.120787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:44.167399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:44.184972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d8ca06f8d2469382275fd2e36c538c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:44.205480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:44.228318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d8ca06f8d2469382275fd2e36c538c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:44.229877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d8ca06f8d2469382275fd2e36c538c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:44.250791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d8ca06f8d2469382275fd2e36c538c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:44.253346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d8ca06f8d2469382275fd2e36c538c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:44.283526 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1675/3349] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:43 2022] DELETE /identity/v3/users/f1d8ca06f8d2469382275fd2e36c538c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:44.284468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:44.287165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:44.292088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca0f1-b66a-49b9-8530-77898e32798e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:44.437441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:44.439248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:44.441264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:44.443774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:44.452960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:44.467994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553264-068c-4b57-bcbe-c1d3dbd335a6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:44.480240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:44.481782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:44.481782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:44.481782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:44.483811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:44.485460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:44.486823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:44.494802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:44.511679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1675/3350] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:44.581116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:44.587877 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1676/3351] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:44 2022] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:44.601034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf104c-f78d-4931-829e-e6a93eb9fa9e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:44.616101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:44.619695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:44.620247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:44.622388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:44.623551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:44.628454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:44.667155 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1676/3352] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:47:44.669455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:44.709630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecf91e-6bb4-486b-9e20-3514625671e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:44.730854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:44.732450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:44.740279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:44.740946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] PATH_INFO: `/v3/projects/c954b5add82d484393972d3762652312/users/f2cdc02847a74ce6adf37f360f247ade/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:44.803693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c954b5add82d484393972d3762652312, user_id=f2cdc02847a74ce6adf37f360f247ade, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:44.814183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:44.868185 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1677/3353] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:44 2022] PUT /identity/v3/projects/c954b5add82d484393972d3762652312/users/f2cdc02847a74ce6adf37f360f247ade/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:44.874319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:44.890484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2adcc5-12fb-4716-887d-3f2322e62ef5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:45.045893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddbc4f-fe67-4712-971b-c5ddd907639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:45.046625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbc4f-fe67-4712-971b-c5ddd907639c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:45.046913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbc4f-fe67-4712-971b-c5ddd907639c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:45.047195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbc4f-fe67-4712-971b-c5ddd907639c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:45.048501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddbc4f-fe67-4712-971b-c5ddd907639c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:45.050470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddbc4f-fe67-4712-971b-c5ddd907639c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:45.066040 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1677/3354] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:45.070896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:45.093319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874a6f4-c20c-4c36-aaf8-d1e845bdd763 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:45.100900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:45.101934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:45.102227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:45.102508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] PATH_INFO: `/v3/projects/c954b5add82d484393972d3762652312/users/f2cdc02847a74ce6adf37f360f247ade/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:45.106105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c954b5add82d484393972d3762652312, user_id=f2cdc02847a74ce6adf37f360f247ade, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:45.109785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:45.146109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1678/3355] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:45 2022] PUT /identity/v3/projects/c954b5add82d484393972d3762652312/users/f2cdc02847a74ce6adf37f360f247ade/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:47:45.148977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee100-c670-4194-8016-6f2266d4fe88 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:45.149656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee100-c670-4194-8016-6f2266d4fe88 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:45.149931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee100-c670-4194-8016-6f2266d4fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:45.204713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-14eee100-c670-4194-8016-6f2266d4fe88 None None] MFA Rules not processed for user `f2cdc02847a74ce6adf37f360f247ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:45.206174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-14eee100-c670-4194-8016-6f2266d4fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:45.237147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:45.245289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:45.333641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:45.418473 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1678/3356] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:45.427889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f211a-15a5-4bd3-ae0e-b866e6e31852 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:45.428410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f211a-15a5-4bd3-ae0e-b866e6e31852 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:45.430418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f211a-15a5-4bd3-ae0e-b866e6e31852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:45.451086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675ce7-26bd-4054-90db-502d16479203 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:45.472888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:45.492113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:45.492113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:45.492113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] PATH_INFO: `/v3/projects/a22f9857a34e48f7bc5d2bd97ef02b14` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:45.492113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22f9857a34e48f7bc5d2bd97ef02b14)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:45.492113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:45.492911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-270f211a-15a5-4bd3-ae0e-b866e6e31852 None None] MFA Rules not processed for user `a185fa24374c417aa2bb9302a608cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:45.494079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-270f211a-15a5-4bd3-ae0e-b866e6e31852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:45.605645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:45.691601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'request_id': 'req-9772429a-600b-49bf-b3b6-d2a54b40cd83'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:45.713737 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1679/3357] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:47:45.714744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'request_id': 'req-9772429a-600b-49bf-b3b6-d2a54b40cd83'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:45.725956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'request_id': 'req-9772429a-600b-49bf-b3b6-d2a54b40cd83'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:45.754760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] The token cache is being invalidate because project a22f9857a34e48f7bc5d2bd97ef02b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:45.756519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:45.758939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9772429a-600b-49bf-b3b6-d2a54b40cd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:45.762681 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1679/3358] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:45 2022] DELETE /identity/v3/projects/a22f9857a34e48f7bc5d2bd97ef02b14 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:47:45.769187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec762d-f6f1-49ea-b629-afc1f2b61f77 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:45.769494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec762d-f6f1-49ea-b629-afc1f2b61f77 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:45.770740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec762d-f6f1-49ea-b629-afc1f2b61f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:45.806253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-77ec762d-f6f1-49ea-b629-afc1f2b61f77 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:45.807658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-77ec762d-f6f1-49ea-b629-afc1f2b61f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:45.969120 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1680/3359] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:45.999000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40c2e-a77d-46f2-b75d-6ac4d4b984ba None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:45.999000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40c2e-a77d-46f2-b75d-6ac4d4b984ba None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:45.999000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40c2e-a77d-46f2-b75d-6ac4d4b984ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.036458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-68d40c2e-a77d-46f2-b75d-6ac4d4b984ba None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:46.038332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-68d40c2e-a77d-46f2-b75d-6ac4d4b984ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:46.061493 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1680/3360] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:46.064048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec762d-f6f1-49ea-b629-afc1f2b61f77 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:46.081744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec762d-f6f1-49ea-b629-afc1f2b61f77 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:46.100707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:46.101433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:46.101730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:46.102024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.102832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:47:46.103150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:46.104920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:46.169348 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1681/3361] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:47:46.171153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40c2e-a77d-46f2-b75d-6ac4d4b984ba None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:46.184597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40c2e-a77d-46f2-b75d-6ac4d4b984ba None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:46.200113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:46.200113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:46.200572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:46.200707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.201412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:46.203485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:46.315472 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1681/3362] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:46 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:47:46.320083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:46.340170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2642cfc-8638-4d82-b8e2-c7ea7aba7ded admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:46.475264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:46.476627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:46.476627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:46.476627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.477382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:46.479577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:46.552265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:46.554178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:46.580915 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1682/3363] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:46 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:46.586031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:46.605620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:46.610298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28747-1fe5-4da9-9487-5343e1d6acbd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:46.634380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:46.635317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:46.635744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:46.636220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.639557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:46.641542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:46.672499 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1683/3364] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:46.675149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:46.716980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004472-e9a9-4c90-a4de-ed5a66dda2b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:46.742929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:46.743640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:46.743942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:46.744233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.750239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:46.752043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:46.790625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4c444-bf79-444f-82b9-06f6d4f9f44a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:46.806018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:46.810782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:46.811334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:46.811847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.822232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:46.822759 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1684/3365] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:46.825790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:46.877560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e009b7e-7dbd-4839-bfb7-a00d418f322e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:46.900840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5117ad2-1435-4fd3-8c6a-ec36f66441a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:46.907943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5117ad2-1435-4fd3-8c6a-ec36f66441a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:46.909865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5117ad2-1435-4fd3-8c6a-ec36f66441a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:46.910355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5117ad2-1435-4fd3-8c6a-ec36f66441a4 admin admin] PATH_INFO: `/v3/projects/178a39e9442c477f854e36b742e7c359/users/897290f2f03d4ac7ad58d50c44a17fb3/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:46.969316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5117ad2-1435-4fd3-8c6a-ec36f66441a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178a39e9442c477f854e36b742e7c359, user_id=897290f2f03d4ac7ad58d50c44a17fb3, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:46.978467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5117ad2-1435-4fd3-8c6a-ec36f66441a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:47.016006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1685/3366] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:46 2022] PUT /identity/v3/projects/178a39e9442c477f854e36b742e7c359/users/897290f2f03d4ac7ad58d50c44a17fb3/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:47.022015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:47.022469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:47.022945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:47.053918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:47.055781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:47.152537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:47.155239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:47.181483 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1686/3367] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:47.184914 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1682/3368] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:47:47.444419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:47.446039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:47.542920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5611d-02c6-4a30-9b00-1e00e27d38a6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:47.548509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:47.549628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:47.550137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:47.551611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:47.570451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:47.574034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:47.598553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1687/3369] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:47.659424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:47.661576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:47.688267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68eaab-cf61-4f4d-a08f-a8e22f11da17 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:47.703314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:47.705684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:47.705684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:47.705684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] PATH_INFO: `/v3/users/c2e85acbfcdc4b3a813830d6723b006f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:47.715089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e85acbfcdc4b3a813830d6723b006f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:47.717155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:47.758307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:47.835920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e85acbfcdc4b3a813830d6723b006f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:47.869596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e85acbfcdc4b3a813830d6723b006f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:47.870666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e85acbfcdc4b3a813830d6723b006f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:47.888727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e85acbfcdc4b3a813830d6723b006f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:47.889790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5fa0b65-59d8-4f95-85db-33f43718c8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e85acbfcdc4b3a813830d6723b006f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:47.922620 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1683/3370] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:47 2022] DELETE /identity/v3/users/c2e85acbfcdc4b3a813830d6723b006f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:49.734161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:49.779835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab80ac-01e1-4c6e-8a5c-45ba89a33824 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:50.006180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:50.009695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:50.010018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:50.011314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] PATH_INFO: `/v3/projects/33d5773713f8495c9018a5aaed6fd744` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:50.018282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d5773713f8495c9018a5aaed6fd744)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:50.025724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:50.031568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:50.165601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d5773713f8495c9018a5aaed6fd744', 'request_id': 'req-2faf888b-b0b3-4119-9f10-4506972bf121'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:50.204106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d5773713f8495c9018a5aaed6fd744', 'request_id': 'req-2faf888b-b0b3-4119-9f10-4506972bf121'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:50.232157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d5773713f8495c9018a5aaed6fd744', 'request_id': 'req-2faf888b-b0b3-4119-9f10-4506972bf121'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:50.279491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] The token cache is being invalidate because project 33d5773713f8495c9018a5aaed6fd744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:47:50.279491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:50.279491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:50.279491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1688/3371] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:49 2022] DELETE /identity/v3/projects/33d5773713f8495c9018a5aaed6fd744 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:50.280817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed7672-0afc-4ba9-ae07-d4237532b0a6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:50.281963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed7672-0afc-4ba9-ae07-d4237532b0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:50.283153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed7672-0afc-4ba9-ae07-d4237532b0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:50.287515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:50.289694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:50.323976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bbed7672-0afc-4ba9-ae07-d4237532b0a6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:50.326644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bbed7672-0afc-4ba9-ae07-d4237532b0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:50.456998 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1684/3372] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:50.467287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f657-0efa-4a28-bd5f-c3950ff2c534 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:50.468294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f657-0efa-4a28-bd5f-c3950ff2c534 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:50.475353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f657-0efa-4a28-bd5f-c3950ff2c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:50.558030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1905f657-0efa-4a28-bd5f-c3950ff2c534 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:50.563348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1905f657-0efa-4a28-bd5f-c3950ff2c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:50.607763 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1685/3373] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:50.609045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905f657-0efa-4a28-bd5f-c3950ff2c534 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:50.624126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf888b-b0b3-4119-9f10-4506972bf121 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:50.646374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:50.647426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:50.647718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:50.647999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:50.648235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905f657-0efa-4a28-bd5f-c3950ff2c534 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:50.658665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:50.668720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:50.669628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:50.671227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:50.672597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:50.675314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:47:50.679623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:50.689591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:50.754640 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1686/3374] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:47:50.761420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:50.797455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7477-2630-4d52-b8e5-da1b5d4c4055 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:50.831171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:50.832403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:50.832403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:50.832744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:50.833799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:50.838696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:50.926736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:50.929254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:50.957075 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1687/3375] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:47:50 2022] POST /identity/v3/projects => generated 391 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:50.963001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:50.979752 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1689/3376] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:47:51.162874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:51.194609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792d0b1-658a-4d0d-b226-a67eb558c12b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:51.215399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:51.216344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:51.216797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:51.217224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:51.218310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:51.220614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:51.277033 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1688/3377] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:47:50 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:47:51.282438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:51.309347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5d40d-c342-40ef-b25b-c699f81108f7 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:51.319671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:51.320298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:51.320582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:51.320863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:51.321634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:51.323391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:51.353693 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1690/3378] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:51.357480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:51.378370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7ced7-98fa-47c3-8ddb-0991b8d2b228 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:51.391998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ffbe2-2c09-4aa3-8f88-2d333b7427c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:51.392984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ffbe2-2c09-4aa3-8f88-2d333b7427c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:51.393481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ffbe2-2c09-4aa3-8f88-2d333b7427c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:51.393913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ffbe2-2c09-4aa3-8f88-2d333b7427c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:51.394934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ffbe2-2c09-4aa3-8f88-2d333b7427c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:51.399439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ffbe2-2c09-4aa3-8f88-2d333b7427c0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:51.430635 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1689/3379] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:47:51.434684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:51.455704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6557-92d3-4e0b-abe8-c8ebc0070e63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:51.472431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:51.473623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:51.473992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:51.474772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] PATH_INFO: `/v3/projects/993c6d6a2aa347838950e9b67df54008/users/029da70c73ee487db039f4dafc0d2948/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:51.514122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:51.528696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=993c6d6a2aa347838950e9b67df54008, user_id=029da70c73ee487db039f4dafc0d2948, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:51.535243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:51.573746 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1691/3380] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:47:51 2022] PUT /identity/v3/projects/993c6d6a2aa347838950e9b67df54008/users/029da70c73ee487db039f4dafc0d2948/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:51.578930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:51.579260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:51.579549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:51.620996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:51.622322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:51.829395 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1690/3381] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:51.896683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:51.899443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:52.092757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939029-70d5-4427-97ca-896aa7747d17 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:52.110337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a7a01-ee55-443e-9050-dec3ba99a96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:52.111029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7a01-ee55-443e-9050-dec3ba99a96d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:52.111622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7a01-ee55-443e-9050-dec3ba99a96d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:52.112144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7a01-ee55-443e-9050-dec3ba99a96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:52.134197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a7a01-ee55-443e-9050-dec3ba99a96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:52.135769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a7a01-ee55-443e-9050-dec3ba99a96d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:52.180529 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1692/3382] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:47:57.806431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:57.809049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:57.878456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331b06-3c01-413f-808e-c69bcc179462 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:57.918198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:57.922702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:57.923151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:57.923569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] PATH_INFO: `/v3/users/6d8f172412334ae48bc109a50ee084fd` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:57.927311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8f172412334ae48bc109a50ee084fd)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:57.931575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:58.115547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8f172412334ae48bc109a50ee084fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:58.155630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8f172412334ae48bc109a50ee084fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:58.156416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8f172412334ae48bc109a50ee084fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:58.173904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8f172412334ae48bc109a50ee084fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:58.178727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8f172412334ae48bc109a50ee084fd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:47:58.232434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1691/3383] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:47:57 2022] DELETE /identity/v3/users/6d8f172412334ae48bc109a50ee084fd => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:47:58.237393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:58.237953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:58.237953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:58.296258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:47:58.297546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:58.555992 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1693/3384] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:47:58.764801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:58.767036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:58.922178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:58.962858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1468c-725f-4389-92f4-06535e140269 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:58.973985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb07d7-9591-4f83-b36a-6ef5ab5a02d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:58.974865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb07d7-9591-4f83-b36a-6ef5ab5a02d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:58.975161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb07d7-9591-4f83-b36a-6ef5ab5a02d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:58.975485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb07d7-9591-4f83-b36a-6ef5ab5a02d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:59.016968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb07d7-9591-4f83-b36a-6ef5ab5a02d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:59.024851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb07d7-9591-4f83-b36a-6ef5ab5a02d2 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:59.054017 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1692/3385] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:00.643954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:00.645644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:00.679419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e3637-d83f-4b2e-9f87-6ecf03ce829f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:00.698326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:00.700224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:00.700941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:00.701536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] PATH_INFO: `/v3/projects/8367f06d1b2b4cd4a95a8bcbd5036287` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:00.711665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8367f06d1b2b4cd4a95a8bcbd5036287)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:00.718121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:00.885593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8367f06d1b2b4cd4a95a8bcbd5036287', 'request_id': 'req-63604e85-341d-4e1f-8dda-01c7b7db3e6f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:00.908247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8367f06d1b2b4cd4a95a8bcbd5036287', 'request_id': 'req-63604e85-341d-4e1f-8dda-01c7b7db3e6f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:00.920603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8367f06d1b2b4cd4a95a8bcbd5036287', 'request_id': 'req-63604e85-341d-4e1f-8dda-01c7b7db3e6f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:00.947624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] The token cache is being invalidate because project 8367f06d1b2b4cd4a95a8bcbd5036287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:48:00.948498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:00.949805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63604e85-341d-4e1f-8dda-01c7b7db3e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:00.952015 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1694/3386] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:00 2022] DELETE /identity/v3/projects/8367f06d1b2b4cd4a95a8bcbd5036287 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:00.959807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e151ca-7733-449e-9fd1-8cb4db065370 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:00.960988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e151ca-7733-449e-9fd1-8cb4db065370 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:00.961483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e151ca-7733-449e-9fd1-8cb4db065370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:01.002558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f9e151ca-7733-449e-9fd1-8cb4db065370 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:01.005108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f9e151ca-7733-449e-9fd1-8cb4db065370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:01.110787 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1693/3387] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:01.124941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62786f92-dd12-484b-83e3-988a073999fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:01.126003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62786f92-dd12-484b-83e3-988a073999fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:01.126545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62786f92-dd12-484b-83e3-988a073999fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:01.195249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-62786f92-dd12-484b-83e3-988a073999fe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:01.209208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62786f92-dd12-484b-83e3-988a073999fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:01.235196 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1695/3388] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:01.240071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e151ca-7733-449e-9fd1-8cb4db065370 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:01.262773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e151ca-7733-449e-9fd1-8cb4db065370 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:01.299605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:01.300918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:01.313446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:01.317788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:01.325206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:48:01.330147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:01.338694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:01.372737 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1694/3389] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:48:01.386426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62786f92-dd12-484b-83e3-988a073999fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:01.423166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62786f92-dd12-484b-83e3-988a073999fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:01.438659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:01.440592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:01.441273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:01.441844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:01.443717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:01.478307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:01.511041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:01.584605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:01.591841 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1696/3390] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:48:01 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:48:01.654254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742d6f9-5178-4d8a-b68a-38f262730955 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:01.852703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:01.853813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:01.854059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:01.854617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:01.855553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:01.857761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:01.890333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1695/3391] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:48:01 2022] POST /identity/v3/users => generated 286 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:48:01.891769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:01.913224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba246aa-5c6a-4905-8821-e97f3afd9a62 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:01.922533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:01.923782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:01.924288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:01.925053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:01.926190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:01.933058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:01.959635 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1697/3392] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:01.961076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:01.973306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02eeb-ebab-49fa-9bb0-d97fb197d6bd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:01.980242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c5452-ade0-4d97-a4e2-3a6823920e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:01.981215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5452-ade0-4d97-a4e2-3a6823920e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:01.981912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5452-ade0-4d97-a4e2-3a6823920e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:01.982356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5452-ade0-4d97-a4e2-3a6823920e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:01.983317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c5452-ade0-4d97-a4e2-3a6823920e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:01.985692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c5452-ade0-4d97-a4e2-3a6823920e81 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:01.999739 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1696/3393] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:02.003443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:02.018971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885edc-6a03-4eff-b007-b23b8e4d881e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:02.026749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb267e3-591b-40f2-923c-7ff854237c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:02.028148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb267e3-591b-40f2-923c-7ff854237c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:02.028678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb267e3-591b-40f2-923c-7ff854237c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:02.029171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb267e3-591b-40f2-923c-7ff854237c94 admin admin] PATH_INFO: `/v3/projects/a0ebe694f2e34ee1a34caa32aba4d755/users/9a5792393e3f4517a52b4e84d5790ec8/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:02.051133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb267e3-591b-40f2-923c-7ff854237c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ebe694f2e34ee1a34caa32aba4d755, user_id=9a5792393e3f4517a52b4e84d5790ec8, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:02.054594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb267e3-591b-40f2-923c-7ff854237c94 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:02.089010 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1698/3394] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:48:02 2022] PUT /identity/v3/projects/a0ebe694f2e34ee1a34caa32aba4d755/users/9a5792393e3f4517a52b4e84d5790ec8/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:48:02.098146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:02.099250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:02.099726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:02.137693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] MFA Rules not processed for user `9a5792393e3f4517a52b4e84d5790ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:02.139589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:02.204357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:02.238008 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1697/3395] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:02.250928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:02.251253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:02.251565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:02.277711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] MFA Rules not processed for user `9a5792393e3f4517a52b4e84d5790ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:02.279025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:02.295069 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1699/3396] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:02.304725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:02.306545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:02.421094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f62da-e227-4096-949f-c2aa109905bf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:02.429507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8badf8-8288-406e-b835-cc544d3631e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:02.430959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8badf8-8288-406e-b835-cc544d3631e7 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:02.430959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8badf8-8288-406e-b835-cc544d3631e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:02.435828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8badf8-8288-406e-b835-cc544d3631e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:02.465068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8badf8-8288-406e-b835-cc544d3631e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:02.467319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8badf8-8288-406e-b835-cc544d3631e7 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:02.502009 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1698/3397] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:03.175697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:03.178443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:03.397193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904086c5-b52b-4f9c-ab81-e697ff76208b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:03.408454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:03.409552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:03.409957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:03.410321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] PATH_INFO: `/v3/users/ba43227f00d04dccac9ebe6c38aae925` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:03.413555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba43227f00d04dccac9ebe6c38aae925)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:03.423703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:03.584674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba43227f00d04dccac9ebe6c38aae925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:03.648801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba43227f00d04dccac9ebe6c38aae925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:03.664648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba43227f00d04dccac9ebe6c38aae925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:03.667196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba43227f00d04dccac9ebe6c38aae925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:03.687603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852858b-170c-44d6-932e-fb27ba50a298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba43227f00d04dccac9ebe6c38aae925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:03.704682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1700/3398] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:48:03 2022] DELETE /identity/v3/users/ba43227f00d04dccac9ebe6c38aae925 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:03.711881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:03.713223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:03.714087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:03.747090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:03.747709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:03.747709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:03.774877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:03.777664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:03.790277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:03.798290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:03.853886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:03.949171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1699/3399] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:03.959089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:03.964924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:04.014153 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1701/3400] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:04.060387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:04.061998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:04.147839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432b20f-ee29-466e-8988-8c7e483a3596 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:04.151872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:04.152559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:04.152843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:04.153168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:04.167205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:04.168683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:04.182864 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1700/3401] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:04.339915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc020-0823-4e80-b315-619ed7fef778 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:04.359649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:04.361042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:04.361512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:04.361980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:04.393984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:04.397564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:04.451706 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1702/3402] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:48:04.577433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:04.581243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:04.657329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:04.820147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:04.822122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:04.846421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664bf22-a8f7-4fa8-832f-359734ab44b3 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:04.854776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:04.855640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:04.856001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:04.856502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:04.862398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6484ffd-9491-46ba-bdb0-510920677b8b service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:04.875705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:04.879166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:04.880684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:04.880970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:04.881248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] PATH_INFO: `/v3/projects/294ea301498240ec8101929ae3f9e4e4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:04.884832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294ea301498240ec8101929ae3f9e4e4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:04.889683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:04.896079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:04.898305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:04.935496 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1701/3403] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:05.027628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294ea301498240ec8101929ae3f9e4e4', 'request_id': 'req-42ff29d8-2c2b-482b-8782-a9c4b89a5305'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.045146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294ea301498240ec8101929ae3f9e4e4', 'request_id': 'req-42ff29d8-2c2b-482b-8782-a9c4b89a5305'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.056410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294ea301498240ec8101929ae3f9e4e4', 'request_id': 'req-42ff29d8-2c2b-482b-8782-a9c4b89a5305'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.084732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] The token cache is being invalidate because project 294ea301498240ec8101929ae3f9e4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:48:05.084732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.085714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42ff29d8-2c2b-482b-8782-a9c4b89a5305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.087934 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1703/3404] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:04 2022] DELETE /identity/v3/projects/294ea301498240ec8101929ae3f9e4e4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:48:05.092405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:05.115336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175966a9-1e74-46ad-95f0-7a73aad41176 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:05.322279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:05.324740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:05.324972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:05.325700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] PATH_INFO: `/v3/users/515d6e6ea58145a7a7d8625bd663e78a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:05.328283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=515d6e6ea58145a7a7d8625bd663e78a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:05.334278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:05.479952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515d6e6ea58145a7a7d8625bd663e78a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.501063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515d6e6ea58145a7a7d8625bd663e78a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.501870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515d6e6ea58145a7a7d8625bd663e78a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.514207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515d6e6ea58145a7a7d8625bd663e78a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.515411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515d6e6ea58145a7a7d8625bd663e78a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:05.552217 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1702/3405] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:48:05 2022] DELETE /identity/v3/users/515d6e6ea58145a7a7d8625bd663e78a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:05.734428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523a23-1a88-4afb-9224-0d8609cb6e34 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:05.736051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523a23-1a88-4afb-9224-0d8609cb6e34 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:05.736866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523a23-1a88-4afb-9224-0d8609cb6e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:05.803869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0b523a23-1a88-4afb-9224-0d8609cb6e34 None None] MFA Rules not processed for user `331a222a893c4f84a08abf11333c7449`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:05.806275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b523a23-1a88-4afb-9224-0d8609cb6e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:05.938059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:05.989278 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1704/3406] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:07.175962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:07.180770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:07.219660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:07.285365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a60c-efc0-49f1-b9b5-a7e2b1571ace admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:07.290810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:07.291668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:07.291957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:07.292237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] PATH_INFO: `/v3/projects/a76716a10ce841bb99fe7ddd8925a416` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:07.293635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76716a10ce841bb99fe7ddd8925a416)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:07.296381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:07.416311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76716a10ce841bb99fe7ddd8925a416', 'request_id': 'req-a5b786d2-6a96-4455-8284-c49f431bc45c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:07.433398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76716a10ce841bb99fe7ddd8925a416', 'request_id': 'req-a5b786d2-6a96-4455-8284-c49f431bc45c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:07.443714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76716a10ce841bb99fe7ddd8925a416', 'request_id': 'req-a5b786d2-6a96-4455-8284-c49f431bc45c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:07.463366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] The token cache is being invalidate because project a76716a10ce841bb99fe7ddd8925a416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:48:07.464006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:07.464943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5b786d2-6a96-4455-8284-c49f431bc45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:07.467470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1703/3407] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:07 2022] DELETE /identity/v3/projects/a76716a10ce841bb99fe7ddd8925a416 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:48:07.474679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56f8e-3f01-4d92-a178-3db333296d60 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:07.475226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56f8e-3f01-4d92-a178-3db333296d60 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:07.475722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56f8e-3f01-4d92-a178-3db333296d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:07.529897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0c56f8e-3f01-4d92-a178-3db333296d60 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:07.532582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0c56f8e-3f01-4d92-a178-3db333296d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:07.667795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1705/3408] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:07.678528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e486501-7f3d-403c-8622-b0bc718d0791 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:07.679413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e486501-7f3d-403c-8622-b0bc718d0791 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:07.680169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e486501-7f3d-403c-8622-b0bc718d0791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:07.726196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2e486501-7f3d-403c-8622-b0bc718d0791 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:07.731810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e486501-7f3d-403c-8622-b0bc718d0791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:07.754920 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1704/3409] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:07.760572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56f8e-3f01-4d92-a178-3db333296d60 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:07.782060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56f8e-3f01-4d92-a178-3db333296d60 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:07.793746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:07.795870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:07.796818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:07.797601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:07.799956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:48:07.802847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:07.806869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:07.844849 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1706/3410] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:48:07.850949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e486501-7f3d-403c-8622-b0bc718d0791 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:07.888895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e486501-7f3d-403c-8622-b0bc718d0791 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:07.900165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:07.901291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:07.901787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:07.902534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:07.903810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:07.906158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:07.974807 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1705/3411] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:48:07 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:48:07.976269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:08.003627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeedc1f-fa68-443c-adfb-0485bd58518d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:08.122489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:08.123988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:08.124877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:08.125552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:08.127302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:08.132322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:08.180752 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1707/3412] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:48:07 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:48:08.183198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:08.204812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809360fd-2180-4d49-932f-c237485abdb8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:08.227079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:08.227852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:08.228233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:08.228665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:08.229693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:08.233738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:08.273189 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1706/3413] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:08.278188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:08.294307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7d0f3-05f6-4466-9528-a338818d9d03 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:08.312793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d1101-cbae-48c0-b4de-92e001b368b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:08.313988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d1101-cbae-48c0-b4de-92e001b368b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:08.313988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d1101-cbae-48c0-b4de-92e001b368b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:08.314253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d1101-cbae-48c0-b4de-92e001b368b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:08.315135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d1101-cbae-48c0-b4de-92e001b368b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:08.318401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d1101-cbae-48c0-b4de-92e001b368b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:08.360619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:08.368120 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1708/3414] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:08.385157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a644ff-312e-4c8e-9e51-0211765fc0bf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:08.401240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:08.407440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:08.408361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:08.408834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] PATH_INFO: `/v3/projects/330af37692f14b2a9df6a2c6c36ae686/users/5ffcea0a3e934f14a681ee4501587971/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:08.444600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=330af37692f14b2a9df6a2c6c36ae686, user_id=5ffcea0a3e934f14a681ee4501587971, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:08.448531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:08.487043 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1707/3415] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:48:08 2022] PUT /identity/v3/projects/330af37692f14b2a9df6a2c6c36ae686/users/5ffcea0a3e934f14a681ee4501587971/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:08.499988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:08.500958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:08.501529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:08.553877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] MFA Rules not processed for user `5ffcea0a3e934f14a681ee4501587971`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:08.555362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:08.689639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:08.753586 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1709/3416] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:08.915711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:08.918893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:09.005937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:09.053639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c34f5-7f5f-454c-8273-aedb0459cd6f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:09.065383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:09.067326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:09.067326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:09.067326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:09.080433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:09.082328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:09.095379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1708/3417] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:11.453267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:11.455034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:11.536079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:11.541145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:11.596736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fff458-c473-48b0-aa33-4af644809f5e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:11.627966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:11.629110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:11.631212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:11.631212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:11.636650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:11.688742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:11.697579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:11.722704 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1710/3418] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:48:11.874951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803ea2-d0dc-4c61-b2b0-7d3474addb9b service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:11.905086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:11.908097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:11.909371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:11.909878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:11.973280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:11.986999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:12.034293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1709/3419] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:48:12.157886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:12.184372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372eac-d484-42f6-a9b3-da3b19ba9b1f service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:12.203007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15336b34-adb2-4f3a-bc19-dc500e482393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:12.204282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336b34-adb2-4f3a-bc19-dc500e482393 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:12.204674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336b34-adb2-4f3a-bc19-dc500e482393 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:12.206071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336b34-adb2-4f3a-bc19-dc500e482393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:12.247855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15336b34-adb2-4f3a-bc19-dc500e482393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:12.335160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:12.339791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15336b34-adb2-4f3a-bc19-dc500e482393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:12.341493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15336b34-adb2-4f3a-bc19-dc500e482393 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:12.365609 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1711/3420] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:12.538354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7932-8e01-4693-9cf0-fd6b8a5029c6 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:12.551056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:12.556892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:12.557237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:12.557530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] PATH_INFO: `/v3/users/5ffcea0a3e934f14a681ee4501587971` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:12.562903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffcea0a3e934f14a681ee4501587971)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:12.565634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:12.712184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffcea0a3e934f14a681ee4501587971'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:12.745297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:12.747527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffcea0a3e934f14a681ee4501587971'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:12.748435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffcea0a3e934f14a681ee4501587971'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:12.765049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffcea0a3e934f14a681ee4501587971'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:12.767521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffcea0a3e934f14a681ee4501587971'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:12.840841 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1710/3421] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:48:12 2022] DELETE /identity/v3/users/5ffcea0a3e934f14a681ee4501587971 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:12.846508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c783-ca8d-4e43-a0a9-0f966e11b349 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:12.847879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c783-ca8d-4e43-a0a9-0f966e11b349 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:12.849131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c783-ca8d-4e43-a0a9-0f966e11b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:12.934611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a25c783-ca8d-4e43-a0a9-0f966e11b349 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:12.949987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a25c783-ca8d-4e43-a0a9-0f966e11b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:13.104837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1712/3422] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:13.182938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:13.184804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:13.454065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfdf0-19c3-4457-b3fe-ea44609f6bf1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:13.473939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ff05-f733-4664-b401-51ddcfd08e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:13.473939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ff05-f733-4664-b401-51ddcfd08e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:13.474859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ff05-f733-4664-b401-51ddcfd08e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:13.475310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ff05-f733-4664-b401-51ddcfd08e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:13.496964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664ff05-f733-4664-b401-51ddcfd08e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:13.498503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664ff05-f733-4664-b401-51ddcfd08e0f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:13.535994 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1711/3423] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:14.341409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25c783-ca8d-4e43-a0a9-0f966e11b349 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:14.357235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25c783-ca8d-4e43-a0a9-0f966e11b349 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:14.371030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bff4f3-a561-40ee-86d7-90da6491a024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:14.371879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bff4f3-a561-40ee-86d7-90da6491a024 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:14.372248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bff4f3-a561-40ee-86d7-90da6491a024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:14.372644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bff4f3-a561-40ee-86d7-90da6491a024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:14.377585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9bff4f3-a561-40ee-86d7-90da6491a024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:14.404747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:14.419501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bff4f3-a561-40ee-86d7-90da6491a024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:14.431113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bff4f3-a561-40ee-86d7-90da6491a024 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:14.454327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1713/3424] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:14.925625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5edc3-d7fb-461d-89ff-b33210d197ba None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:14.926957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5edc3-d7fb-461d-89ff-b33210d197ba None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:14.926957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5edc3-d7fb-461d-89ff-b33210d197ba None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:14.929102 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1712/3425] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:48:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:48:14.938018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84836588-0141-4d38-a30c-4c038d993593 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:14.938332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84836588-0141-4d38-a30c-4c038d993593 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:14.938606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84836588-0141-4d38-a30c-4c038d993593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:14.972469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-84836588-0141-4d38-a30c-4c038d993593 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:14.974372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84836588-0141-4d38-a30c-4c038d993593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:15.180750 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1714/3426] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:15.208372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5edc3-d7fb-461d-89ff-b33210d197ba None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:15.210420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27b5edc3-d7fb-461d-89ff-b33210d197ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:15.258580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5edc3-d7fb-461d-89ff-b33210d197ba None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:15.264873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:15.266002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:15.267286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:15.267783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:15.295684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:15.299320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:15.332297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1713/3427] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:16.138189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84836588-0141-4d38-a30c-4c038d993593 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:16.143060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84836588-0141-4d38-a30c-4c038d993593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:16.209982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84836588-0141-4d38-a30c-4c038d993593 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:16.226765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a581dda-f248-4ce9-9eda-6692bac73858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:16.227786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581dda-f248-4ce9-9eda-6692bac73858 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:16.228257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581dda-f248-4ce9-9eda-6692bac73858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:16.229894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581dda-f248-4ce9-9eda-6692bac73858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:16.236836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a581dda-f248-4ce9-9eda-6692bac73858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:16.290859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a581dda-f248-4ce9-9eda-6692bac73858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:16.293080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a581dda-f248-4ce9-9eda-6692bac73858 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:16.352908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1715/3428] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:16.400204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:16.403427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:16.438882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e397-45c6-4dbe-abcf-0dcce62f8cc7 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:16.450116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:16.451097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:16.451424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:16.451670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] PATH_INFO: `/v3/projects/330af37692f14b2a9df6a2c6c36ae686` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:16.460346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330af37692f14b2a9df6a2c6c36ae686)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:16.462948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:16.653058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330af37692f14b2a9df6a2c6c36ae686', 'request_id': 'req-75aae31b-01ae-4570-8f7f-a39969ba8a73'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:16.681328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330af37692f14b2a9df6a2c6c36ae686', 'request_id': 'req-75aae31b-01ae-4570-8f7f-a39969ba8a73'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:16.692358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330af37692f14b2a9df6a2c6c36ae686', 'request_id': 'req-75aae31b-01ae-4570-8f7f-a39969ba8a73'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:16.724453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] The token cache is being invalidate because project 330af37692f14b2a9df6a2c6c36ae686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:48:16.724802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:16.727832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75aae31b-01ae-4570-8f7f-a39969ba8a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:16.736116 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1714/3429] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:16 2022] DELETE /identity/v3/projects/330af37692f14b2a9df6a2c6c36ae686 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:16.743893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd1b5-7aa7-47ec-a419-380e1c5c398b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:16.744388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd1b5-7aa7-47ec-a419-380e1c5c398b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:16.744883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd1b5-7aa7-47ec-a419-380e1c5c398b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:16.863038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f2bd1b5-7aa7-47ec-a419-380e1c5c398b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:16.865960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f2bd1b5-7aa7-47ec-a419-380e1c5c398b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:16.932660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd121fd-6b95-4fb7-ae4f-c11cac4ccb1a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:16.932989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd121fd-6b95-4fb7-ae4f-c11cac4ccb1a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:16.933236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd121fd-6b95-4fb7-ae4f-c11cac4ccb1a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:16.935573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1715/3430] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:48:16.961945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:16.962472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:16.962923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.005055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:17.008684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:17.101686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1716/3431] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:17.109535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f093-b297-4e44-812a-390df1bb4f73 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.109816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f093-b297-4e44-812a-390df1bb4f73 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.110090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f093-b297-4e44-812a-390df1bb4f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.156658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a275f093-b297-4e44-812a-390df1bb4f73 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:17.157563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:17.161396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a275f093-b297-4e44-812a-390df1bb4f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:17.185267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1717/3432] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:17.194193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f093-b297-4e44-812a-390df1bb4f73 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:17.213446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f093-b297-4e44-812a-390df1bb4f73 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:17.230006 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1716/3433] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:17.239059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:17.247626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.248334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.248962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.251253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:48:17.252412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:17.254936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:17.281952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:17.284354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:17.290127 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1718/3434] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:48:17.296758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:17.308783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e7ae-b6aa-4e7e-8cbf-2982952513c8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:17.313211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d9be-5cf8-4227-ba9f-9bd60728a81f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:17.319871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:17.320987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.321899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.322407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.323392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:17.328562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:17.329273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.329563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.329855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.333346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:17.361283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:17.374820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:17.398875 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1717/3435] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:48:17.406792 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1719/3436] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:48:17 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:48:17.414880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:17.438720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afee07-70d1-45bb-ba57-4ee8dab69afa service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:17.579311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:17.581177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.584005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.584935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.586574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:17.590805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:17.664906 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1718/3437] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:48:17 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:48:17.670901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:17.693566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af5eb-a19d-49e7-8220-4454e0218cb0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:17.715494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:17.716792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.717247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.717693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.720886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:17.722940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:17.756516 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1720/3438] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:48:17.759806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:17.780242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fbde5-13b9-46b9-b91b-a27bc4ae35b8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:17.807564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a4d6-7a2b-4bbc-9354-85fcc7003a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:17.811809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a4d6-7a2b-4bbc-9354-85fcc7003a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.818883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a4d6-7a2b-4bbc-9354-85fcc7003a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.822765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a4d6-7a2b-4bbc-9354-85fcc7003a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.828082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a4d6-7a2b-4bbc-9354-85fcc7003a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:17.842622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a4d6-7a2b-4bbc-9354-85fcc7003a70 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:17.911133 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1719/3439] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:17.916818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:17.941091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe3e00-e101-4f99-9900-edce2c54bb70 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:17.955377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937c280-805c-4453-9278-b67472648db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:17.956530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937c280-805c-4453-9278-b67472648db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.956819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937c280-805c-4453-9278-b67472648db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.957092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937c280-805c-4453-9278-b67472648db6 admin admin] PATH_INFO: `/v3/projects/5ffc690dc81847199f7339b22ab61dea/users/0dc1c56423ac4676b94f4e086338a712/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:17.993640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7705e5c-0e58-45be-9591-72f8bae310e4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:17.994153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7705e5c-0e58-45be-9591-72f8bae310e4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:17.995258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7705e5c-0e58-45be-9591-72f8bae310e4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:18.001360 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1720/3440] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:48:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:48:18.002071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937c280-805c-4453-9278-b67472648db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc690dc81847199f7339b22ab61dea, user_id=0dc1c56423ac4676b94f4e086338a712, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:18.007829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937c280-805c-4453-9278-b67472648db6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:18.012258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be616c-11e8-44b2-8a22-221f283516df None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:18.012898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be616c-11e8-44b2-8a22-221f283516df None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:18.013573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be616c-11e8-44b2-8a22-221f283516df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:18.037561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:18.044187 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1721/3441] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:48:17 2022] PUT /identity/v3/projects/5ffc690dc81847199f7339b22ab61dea/users/0dc1c56423ac4676b94f4e086338a712/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:18.052266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:18.052591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:18.053028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:18.092698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:18.094129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:18.107697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-90be616c-11e8-44b2-8a22-221f283516df None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:18.107697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90be616c-11e8-44b2-8a22-221f283516df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:18.215094 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1721/3442] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:18.253769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be616c-11e8-44b2-8a22-221f283516df None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:18.257932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90be616c-11e8-44b2-8a22-221f283516df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:18.259741 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1722/3443] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:18.283959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:18.285969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:18.381182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:18.460227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e93ce-4853-4ef6-86ed-cc33581b6521 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:18.466654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be616c-11e8-44b2-8a22-221f283516df None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:18.472036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:18.472573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:18.473447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:18.475680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:18.476512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330a823-997b-45b5-bc9d-d9b390c13f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:18.478155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330a823-997b-45b5-bc9d-d9b390c13f8f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:18.479114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330a823-997b-45b5-bc9d-d9b390c13f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:18.480694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330a823-997b-45b5-bc9d-d9b390c13f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:18.499119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:18.501185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:18.510188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330a823-997b-45b5-bc9d-d9b390c13f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:18.512032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330a823-997b-45b5-bc9d-d9b390c13f8f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:18.537030 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1723/3444] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:48:18.546994 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1722/3445] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:20.205443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:20.206852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:20.222828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07aae-530a-4d5f-866b-329c3ebd60dd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:20.235324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:20.236563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:20.237166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:20.237597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] PATH_INFO: `/v3/users/2020ca323f8947adb35690d56979724d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:20.248756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2020ca323f8947adb35690d56979724d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:20.251628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:20.252619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:20.253078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:20.288151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:20.350410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] MFA Rules not processed for user `897290f2f03d4ac7ad58d50c44a17fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:20.352029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:20.413696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2020ca323f8947adb35690d56979724d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:20.444749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2020ca323f8947adb35690d56979724d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:20.461669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2020ca323f8947adb35690d56979724d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:20.463478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2020ca323f8947adb35690d56979724d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:20.484402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-454a9275-39b6-4e8f-ab9e-51a5ecef84d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2020ca323f8947adb35690d56979724d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:20.501635 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1724/3446] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:48:20 2022] DELETE /identity/v3/users/2020ca323f8947adb35690d56979724d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:20.527930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1723/3447] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:20.539165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:20.539850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:20.540398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:20.563763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] MFA Rules not processed for user `897290f2f03d4ac7ad58d50c44a17fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:20.566121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:20.580274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:20.742468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:20.744766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:20.752253 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1725/3448] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:20.785242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dea09f-e9d1-4d89-a01c-d194cd380319 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:21.008485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:21.009547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:21.010064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:21.010877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:21.032734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:21.037954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:21.081753 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1724/3449] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:21.560477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:21.562801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:21.781182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:21.785219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:21.808656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6718e6-11a5-4017-b675-cf30eda7a045 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:21.817042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:21.820234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:21.821094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:21.821894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] PATH_INFO: `/v3/projects/93c4325b23c544eab268df27d8f485af` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:21.825263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c4325b23c544eab268df27d8f485af)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:21.829942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:21.925468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf98807-31ee-4d47-8e0c-811e7b474931 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:21.955714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:21.958459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c4325b23c544eab268df27d8f485af', 'request_id': 'req-befbf27b-b0ae-4578-b8ba-6bb3cad549af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:21.976735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c4325b23c544eab268df27d8f485af', 'request_id': 'req-befbf27b-b0ae-4578-b8ba-6bb3cad549af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:21.996512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c4325b23c544eab268df27d8f485af', 'request_id': 'req-befbf27b-b0ae-4578-b8ba-6bb3cad549af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.044998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] The token cache is being invalidate because project 93c4325b23c544eab268df27d8f485af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:48:22.045652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.048373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.057257 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1726/3450] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:21 2022] DELETE /identity/v3/projects/93c4325b23c544eab268df27d8f485af => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:22.059056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:22.062267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:22.089182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab9b5b-19cb-49b9-9da3-8f7688787720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:22.092712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9b5b-19cb-49b9-9da3-8f7688787720 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:22.093289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9b5b-19cb-49b9-9da3-8f7688787720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:22.093856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9b5b-19cb-49b9-9da3-8f7688787720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:22.098514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42ab9b5b-19cb-49b9-9da3-8f7688787720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:22.136455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab9b5b-19cb-49b9-9da3-8f7688787720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:22.138582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab9b5b-19cb-49b9-9da3-8f7688787720 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:22.185971 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1725/3451] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:22.262155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:22.290638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbf27b-b0ae-4578-b8ba-6bb3cad549af admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:22.312091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:22.313716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:22.314215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:22.314679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] PATH_INFO: `/v3/users/ff56711cd7b345788044ca9266a53ae0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:22.318824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff56711cd7b345788044ca9266a53ae0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:22.322511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:22.476698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f69ad-7a29-42c1-a2ec-0a917f92f09f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:22.477400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f69ad-7a29-42c1-a2ec-0a917f92f09f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:22.478640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f69ad-7a29-42c1-a2ec-0a917f92f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:22.510538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff56711cd7b345788044ca9266a53ae0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.568556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff56711cd7b345788044ca9266a53ae0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.604831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff56711cd7b345788044ca9266a53ae0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.606995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff56711cd7b345788044ca9266a53ae0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.610472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-538f69ad-7a29-42c1-a2ec-0a917f92f09f None None] MFA Rules not processed for user `029da70c73ee487db039f4dafc0d2948`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:22.633659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-538f69ad-7a29-42c1-a2ec-0a917f92f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:22.657138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecc37f8-64f9-45ca-9a22-ff9df2be3436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff56711cd7b345788044ca9266a53ae0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:22.676405 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1727/3452] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:48:22 2022] DELETE /identity/v3/users/ff56711cd7b345788044ca9266a53ae0 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:23.037987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1726/3453] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:23.048341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:23.048771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:23.048925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:23.085715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] MFA Rules not processed for user `029da70c73ee487db039f4dafc0d2948`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:23.088212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:23.350636 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1728/3454] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:23.828092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:23.828869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:23.829309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:23.881009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:23.883662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:23.890728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:23.896462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:24.077982 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1727/3455] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:24.096823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:24.099420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:24.216019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0086b5a-15cf-4f53-918e-3c030ded888e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:24.257771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:24.259426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:24.260203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:24.260930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:24.295871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:24.299089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:24.320101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:24.321807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:24.355680 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1729/3456] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:24.403119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d628af-d5ea-44f2-bfe7-109d6991bdfb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:24.405160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:24.407574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:24.408801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e1f3f-d9ab-4d9e-9ee1-1d87ba198248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:24.409496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1f3f-d9ab-4d9e-9ee1-1d87ba198248 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:24.410301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1f3f-d9ab-4d9e-9ee1-1d87ba198248 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:24.410301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1f3f-d9ab-4d9e-9ee1-1d87ba198248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:24.434208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e1f3f-d9ab-4d9e-9ee1-1d87ba198248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:24.435824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e1f3f-d9ab-4d9e-9ee1-1d87ba198248 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:24.448593 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1728/3457] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:48:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:48:24.722441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8592-4474-4f19-a5e4-675064b6f8a9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:24.735538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:24.736975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:24.737778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:24.738414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] PATH_INFO: `/v3/projects/21aa538486dc410b865e97aed2d41401` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:24.740372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21aa538486dc410b865e97aed2d41401)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:24.742664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:24.897610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21aa538486dc410b865e97aed2d41401', 'request_id': 'req-ba42753b-1e31-4840-82e6-97db6868d9e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:24.915688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21aa538486dc410b865e97aed2d41401', 'request_id': 'req-ba42753b-1e31-4840-82e6-97db6868d9e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:24.933603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21aa538486dc410b865e97aed2d41401', 'request_id': 'req-ba42753b-1e31-4840-82e6-97db6868d9e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:24.966719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] The token cache is being invalidate because project 21aa538486dc410b865e97aed2d41401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:48:24.970317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:24.972065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba42753b-1e31-4840-82e6-97db6868d9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:48:24.985572 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1730/3458] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:24 2022] DELETE /identity/v3/projects/21aa538486dc410b865e97aed2d41401 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:24.994185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e9fc9-2c9b-44f2-8643-d7ed4f2747ff None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:24.994684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e9fc9-2c9b-44f2-8643-d7ed4f2747ff None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:24.995178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e9fc9-2c9b-44f2-8643-d7ed4f2747ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:25.095222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6c3e9fc9-2c9b-44f2-8643-d7ed4f2747ff None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:25.101759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6c3e9fc9-2c9b-44f2-8643-d7ed4f2747ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:25.373141 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1729/3459] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:25.386622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9bae-85dd-4027-8ad6-55ac18a08af2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:25.387242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9bae-85dd-4027-8ad6-55ac18a08af2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:25.387855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9bae-85dd-4027-8ad6-55ac18a08af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:25.502283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-186b9bae-85dd-4027-8ad6-55ac18a08af2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:25.510880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-186b9bae-85dd-4027-8ad6-55ac18a08af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:25.544987 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1731/3460] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:25.546293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e9fc9-2c9b-44f2-8643-d7ed4f2747ff None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:25.562671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e9fc9-2c9b-44f2-8643-d7ed4f2747ff None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:25.587913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:25.588648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:25.588939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:25.589227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:25.602590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:48:25.602993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:25.604868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:25.674122 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1730/3461] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:48:25.675106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9bae-85dd-4027-8ad6-55ac18a08af2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:25.685100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9bae-85dd-4027-8ad6-55ac18a08af2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:25.702208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:25.702896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:25.703444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:25.703729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:25.704467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:25.706623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:25.780447 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1732/3462] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:48:25 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:48:25.785286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:25.820389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22de87-6d67-4f91-872b-4e1bc466e93b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:26.092892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:26.094120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:26.094628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:26.095141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:26.102840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:26.116999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:26.203711 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1731/3463] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:48:25 2022] POST /identity/v3/users => generated 302 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:48:26.206221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:26.267865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea77c1-3f18-41f4-9914-e1ecaf29bb90 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:26.335029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:26.345044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:26.345564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:26.346125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:26.347578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:26.369133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:26.421075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:26.422656 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1733/3464] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:48:26.455570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f40b93-b471-44e3-b691-089b8974d178 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:26.481961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d0951-7965-4563-b2a1-705496c4374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:26.482872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0951-7965-4563-b2a1-705496c4374a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:26.483455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0951-7965-4563-b2a1-705496c4374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:26.483634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0951-7965-4563-b2a1-705496c4374a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:26.484997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d0951-7965-4563-b2a1-705496c4374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:26.488100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d0951-7965-4563-b2a1-705496c4374a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:26.531106 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1732/3465] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:26.536311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:26.567133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9f97-5618-4b42-82cd-42d4d6273ebd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:26.599752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:26.601387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:26.602132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:26.603037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] PATH_INFO: `/v3/projects/e4a6f1fb6e554564b4ee3c6586646b17/users/a05fac57c00245d8965ed40f144b27e9/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:26.679306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a6f1fb6e554564b4ee3c6586646b17, user_id=a05fac57c00245d8965ed40f144b27e9, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:26.711453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:26.803105 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1734/3466] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:48:26 2022] PUT /identity/v3/projects/e4a6f1fb6e554564b4ee3c6586646b17/users/a05fac57c00245d8965ed40f144b27e9/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:48:26.814310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ffa77-8b5d-4e8a-95cb-1be0750a7e54 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:26.814836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ffa77-8b5d-4e8a-95cb-1be0750a7e54 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:26.815440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ffa77-8b5d-4e8a-95cb-1be0750a7e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:26.916577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d46ffa77-8b5d-4e8a-95cb-1be0750a7e54 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:26.922417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d46ffa77-8b5d-4e8a-95cb-1be0750a7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:27.046419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:27.141526 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1733/3467] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:27.178100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:27.181206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:27.323869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:27.418692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d60a-ead7-4d85-b1e3-61de07611d23 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:27.456055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:27.460663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:27.461435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:27.461940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:27.523895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:27.526113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:27.562267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1735/3468] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:37.112064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:37.543869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=14 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:44.747037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1709a-970f-4b05-b300-98ee98e1d286 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:44.747690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1709a-970f-4b05-b300-98ee98e1d286 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:44.748112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1709a-970f-4b05-b300-98ee98e1d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:44.927668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e2d1709a-970f-4b05-b300-98ee98e1d286 None None] MFA Rules not processed for user `0dc1c56423ac4676b94f4e086338a712`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:44.929560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e2d1709a-970f-4b05-b300-98ee98e1d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:45.204773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1734/3469] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:46.060853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:46.068262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:46.301338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd911e-1a83-404f-912a-62d8d36b3d72 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:46.317241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:46.318607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:46.319399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:46.320279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:46.340660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:46.349372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:46.378607 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1736/3470] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:48:53.286208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf67464-1fae-47fc-8f13-3a659acaac67 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:53.286752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf67464-1fae-47fc-8f13-3a659acaac67 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:53.287219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf67464-1fae-47fc-8f13-3a659acaac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:53.354391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-daf67464-1fae-47fc-8f13-3a659acaac67 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:53.362969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-daf67464-1fae-47fc-8f13-3a659acaac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:53.525377 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1735/3471] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:48:53.544500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:53.547739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:53.779092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5541c9-c1b8-4c6b-a1a1-1f0a35bf6fb3 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:53.785025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:53.785722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:53.786009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:53.786289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:53.796830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:53.798548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:53.810044 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1737/3472] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:48:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:48:53.974556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d168-be08-4b42-b0fc-37487747acc9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:53.975622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d168-be08-4b42-b0fc-37487747acc9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:53.976249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d168-be08-4b42-b0fc-37487747acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:54.070800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a319d168-be08-4b42-b0fc-37487747acc9 None None] MFA Rules not processed for user `a05fac57c00245d8965ed40f144b27e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:48:54.072109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a319d168-be08-4b42-b0fc-37487747acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:54.246719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:54.267872 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1736/3473] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:48:54.282932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9208f-5c6e-4e0b-8d17-69820397e8ba service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:54.303078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:54.303945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:54.304989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:54.305283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:54.306131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:54.309070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:54.395637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d168-be08-4b42-b0fc-37487747acc9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:54.407594 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1738/3474] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:48:54 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:48:54.416284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d168-be08-4b42-b0fc-37487747acc9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:54.501783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:54.641726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:54.642622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:54.642916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:54.643619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:54.651755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:54.654240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:54.716528 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1737/3475] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:48:54 2022] POST /identity/v3/users => generated 302 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:48:54.721390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:54.745483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5522c2-8da1-4a65-aa1a-c621196a388b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:54.761069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:54.763584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:54.763880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:54.769063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:54.771076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:54.793825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:54.918686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1739/3476] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:54.924375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:54.951365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2359c6-31f0-488f-85b9-5dcbd60f1602 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:54.971427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:54.975314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:54.975792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:54.976193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:54.977270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:54.984176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:55.039709 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1738/3477] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:48:55.044969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:55.074672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ac337-6add-4d00-be6b-e02596fe54f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:55.103920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72719010-2078-411d-9c76-77f0cd55ae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:55.106212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719010-2078-411d-9c76-77f0cd55ae24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:55.115831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719010-2078-411d-9c76-77f0cd55ae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:55.116497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719010-2078-411d-9c76-77f0cd55ae24 admin admin] PATH_INFO: `/v3/projects/68dbc7aaa5704a53b305a1d1c2f406fd/users/73d4f50dad7f4217806d7a9229dd5868/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:55.189471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72719010-2078-411d-9c76-77f0cd55ae24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dbc7aaa5704a53b305a1d1c2f406fd, user_id=73d4f50dad7f4217806d7a9229dd5868, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:55.200219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72719010-2078-411d-9c76-77f0cd55ae24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:55.258993 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1740/3478] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:48:55 2022] PUT /identity/v3/projects/68dbc7aaa5704a53b305a1d1c2f406fd/users/73d4f50dad7f4217806d7a9229dd5868/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:01.340171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:01.342941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:01.373239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d124226-b6d4-46a9-9ec5-64e3ec9886b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:01.467656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:01.467656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:01.467656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:01.467656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] PATH_INFO: `/v3/users/9a5792393e3f4517a52b4e84d5790ec8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:01.468136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5792393e3f4517a52b4e84d5790ec8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:01.468136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:01.579459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5792393e3f4517a52b4e84d5790ec8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:01.646852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5792393e3f4517a52b4e84d5790ec8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:01.648856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5792393e3f4517a52b4e84d5790ec8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:01.676382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5792393e3f4517a52b4e84d5790ec8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:01.679322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5792393e3f4517a52b4e84d5790ec8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:01.716742 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1739/3479] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:49:01 2022] DELETE /identity/v3/users/9a5792393e3f4517a52b4e84d5790ec8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:01.723641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:01.724176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:01.724509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:01.766285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:01.773991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:01.811967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:02.155261 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1741/3480] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:02.199408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:02.202183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:02.384510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:02.455084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3212-20c2-41a3-b221-0fff741793a4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:02.462999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03105-a2c8-4f6a-9ad2-2e701f460644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:02.464112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03105-a2c8-4f6a-9ad2-2e701f460644 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:02.464521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03105-a2c8-4f6a-9ad2-2e701f460644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:02.465790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03105-a2c8-4f6a-9ad2-2e701f460644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:02.499824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03105-a2c8-4f6a-9ad2-2e701f460644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:02.501398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03105-a2c8-4f6a-9ad2-2e701f460644 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:02.547549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1740/3481] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:04.120621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:04.122863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:04.149859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92c98b-a595-4b43-a6a6-7c5428b171d6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:04.176630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:04.177471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:04.177763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:04.178035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] PATH_INFO: `/v3/projects/a0ebe694f2e34ee1a34caa32aba4d755` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:04.180062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ebe694f2e34ee1a34caa32aba4d755)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:04.188936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:04.368126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ebe694f2e34ee1a34caa32aba4d755', 'request_id': 'req-2106507e-dc27-464f-ad36-e62352ce4ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:04.378903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ebe694f2e34ee1a34caa32aba4d755', 'request_id': 'req-2106507e-dc27-464f-ad36-e62352ce4ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:04.390749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ebe694f2e34ee1a34caa32aba4d755', 'request_id': 'req-2106507e-dc27-464f-ad36-e62352ce4ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:04.418919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] The token cache is being invalidate because project a0ebe694f2e34ee1a34caa32aba4d755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:49:04.419244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:04.420163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2106507e-dc27-464f-ad36-e62352ce4ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:04.422089 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1742/3482] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:04 2022] DELETE /identity/v3/projects/a0ebe694f2e34ee1a34caa32aba4d755 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:04.427184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8b8f-4689-476a-9ffe-5f39bc30a2cf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:04.428564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8b8f-4689-476a-9ffe-5f39bc30a2cf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:04.429869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8b8f-4689-476a-9ffe-5f39bc30a2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:04.483516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-11be8b8f-4689-476a-9ffe-5f39bc30a2cf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:04.486394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11be8b8f-4689-476a-9ffe-5f39bc30a2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:04.648015 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1741/3483] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:04.650248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09875c6-17d7-4f18-bac1-761b93a504b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:04.651366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09875c6-17d7-4f18-bac1-761b93a504b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:04.651366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09875c6-17d7-4f18-bac1-761b93a504b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:04.754803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b09875c6-17d7-4f18-bac1-761b93a504b1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:04.761912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b09875c6-17d7-4f18-bac1-761b93a504b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:04.807823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1743/3484] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:04.813926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8b8f-4689-476a-9ffe-5f39bc30a2cf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:04.865396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8b8f-4689-476a-9ffe-5f39bc30a2cf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:04.877942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:04.884290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:04.885055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:04.885497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:04.886422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:49:04.886849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:04.889210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:04.945718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09875c6-17d7-4f18-bac1-761b93a504b1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:04.961362 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1742/3485] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:49:04.975665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09875c6-17d7-4f18-bac1-761b93a504b1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:04.988162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:04.989506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:04.989900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:04.990303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:04.991144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:04.994245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:05.069008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1744/3486] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:49:04 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:49:05.071113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:05.101770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42d40-f02a-4a43-949c-b6dac72ab911 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:05.298516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:05.299578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:05.300680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:05.301250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:05.303088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:05.305451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:05.349823 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1743/3487] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:49:05 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:49:05.354410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:05.382549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cf38a-63f7-4a91-ae68-453cdafa297c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:05.400047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:05.403458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:05.403906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:05.405638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:05.408514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:05.415823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:05.446684 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1745/3488] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:49:05.451307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:05.473309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d94b-3549-488e-a816-4f5ddad266c1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:05.510407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606a6e9-1bc1-424e-ab47-02f21edb7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:05.511572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a6e9-1bc1-424e-ab47-02f21edb7df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:05.511935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a6e9-1bc1-424e-ab47-02f21edb7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:05.512296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a6e9-1bc1-424e-ab47-02f21edb7df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:05.513209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606a6e9-1bc1-424e-ab47-02f21edb7df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:05.518327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606a6e9-1bc1-424e-ab47-02f21edb7df6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:05.552107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1744/3489] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:49:05.553483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:05.567419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e71d31-d754-47f1-8a48-15b8e7deb584 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:05.578882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:05.580349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:05.580849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:05.581309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] PATH_INFO: `/v3/projects/35d9216142b2488ebf8d0e0e2c877c0c/users/970a3f5ec65b43e89648bbf28ba74c43/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:05.610822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d9216142b2488ebf8d0e0e2c877c0c, user_id=970a3f5ec65b43e89648bbf28ba74c43, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:05.615894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:05.653465 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1746/3490] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:49:05 2022] PUT /identity/v3/projects/35d9216142b2488ebf8d0e0e2c877c0c/users/970a3f5ec65b43e89648bbf28ba74c43/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:05.662678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffda77-c8e4-4908-a71c-c1aa092981cf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:05.663471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffda77-c8e4-4908-a71c-c1aa092981cf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:05.663898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffda77-c8e4-4908-a71c-c1aa092981cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:05.712462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-99ffda77-c8e4-4908-a71c-c1aa092981cf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:05.715696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99ffda77-c8e4-4908-a71c-c1aa092981cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:05.788254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:05.863653 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1745/3491] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:05.876294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:05.879676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:06.064143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:06.145973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33842e-ba48-4e42-b239-05fc91bf60b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:06.173282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:06.180177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:06.181070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:06.185402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:06.256315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:06.265797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:06.332608 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1747/3492] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:11.604303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6adcaf-bd97-4ad7-a6cc-3408b40bd637 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:11.604844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6adcaf-bd97-4ad7-a6cc-3408b40bd637 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:11.606071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6adcaf-bd97-4ad7-a6cc-3408b40bd637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:11.785713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8e6adcaf-bd97-4ad7-a6cc-3408b40bd637 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:11.787344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8e6adcaf-bd97-4ad7-a6cc-3408b40bd637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:11.929628 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1746/3493] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:11.966972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:11.970353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:12.357432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b62e-9a6d-4246-ae10-47b9e71bfa61 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:12.384690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8f85d-adf8-4d0b-be92-5e2b213d5b8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:12.385762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8f85d-adf8-4d0b-be92-5e2b213d5b8e service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:12.386381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8f85d-adf8-4d0b-be92-5e2b213d5b8e service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:12.387174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8f85d-adf8-4d0b-be92-5e2b213d5b8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:12.439942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8f85d-adf8-4d0b-be92-5e2b213d5b8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:12.439942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8f85d-adf8-4d0b-be92-5e2b213d5b8e service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:12.446281 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1748/3494] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:49:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:17.746311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:17.747784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:17.748598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:18.011398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] MFA Rules not processed for user `73d4f50dad7f4217806d7a9229dd5868`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:18.014112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:18.281713 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1747/3495] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:18.298122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed106-eb1a-4b30-a037-2a26da3784cb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:18.299005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed106-eb1a-4b30-a037-2a26da3784cb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:18.299005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed106-eb1a-4b30-a037-2a26da3784cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:18.374621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e67ed106-eb1a-4b30-a037-2a26da3784cb None None] MFA Rules not processed for user `a05fac57c00245d8965ed40f144b27e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:18.388403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e67ed106-eb1a-4b30-a037-2a26da3784cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:18.699911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1749/3496] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:22.008550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:22.010902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:22.226302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:22.370679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362a9a2-66d4-4e54-8033-7ea9ce2b4d30 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:22.386258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fca3f2-9f93-4172-90d7-a06fc253a64a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:22.386957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fca3f2-9f93-4172-90d7-a06fc253a64a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:22.387257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fca3f2-9f93-4172-90d7-a06fc253a64a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:22.387578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fca3f2-9f93-4172-90d7-a06fc253a64a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:22.394051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-77fca3f2-9f93-4172-90d7-a06fc253a64a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:22.432836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fca3f2-9f93-4172-90d7-a06fc253a64a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:22.434728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fca3f2-9f93-4172-90d7-a06fc253a64a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:22.462885 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1748/3497] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:22.850333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a7286-2499-4282-a783-e63ed5c665e9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:22.851616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a7286-2499-4282-a783-e63ed5c665e9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:22.852267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a7286-2499-4282-a783-e63ed5c665e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:22.952360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b47a7286-2499-4282-a783-e63ed5c665e9 None None] MFA Rules not processed for user `970a3f5ec65b43e89648bbf28ba74c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:22.954234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b47a7286-2499-4282-a783-e63ed5c665e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:23.190411 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1750/3498] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:23.730803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0560-7396-4b69-9a24-c07ecb5357ea None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:23.732062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0560-7396-4b69-9a24-c07ecb5357ea None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:23.734230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0560-7396-4b69-9a24-c07ecb5357ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:23.786859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5fbe0560-7396-4b69-9a24-c07ecb5357ea None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:23.788576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5fbe0560-7396-4b69-9a24-c07ecb5357ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:23.819759 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1749/3499] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:49:23.826174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a7286-2499-4282-a783-e63ed5c665e9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:23.838927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:23.862672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a7286-2499-4282-a783-e63ed5c665e9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:23.883090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff87e2-f981-42cf-82ad-78dfd84d397f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:23.887869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff87e2-f981-42cf-82ad-78dfd84d397f service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:23.888754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff87e2-f981-42cf-82ad-78dfd84d397f service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:23.889251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff87e2-f981-42cf-82ad-78dfd84d397f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:23.909390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff87e2-f981-42cf-82ad-78dfd84d397f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:23.911742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff87e2-f981-42cf-82ad-78dfd84d397f service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:23.930310 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1751/3500] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:49:26.098901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:26.099869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:26.100303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:26.139764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] MFA Rules not processed for user `a185fa24374c417aa2bb9302a608cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:26.141797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:26.449099 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1750/3501] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:26.789755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:26.790926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:26.791408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:26.868992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] MFA Rules not processed for user `331a222a893c4f84a08abf11333c7449`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:26.874879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:27.157778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1752/3502] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:35.662632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:35.666168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:35.887156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053a804-dc0a-42dc-b312-b1272c8042d5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:35.907721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:35.909575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:35.910286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:35.910962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:35.932484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:35.953463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:35.958752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:36.001064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:36.004532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:36.057701 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1751/3503] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:36.085369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a5c0-9355-4a4c-acf9-0a16a45a11b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:36.091878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:36.094150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:36.095541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:36.096089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] PATH_INFO: `/v3/users/897290f2f03d4ac7ad58d50c44a17fb3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:36.102056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897290f2f03d4ac7ad58d50c44a17fb3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:36.106473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:36.271836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897290f2f03d4ac7ad58d50c44a17fb3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:36.308868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897290f2f03d4ac7ad58d50c44a17fb3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:36.328714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897290f2f03d4ac7ad58d50c44a17fb3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:36.330362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897290f2f03d4ac7ad58d50c44a17fb3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:36.349909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d44e95b0-f48b-408e-908f-034979210ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897290f2f03d4ac7ad58d50c44a17fb3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:36.369918 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1753/3504] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:49:35 2022] DELETE /identity/v3/users/897290f2f03d4ac7ad58d50c44a17fb3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:49:38.131465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:38.154760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cbd31-d3c9-4d7d-9591-63f13e56d37a service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:38.320660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:38.334043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:38.335227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:38.338048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:38.338704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] PATH_INFO: `/v3/projects/178a39e9442c477f854e36b742e7c359` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:38.341078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178a39e9442c477f854e36b742e7c359)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:38.349819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:38.478935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178a39e9442c477f854e36b742e7c359', 'request_id': 'req-db1206e0-489c-4d49-bbec-3761841310b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:38.515971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178a39e9442c477f854e36b742e7c359', 'request_id': 'req-db1206e0-489c-4d49-bbec-3761841310b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:38.560952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178a39e9442c477f854e36b742e7c359', 'request_id': 'req-db1206e0-489c-4d49-bbec-3761841310b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:38.599698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] The token cache is being invalidate because project 178a39e9442c477f854e36b742e7c359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:49:38.603374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:38.608101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db1206e0-489c-4d49-bbec-3761841310b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:38.613888 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1752/3505] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:38 2022] DELETE /identity/v3/projects/178a39e9442c477f854e36b742e7c359 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:38.620818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e93e4-eeeb-4fa5-9155-8e841106f0cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:38.622386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e93e4-eeeb-4fa5-9155-8e841106f0cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:38.622846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e93e4-eeeb-4fa5-9155-8e841106f0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:38.700601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c15e93e4-eeeb-4fa5-9155-8e841106f0cd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:38.701903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c15e93e4-eeeb-4fa5-9155-8e841106f0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:38.886040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:39.084152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327217-5c1a-4391-974f-857c75b0019e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:39.084540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327217-5c1a-4391-974f-857c75b0019e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:39.084797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327217-5c1a-4391-974f-857c75b0019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:39.087748 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1754/3506] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:39.167554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-51327217-5c1a-4391-974f-857c75b0019e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:39.173531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-51327217-5c1a-4391-974f-857c75b0019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:39.221992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e93e4-eeeb-4fa5-9155-8e841106f0cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:39.242049 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1753/3507] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:39.260689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e93e4-eeeb-4fa5-9155-8e841106f0cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:39.312094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:39.312812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:39.313103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:39.313387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:39.314191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:49:39.314507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:39.340878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:39.409364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51327217-5c1a-4391-974f-857c75b0019e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:39.411907 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1755/3508] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:49:39.420533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51327217-5c1a-4391-974f-857c75b0019e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:39.460158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:39.461120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:39.461569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:39.461995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:39.462885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:39.470378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:39.545144 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1754/3509] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:49:39 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:49:39.550865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:39.578539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f444f9-96dd-47cb-a15c-65342287bff0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:39.791303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:39.792006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:39.793400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:39.794660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:39.798357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:39.801460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:39.863418 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1756/3510] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:49:39 2022] POST /identity/v3/users => generated 300 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:49:39.867481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:39.913411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014d1-0e4c-4b8a-baba-ab1f240939b2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:39.934357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:39.938130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:39.938497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:39.938724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:39.939666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:39.941595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:39.975179 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1755/3511] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:49:39.979916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:39.999542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0c29-1106-4306-9608-8d713569fab8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:40.015231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bc012-5c18-4ec6-8cbd-6e58940bf46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:40.016207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc012-5c18-4ec6-8cbd-6e58940bf46f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:40.016615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc012-5c18-4ec6-8cbd-6e58940bf46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:40.017026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc012-5c18-4ec6-8cbd-6e58940bf46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:40.018965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bc012-5c18-4ec6-8cbd-6e58940bf46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:40.021260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bc012-5c18-4ec6-8cbd-6e58940bf46f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:40.063140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1757/3512] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:49:40.064700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:40.080975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e722c24-8748-4793-851a-30ffb13de183 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:40.108857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:40.115073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:40.116548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:40.117584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] PATH_INFO: `/v3/projects/f30b8cc1b9254cca90487359e0872a93/users/a7edefb2896948e39ac7aed5a3884233/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:40.177867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30b8cc1b9254cca90487359e0872a93, user_id=a7edefb2896948e39ac7aed5a3884233, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:40.182044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:40.221265 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1756/3513] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:49:40 2022] PUT /identity/v3/projects/f30b8cc1b9254cca90487359e0872a93/users/a7edefb2896948e39ac7aed5a3884233/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:40.228274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38efb71-bac3-4b18-b1c3-02a536bcf2db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:40.228629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38efb71-bac3-4b18-b1c3-02a536bcf2db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:40.229557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38efb71-bac3-4b18-b1c3-02a536bcf2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:40.293846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f38efb71-bac3-4b18-b1c3-02a536bcf2db None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:40.295154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f38efb71-bac3-4b18-b1c3-02a536bcf2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:40.539157 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1758/3514] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:40.671672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:40.676641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:40.824212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea28b2-c410-46c4-9c62-f9d014f836e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:40.833977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:40.834704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:40.835004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:40.835368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:40.862429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:40.863993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:40.897455 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1757/3515] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:49.840807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:49.841681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:49.842432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:49.869390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:49.871137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:50.041194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:50.093536 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1759/3516] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:50.100831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:50.104145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:50.189231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:50.316568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0caf4f-97c2-466d-a31c-75592f41f986 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:50.327824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:50.328617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:50.331201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:50.331724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:50.355149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:50.359542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:50.389463 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1758/3517] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:49:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:49:51.474581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:51.476308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:51.508531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121952e-2d0e-498e-9b12-65368e7d4cc2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:51.523019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:51.524290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:51.526429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:51.527465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] PATH_INFO: `/v3/users/970a3f5ec65b43e89648bbf28ba74c43` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:51.529633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] RBAC: Authorizing `identity:delete_user(user_id=970a3f5ec65b43e89648bbf28ba74c43)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:51.534226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:51.810495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970a3f5ec65b43e89648bbf28ba74c43'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:51.941064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970a3f5ec65b43e89648bbf28ba74c43'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:51.960994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970a3f5ec65b43e89648bbf28ba74c43'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:51.961793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970a3f5ec65b43e89648bbf28ba74c43'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:51.980523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5fc011df-1cae-4023-b00b-7d921fe3776f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970a3f5ec65b43e89648bbf28ba74c43'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:52.000650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1760/3518] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:49:51 2022] DELETE /identity/v3/users/970a3f5ec65b43e89648bbf28ba74c43 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:49:53.094126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:53.114563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee56f73-c456-4a84-8291-69ac8b2bc487 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:53.304438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:53.305779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:53.306460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:53.306899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] PATH_INFO: `/v3/projects/35d9216142b2488ebf8d0e0e2c877c0c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:53.310466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d9216142b2488ebf8d0e0e2c877c0c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:53.313495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:53.449088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d9216142b2488ebf8d0e0e2c877c0c', 'request_id': 'req-1347409c-1804-49c9-9729-049794a9ef09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:53.466799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d9216142b2488ebf8d0e0e2c877c0c', 'request_id': 'req-1347409c-1804-49c9-9729-049794a9ef09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:53.484068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d9216142b2488ebf8d0e0e2c877c0c', 'request_id': 'req-1347409c-1804-49c9-9729-049794a9ef09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:53.514204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] The token cache is being invalidate because project 35d9216142b2488ebf8d0e0e2c877c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:49:53.514807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:53.515770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1347409c-1804-49c9-9729-049794a9ef09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:53.531384 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1759/3519] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:53 2022] DELETE /identity/v3/projects/35d9216142b2488ebf8d0e0e2c877c0c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:53.534308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ea071-feb7-460b-ac0f-2626d4f604bf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:53.535021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ea071-feb7-460b-ac0f-2626d4f604bf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:53.535596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ea071-feb7-460b-ac0f-2626d4f604bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:53.587738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-794ea071-feb7-460b-ac0f-2626d4f604bf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:53.593328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-794ea071-feb7-460b-ac0f-2626d4f604bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:53.771674 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1761/3520] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:49:53.772590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c390a-99b4-4441-a03f-d874653ea6ad None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:53.773073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c390a-99b4-4441-a03f-d874653ea6ad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:53.773541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c390a-99b4-4441-a03f-d874653ea6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:53.826699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-020c390a-99b4-4441-a03f-d874653ea6ad None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:53.828923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-020c390a-99b4-4441-a03f-d874653ea6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:53.853958 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1760/3521] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:53.858910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ea071-feb7-460b-ac0f-2626d4f604bf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:53.886717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ea071-feb7-460b-ac0f-2626d4f604bf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:53.899411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:53.900465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:53.901188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:53.901587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:53.902779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:49:53.903215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:53.905430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:53.932404 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1762/3522] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:49:53.934076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c390a-99b4-4441-a03f-d874653ea6ad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:53.960160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c390a-99b4-4441-a03f-d874653ea6ad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:53.973929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:53.974666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:53.975194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:53.976728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:53.977499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:53.980507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:54.039047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:54.046779 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1761/3523] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:49:53 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:49:54.056116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bc7d8-1556-4736-8f89-ac2bb90f2500 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:54.259902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:54.289446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:54.290664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:54.291170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:54.291714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:54.293144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:54.297245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:54.370668 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1763/3524] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:49:54 2022] POST /identity/v3/users => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:49:54.375230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:54.396409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847062e-f4b1-42b7-9d1c-f5bf0c5c2e7f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:54.411785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:54.412610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:54.412898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:54.413241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:54.414408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:54.416354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:54.448500 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1762/3525] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:49:54.454216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:54.472135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d93fa-c1c9-4582-92b2-5b50eb0eaa7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:54.481134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06799a1e-5d6f-4c7c-a1e8-4be683904069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:54.482411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06799a1e-5d6f-4c7c-a1e8-4be683904069 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:54.482708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06799a1e-5d6f-4c7c-a1e8-4be683904069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:54.482989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06799a1e-5d6f-4c7c-a1e8-4be683904069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:54.483798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06799a1e-5d6f-4c7c-a1e8-4be683904069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:54.485616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06799a1e-5d6f-4c7c-a1e8-4be683904069 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:54.499079 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1764/3526] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:49:54.502955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:54.515850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:54.522080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3630-332b-4418-af35-36004172007e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:54.536055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:54.537074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:54.537442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:54.537928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] PATH_INFO: `/v3/projects/cfb1ef3f5baa42f2811f4f21330b52e5/users/20a9572179bb46488a5ebf92dea4b30c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:54.599990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb1ef3f5baa42f2811f4f21330b52e5, user_id=20a9572179bb46488a5ebf92dea4b30c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:54.612163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:54.647676 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1763/3527] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:49:54 2022] PUT /identity/v3/projects/cfb1ef3f5baa42f2811f4f21330b52e5/users/20a9572179bb46488a5ebf92dea4b30c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:49:54.660676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:54.661398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:54.661864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:54.786773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] MFA Rules not processed for user `20a9572179bb46488a5ebf92dea4b30c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:54.789148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:55.067253 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1765/3528] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:49:55.107829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:55.136369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:55.140126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:55.376649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086373f7-a4ac-456c-a583-00b67ccdf472 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:55.395368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:55.396988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:55.397500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:55.397988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] PATH_INFO: `/v3/users/20a9572179bb46488a5ebf92dea4b30c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:55.413140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a9572179bb46488a5ebf92dea4b30c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:55.416375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:55.448931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c8a0e-68fa-422d-bffd-5e22b3a06ca8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:55.457636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:55.459398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:55.459976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:55.460685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] PATH_INFO: `/v3/users/0dc1c56423ac4676b94f4e086338a712` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:55.462422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc1c56423ac4676b94f4e086338a712)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:55.465360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:55.552543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc1c56423ac4676b94f4e086338a712'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.570489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:55.576448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc1c56423ac4676b94f4e086338a712'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.587190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a9572179bb46488a5ebf92dea4b30c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.600738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc1c56423ac4676b94f4e086338a712'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.604678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc1c56423ac4676b94f4e086338a712'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.620757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9be2abb-fe8f-4c71-aedc-1ab8787b0927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc1c56423ac4676b94f4e086338a712'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.634244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1766/3529] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:49:55 2022] DELETE /identity/v3/users/0dc1c56423ac4676b94f4e086338a712 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:55.641778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a9572179bb46488a5ebf92dea4b30c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.645452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a9572179bb46488a5ebf92dea4b30c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.682833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a9572179bb46488a5ebf92dea4b30c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.684782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a9572179bb46488a5ebf92dea4b30c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:55.737442 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1764/3530] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:49:55 2022] DELETE /identity/v3/users/20a9572179bb46488a5ebf92dea4b30c => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:55.739949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:55.740464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:55.740755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:55.794695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:55.800968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:56.070655 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1767/3531] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:56.118445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:56.120606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:56.354175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e440c6-91ce-4d48-823e-6131c117f966 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:56.369455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031642bd-34f2-485b-be0f-cc102431caa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:56.370342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031642bd-34f2-485b-be0f-cc102431caa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:56.370635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031642bd-34f2-485b-be0f-cc102431caa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:56.370915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031642bd-34f2-485b-be0f-cc102431caa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:56.402900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031642bd-34f2-485b-be0f-cc102431caa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:56.408617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031642bd-34f2-485b-be0f-cc102431caa4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:56.438146 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1765/3532] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:57.681609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:57.683471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:57.717306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e774b-5f1d-4b76-8be2-201804357a7e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:57.746487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:57.752686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:57.753153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:57.756280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] PATH_INFO: `/v3/projects/5ffc690dc81847199f7339b22ab61dea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:57.760821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffc690dc81847199f7339b22ab61dea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:57.772208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:58.026179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffc690dc81847199f7339b22ab61dea', 'request_id': 'req-0e17032a-59aa-4aef-9812-5f96051f2f84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:58.052802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffc690dc81847199f7339b22ab61dea', 'request_id': 'req-0e17032a-59aa-4aef-9812-5f96051f2f84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:58.088596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffc690dc81847199f7339b22ab61dea', 'request_id': 'req-0e17032a-59aa-4aef-9812-5f96051f2f84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:58.132427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] The token cache is being invalidate because project 5ffc690dc81847199f7339b22ab61dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:49:58.135650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:58.138723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0e17032a-59aa-4aef-9812-5f96051f2f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:58.145532 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1768/3533] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:57 2022] DELETE /identity/v3/projects/5ffc690dc81847199f7339b22ab61dea => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:49:58.147423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcd5b2-84ae-4999-81e3-c9ce57f75321 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:58.147954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcd5b2-84ae-4999-81e3-c9ce57f75321 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:58.148105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcd5b2-84ae-4999-81e3-c9ce57f75321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:58.156774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:58.204575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6dfcd5b2-84ae-4999-81e3-c9ce57f75321 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:58.211193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6dfcd5b2-84ae-4999-81e3-c9ce57f75321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:58.385147 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1766/3534] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:58.393721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0cee-8e29-4b3b-8e52-4ee2cbcc061e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:58.394062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0cee-8e29-4b3b-8e52-4ee2cbcc061e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:58.394283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0cee-8e29-4b3b-8e52-4ee2cbcc061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:58.440514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fb3d0cee-8e29-4b3b-8e52-4ee2cbcc061e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:58.441959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb3d0cee-8e29-4b3b-8e52-4ee2cbcc061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:58.470239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1769/3535] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:49:58.475038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcd5b2-84ae-4999-81e3-c9ce57f75321 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:58.508788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcd5b2-84ae-4999-81e3-c9ce57f75321 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:58.523248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:58.523972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:58.524258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:58.524540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:58.525292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:49:58.525602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:58.527308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:58.600656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0cee-8e29-4b3b-8e52-4ee2cbcc061e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:58.601373 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1767/3536] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:49:58.615223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0cee-8e29-4b3b-8e52-4ee2cbcc061e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:58.636131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:58.636929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:58.637285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:58.638069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:58.643621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:58.652768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:58.807933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:58.818052 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1770/3537] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:49:58 2022] POST /identity/v3/projects => generated 359 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:49:58.835526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a20e4-ab6b-42e8-9df6-39f4e2e3353e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:59.235297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:59.259225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:59.260247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:59.263710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:59.265518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:59.304013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:59.401203 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1768/3538] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:49:58 2022] POST /identity/v3/users => generated 280 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:49:59.405599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:59.421970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f81bd-65de-4fa7-9342-ceb068112c1d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:59.443066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:59.444524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:59.444524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:59.444524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:59.445087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:59.446780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:59.483783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:59.491670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1771/3539] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:49:59.500288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634f4c-ace5-40c9-8018-0b720176d940 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:59.513260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c7bde-c180-4c1a-83ed-fe3253e1238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:59.516830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7bde-c180-4c1a-83ed-fe3253e1238c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:59.517729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7bde-c180-4c1a-83ed-fe3253e1238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:59.518235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7bde-c180-4c1a-83ed-fe3253e1238c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:59.519457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c7bde-c180-4c1a-83ed-fe3253e1238c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:59.523693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c7bde-c180-4c1a-83ed-fe3253e1238c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:59.578819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:59.585240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1769/3540] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:49:59.592501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e515b2-e4a5-4914-95cc-1ac0eb9ffdc8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:59.615635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:59.617009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:59.619093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:59.619852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] PATH_INFO: `/v3/projects/4da9bfba7a6e411fa22206a70417ae73/users/1db067ac2fdc491e866b8dcfdfe8d606/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:59.667140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da9bfba7a6e411fa22206a70417ae73, user_id=1db067ac2fdc491e866b8dcfdfe8d606, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:59.674534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:59.700107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:59.713708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e705-4357-4689-b296-ee6c46459467 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:59.714125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e705-4357-4689-b296-ee6c46459467 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:59.714669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e705-4357-4689-b296-ee6c46459467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:59.717039 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1772/3541] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:49:59 2022] PUT /identity/v3/projects/4da9bfba7a6e411fa22206a70417ae73/users/1db067ac2fdc491e866b8dcfdfe8d606/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:59.759125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7409e705-4357-4689-b296-ee6c46459467 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:59.760599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7409e705-4357-4689-b296-ee6c46459467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:59.818597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:59.823543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:59.981137 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1770/3542] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:59.997066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409e705-4357-4689-b296-ee6c46459467 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:00.000373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7409e705-4357-4689-b296-ee6c46459467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:00.025997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:00.034524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a815-ce4d-4edc-92c5-97401fda1640 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:00.059083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:00.060053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:00.060327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:00.060614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] PATH_INFO: `/v3/projects/cfb1ef3f5baa42f2811f4f21330b52e5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:00.064922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb1ef3f5baa42f2811f4f21330b52e5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:00.067088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:00.185698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409e705-4357-4689-b296-ee6c46459467 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:00.188533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb1ef3f5baa42f2811f4f21330b52e5', 'request_id': 'req-8acffc03-8a0b-459d-9367-76175d25b619'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:00.219102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb1ef3f5baa42f2811f4f21330b52e5', 'request_id': 'req-8acffc03-8a0b-459d-9367-76175d25b619'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:00.248788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb1ef3f5baa42f2811f4f21330b52e5', 'request_id': 'req-8acffc03-8a0b-459d-9367-76175d25b619'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:00.284313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] The token cache is being invalidate because project cfb1ef3f5baa42f2811f4f21330b52e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:50:00.286195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:00.287537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8acffc03-8a0b-459d-9367-76175d25b619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:00.294313 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1773/3543] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:59 2022] DELETE /identity/v3/projects/cfb1ef3f5baa42f2811f4f21330b52e5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:00.303064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3499-d3ac-43c3-a974-ea8c9fb3b454 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:00.305600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3499-d3ac-43c3-a974-ea8c9fb3b454 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:00.305962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3499-d3ac-43c3-a974-ea8c9fb3b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:00.374247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb1a10-7493-44df-a547-5c74f199cf5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:00.376020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb1a10-7493-44df-a547-5c74f199cf5e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:00.376684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb1a10-7493-44df-a547-5c74f199cf5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:00.377636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb1a10-7493-44df-a547-5c74f199cf5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:00.382184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05eb1a10-7493-44df-a547-5c74f199cf5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:00.387652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f44c3499-d3ac-43c3-a974-ea8c9fb3b454 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:00.391881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f44c3499-d3ac-43c3-a974-ea8c9fb3b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:00.546024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb1a10-7493-44df-a547-5c74f199cf5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:00.547607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb1a10-7493-44df-a547-5c74f199cf5e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:00.580549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1771/3544] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:50:00.706941 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1774/3545] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:00.714302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda243b8-d5d2-4e99-9f91-001d3f79a3ba None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:00.714925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda243b8-d5d2-4e99-9f91-001d3f79a3ba None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:00.715412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda243b8-d5d2-4e99-9f91-001d3f79a3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:00.764555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-eda243b8-d5d2-4e99-9f91-001d3f79a3ba None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:00.766107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eda243b8-d5d2-4e99-9f91-001d3f79a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:00.798998 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1772/3546] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:00.803890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c3499-d3ac-43c3-a974-ea8c9fb3b454 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:00.856349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c3499-d3ac-43c3-a974-ea8c9fb3b454 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:00.898958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:00.904334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:00.906223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:00.907945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:00.909017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:50:00.912697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:00.931981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:00.954874 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1775/3547] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:50:00.959496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda243b8-d5d2-4e99-9f91-001d3f79a3ba None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:00.969351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda243b8-d5d2-4e99-9f91-001d3f79a3ba None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:01.003133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:01.004121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:01.004359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:01.004646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:01.005386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:01.007422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:01.249318 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1773/3548] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:50:00 2022] POST /identity/v3/projects => generated 361 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:50:01.254896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:01.289095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82102a-5a23-4e70-bdfa-be693afd4a3c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:01.332969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:01.421199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:01.427092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:01.432719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:01.433633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:01.434005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:01.434848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:01.435432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:01.440644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:01.479418 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1776/3549] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:50:01 2022] POST /identity/v3/users => generated 281 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:50:01.484885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:01.507938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b638624-68b4-41f8-beeb-0e9b1a5e0d35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:01.516842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:01.516842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:01.517839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:01.518637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:01.520540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:01.523351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:01.539403 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1777/3550] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:01.546611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:01.560365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1515-e303-4427-a4bb-c0b1b77cae89 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:01.566981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:01.567828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:01.568211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:01.569183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:01.570056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:01.573059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:01.587744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:01.588584 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1778/3551] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:01.594114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:01.618924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a77b00-8b11-4f29-9628-3c1572594d9e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:01.628503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca676107-ceb0-404a-97c9-c89b61650d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:01.634105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca676107-ceb0-404a-97c9-c89b61650d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:01.634498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca676107-ceb0-404a-97c9-c89b61650d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:01.634867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca676107-ceb0-404a-97c9-c89b61650d51 admin admin] PATH_INFO: `/v3/projects/4e1b2ad7693144bdbb464caa8e78f8da/users/d765033785f8408195306246e2749b11/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:01.664590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ea665-7257-4044-a90c-b3ffbbd13b66 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:01.665607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca676107-ceb0-404a-97c9-c89b61650d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1b2ad7693144bdbb464caa8e78f8da, user_id=d765033785f8408195306246e2749b11, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:01.670284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca676107-ceb0-404a-97c9-c89b61650d51 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:01.680982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:01.688756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:01.690849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:01.692605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:01.702993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:01.716156 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1779/3552] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:50:01 2022] PUT /identity/v3/projects/4e1b2ad7693144bdbb464caa8e78f8da/users/d765033785f8408195306246e2749b11/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:01.741117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f110f55-6d4e-4e53-9edf-45beb7feb769 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:01.741615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f110f55-6d4e-4e53-9edf-45beb7feb769 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:01.742111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f110f55-6d4e-4e53-9edf-45beb7feb769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:01.900513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8f110f55-6d4e-4e53-9edf-45beb7feb769 None None] MFA Rules not processed for user `d765033785f8408195306246e2749b11`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:01.907024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f110f55-6d4e-4e53-9edf-45beb7feb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:02.068902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:02.075332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:02.141821 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1774/3553] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:02.337580 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1780/3554] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 595 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:03.276038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:03.331551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c2805-c205-42ae-a52b-1345327ac426 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:03.530441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f110f55-6d4e-4e53-9edf-45beb7feb769 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:03.684253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:03.740980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f110f55-6d4e-4e53-9edf-45beb7feb769 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:03.764693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:03.769928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:03.770451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:03.771397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:03.773144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] PATH_INFO: `/v3/users/d765033785f8408195306246e2749b11` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:03.773720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:03.774257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:03.774769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:03.778793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d765033785f8408195306246e2749b11)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:03.785018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:03.787899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:03.972303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd765033785f8408195306246e2749b11'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:04.004290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd765033785f8408195306246e2749b11'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:04.029316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd765033785f8408195306246e2749b11'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:04.030509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd765033785f8408195306246e2749b11'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:04.056046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef48a8dc-85c0-4da8-a606-8c26349479ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd765033785f8408195306246e2749b11'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:04.086711 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1781/3555] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:50:03 2022] DELETE /identity/v3/users/d765033785f8408195306246e2749b11 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:04.088651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:04.088940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:04.089230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:04.138559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:04.140301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:04.344518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:04.348978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:04.384762 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1775/3556] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 1110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:04.425191 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1782/3557] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:04.453571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:04.456931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:04.648892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:04.848609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cc5e2-3f50-4c6f-abf3-a0a6dab245ca service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:05.109483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:05.110681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:05.111391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:05.112168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:05.162181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:05.164879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:05.211077 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1776/3558] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:06.895905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:06.901613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:07.148600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a5bb-d99c-40f1-b47f-2bfec7a82608 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:07.158431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:07.159350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:07.159665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:07.159995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:07.166096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:07.195663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:07.197331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:07.202784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:07.230115 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1783/3559] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:50:07.525930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:07.529977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:07.568484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95034ad-8414-4d82-81d7-65cc974580ff service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:07.586447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:07.588312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:07.588980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:07.589669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] PATH_INFO: `/v3/users/029da70c73ee487db039f4dafc0d2948` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:07.594467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029da70c73ee487db039f4dafc0d2948)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:07.599532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:07.881450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029da70c73ee487db039f4dafc0d2948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:07.900065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:07.902664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:07.969136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fbb8f-0923-425f-80f1-730fbfe738c3 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:07.986846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029da70c73ee487db039f4dafc0d2948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:07.994514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029da70c73ee487db039f4dafc0d2948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.001154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:08.003666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:08.004350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:08.005105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] PATH_INFO: `/v3/projects/4e1b2ad7693144bdbb464caa8e78f8da` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:08.009863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1b2ad7693144bdbb464caa8e78f8da)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:08.017009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:08.033991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029da70c73ee487db039f4dafc0d2948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.037453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7de93728-8bd7-487d-b074-56257e199945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029da70c73ee487db039f4dafc0d2948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.134827 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1777/3560] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:50:07 2022] DELETE /identity/v3/users/029da70c73ee487db039f4dafc0d2948 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:08.146602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978301-e8a5-44d3-8c5a-8c592ad20d67 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:08.147229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978301-e8a5-44d3-8c5a-8c592ad20d67 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:08.147772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978301-e8a5-44d3-8c5a-8c592ad20d67 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:08.152747 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1778/3561] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:50:08 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:50:08.160421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:08.161315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:08.161755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:08.241858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1b2ad7693144bdbb464caa8e78f8da', 'request_id': 'req-07195139-914c-41c9-82fb-b4ede0d208d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.266652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:08.268746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:08.275583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1b2ad7693144bdbb464caa8e78f8da', 'request_id': 'req-07195139-914c-41c9-82fb-b4ede0d208d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.304395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1b2ad7693144bdbb464caa8e78f8da', 'request_id': 'req-07195139-914c-41c9-82fb-b4ede0d208d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.356130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] The token cache is being invalidate because project 4e1b2ad7693144bdbb464caa8e78f8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:50:08.356810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.358158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-07195139-914c-41c9-82fb-b4ede0d208d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:08.369118 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1784/3562] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:07 2022] DELETE /identity/v3/projects/4e1b2ad7693144bdbb464caa8e78f8da => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:08.378165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e51a8-aa4b-4441-ab2d-cbda03d2aa76 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:08.379149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e51a8-aa4b-4441-ab2d-cbda03d2aa76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:08.379442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e51a8-aa4b-4441-ab2d-cbda03d2aa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:08.457065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-790e51a8-aa4b-4441-ab2d-cbda03d2aa76 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:08.459416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-790e51a8-aa4b-4441-ab2d-cbda03d2aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:08.491639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:08.571893 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1779/3563] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:08.597920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:08.599424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:08.624089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449ff7d-7d7c-4d8d-baf7-4aa735c70d87 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:08.638710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a2021-9c9f-4068-addf-c8503e77679d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:08.639691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a2021-9c9f-4068-addf-c8503e77679d service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:08.639901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a2021-9c9f-4068-addf-c8503e77679d service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:08.652445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a2021-9c9f-4068-addf-c8503e77679d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:08.698665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a2021-9c9f-4068-addf-c8503e77679d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:08.700427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a2021-9c9f-4068-addf-c8503e77679d service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:08.777582 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1780/3564] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:08.913630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc331cb-b15a-4f0e-b790-db46dc44af3f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:08.913899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc331cb-b15a-4f0e-b790-db46dc44af3f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:08.914383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc331cb-b15a-4f0e-b790-db46dc44af3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:08.915393 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1785/3565] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:09.127618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5fc331cb-b15a-4f0e-b790-db46dc44af3f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:09.136690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5fc331cb-b15a-4f0e-b790-db46dc44af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:09.233728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e51a8-aa4b-4441-ab2d-cbda03d2aa76 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:09.234339 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1781/3566] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:09.256956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e51a8-aa4b-4441-ab2d-cbda03d2aa76 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:09.284538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:09.285342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:09.285701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:09.286098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:09.288365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:50:09.289530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:09.291408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:09.331545 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1786/3567] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:50:09.337465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc331cb-b15a-4f0e-b790-db46dc44af3f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:09.348783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc331cb-b15a-4f0e-b790-db46dc44af3f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:09.375352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:09.379147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:09.380702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:09.381344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:09.384419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:09.389119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:09.573579 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1782/3568] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:50:09 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:50:09.577029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:09.628488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48603cc-b10d-441e-bfa5-02aac948df27 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:09.806355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:09.807949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:09.808315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:09.808613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:09.809727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:09.816459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:09.855085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:09.874682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1787/3569] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:50:09 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:50:09.875377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:09.882327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:09.885913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:09.932359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1879ba-96d1-47b1-b57b-1d7ba03c705c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:09.944481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a549d9-36fa-4692-bad1-142df7486a42 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:09.952384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:09.953300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:09.953581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:09.954045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] PATH_INFO: `/v3/projects/993c6d6a2aa347838950e9b67df54008` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:09.957078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=993c6d6a2aa347838950e9b67df54008)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:09.959008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:09.959401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:09.960831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:09.961303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:09.962315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:09.963643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:09.970156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:10.014431 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1783/3570] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:10.021667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:10.040202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6cacb-6e28-4947-af5a-3bc70ced0185 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:10.046323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:10.047863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:10.049409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:10.050856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:10.052427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:10.054677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:10.084058 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1784/3571] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:10.088322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:10.098656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993c6d6a2aa347838950e9b67df54008', 'request_id': 'req-cc1f4367-a010-4c18-8885-8a1f26316e1c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:10.124179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc8f5d-7191-4aaf-a02a-7188c8a2f505 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:10.124981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993c6d6a2aa347838950e9b67df54008', 'request_id': 'req-cc1f4367-a010-4c18-8885-8a1f26316e1c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:10.145028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993c6d6a2aa347838950e9b67df54008', 'request_id': 'req-cc1f4367-a010-4c18-8885-8a1f26316e1c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:10.176344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] The token cache is being invalidate because project 993c6d6a2aa347838950e9b67df54008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:50:10.178491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:10.180949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc1f4367-a010-4c18-8885-8a1f26316e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:10.186144 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1788/3572] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:09 2022] DELETE /identity/v3/projects/993c6d6a2aa347838950e9b67df54008 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:50:10.191407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3e414-9166-49fb-8a23-c1a89a36392e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:10.192026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3e414-9166-49fb-8a23-c1a89a36392e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:10.192614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3e414-9166-49fb-8a23-c1a89a36392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:10.256669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d6d3e414-9166-49fb-8a23-c1a89a36392e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:10.260062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d6d3e414-9166-49fb-8a23-c1a89a36392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:10.364404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e61d23-c829-4d80-854b-d2a8c5dc155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:10.365577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61d23-c829-4d80-854b-d2a8c5dc155b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:10.366014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61d23-c829-4d80-854b-d2a8c5dc155b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:10.366392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61d23-c829-4d80-854b-d2a8c5dc155b admin admin] PATH_INFO: `/v3/projects/bcf2159a7a09439aa1be7f78d8b9d1eb/users/2625ce3aa5034d048494fca0dc403c51/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:10.431883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e61d23-c829-4d80-854b-d2a8c5dc155b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf2159a7a09439aa1be7f78d8b9d1eb, user_id=2625ce3aa5034d048494fca0dc403c51, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:10.446420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e61d23-c829-4d80-854b-d2a8c5dc155b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:10.475310 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1789/3573] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:10.475310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8bf7-a7fb-416b-9c1c-aa87778d05e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:10.475310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8bf7-a7fb-416b-9c1c-aa87778d05e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:10.475310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8bf7-a7fb-416b-9c1c-aa87778d05e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:10.495568 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1785/3574] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:50:10 2022] PUT /identity/v3/projects/bcf2159a7a09439aa1be7f78d8b9d1eb/users/2625ce3aa5034d048494fca0dc403c51/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:10.501900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:10.503349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:10.504806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:10.581936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:10.582942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-455b8bf7-a7fb-416b-9c1c-aa87778d05e4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:10.583563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:10.596347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-455b8bf7-a7fb-416b-9c1c-aa87778d05e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:10.818840 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1786/3575] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:10.843573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:10.847822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:10.890030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:11.105981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1790/3576] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 636 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:11.114461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b8bf7-a7fb-416b-9c1c-aa87778d05e4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:11.183942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a29db-ca3c-4765-b3fe-2beb129a211c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:11.200684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:11.201899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:11.202795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:11.203329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:11.209890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b8bf7-a7fb-416b-9c1c-aa87778d05e4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:11.242036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:11.246150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:11.246391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:11.247738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:11.248249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:11.248881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:11.250469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:50:11.251158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:11.276260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:11.310930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1787/3577] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:11.351316 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1791/3578] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:50:11.356451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:11.382663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02944f09-b6a9-4e6a-9915-1013f09f6275 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:11.407771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:11.409628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:11.410240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:11.410798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:11.412378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:11.417724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:11.574257 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1788/3579] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:50:11 2022] POST /identity/v3/projects => generated 397 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:50:11.576248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:11.631156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42d425-35c7-4456-b078-adb3e133a125 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:11.658204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:11.904772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:11.909839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:11.911624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:11.916097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:11.916978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:11.924949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:12.004114 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1792/3580] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:50:11 2022] POST /identity/v3/users => generated 299 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:50:12.005565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:12.062029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a46564-59e7-48c5-9659-b3441fb7d200 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:12.081441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:12.085931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:12.086983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:12.087900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:12.089880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:12.095495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:12.172926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1789/3581] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:12.179629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:12.295462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233594e-e476-4791-867a-5a077e2d433f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:12.322282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b0b9-53d0-4155-b78b-a701dd1a7279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:12.325417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b0b9-53d0-4155-b78b-a701dd1a7279 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:12.328091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b0b9-53d0-4155-b78b-a701dd1a7279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:12.336344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b0b9-53d0-4155-b78b-a701dd1a7279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:12.337270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b0b9-53d0-4155-b78b-a701dd1a7279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:12.338999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b0b9-53d0-4155-b78b-a701dd1a7279 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:12.407132 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1793/3582] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:12.414078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:12.452462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ba9af-1732-44b1-b3bb-7f649c29c8b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:12.481179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197e7d2-8a8e-4aa8-a6d1-41f180e8fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:12.485966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e7d2-8a8e-4aa8-a6d1-41f180e8fccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:12.486780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e7d2-8a8e-4aa8-a6d1-41f180e8fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:12.488058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e7d2-8a8e-4aa8-a6d1-41f180e8fccb admin admin] PATH_INFO: `/v3/projects/f520518ffcc94715b63f06b2711cab51/users/4fb9f90ead624da1bbed75cd6215183e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:12.583602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197e7d2-8a8e-4aa8-a6d1-41f180e8fccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f520518ffcc94715b63f06b2711cab51, user_id=4fb9f90ead624da1bbed75cd6215183e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:12.607580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197e7d2-8a8e-4aa8-a6d1-41f180e8fccb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:12.658749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c712-c4f1-44e7-814c-e651b00d0285 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:12.659231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c712-c4f1-44e7-814c-e651b00d0285 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:12.660325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c712-c4f1-44e7-814c-e651b00d0285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:12.758702 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1790/3583] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:50:12 2022] PUT /identity/v3/projects/f520518ffcc94715b63f06b2711cab51/users/4fb9f90ead624da1bbed75cd6215183e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:12.777546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51088f-3887-457c-8a16-4ce265fbb47d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:12.778088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51088f-3887-457c-8a16-4ce265fbb47d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:12.778659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51088f-3887-457c-8a16-4ce265fbb47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:12.860524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3135c712-c4f1-44e7-814c-e651b00d0285 None None] MFA Rules not processed for user `a7edefb2896948e39ac7aed5a3884233`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:12.863330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3135c712-c4f1-44e7-814c-e651b00d0285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:12.931364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1c51088f-3887-457c-8a16-4ce265fbb47d None None] MFA Rules not processed for user `4fb9f90ead624da1bbed75cd6215183e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:12.934281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c51088f-3887-457c-8a16-4ce265fbb47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:13.330069 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1791/3584] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:13.345909 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1794/3585] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 690 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:13.348622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:13.349107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:13.349581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:13.350737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:13.352148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:13.352668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:13.450112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] MFA Rules not processed for user `4fb9f90ead624da1bbed75cd6215183e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:13.457333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:13.473177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] MFA Rules not processed for user `a7edefb2896948e39ac7aed5a3884233`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:13.475435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:13.503002 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1792/3586] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:13.511671 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1795/3587] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:13.596165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:13.602042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:13.832968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:14.019064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:14.022821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:14.080454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b6cc4-6cdf-4ddf-8fa3-c30ec8b8532a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:14.118913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b409-5d1e-4318-8d6a-2549daec449b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:14.128579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23ec1c-5272-4a5b-9abb-6ee21b32635e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:14.129817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23ec1c-5272-4a5b-9abb-6ee21b32635e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:14.130285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23ec1c-5272-4a5b-9abb-6ee21b32635e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:14.130773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23ec1c-5272-4a5b-9abb-6ee21b32635e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:14.135678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3137f6d-e82b-49b2-8cdb-c788a21ce54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:14.136861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137f6d-e82b-49b2-8cdb-c788a21ce54f service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:14.137244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137f6d-e82b-49b2-8cdb-c788a21ce54f service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:14.137852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137f6d-e82b-49b2-8cdb-c788a21ce54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:14.165370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3137f6d-e82b-49b2-8cdb-c788a21ce54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:14.167329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3137f6d-e82b-49b2-8cdb-c788a21ce54f service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:14.179392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23ec1c-5272-4a5b-9abb-6ee21b32635e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:14.189427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23ec1c-5272-4a5b-9abb-6ee21b32635e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:14.234787 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1793/3588] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:14.235107 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1796/3589] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:50:14.317776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fd05-ebf8-4f87-a07d-d8877ba967a9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:14.318223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fd05-ebf8-4f87-a07d-d8877ba967a9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:14.318691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fd05-ebf8-4f87-a07d-d8877ba967a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:14.406378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ee36fd05-ebf8-4f87-a07d-d8877ba967a9 None None] MFA Rules not processed for user `4fb9f90ead624da1bbed75cd6215183e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:14.415045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ee36fd05-ebf8-4f87-a07d-d8877ba967a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:14.446552 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1794/3590] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:15.698737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df7861-9685-4352-a907-8cad6ac45e2b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:15.699344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df7861-9685-4352-a907-8cad6ac45e2b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:15.699802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df7861-9685-4352-a907-8cad6ac45e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:15.754262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-57df7861-9685-4352-a907-8cad6ac45e2b None None] MFA Rules not processed for user `4fb9f90ead624da1bbed75cd6215183e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:15.762475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57df7861-9685-4352-a907-8cad6ac45e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:15.780191 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1797/3591] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:16.370417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b3d1-988c-4896-bdd0-9ad0983930a1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:16.371160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b3d1-988c-4896-bdd0-9ad0983930a1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:16.371160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b3d1-988c-4896-bdd0-9ad0983930a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:16.433815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d0b5b3d1-988c-4896-bdd0-9ad0983930a1 None None] MFA Rules not processed for user `4fb9f90ead624da1bbed75cd6215183e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:16.441953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d0b5b3d1-988c-4896-bdd0-9ad0983930a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:16.464235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1795/3592] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:16.632080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c5c8-6103-4e7c-8999-ace1b2f975c6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:16.633947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c5c8-6103-4e7c-8999-ace1b2f975c6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:16.634432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c5c8-6103-4e7c-8999-ace1b2f975c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:16.672441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c73c5c8-6103-4e7c-8999-ace1b2f975c6 None None] MFA Rules not processed for user `4fb9f90ead624da1bbed75cd6215183e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:16.675206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c73c5c8-6103-4e7c-8999-ace1b2f975c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:16.689564 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1798/3593] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:16.849735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b3d1-988c-4896-bdd0-9ad0983930a1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:17.164426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b3d1-988c-4896-bdd0-9ad0983930a1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:17.185650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:17.186997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:17.187600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:17.188238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] PATH_INFO: `/v3/users/4fb9f90ead624da1bbed75cd6215183e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:17.197675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb9f90ead624da1bbed75cd6215183e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:17.201619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:17.417507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb9f90ead624da1bbed75cd6215183e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:17.461806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb9f90ead624da1bbed75cd6215183e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:17.463855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb9f90ead624da1bbed75cd6215183e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:17.502695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb9f90ead624da1bbed75cd6215183e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:17.503874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb9f90ead624da1bbed75cd6215183e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:17.542976 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1796/3594] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:50:16 2022] DELETE /identity/v3/users/4fb9f90ead624da1bbed75cd6215183e => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:50:17.545055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4fa25-a806-4117-92b0-ee2cc3a2a545 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:17.545589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4fa25-a806-4117-92b0-ee2cc3a2a545 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:17.545702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4fa25-a806-4117-92b0-ee2cc3a2a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:17.582145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97f4fa25-a806-4117-92b0-ee2cc3a2a545 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:17.584083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97f4fa25-a806-4117-92b0-ee2cc3a2a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:17.724348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:17.818919 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1799/3595] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:17.868525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:17.870108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:18.035617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:18.186187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bc3a9-6e11-4f6e-a60b-0f46790dd969 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:18.191689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:18.195515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:18.196489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:18.197022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:18.230920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:18.240030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:18.295426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1797/3596] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:18.488811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4fa25-a806-4117-92b0-ee2cc3a2a545 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:18.565337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4fa25-a806-4117-92b0-ee2cc3a2a545 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:18.615307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:18.619060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:18.620064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:18.633553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:18.643614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:18.714438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:18.721455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:18.764385 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1800/3597] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:19.415097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:19.417730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:19.439165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b587f-b557-4a93-9344-05ab423b8e31 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:19.451567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3638bd-bde3-410f-a4ef-c01bef333841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:19.452844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3638bd-bde3-410f-a4ef-c01bef333841 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:19.455717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3638bd-bde3-410f-a4ef-c01bef333841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:19.457369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3638bd-bde3-410f-a4ef-c01bef333841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:19.464784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb3638bd-bde3-410f-a4ef-c01bef333841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:19.658794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3638bd-bde3-410f-a4ef-c01bef333841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:19.662096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3638bd-bde3-410f-a4ef-c01bef333841 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:19.697323 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1798/3598] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:22.005498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:22.008351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:22.034427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead91450-aaad-45ef-8b98-5d7a660bd687 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:22.043396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:22.044309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:22.044603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:22.044893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] PATH_INFO: `/v3/projects/f520518ffcc94715b63f06b2711cab51` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:22.047476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f520518ffcc94715b63f06b2711cab51)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:22.055921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:22.175835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f520518ffcc94715b63f06b2711cab51', 'request_id': 'req-cba324e1-a87c-49c9-8c50-f569d7b67296'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:22.183957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f520518ffcc94715b63f06b2711cab51', 'request_id': 'req-cba324e1-a87c-49c9-8c50-f569d7b67296'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:22.193464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f520518ffcc94715b63f06b2711cab51', 'request_id': 'req-cba324e1-a87c-49c9-8c50-f569d7b67296'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:22.226244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] The token cache is being invalidate because project f520518ffcc94715b63f06b2711cab51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:50:22.226756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:22.228018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba324e1-a87c-49c9-8c50-f569d7b67296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:22.231474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1801/3599] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:22 2022] DELETE /identity/v3/projects/f520518ffcc94715b63f06b2711cab51 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:50:22.242052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b8dd-bb11-4807-b77d-46fd4172cc79 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:22.243165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b8dd-bb11-4807-b77d-46fd4172cc79 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:22.243490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b8dd-bb11-4807-b77d-46fd4172cc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:22.294221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3cb8b8dd-bb11-4807-b77d-46fd4172cc79 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:22.296238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3cb8b8dd-bb11-4807-b77d-46fd4172cc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:22.533530 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1799/3600] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:22.535913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0081b2-4243-461a-a130-31bdcadd1d99 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:22.536183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0081b2-4243-461a-a130-31bdcadd1d99 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:22.536554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0081b2-4243-461a-a130-31bdcadd1d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:22.582955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da0081b2-4243-461a-a130-31bdcadd1d99 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:22.584585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da0081b2-4243-461a-a130-31bdcadd1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:22.623779 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1802/3601] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:22.631074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8b8dd-bb11-4807-b77d-46fd4172cc79 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:22.719507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8b8dd-bb11-4807-b77d-46fd4172cc79 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:22.759484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:22.762696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:22.768513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:22.769049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:22.771252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:50:22.771909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:22.786367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:22.852768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0081b2-4243-461a-a130-31bdcadd1d99 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:22.854265 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1800/3602] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:50:22.870135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0081b2-4243-461a-a130-31bdcadd1d99 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:22.894783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:22.896272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:22.906026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:22.906864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:22.908636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:22.913278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:23.034701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:23.046949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1803/3603] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:50:22 2022] POST /identity/v3/projects => generated 395 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:50:23.067242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:23.077681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:23.096217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e01a-21f0-49c9-8488-97ed104af6e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:23.382298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e92fe4-9eb4-4543-b088-ed7869eebcc2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:23.399002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:23.400047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:23.400738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:23.401021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:23.412554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:23.433456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:23.484744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:23.539634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:23.542393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:23.567089 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1804/3604] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:23.592335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:23.593058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:23.593350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:23.593688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:23.597392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:23.600371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:23.662106 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1801/3605] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:50:23 2022] POST /identity/v3/users => generated 298 bytes in 628 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:50:23.667827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:23.689678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a41d9-e677-4076-be95-6611f237d150 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:23.704165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:23.705901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:23.706269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:23.707749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:23.711576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:23.717366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:23.755197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1805/3606] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:50:23.761397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:23.780326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da223be4-870b-412b-a23e-6fc19fcc0b39 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:23.793144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b54b4-2586-4523-bac7-8030ca740d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:23.794405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b54b4-2586-4523-bac7-8030ca740d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:23.794927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b54b4-2586-4523-bac7-8030ca740d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:23.795529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b54b4-2586-4523-bac7-8030ca740d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:23.796778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b54b4-2586-4523-bac7-8030ca740d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:23.801115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b54b4-2586-4523-bac7-8030ca740d96 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:23.832747 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1802/3607] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:23.850124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:23.873450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe273c-3172-47f8-8ad2-1dabd2b1f1f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:23.890723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:23.893773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:23.896298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:23.896985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] PATH_INFO: `/v3/projects/633d43bf7c6c48e5ba244d103fbd2fe6/users/24ffcc115d374182b9039ddfe987042d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:23.937967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633d43bf7c6c48e5ba244d103fbd2fe6, user_id=24ffcc115d374182b9039ddfe987042d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:23.946201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:23.985117 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1806/3608] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:50:23 2022] PUT /identity/v3/projects/633d43bf7c6c48e5ba244d103fbd2fe6/users/24ffcc115d374182b9039ddfe987042d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:50:23.993354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326616b-5dad-403b-ab97-b2e75f913a6b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:23.994298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326616b-5dad-403b-ab97-b2e75f913a6b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:23.995527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326616b-5dad-403b-ab97-b2e75f913a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:24.044202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9326616b-5dad-403b-ab97-b2e75f913a6b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:24.047292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9326616b-5dad-403b-ab97-b2e75f913a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:24.320939 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1803/3609] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:25.105258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:25.108274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:25.384099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b608b1-af45-4d66-91fd-5cc48c4b2d05 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:25.399923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae065e-85b3-4d0f-ada1-55f78cc166bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:25.401198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae065e-85b3-4d0f-ada1-55f78cc166bf service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:25.401690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae065e-85b3-4d0f-ada1-55f78cc166bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:25.402884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae065e-85b3-4d0f-ada1-55f78cc166bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:25.444374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae065e-85b3-4d0f-ada1-55f78cc166bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:25.449635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae065e-85b3-4d0f-ada1-55f78cc166bf service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:25.499781 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1807/3610] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:30.583454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326616b-5dad-403b-ab97-b2e75f913a6b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:30.636238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd79c77-4fd1-4049-83ff-aee3ef907228 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:30.636752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326616b-5dad-403b-ab97-b2e75f913a6b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:30.636858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd79c77-4fd1-4049-83ff-aee3ef907228 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:30.637266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd79c77-4fd1-4049-83ff-aee3ef907228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:30.656552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:30.662008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:30.666713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:30.667489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:30.677416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:30.704298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5dd79c77-4fd1-4049-83ff-aee3ef907228 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:30.705943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5dd79c77-4fd1-4049-83ff-aee3ef907228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:30.719189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:30.728616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:30.793871 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1804/3611] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:30.885985 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1808/3612] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:30.954423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:30.957064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:31.266408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6de5-013a-41ef-bbba-ffd885343b73 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:31.279258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:31.280717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:31.281699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:31.283117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:31.304625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:31.308296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:31.366466 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1805/3613] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:50:32.250532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48776d9-afd9-4d77-8d92-47c5f76ae457 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:32.251582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48776d9-afd9-4d77-8d92-47c5f76ae457 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:32.252025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48776d9-afd9-4d77-8d92-47c5f76ae457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:32.283239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a48776d9-afd9-4d77-8d92-47c5f76ae457 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:32.284946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a48776d9-afd9-4d77-8d92-47c5f76ae457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:32.293981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1809/3614] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:32.322486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:32.341258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a646-1bc6-4558-be2f-c0a33c73c7ba service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:32.358471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:32.365685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:32.366669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:32.367212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:32.379608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:32.381581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:32.417600 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1806/3615] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:50:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:33.080523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af476-29f1-4808-bfba-9aaee44f8d3b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:33.080804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af476-29f1-4808-bfba-9aaee44f8d3b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:33.081964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af476-29f1-4808-bfba-9aaee44f8d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:33.125055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b80af476-29f1-4808-bfba-9aaee44f8d3b None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:33.133925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b80af476-29f1-4808-bfba-9aaee44f8d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:33.160421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1810/3616] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:33.178392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:33.191113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01fa98-7376-4d75-952c-9290b186210c service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:33.207953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036cedd-f48e-439f-b1ea-4d73e9f12fee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:33.230034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036cedd-f48e-439f-b1ea-4d73e9f12fee service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:33.230791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036cedd-f48e-439f-b1ea-4d73e9f12fee service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:33.231326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036cedd-f48e-439f-b1ea-4d73e9f12fee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:33.253847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036cedd-f48e-439f-b1ea-4d73e9f12fee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:33.256048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036cedd-f48e-439f-b1ea-4d73e9f12fee service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:33.290480 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1807/3617] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:50:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:34.308786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:34.309771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:34.310237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:34.325237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:34.325706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:34.325896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:34.379972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] MFA Rules not processed for user `2625ce3aa5034d048494fca0dc403c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:34.381734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:34.396130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:34.405593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:34.417494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] MFA Rules not processed for user `1db067ac2fdc491e866b8dcfdfe8d606`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:34.419109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:34.539159 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1811/3618] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:34.592405 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1808/3619] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:34.663804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:34.665727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:34.853635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e691a-1159-4feb-9682-dfef9f890f46 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:34.884001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:34.885063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:34.885459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:34.887728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:34.915650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:34.919571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:34.963793 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1812/3620] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:50:34.996202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:34.998109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:35.032591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85501-8266-41ed-9065-7e58bc93a7de None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:35.046427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:35.047551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:35.048010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:35.048520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:35.074156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:35.075953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:35.093826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1809/3621] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:50:37.950780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:37.952900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:38.001432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700eb28f-9cd3-4d01-af8f-f873693f0e0b service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:38.020314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:38.021559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:38.022132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:38.022643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] PATH_INFO: `/v3/users/331a222a893c4f84a08abf11333c7449` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:38.025397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=331a222a893c4f84a08abf11333c7449)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:38.028199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:38.174555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '331a222a893c4f84a08abf11333c7449'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:38.225118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '331a222a893c4f84a08abf11333c7449'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:38.254174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '331a222a893c4f84a08abf11333c7449'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:38.256501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '331a222a893c4f84a08abf11333c7449'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:38.273799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cab1a4ee-8f0f-4722-9f51-d9e233cadaf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '331a222a893c4f84a08abf11333c7449'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:38.301198 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1813/3622] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:50:37 2022] DELETE /identity/v3/users/331a222a893c4f84a08abf11333c7449 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:50:39.789648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:39.806543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89004bf6-72d8-4e3d-8ddc-b18b1b3a34e4 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:39.959354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:39.960273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:39.960741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:39.961269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] PATH_INFO: `/v3/projects/52b2ada3fd2842f0a04fdedaf4bd908e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:39.963140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b2ada3fd2842f0a04fdedaf4bd908e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:39.966831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:40.058443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b2ada3fd2842f0a04fdedaf4bd908e', 'request_id': 'req-81d81875-0afa-43fa-a085-b1b462d46f4f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:40.075465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b2ada3fd2842f0a04fdedaf4bd908e', 'request_id': 'req-81d81875-0afa-43fa-a085-b1b462d46f4f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:40.136895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b2ada3fd2842f0a04fdedaf4bd908e', 'request_id': 'req-81d81875-0afa-43fa-a085-b1b462d46f4f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:40.155007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] The token cache is being invalidate because project 52b2ada3fd2842f0a04fdedaf4bd908e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:50:40.155339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:40.156139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81d81875-0afa-43fa-a085-b1b462d46f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:40.164050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1b23-6adf-49fb-a21e-9eab2b073922 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:40.164587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1b23-6adf-49fb-a21e-9eab2b073922 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:40.164917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1b23-6adf-49fb-a21e-9eab2b073922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:40.166344 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1810/3623] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:39 2022] DELETE /identity/v3/projects/52b2ada3fd2842f0a04fdedaf4bd908e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:40.197384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-68cc1b23-6adf-49fb-a21e-9eab2b073922 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:40.199573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-68cc1b23-6adf-49fb-a21e-9eab2b073922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:40.226496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:40.387655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e4e6-cafc-4b14-b37f-a7cf4ad6ca3d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:40.388209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e4e6-cafc-4b14-b37f-a7cf4ad6ca3d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:40.388687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e4e6-cafc-4b14-b37f-a7cf4ad6ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:40.392408 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1814/3624] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:40.414069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b259e4e6-cafc-4b14-b37f-a7cf4ad6ca3d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:40.415676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b259e4e6-cafc-4b14-b37f-a7cf4ad6ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:40.429376 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1811/3625] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:40.434080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc1b23-6adf-49fb-a21e-9eab2b073922 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:40.449495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc1b23-6adf-49fb-a21e-9eab2b073922 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:40.457032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:40.458692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:40.459549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:40.459998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:40.460958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:50:40.461501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:40.468190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:40.493007 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1815/3626] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:50:40.498432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e4e6-cafc-4b14-b37f-a7cf4ad6ca3d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:40.513963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e4e6-cafc-4b14-b37f-a7cf4ad6ca3d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:40.521890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:40.522526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:40.522952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:40.523431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:40.524385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:40.527765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:40.539977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:40.602191 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1812/3627] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:50:40 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:50:40.607043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:40.638026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0238-2d5d-41aa-a63f-a4e52fa65ff9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:40.805256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:40.805982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:40.806278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:40.806566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:40.807324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:40.813457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:40.870107 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1816/3628] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:50:40 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:50:40.876726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:40.894124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b70cdd-1fa1-443d-81d1-699ade1b5086 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:40.900331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:40.901600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:40.902238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:40.904113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:40.905212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:40.907869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:40.929106 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1813/3629] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:40.930896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:40.945522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92446832-c4ac-4c1e-a2f6-1781d80d8e60 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:40.955181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483696e-3d2d-4c42-8f50-c9096c0886bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:40.955964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483696e-3d2d-4c42-8f50-c9096c0886bd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:40.956259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483696e-3d2d-4c42-8f50-c9096c0886bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:40.956550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483696e-3d2d-4c42-8f50-c9096c0886bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:40.957343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483696e-3d2d-4c42-8f50-c9096c0886bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:40.959468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483696e-3d2d-4c42-8f50-c9096c0886bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:40.977747 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1817/3630] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:50:40.980169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:41.003201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96619f4-5aa0-4d96-8b0c-51d415c50241 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:41.013832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:41.015674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:41.016298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:41.017143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] PATH_INFO: `/v3/projects/1a307dcb18fe4909bc0421fb1fb18892/users/7ef211f562144656a4a95f4e0df02341/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:41.054140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a307dcb18fe4909bc0421fb1fb18892, user_id=7ef211f562144656a4a95f4e0df02341, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:41.061565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:41.096492 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1814/3631] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:50:40 2022] PUT /identity/v3/projects/1a307dcb18fe4909bc0421fb1fb18892/users/7ef211f562144656a4a95f4e0df02341/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:50:41.099979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025d473-37fc-48dc-b2bd-b70626d25906 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:41.100712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025d473-37fc-48dc-b2bd-b70626d25906 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:41.101343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025d473-37fc-48dc-b2bd-b70626d25906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:41.149977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9025d473-37fc-48dc-b2bd-b70626d25906 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:41.157560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9025d473-37fc-48dc-b2bd-b70626d25906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:41.378341 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1818/3632] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:41.492138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:41.494143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:41.664603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ad864-b041-4c55-aa6a-032acd30f7a1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:41.696831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:41.704613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:41.705326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:41.705822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:41.778658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:41.781104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:41.832083 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1815/3633] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:44.709427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa466-bff3-4366-8de0-a3ff36d03cbe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:44.710542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa466-bff3-4366-8de0-a3ff36d03cbe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:44.711113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa466-bff3-4366-8de0-a3ff36d03cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:44.756158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-88dfa466-bff3-4366-8de0-a3ff36d03cbe None None] MFA Rules not processed for user `1db067ac2fdc491e866b8dcfdfe8d606`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:44.757742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88dfa466-bff3-4366-8de0-a3ff36d03cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:44.794508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:44.927091 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1819/3634] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:45.534205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:45.544628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:45.618245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e26abf-6a51-455d-99ad-043facea9628 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:45.644021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:45.649197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:45.650331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:45.651143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:45.670023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:45.714519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:45.718649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:45.743672 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1816/3635] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:49.475131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f44c-48f6-489d-8557-095b493b514b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:49.476414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f44c-48f6-489d-8557-095b493b514b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:49.476920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f44c-48f6-489d-8557-095b493b514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:49.529599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-18f5f44c-48f6-489d-8557-095b493b514b None None] MFA Rules not processed for user `2625ce3aa5034d048494fca0dc403c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:49.541603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18f5f44c-48f6-489d-8557-095b493b514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:49.667253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:49.669105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:49.793869 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1820/3636] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:49.894484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae604406-ebe1-4666-bcca-2234e4bb6807 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:49.904164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:49.905659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:49.906153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:49.907222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:49.918778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:49.983377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:49.985383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:50.033337 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1817/3637] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:53.410110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e3019-6e2f-4046-85fc-909b1e6bc54f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:53.411489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e3019-6e2f-4046-85fc-909b1e6bc54f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:53.412699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e3019-6e2f-4046-85fc-909b1e6bc54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:53.446812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d26e3019-6e2f-4046-85fc-909b1e6bc54f None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:53.450056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d26e3019-6e2f-4046-85fc-909b1e6bc54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:53.651136 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1821/3638] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:53.718921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:53.725858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:53.860278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:53.972752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e355d4-1467-4414-9b58-134bae35318a service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:53.998362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb6ab4-4150-4634-8617-b457e8ffbe9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:53.999075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6ab4-4150-4634-8617-b457e8ffbe9a service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:53.999472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6ab4-4150-4634-8617-b457e8ffbe9a service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:53.999765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6ab4-4150-4634-8617-b457e8ffbe9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:54.019542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb6ab4-4150-4634-8617-b457e8ffbe9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:54.021228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb6ab4-4150-4634-8617-b457e8ffbe9a service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:54.032911 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1818/3639] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:54.322874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc0a5-39a5-4ff9-8b09-ebf6f556b22f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:54.323168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc0a5-39a5-4ff9-8b09-ebf6f556b22f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:54.323783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc0a5-39a5-4ff9-8b09-ebf6f556b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:54.394776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-20dcc0a5-39a5-4ff9-8b09-ebf6f556b22f None None] MFA Rules not processed for user `24ffcc115d374182b9039ddfe987042d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:54.396135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20dcc0a5-39a5-4ff9-8b09-ebf6f556b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:54.572341 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1822/3640] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:54.573002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d599a1-37e1-4fe6-b5c7-d75337c9e986 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:54.573002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d599a1-37e1-4fe6-b5c7-d75337c9e986 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:54.573353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d599a1-37e1-4fe6-b5c7-d75337c9e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:54.614460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-31d599a1-37e1-4fe6-b5c7-d75337c9e986 None None] MFA Rules not processed for user `24ffcc115d374182b9039ddfe987042d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:54.616620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31d599a1-37e1-4fe6-b5c7-d75337c9e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:54.637985 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1819/3641] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:54.976991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:54.977595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:54.978093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:54.987165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:55.018828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:55.020985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:55.046805 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1823/3642] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:50:55.059454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d599a1-37e1-4fe6-b5c7-d75337c9e986 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:55.086783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d599a1-37e1-4fe6-b5c7-d75337c9e986 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:55.106682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1348d-27b7-418c-8d86-bf7f54293fe0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:55.107866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1348d-27b7-418c-8d86-bf7f54293fe0 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:55.113285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1348d-27b7-418c-8d86-bf7f54293fe0 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:55.113957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1348d-27b7-418c-8d86-bf7f54293fe0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:55.144497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1348d-27b7-418c-8d86-bf7f54293fe0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:55.157729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1348d-27b7-418c-8d86-bf7f54293fe0 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:55.197302 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1820/3643] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:50:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:50:55.490526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:55.492211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:55.802353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b76e6-d16f-4107-8ac0-cc13bd82d397 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:55.822204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:55.824064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:55.824563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:55.825241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:55.856423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:55.858968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:55.917383 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1824/3644] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:56.519056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:56.519947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:56.519947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:56.554194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:56.556456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:56.575314 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1821/3645] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:56.603425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:56.637810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38d04c-af88-4e36-b4ca-7edbd704e55d service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:56.660327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4ea1d-e704-45c0-b083-a1c9e8db7d18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:56.661428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4ea1d-e704-45c0-b083-a1c9e8db7d18 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:56.661953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4ea1d-e704-45c0-b083-a1c9e8db7d18 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:56.662476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4ea1d-e704-45c0-b083-a1c9e8db7d18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:56.689633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4ea1d-e704-45c0-b083-a1c9e8db7d18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:56.696634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4ea1d-e704-45c0-b083-a1c9e8db7d18 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:56.715028 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1825/3646] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:50:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:57.041952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:57.044486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:57.086482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13eb212-6ebb-43d7-8123-169f73208dbb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:57.101828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:57.102835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:57.103167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:57.103727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] PATH_INFO: `/v3/users/9ac47e12cd544be0bb7a6c7616e1aaed` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:57.107231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac47e12cd544be0bb7a6c7616e1aaed)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:57.112984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:57.233699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac47e12cd544be0bb7a6c7616e1aaed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:57.260372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac47e12cd544be0bb7a6c7616e1aaed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:57.270675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac47e12cd544be0bb7a6c7616e1aaed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:57.323852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac47e12cd544be0bb7a6c7616e1aaed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:57.325245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac47e12cd544be0bb7a6c7616e1aaed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:50:57.360803 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1822/3647] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:50:57 2022] DELETE /identity/v3/users/9ac47e12cd544be0bb7a6c7616e1aaed => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:50:57.367022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046072c-40ca-4040-bfae-946d40f1288e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:57.367804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046072c-40ca-4040-bfae-946d40f1288e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:57.368425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046072c-40ca-4040-bfae-946d40f1288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:57.469465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5046072c-40ca-4040-bfae-946d40f1288e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:50:57.478884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5046072c-40ca-4040-bfae-946d40f1288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:57.773949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1826/3648] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:50:57.981293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:50:57.984029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:50:58.259941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7387e1-d6dd-4366-af85-451bbd339fe3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:50:58.284804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:50:58.286063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:50:58.286491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:50:58.286788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:50:58.312835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:50:58.314642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:50:58.343207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1823/3649] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:00.274501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:00.279105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:00.283127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:00.393820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] MFA Rules not processed for user `7ef211f562144656a4a95f4e0df02341`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:00.398513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:00.675645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:00.708177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1827/3650] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:00.937271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:00.939910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:00.944418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:00.948009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:01.004326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e44ff-9838-429a-b2a5-9644a30186bc service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:01.037463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:01.038794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:01.040080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:01.040657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] PATH_INFO: `/v3/projects/accf60fb4fd44f6fa6f8cf9302662d68` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:01.048798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accf60fb4fd44f6fa6f8cf9302662d68)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:01.052858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:01.094731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:01.276943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56ff6-b7b4-4b8a-b3d9-7a24cbb921ba None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:01.333567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accf60fb4fd44f6fa6f8cf9302662d68', 'request_id': 'req-b7c1d9af-a360-469a-8916-62d2abf17900'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:01.354710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accf60fb4fd44f6fa6f8cf9302662d68', 'request_id': 'req-b7c1d9af-a360-469a-8916-62d2abf17900'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:01.386726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accf60fb4fd44f6fa6f8cf9302662d68', 'request_id': 'req-b7c1d9af-a360-469a-8916-62d2abf17900'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:01.422612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] The token cache is being invalidate because project accf60fb4fd44f6fa6f8cf9302662d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:51:01.422922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:01.424498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7c1d9af-a360-469a-8916-62d2abf17900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:01.435775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1824/3651] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:51:00 2022] DELETE /identity/v3/projects/accf60fb4fd44f6fa6f8cf9302662d68 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:01.437376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f57842-0363-4352-800e-3056a8f91c96 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:01.437710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f57842-0363-4352-800e-3056a8f91c96 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:01.438004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f57842-0363-4352-800e-3056a8f91c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:01.464251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef938b7-d0f1-4515-9db7-a787f6d8c5c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:01.465282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef938b7-d0f1-4515-9db7-a787f6d8c5c2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:01.465838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef938b7-d0f1-4515-9db7-a787f6d8c5c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:01.466304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef938b7-d0f1-4515-9db7-a787f6d8c5c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:01.469764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ef938b7-d0f1-4515-9db7-a787f6d8c5c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:01.512185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b2f57842-0363-4352-800e-3056a8f91c96 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:01.521835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2f57842-0363-4352-800e-3056a8f91c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:01.732436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef938b7-d0f1-4515-9db7-a787f6d8c5c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:01.734603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef938b7-d0f1-4515-9db7-a787f6d8c5c2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:01.758302 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1828/3652] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:01.764338 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1825/3653] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:01.775223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3ac2-2265-485a-9ea2-41220c70c6df None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:01.775554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3ac2-2265-485a-9ea2-41220c70c6df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:01.775845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3ac2-2265-485a-9ea2-41220c70c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:01.833576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5f8f3ac2-2265-485a-9ea2-41220c70c6df None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:01.835458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f8f3ac2-2265-485a-9ea2-41220c70c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:01.849048 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1829/3654] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:01.853609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f57842-0363-4352-800e-3056a8f91c96 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:01.880118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f57842-0363-4352-800e-3056a8f91c96 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:01.905016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:01.906024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:01.910572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:01.911317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:01.913044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:51:01.913882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:01.919146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:01.946575 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1826/3655] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:51:01.951339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f3ac2-2265-485a-9ea2-41220c70c6df None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:01.983919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f3ac2-2265-485a-9ea2-41220c70c6df None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:01.997940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:01.998878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:01.999320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:01.999711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:02.001843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:02.006744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:02.093368 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1830/3656] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:51:01 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:51:02.093573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:02.109686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f71db-2503-4f16-bc66-ed5a0352c57d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:02.213978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:02.214987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:02.216804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:02.217210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:02.218250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:02.221254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:02.298686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:02.299969 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1827/3657] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:51:02 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:51:02.319959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c3b9-9a69-4995-ada0-da0613e04ced admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:02.330426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:02.331548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:02.331964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:02.332359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:02.333286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:02.335327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:02.337854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:02.369863 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1831/3658] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:51:02.374387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:02.393094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add06534-57d5-44e2-9678-28300b2fb1cb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:02.402183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd60ed-8529-40d9-94cd-c428700388ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:02.403030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd60ed-8529-40d9-94cd-c428700388ec admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:02.403586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd60ed-8529-40d9-94cd-c428700388ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:02.404601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd60ed-8529-40d9-94cd-c428700388ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:02.405474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd60ed-8529-40d9-94cd-c428700388ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:02.408873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd60ed-8529-40d9-94cd-c428700388ec admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:02.419516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:02.432646 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1828/3659] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:51:02.437468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:02.451295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e6b01-0eef-4f8c-a672-5bd0e17867c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:02.459143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:02.460682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:02.461346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:02.461346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] PATH_INFO: `/v3/projects/6411d2a129c34c4080f7097ff8e2a566/users/5f3aa69fa13247cdb6cb55057b6bba13/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:02.487747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6411d2a129c34c4080f7097ff8e2a566, user_id=5f3aa69fa13247cdb6cb55057b6bba13, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:02.491982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:02.540006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1832/3660] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:51:02 2022] PUT /identity/v3/projects/6411d2a129c34c4080f7097ff8e2a566/users/5f3aa69fa13247cdb6cb55057b6bba13/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:02.554507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:02.555014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:02.555556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:02.664508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] MFA Rules not processed for user `5f3aa69fa13247cdb6cb55057b6bba13`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:02.668334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:02.706874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:02.709285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:02.877478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce13ea-3975-4536-bbe8-ff5acd16a0bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:02.893938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:02.894876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:02.895203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:02.896816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] PATH_INFO: `/v3/users/a05fac57c00245d8965ed40f144b27e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:02.900125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05fac57c00245d8965ed40f144b27e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:02.909930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:02.910276 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1829/3661] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:02.912398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:02.915482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:03.039219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05fac57c00245d8965ed40f144b27e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:03.073559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05fac57c00245d8965ed40f144b27e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:03.098007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05fac57c00245d8965ed40f144b27e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:03.098815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05fac57c00245d8965ed40f144b27e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:03.114333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05fac57c00245d8965ed40f144b27e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:03.122431 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1833/3662] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:51:02 2022] DELETE /identity/v3/users/a05fac57c00245d8965ed40f144b27e9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:03.276685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012f955-36a6-403a-8d08-364a75a08919 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:03.465560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:03.466370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:03.467740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:03.467832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:03.476759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:03.513501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:03.515590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:03.543783 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1830/3663] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:04.775622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:04.777239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:04.807671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369c6a-ee16-4d87-89b6-c2a7785b99ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:04.816263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:04.823169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:04.836636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:04.841343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:04.841944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:04.843653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:04.849816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:04.882822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:05.016834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d7ac5-f94e-408a-9c7d-577d1fe707f6 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:05.025529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:05.026945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:05.029103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:05.029531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] PATH_INFO: `/v3/projects/e4a6f1fb6e554564b4ee3c6586646b17` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:05.032996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a6f1fb6e554564b4ee3c6586646b17)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:05.043081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:05.085085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:05.124670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:05.126880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:05.159732 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1834/3664] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:05.196338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a6f1fb6e554564b4ee3c6586646b17', 'request_id': 'req-84cf5be6-4bfc-4934-9641-3b869b026f0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.241042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a6f1fb6e554564b4ee3c6586646b17', 'request_id': 'req-84cf5be6-4bfc-4934-9641-3b869b026f0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.281711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a6f1fb6e554564b4ee3c6586646b17', 'request_id': 'req-84cf5be6-4bfc-4934-9641-3b869b026f0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.325881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] The token cache is being invalidate because project e4a6f1fb6e554564b4ee3c6586646b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:51:05.326230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.327686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84cf5be6-4bfc-4934-9641-3b869b026f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.332949 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1831/3665] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:51:04 2022] DELETE /identity/v3/projects/e4a6f1fb6e554564b4ee3c6586646b17 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:05.336821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:05.353317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395def1-8ea2-4925-b04e-472f14f10d9a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:05.577120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:05.578979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:05.579760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:05.580343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] PATH_INFO: `/v3/users/73d4f50dad7f4217806d7a9229dd5868` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:05.586384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d4f50dad7f4217806d7a9229dd5868)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:05.588772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:05.697340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d4f50dad7f4217806d7a9229dd5868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.719065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d4f50dad7f4217806d7a9229dd5868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.732612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d4f50dad7f4217806d7a9229dd5868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.734667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d4f50dad7f4217806d7a9229dd5868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.747298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d4f50dad7f4217806d7a9229dd5868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:05.761029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1835/3666] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:51:05 2022] DELETE /identity/v3/users/73d4f50dad7f4217806d7a9229dd5868 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:05.903646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db651e-53ed-4e6e-9d6a-38594f7bae90 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:05.905636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db651e-53ed-4e6e-9d6a-38594f7bae90 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:05.908285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db651e-53ed-4e6e-9d6a-38594f7bae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:06.006707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e1db651e-53ed-4e6e-9d6a-38594f7bae90 None None] MFA Rules not processed for user `7ef211f562144656a4a95f4e0df02341`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:06.009041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e1db651e-53ed-4e6e-9d6a-38594f7bae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:06.407903 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1832/3667] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:07.123977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:07.127593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:07.361134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c561bbb-bc74-42cb-a02b-a32e8d3b9dcd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:07.379223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:07.380764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:07.381063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:07.381346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] PATH_INFO: `/v3/projects/68dbc7aaa5704a53b305a1d1c2f406fd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:07.384329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68dbc7aaa5704a53b305a1d1c2f406fd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:07.386562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:07.432774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:07.561215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68dbc7aaa5704a53b305a1d1c2f406fd', 'request_id': 'req-0b7277c4-25de-424a-8efe-0bfa877b828f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:07.571563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68dbc7aaa5704a53b305a1d1c2f406fd', 'request_id': 'req-0b7277c4-25de-424a-8efe-0bfa877b828f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:07.587192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68dbc7aaa5704a53b305a1d1c2f406fd', 'request_id': 'req-0b7277c4-25de-424a-8efe-0bfa877b828f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:07.612681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] The token cache is being invalidate because project 68dbc7aaa5704a53b305a1d1c2f406fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:51:07.613094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:07.614182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b7277c4-25de-424a-8efe-0bfa877b828f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:07.618613 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1836/3668] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:51:07 2022] DELETE /identity/v3/projects/68dbc7aaa5704a53b305a1d1c2f406fd => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:07.624470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719e6e-8a35-4adc-be25-fcee89d7376c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:07.625100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719e6e-8a35-4adc-be25-fcee89d7376c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:07.625227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719e6e-8a35-4adc-be25-fcee89d7376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:07.667314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9c719e6e-8a35-4adc-be25-fcee89d7376c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:07.669079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9c719e6e-8a35-4adc-be25-fcee89d7376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:07.795115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:07.837618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2dc5-a4c4-4a29-9763-739dcf35fba0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:07.838279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2dc5-a4c4-4a29-9763-739dcf35fba0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:07.838716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2dc5-a4c4-4a29-9763-739dcf35fba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:07.839106 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1833/3669] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:07.904409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8abf2dc5-a4c4-4a29-9763-739dcf35fba0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:07.908584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8abf2dc5-a4c4-4a29-9763-739dcf35fba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:07.939226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1837/3670] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:07.946703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c719e6e-8a35-4adc-be25-fcee89d7376c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:07.971427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c719e6e-8a35-4adc-be25-fcee89d7376c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:07.978216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:07.979876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:07.980490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:07.981097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:07.982164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:51:07.982758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:07.985857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:08.012257 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1834/3671] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:51:08.018148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf2dc5-a4c4-4a29-9763-739dcf35fba0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:08.031556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf2dc5-a4c4-4a29-9763-739dcf35fba0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:08.038962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:08.039968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:08.040707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:08.041259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:08.043067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:08.046230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:08.117682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1838/3672] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:51:08 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:51:08.118517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:08.134728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d08fe-597c-40f2-8833-a4c123e9a1b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:08.273982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:08.275459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:08.276064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:08.277032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:08.278150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:08.280760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:08.333826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1835/3673] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:51:08 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:51:08.336429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:08.369528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd62e9-026c-4746-9e2a-6b054613b3ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:08.413119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:08.418983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:08.419893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:08.426736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:08.427547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:08.434581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:08.470160 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1839/3674] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:51:08.476853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:08.504753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21726da-721f-4bb4-8bfe-59fe6fb356ae admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:08.517624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9fec2-eaef-45bd-ba10-d5f7e4b4821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:08.520031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9fec2-eaef-45bd-ba10-d5f7e4b4821e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:08.520924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9fec2-eaef-45bd-ba10-d5f7e4b4821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:08.521531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9fec2-eaef-45bd-ba10-d5f7e4b4821e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:08.523174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9fec2-eaef-45bd-ba10-d5f7e4b4821e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:08.527083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9fec2-eaef-45bd-ba10-d5f7e4b4821e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:08.591031 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1836/3675] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:51:08.599065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:08.640798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a455-81fb-461f-98f4-47e3148d96ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:08.664907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:08.668281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:08.672606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:08.673389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] PATH_INFO: `/v3/projects/27951e61632946f58c199f09723d6fdd/users/b06a5d6f31ea4d4a9a7e69f759a3c7ce/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:08.728533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27951e61632946f58c199f09723d6fdd, user_id=b06a5d6f31ea4d4a9a7e69f759a3c7ce, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:08.735129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:08.788974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:08.789641 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1840/3676] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:51:08 2022] PUT /identity/v3/projects/27951e61632946f58c199f09723d6fdd/users/b06a5d6f31ea4d4a9a7e69f759a3c7ce/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:08.790137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:08.790417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:08.836605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:08.837897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:08.986743 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1837/3677] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:08.988338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:08.992670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:09.089422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bedc4-b776-4016-8f10-5d5265ea90e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:09.101871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4feafa-e104-48eb-8161-4eb9acbe8236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:09.103053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4feafa-e104-48eb-8161-4eb9acbe8236 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:09.103756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4feafa-e104-48eb-8161-4eb9acbe8236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:09.103952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4feafa-e104-48eb-8161-4eb9acbe8236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:09.116759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4feafa-e104-48eb-8161-4eb9acbe8236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:09.123666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4feafa-e104-48eb-8161-4eb9acbe8236 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:09.148463 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1841/3678] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:10.177791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:10.180325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:10.203918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6f83-8aeb-41d2-844c-e318e542a606 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:10.232282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:10.233785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:10.235213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:10.235775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] PATH_INFO: `/v3/users/5f3aa69fa13247cdb6cb55057b6bba13` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:10.238910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3aa69fa13247cdb6cb55057b6bba13)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:10.243342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:10.376516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3aa69fa13247cdb6cb55057b6bba13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:10.382488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:10.418664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3aa69fa13247cdb6cb55057b6bba13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:10.419994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3aa69fa13247cdb6cb55057b6bba13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:10.448761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3aa69fa13247cdb6cb55057b6bba13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:10.449777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3aa69fa13247cdb6cb55057b6bba13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:10.488239 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1838/3679] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:51:10 2022] DELETE /identity/v3/users/5f3aa69fa13247cdb6cb55057b6bba13 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:10.493166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:10.494231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:10.494701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:10.541311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:10.543157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:10.653047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:10.747722 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1842/3680] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:51:10.778038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:10.780384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:10.871731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d40f8-806c-432a-a9d7-73697a7ffca9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:10.881457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ac9b-163a-48f2-8f4a-92f50913a3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:10.881457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ac9b-163a-48f2-8f4a-92f50913a3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:10.881457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ac9b-163a-48f2-8f4a-92f50913a3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:10.883842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ac9b-163a-48f2-8f4a-92f50913a3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:10.917620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ac9b-163a-48f2-8f4a-92f50913a3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:10.922535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ac9b-163a-48f2-8f4a-92f50913a3e1 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:10.948246 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1839/3681] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:51:12.367259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:12.370422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:12.412791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1da98f-aeba-4ed9-94d4-813f99260bb9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:12.427392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:12.430280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:12.430806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:12.431329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] PATH_INFO: `/v3/projects/6411d2a129c34c4080f7097ff8e2a566` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:12.433373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6411d2a129c34c4080f7097ff8e2a566)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:12.441139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:12.587452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8b7fe-0c48-4b00-885f-e53c28302c23 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:12.588011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8b7fe-0c48-4b00-885f-e53c28302c23 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:12.588229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8b7fe-0c48-4b00-885f-e53c28302c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:12.600187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6411d2a129c34c4080f7097ff8e2a566', 'request_id': 'req-eb367204-08a6-4225-8980-8c9520aeb031'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:12.613829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6411d2a129c34c4080f7097ff8e2a566', 'request_id': 'req-eb367204-08a6-4225-8980-8c9520aeb031'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:12.634805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6411d2a129c34c4080f7097ff8e2a566', 'request_id': 'req-eb367204-08a6-4225-8980-8c9520aeb031'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:12.650359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b1d8b7fe-0c48-4b00-885f-e53c28302c23 None None] MFA Rules not processed for user `a185fa24374c417aa2bb9302a608cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:12.653383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b1d8b7fe-0c48-4b00-885f-e53c28302c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:12.699762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] The token cache is being invalidate because project 6411d2a129c34c4080f7097ff8e2a566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:51:12.703305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:12.707147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb367204-08a6-4225-8980-8c9520aeb031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:12.721580 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1843/3682] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:51:12 2022] DELETE /identity/v3/projects/6411d2a129c34c4080f7097ff8e2a566 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:12.734319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27331-7a68-44ff-8ee9-b0592b12cb43 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:12.734930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27331-7a68-44ff-8ee9-b0592b12cb43 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:12.735997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27331-7a68-44ff-8ee9-b0592b12cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:12.784525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d1b27331-7a68-44ff-8ee9-b0592b12cb43 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:12.788289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1b27331-7a68-44ff-8ee9-b0592b12cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:12.884906 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1840/3683] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:12.965012 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1844/3684] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:12.966459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346acfe-701d-47cc-907b-a40681a14051 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:12.966750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346acfe-701d-47cc-907b-a40681a14051 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:12.967031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346acfe-701d-47cc-907b-a40681a14051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:13.006143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a346acfe-701d-47cc-907b-a40681a14051 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:13.008568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a346acfe-701d-47cc-907b-a40681a14051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:13.030258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27331-7a68-44ff-8ee9-b0592b12cb43 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:13.030787 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1841/3685] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:13.058687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27331-7a68-44ff-8ee9-b0592b12cb43 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:13.071088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:13.073838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:13.074806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:13.075595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:13.078033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:51:13.078712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:13.082423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:13.115565 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1845/3686] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:51:13.120053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346acfe-701d-47cc-907b-a40681a14051 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:13.138021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346acfe-701d-47cc-907b-a40681a14051 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:13.150783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:13.151676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:13.152036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:13.152387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:13.153378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:13.157907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:13.279946 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1842/3687] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:51:13 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:51:13.281433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:13.301974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a4dd7-fe8f-4af7-8d58-21b6c0f266d4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:13.461444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:13.505087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:13.506614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:13.507399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:13.508137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:13.509692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:13.516722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:13.590320 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1846/3688] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:51:13 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:51:13.595869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:13.630879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551de546-f4b9-4c7b-b0a0-8ff794a4e680 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:13.656794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:13.657947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:13.658448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:13.658948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:13.662323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:13.685408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:13.718006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:13.731608 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1843/3689] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:51:13.735173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012580d-6919-4f0f-8b6e-6b290a74de13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:13.749289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c3d09-7248-46c4-8db0-943d3a834548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:13.750573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c3d09-7248-46c4-8db0-943d3a834548 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:13.751187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c3d09-7248-46c4-8db0-943d3a834548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:13.751658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c3d09-7248-46c4-8db0-943d3a834548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:13.753113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c3d09-7248-46c4-8db0-943d3a834548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:13.755380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c3d09-7248-46c4-8db0-943d3a834548 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:13.817064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:13.828235 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1847/3690] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:51:13.842591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dd99e-bea9-48e1-9f8e-602373140e46 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:13.865945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:13.868114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:13.869469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:13.871587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] PATH_INFO: `/v3/projects/1ea96ec22cc6498da49173cf1f6bb455/users/86449d2ab5474b80bd4a05cc4c233da2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:13.947427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea96ec22cc6498da49173cf1f6bb455, user_id=86449d2ab5474b80bd4a05cc4c233da2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:13.954477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:14.022171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1844/3691] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:51:13 2022] PUT /identity/v3/projects/1ea96ec22cc6498da49173cf1f6bb455/users/86449d2ab5474b80bd4a05cc4c233da2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:14.040724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:14.041203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:14.041689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:14.167367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] MFA Rules not processed for user `86449d2ab5474b80bd4a05cc4c233da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:14.168370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:14.314435 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1848/3692] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:14.583248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:14.585182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:14.605621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:14.729243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf81cf-60ec-4b7e-9b70-0d63ace9a2a9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:14.757561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:14.759332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:14.760119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:14.760931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:14.766330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:14.818247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:14.824343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:14.871402 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1845/3693] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:15.647497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:15.653053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:15.693999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929d980-8954-4ffa-9f67-ce6bac221a21 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:15.701135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fa041-88af-40db-94ef-f322487533b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:15.702700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa041-88af-40db-94ef-f322487533b2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:15.708370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa041-88af-40db-94ef-f322487533b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:15.711433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa041-88af-40db-94ef-f322487533b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:15.723023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fa041-88af-40db-94ef-f322487533b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:15.725670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fa041-88af-40db-94ef-f322487533b2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:15.751751 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1849/3694] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:17.251688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:17.278950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70fa1-0b98-4013-b101-dc3bce59db6f service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:17.300568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:17.301658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:17.303074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:17.303689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:17.309568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:17.344684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:17.348460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:17.402931 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1846/3695] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:23.545503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6e2d-a094-40df-850b-4b0fffaeadb5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:23.546845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6e2d-a094-40df-850b-4b0fffaeadb5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:23.546845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6e2d-a094-40df-850b-4b0fffaeadb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:23.614873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1e1f6e2d-a094-40df-850b-4b0fffaeadb5 None None] MFA Rules not processed for user `b06a5d6f31ea4d4a9a7e69f759a3c7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:23.617066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e1f6e2d-a094-40df-850b-4b0fffaeadb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:23.806908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1850/3696] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:24.136730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:24.166167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd7b4-65a9-4068-9432-49a9a5cb6f03 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:24.180942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481be1ea-3475-4536-9d79-0d37ce019ba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:24.184917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481be1ea-3475-4536-9d79-0d37ce019ba9 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:24.186904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481be1ea-3475-4536-9d79-0d37ce019ba9 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:24.187828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481be1ea-3475-4536-9d79-0d37ce019ba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:24.213068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481be1ea-3475-4536-9d79-0d37ce019ba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:24.217740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481be1ea-3475-4536-9d79-0d37ce019ba9 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:24.270576 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1847/3697] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:24.438136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f6e2d-a094-40df-850b-4b0fffaeadb5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:24.626955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:24.793192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f6e2d-a094-40df-850b-4b0fffaeadb5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:24.815229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:24.816790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:24.820981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:24.821764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] PATH_INFO: `/v3/users/86449d2ab5474b80bd4a05cc4c233da2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:24.840423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86449d2ab5474b80bd4a05cc4c233da2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:24.844996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:25.027740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86449d2ab5474b80bd4a05cc4c233da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:25.066262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86449d2ab5474b80bd4a05cc4c233da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:25.089048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86449d2ab5474b80bd4a05cc4c233da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:25.094721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86449d2ab5474b80bd4a05cc4c233da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:25.118604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86449d2ab5474b80bd4a05cc4c233da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:25.142518 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1851/3698] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:51:24 2022] DELETE /identity/v3/users/86449d2ab5474b80bd4a05cc4c233da2 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:25.147259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:25.148552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:25.149295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:25.192742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:25.194202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:25.316911 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1848/3699] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:25.335752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:25.342432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:25.497997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af757-b66e-4220-831a-19ed622cde73 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:25.504637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122691d5-962d-4fed-83bc-9f003d2918c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:25.506950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122691d5-962d-4fed-83bc-9f003d2918c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:25.507592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122691d5-962d-4fed-83bc-9f003d2918c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:25.508110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122691d5-962d-4fed-83bc-9f003d2918c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:25.523475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122691d5-962d-4fed-83bc-9f003d2918c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:25.526203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122691d5-962d-4fed-83bc-9f003d2918c3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:25.544415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1852/3700] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:27.086271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:27.087891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:27.115689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2f49-d3ac-4e23-bc06-5ab42a5ac56a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:27.147212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:27.149373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:27.150343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:27.152648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] PATH_INFO: `/v3/projects/1ea96ec22cc6498da49173cf1f6bb455` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:27.162094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea96ec22cc6498da49173cf1f6bb455)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:27.166764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:27.395983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea96ec22cc6498da49173cf1f6bb455', 'request_id': 'req-8c7782da-b33c-40f1-8904-f0e2e10b178f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:27.419554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea96ec22cc6498da49173cf1f6bb455', 'request_id': 'req-8c7782da-b33c-40f1-8904-f0e2e10b178f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:27.459259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea96ec22cc6498da49173cf1f6bb455', 'request_id': 'req-8c7782da-b33c-40f1-8904-f0e2e10b178f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:27.469681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:27.504625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] The token cache is being invalidate because project 1ea96ec22cc6498da49173cf1f6bb455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:51:27.505537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:27.508833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c7782da-b33c-40f1-8904-f0e2e10b178f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:51:27.514585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1849/3701] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:51:27 2022] DELETE /identity/v3/projects/1ea96ec22cc6498da49173cf1f6bb455 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:27.522061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72344cd-893e-450b-8aab-9b990f14dcd3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:27.522622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72344cd-893e-450b-8aab-9b990f14dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:27.523502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72344cd-893e-450b-8aab-9b990f14dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:27.558135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e72344cd-893e-450b-8aab-9b990f14dcd3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:27.561053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e72344cd-893e-450b-8aab-9b990f14dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:27.656864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:27.718999 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1853/3702] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:27.731902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90c75-e664-414b-a845-cb0f52d81467 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:27.732508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90c75-e664-414b-a845-cb0f52d81467 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:27.732965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90c75-e664-414b-a845-cb0f52d81467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:27.757025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0ec90c75-e664-414b-a845-cb0f52d81467 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:27.758698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ec90c75-e664-414b-a845-cb0f52d81467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:27.771192 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1850/3703] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:51:27.777727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72344cd-893e-450b-8aab-9b990f14dcd3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:27.801074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72344cd-893e-450b-8aab-9b990f14dcd3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:27.806851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:27.808150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:27.809395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:27.810933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:27.812659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:51:27.813093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:27.816054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:27.843414 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1854/3704] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:51:27.844628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90c75-e664-414b-a845-cb0f52d81467 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:27.857794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90c75-e664-414b-a845-cb0f52d81467 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:27.869027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:27.870309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:27.870650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:27.870935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:27.874872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:27.879199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:27.947623 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1851/3705] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:51:27 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:51:27.950607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:27.975915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d79a2-7972-40cd-81ca-7bec798f9b4e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:28.142437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:28.144700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:28.145868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:28.146608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:28.148598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:28.154199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:28.232266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:28.238260 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1855/3706] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:51:27 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:51:28.260609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad10e-3f94-4aaa-9b69-9d16cf074076 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:28.284752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:28.286633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:28.287643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:28.288471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:28.290453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:28.294081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:28.335094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:28.348249 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1852/3707] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:51:28.361498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c208c-c749-4fdc-981c-302e3b436a83 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:28.375477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa11c9-f658-47c2-a0d1-79f25d95d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:28.377662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa11c9-f658-47c2-a0d1-79f25d95d9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:28.378937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa11c9-f658-47c2-a0d1-79f25d95d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:28.379702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa11c9-f658-47c2-a0d1-79f25d95d9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:28.381380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa11c9-f658-47c2-a0d1-79f25d95d9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:28.387443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa11c9-f658-47c2-a0d1-79f25d95d9ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:28.420679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1856/3708] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:51:28.448505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:28.497703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b174e5-738e-456e-bec2-b23ab5f40d2d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:28.506843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:28.508604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:28.509177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:28.509693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] PATH_INFO: `/v3/projects/adc60bcb471e44fb8787afd9f5b623ab/users/3323669591584736b1e19db6da8fa08f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:28.558061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc60bcb471e44fb8787afd9f5b623ab, user_id=3323669591584736b1e19db6da8fa08f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:28.564490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:28.602083 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1853/3709] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:51:28 2022] PUT /identity/v3/projects/adc60bcb471e44fb8787afd9f5b623ab/users/3323669591584736b1e19db6da8fa08f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:51:28.605446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9c7f-7528-4504-9e67-67e5952f5e53 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:28.606913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9c7f-7528-4504-9e67-67e5952f5e53 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:28.607487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9c7f-7528-4504-9e67-67e5952f5e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:28.633044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2b0a9c7f-7528-4504-9e67-67e5952f5e53 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:28.634786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b0a9c7f-7528-4504-9e67-67e5952f5e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:28.742574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1857/3710] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:28.787035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:28.797380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:29.064825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf726-9f1c-4973-baf2-7f50443b9f22 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:29.072920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bbc75-1df9-4940-bc3f-cdf30236abb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:29.074332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbc75-1df9-4940-bc3f-cdf30236abb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:29.074959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbc75-1df9-4940-bc3f-cdf30236abb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:29.076143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbc75-1df9-4940-bc3f-cdf30236abb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:29.107740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bbc75-1df9-4940-bc3f-cdf30236abb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:29.111175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bbc75-1df9-4940-bc3f-cdf30236abb4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:29.134907 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1854/3711] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:29.423310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512d3c-71f5-4763-908c-ce1bd604981c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:29.423620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512d3c-71f5-4763-908c-ce1bd604981c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:29.423859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512d3c-71f5-4763-908c-ce1bd604981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:29.504361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97512d3c-71f5-4763-908c-ce1bd604981c None None] MFA Rules not processed for user `a7edefb2896948e39ac7aed5a3884233`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:29.514750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97512d3c-71f5-4763-908c-ce1bd604981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:29.708407 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1858/3712] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:30.717363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321403db-c96a-4e99-81df-eeaffdc83f04 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:30.718983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321403db-c96a-4e99-81df-eeaffdc83f04 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:30.719776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321403db-c96a-4e99-81df-eeaffdc83f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:30.775126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-321403db-c96a-4e99-81df-eeaffdc83f04 None None] MFA Rules not processed for user `b06a5d6f31ea4d4a9a7e69f759a3c7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:30.777967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-321403db-c96a-4e99-81df-eeaffdc83f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:30.944975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1855/3713] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:31.300219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3af8-5bb2-4339-8173-f6a607d00f96 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:31.301100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3af8-5bb2-4339-8173-f6a607d00f96 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:31.301100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3af8-5bb2-4339-8173-f6a607d00f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:31.325699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:31.381219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-56ad3af8-5bb2-4339-8173-f6a607d00f96 None None] MFA Rules not processed for user `3323669591584736b1e19db6da8fa08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:31.382844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56ad3af8-5bb2-4339-8173-f6a607d00f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:31.575322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1859/3714] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:31.584904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:31.585459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:31.586036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:31.629967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] MFA Rules not processed for user `3323669591584736b1e19db6da8fa08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:31.631741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:31.651924 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1856/3715] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:31.664041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a1cf1-a67d-429f-a5e7-e25f1643322a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:31.664675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a1cf1-a67d-429f-a5e7-e25f1643322a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:31.666150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a1cf1-a67d-429f-a5e7-e25f1643322a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:31.744841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3c6a1cf1-a67d-429f-a5e7-e25f1643322a None None] MFA Rules not processed for user `3323669591584736b1e19db6da8fa08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:31.748617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c6a1cf1-a67d-429f-a5e7-e25f1643322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:31.785571 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1860/3716] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:32.931969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:32.934475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:33.065430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:33.284612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e907c-cbef-47f6-a655-dc10590d8371 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:33.296705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e86bef-0216-42a2-9d77-8b8e76e8dd7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:33.298527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86bef-0216-42a2-9d77-8b8e76e8dd7a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:33.299381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86bef-0216-42a2-9d77-8b8e76e8dd7a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:33.300188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86bef-0216-42a2-9d77-8b8e76e8dd7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:33.331104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e86bef-0216-42a2-9d77-8b8e76e8dd7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:33.364223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e86bef-0216-42a2-9d77-8b8e76e8dd7a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:33.451783 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1857/3717] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:34.445503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa977a62-63a0-4500-9675-6ab5d53fb71d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:34.446208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa977a62-63a0-4500-9675-6ab5d53fb71d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:34.446817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa977a62-63a0-4500-9675-6ab5d53fb71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:34.509275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fa977a62-63a0-4500-9675-6ab5d53fb71d None None] MFA Rules not processed for user `3323669591584736b1e19db6da8fa08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:34.513541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa977a62-63a0-4500-9675-6ab5d53fb71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:34.541199 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1861/3718] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:36.775250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c498-afcb-47f6-94ce-bc0b1a7949c2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:36.775844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c498-afcb-47f6-94ce-bc0b1a7949c2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:36.776066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c498-afcb-47f6-94ce-bc0b1a7949c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:36.798280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6727c498-afcb-47f6-94ce-bc0b1a7949c2 None None] MFA Rules not processed for user `3323669591584736b1e19db6da8fa08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:36.799623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6727c498-afcb-47f6-94ce-bc0b1a7949c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:36.812203 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1858/3719] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:51:41.945270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5472-ada8-4a8d-9d2a-41312aec6cec None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:41.945985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5472-ada8-4a8d-9d2a-41312aec6cec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:41.946553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5472-ada8-4a8d-9d2a-41312aec6cec None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:41.948556 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1862/3720] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:51:41.962084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad78c67-31cb-4e67-be41-c299a546e0e1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:41.962973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad78c67-31cb-4e67-be41-c299a546e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:41.962973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad78c67-31cb-4e67-be41-c299a546e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:41.994417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-aad78c67-31cb-4e67-be41-c299a546e0e1 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:42.006449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aad78c67-31cb-4e67-be41-c299a546e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:42.159385 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1859/3721] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:51:42.173371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb5472-ada8-4a8d-9d2a-41312aec6cec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:51:42.177885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9bbb5472-ada8-4a8d-9d2a-41312aec6cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:42.215376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb5472-ada8-4a8d-9d2a-41312aec6cec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:51:42.238262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbfdd4-d595-4a62-a57a-291f422bb928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:51:42.239306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfdd4-d595-4a62-a57a-291f422bb928 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:42.239815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfdd4-d595-4a62-a57a-291f422bb928 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:42.240288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfdd4-d595-4a62-a57a-291f422bb928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:42.252656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbfdd4-d595-4a62-a57a-291f422bb928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:51:42.255567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbfdd4-d595-4a62-a57a-291f422bb928 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:51:42.282823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1863/3722] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:51:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:51:52.131191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=52 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:52.267099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=41 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:52.520437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:51:52.520909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:51:52.521355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:51:52.542930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] MFA Rules not processed for user `7ef211f562144656a4a95f4e0df02341`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:51:52.544291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:51:52.612575 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1860/3723] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:02.604487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=25 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:06.898462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a23ae-b910-4187-a01f-8450573b0c67 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:06.899809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a23ae-b910-4187-a01f-8450573b0c67 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:06.900102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a23ae-b910-4187-a01f-8450573b0c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:06.921328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-617a23ae-b910-4187-a01f-8450573b0c67 None None] MFA Rules not processed for user `a7edefb2896948e39ac7aed5a3884233`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:06.923031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-617a23ae-b910-4187-a01f-8450573b0c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:06.931074 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1864/3724] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:16.915618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:17.627482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:17.630752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:17.649382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14255-d13c-4380-82f8-2e8e38b768bb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:17.669043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:17.671751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:17.672501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:17.673112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] PATH_INFO: `/v3/users/1db067ac2fdc491e866b8dcfdfe8d606` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:17.675580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db067ac2fdc491e866b8dcfdfe8d606)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:17.678722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:17.775368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db067ac2fdc491e866b8dcfdfe8d606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:17.797838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db067ac2fdc491e866b8dcfdfe8d606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:17.798774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db067ac2fdc491e866b8dcfdfe8d606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:17.808863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db067ac2fdc491e866b8dcfdfe8d606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:17.810178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c77de3c-6b2c-4113-add0-1fe334cf54ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db067ac2fdc491e866b8dcfdfe8d606'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:17.835602 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1861/3725] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:52:17 2022] DELETE /identity/v3/users/1db067ac2fdc491e866b8dcfdfe8d606 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:18.333859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a23ae-b910-4187-a01f-8450573b0c67 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:18.350239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a23ae-b910-4187-a01f-8450573b0c67 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:18.514765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:18.516465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:18.516985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:18.517498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] PATH_INFO: `/v3/projects/4da9bfba7a6e411fa22206a70417ae73` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:18.520112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da9bfba7a6e411fa22206a70417ae73)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:18.524327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:18.633212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da9bfba7a6e411fa22206a70417ae73', 'request_id': 'req-e2dcfff4-fa50-4465-9d23-017d230b8965'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:18.641655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da9bfba7a6e411fa22206a70417ae73', 'request_id': 'req-e2dcfff4-fa50-4465-9d23-017d230b8965'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:18.651440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da9bfba7a6e411fa22206a70417ae73', 'request_id': 'req-e2dcfff4-fa50-4465-9d23-017d230b8965'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:18.670739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] The token cache is being invalidate because project 4da9bfba7a6e411fa22206a70417ae73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:52:18.671096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:18.672270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2dcfff4-fa50-4465-9d23-017d230b8965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:18.674674 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1865/3726] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:52:18 2022] DELETE /identity/v3/projects/4da9bfba7a6e411fa22206a70417ae73 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:18.682986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75f01c-b8a9-4418-bd02-6647e1e3b273 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:18.686039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75f01c-b8a9-4418-bd02-6647e1e3b273 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:18.686980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75f01c-b8a9-4418-bd02-6647e1e3b273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:18.731626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dd75f01c-b8a9-4418-bd02-6647e1e3b273 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:18.735777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd75f01c-b8a9-4418-bd02-6647e1e3b273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:18.892964 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1862/3727] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:18.906109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bba0e-77a7-4886-b321-410d1c0aac94 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:18.906544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bba0e-77a7-4886-b321-410d1c0aac94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:18.907035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bba0e-77a7-4886-b321-410d1c0aac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:18.932603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b75bba0e-77a7-4886-b321-410d1c0aac94 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:18.933886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b75bba0e-77a7-4886-b321-410d1c0aac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:18.949675 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1866/3728] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:18.952768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75f01c-b8a9-4418-bd02-6647e1e3b273 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:18.970958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75f01c-b8a9-4418-bd02-6647e1e3b273 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:19.001764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:19.003186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:19.003999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:19.004591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:19.006232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:52:19.007072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:19.011128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:19.055777 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1863/3729] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:52:19.059314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bba0e-77a7-4886-b321-410d1c0aac94 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:19.094819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bba0e-77a7-4886-b321-410d1c0aac94 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:19.123567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:19.125532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:19.126550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:19.129052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:19.133270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:19.137757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:19.199606 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1867/3730] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:52:19 2022] POST /identity/v3/projects => generated 397 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:52:19.205236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:19.222858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3bb3c-d6ef-4448-b709-07104b9de08c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:19.389658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:19.390720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:19.392282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:19.392965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:19.393914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:19.399243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:19.425961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:19.465133 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1864/3731] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:52:19 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:52:19.471216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:19.494125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e30829-4475-40fc-a646-b01799bc8aad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:19.501384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:19.502460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:19.503079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:19.503642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:19.506741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:19.535912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:19.551752 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1868/3732] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:52:19.557959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:19.580323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54b8b5-79d8-4437-b340-00d9962be051 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:19.591098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5cf95-66cd-467a-8ae1-b95f7ee70d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:19.593676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5cf95-66cd-467a-8ae1-b95f7ee70d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:19.594284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5cf95-66cd-467a-8ae1-b95f7ee70d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:19.594862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5cf95-66cd-467a-8ae1-b95f7ee70d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:19.596518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5cf95-66cd-467a-8ae1-b95f7ee70d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:19.600182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5cf95-66cd-467a-8ae1-b95f7ee70d29 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:19.630950 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1865/3733] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:52:19.632075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:19.666561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afde6-4ca1-4863-b82f-f48953090e99 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:19.681821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:19.684902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:19.686290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:19.687113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] PATH_INFO: `/v3/projects/4381d698f8624ab2b1e932305ea8b67a/users/b72083f0df93495194118d6a12088c75/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:19.721274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4381d698f8624ab2b1e932305ea8b67a, user_id=b72083f0df93495194118d6a12088c75, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:19.728339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:19.768839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1869/3734] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:52:19 2022] PUT /identity/v3/projects/4381d698f8624ab2b1e932305ea8b67a/users/b72083f0df93495194118d6a12088c75/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:19.769928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2792dad-3747-4bf7-b135-4eea6bc6c0f8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:19.770696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2792dad-3747-4bf7-b135-4eea6bc6c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:19.770696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2792dad-3747-4bf7-b135-4eea6bc6c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:19.809639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d2792dad-3747-4bf7-b135-4eea6bc6c0f8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:19.813530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2792dad-3747-4bf7-b135-4eea6bc6c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:20.041653 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1866/3735] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:20.068337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:20.074567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:20.225015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:20.323191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475c65-96d6-4ef5-be1a-e006701ef801 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:20.329953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:20.331009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:20.331504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:20.331947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:20.346880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:20.348830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:20.364074 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1870/3736] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:52:25.521649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1879216-0892-4265-908e-9bfa1eb96afb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:25.522634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1879216-0892-4265-908e-9bfa1eb96afb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:25.523108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1879216-0892-4265-908e-9bfa1eb96afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:25.575340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d1879216-0892-4265-908e-9bfa1eb96afb None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:25.576991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d1879216-0892-4265-908e-9bfa1eb96afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:25.767565 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1867/3737] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:25.842977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:25.844559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:25.959848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdd5db-6dc3-4eee-8c97-aca15289e919 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:25.967578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd84956-64f9-49fa-9b7c-a4555ae9fccd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:25.968634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84956-64f9-49fa-9b7c-a4555ae9fccd service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:25.969090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84956-64f9-49fa-9b7c-a4555ae9fccd service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:25.969542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84956-64f9-49fa-9b7c-a4555ae9fccd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:25.979829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd84956-64f9-49fa-9b7c-a4555ae9fccd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:25.981822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd84956-64f9-49fa-9b7c-a4555ae9fccd service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:26.003473 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1871/3738] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:52:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:35.744240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:SELECT=59 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:35.988600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=46 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:36.073808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:36.074325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:36.074831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:36.150517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] MFA Rules not processed for user `b72083f0df93495194118d6a12088c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:36.153453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:36.342622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:36.343113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:36.343584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:36.360143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1868/3739] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:36.397480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] MFA Rules not processed for user `b72083f0df93495194118d6a12088c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:36.399058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:36.441002 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1872/3740] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:37.394766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:37.398817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:37.621575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716ffb-565c-411b-ad81-b32f23b61c6f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:37.629607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2239fd8-455a-4460-88e0-aea07a06b14a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:37.633643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239fd8-455a-4460-88e0-aea07a06b14a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:37.634321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239fd8-455a-4460-88e0-aea07a06b14a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:37.634663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239fd8-455a-4460-88e0-aea07a06b14a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:37.652490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2239fd8-455a-4460-88e0-aea07a06b14a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:37.655051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2239fd8-455a-4460-88e0-aea07a06b14a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:37.683211 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1869/3741] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:52:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:52:46.375138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:46.806392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:46.814541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:46.938760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01ffe5-6a79-437b-832d-2505f1b96081 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:46.961493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:46.968017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:46.969898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:46.970845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:46.981557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:47.264189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:47.267674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:47.322577 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1873/3742] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 14:52:46 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:52:47.664376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=66 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:48.824562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddc7c-2d06-4ecd-ad18-ab6bd51431f7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:48.825300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddc7c-2d06-4ecd-ad18-ab6bd51431f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:48.826744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddc7c-2d06-4ecd-ad18-ab6bd51431f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:48.912886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-68bddc7c-2d06-4ecd-ad18-ab6bd51431f7 None None] MFA Rules not processed for user `a185fa24374c417aa2bb9302a608cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:48.917861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-68bddc7c-2d06-4ecd-ad18-ab6bd51431f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:48.954648 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1870/3743] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:50.924857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:50.926754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:50.967414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8303d-ee7a-4e1c-8711-101b51f5d5e7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:51.040594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:51.041581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:51.053763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:51.054121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] PATH_INFO: `/v3/users/24ffcc115d374182b9039ddfe987042d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:51.061882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ffcc115d374182b9039ddfe987042d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:51.081298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:51.342866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ffcc115d374182b9039ddfe987042d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:51.377852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ffcc115d374182b9039ddfe987042d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:51.408275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ffcc115d374182b9039ddfe987042d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:51.409169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ffcc115d374182b9039ddfe987042d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:51.422644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f877d19f-65a0-4cf6-8af9-e5260fb3d9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ffcc115d374182b9039ddfe987042d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:51.438930 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1874/3744] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:52:50 2022] DELETE /identity/v3/users/24ffcc115d374182b9039ddfe987042d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:52.370652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddc7c-2d06-4ecd-ad18-ab6bd51431f7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:52.475893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddc7c-2d06-4ecd-ad18-ab6bd51431f7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:52.760723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:52.763311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:52.766660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:52.767385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] PATH_INFO: `/v3/projects/633d43bf7c6c48e5ba244d103fbd2fe6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:52.770137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=633d43bf7c6c48e5ba244d103fbd2fe6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:52.776818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:52.988476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633d43bf7c6c48e5ba244d103fbd2fe6', 'request_id': 'req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:53.028779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633d43bf7c6c48e5ba244d103fbd2fe6', 'request_id': 'req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:53.069650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633d43bf7c6c48e5ba244d103fbd2fe6', 'request_id': 'req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:53.126175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] The token cache is being invalidate because project 633d43bf7c6c48e5ba244d103fbd2fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:52:53.126529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:53.131341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a39d7b3f-d8e4-4759-900d-f68b0755dc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:53.136773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1871/3745] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:52:52 2022] DELETE /identity/v3/projects/633d43bf7c6c48e5ba244d103fbd2fe6 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:53.148979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389fa58-7d7a-42fb-addc-5f3a3b6288a3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:53.149520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389fa58-7d7a-42fb-addc-5f3a3b6288a3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:53.150067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389fa58-7d7a-42fb-addc-5f3a3b6288a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:53.203857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f389fa58-7d7a-42fb-addc-5f3a3b6288a3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:53.207000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f389fa58-7d7a-42fb-addc-5f3a3b6288a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:53.583448 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1875/3746] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:53.597131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2612-5543-4fb7-9598-a3a5a7f28984 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:53.598005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2612-5543-4fb7-9598-a3a5a7f28984 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:53.598912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2612-5543-4fb7-9598-a3a5a7f28984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:53.721156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2daa2612-5543-4fb7-9598-a3a5a7f28984 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:53.730211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2daa2612-5543-4fb7-9598-a3a5a7f28984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:53.791380 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1872/3747] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:52:53.801495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389fa58-7d7a-42fb-addc-5f3a3b6288a3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:53.814248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:53.838268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389fa58-7d7a-42fb-addc-5f3a3b6288a3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:53.860511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:53.861223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:53.861507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:53.861788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:53.862571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:52:53.862881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:53.875190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:53.932747 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1876/3748] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:52:53.933988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2612-5543-4fb7-9598-a3a5a7f28984 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:53.953203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2612-5543-4fb7-9598-a3a5a7f28984 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:53.975940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:53.976679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:53.976955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:53.977418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:53.978310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:53.983605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:54.037632 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1873/3749] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:52:53 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:52:54.043020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:54.057370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fb1e1-c7ce-466e-9ed1-d9febb37d5b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:54.222801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:54.224075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:54.224272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:54.224724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:54.225630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:54.227920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:54.302515 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1877/3750] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:52:54 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:52:54.304469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:54.346221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14035-dc30-45a4-9c5a-8125f01d34ca admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:54.365123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:54.366273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:54.366772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:54.367253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:54.368742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:54.371986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:54.441708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:54.453935 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1874/3751] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:52:54.474555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b20afd-b952-4f17-bb74-85caef40c7b2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:54.504127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09a69a-83ee-4ed9-b3d2-9acf293446d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:54.505190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09a69a-83ee-4ed9-b3d2-9acf293446d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:54.506901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09a69a-83ee-4ed9-b3d2-9acf293446d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:54.507295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09a69a-83ee-4ed9-b3d2-9acf293446d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:54.507989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09a69a-83ee-4ed9-b3d2-9acf293446d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:54.509837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09a69a-83ee-4ed9-b3d2-9acf293446d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:54.522230 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1878/3752] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:52:54.527551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:54.557286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2b96d-e7a6-4837-8d45-19fb0c7081d2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:54.566635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:54.568949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:54.570119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:54.571045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] PATH_INFO: `/v3/projects/619a7e9d667841b4acb15e624d9866cd/users/02f251dfe887419aa326fcaee4780de4/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:54.624754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619a7e9d667841b4acb15e624d9866cd, user_id=02f251dfe887419aa326fcaee4780de4, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:54.628420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:54.675507 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1875/3753] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:52:54 2022] PUT /identity/v3/projects/619a7e9d667841b4acb15e624d9866cd/users/02f251dfe887419aa326fcaee4780de4/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:54.679919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128637f-e2f3-46c6-bb3b-ef0a84a15f41 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:54.682107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128637f-e2f3-46c6-bb3b-ef0a84a15f41 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:54.683608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128637f-e2f3-46c6-bb3b-ef0a84a15f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:54.754095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6128637f-e2f3-46c6-bb3b-ef0a84a15f41 None None] MFA Rules not processed for user `02f251dfe887419aa326fcaee4780de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:54.756766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6128637f-e2f3-46c6-bb3b-ef0a84a15f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:54.960596 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1879/3754] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:54.965276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:55.033264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:55.158008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c108a-a21c-4567-86b8-0fed36544c13 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:55.176938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:55.178396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:55.179085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:55.180163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:55.181643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:55.187826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:55.300923 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1876/3755] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:52:54 2022] POST /identity/v3/projects => generated 375 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:52:55.307086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128637f-e2f3-46c6-bb3b-ef0a84a15f41 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:55.353634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128637f-e2f3-46c6-bb3b-ef0a84a15f41 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:55.610632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:55.644332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:55.645063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:55.645358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:55.645820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:55.646736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:55.649989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:55.723172 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1880/3756] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:52:55 2022] POST /identity/v3/users => generated 294 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:52:55.729686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:55.763853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24fdd8-090b-4110-b51d-7b8aed18f1a6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:55.782598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:55.784127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:55.784850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:55.785525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:55.787091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:55.790363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:55.830660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1877/3757] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:52:55.837122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:55.886312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b034118-786a-4c99-923b-20ee16d00a17 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:55.916308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:55.921357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:55.925581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:55.933605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] PATH_INFO: `/v3/projects/43b9f4b7c2924cffbb089ef27fdc96c7/users/0b22886ac6b74409ba0bf54529191def/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:56.026442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b9f4b7c2924cffbb089ef27fdc96c7, user_id=0b22886ac6b74409ba0bf54529191def, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:56.043118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:56.097885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1881/3758] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:52:55 2022] PUT /identity/v3/projects/43b9f4b7c2924cffbb089ef27fdc96c7/users/0b22886ac6b74409ba0bf54529191def/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:52:56.103962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:56.144650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43510d-8833-4bcd-b9ca-b0879ddbeff7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:56.477029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81ab20-92ab-4083-bcdf-b97af35106be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:56.478527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81ab20-92ab-4083-bcdf-b97af35106be admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:56.479066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81ab20-92ab-4083-bcdf-b97af35106be admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:56.479550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81ab20-92ab-4083-bcdf-b97af35106be admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:56.481831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81ab20-92ab-4083-bcdf-b97af35106be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:56.486220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81ab20-92ab-4083-bcdf-b97af35106be admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:56.524465 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1878/3759] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:52:56.524880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:56.553427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f0f7b-733a-4c34-974f-7b7321c56b5e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:56.572567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:56.576465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:56.576945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:56.577455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] PATH_INFO: `/v3/projects/43b9f4b7c2924cffbb089ef27fdc96c7/users/0b22886ac6b74409ba0bf54529191def/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:56.591320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b9f4b7c2924cffbb089ef27fdc96c7, user_id=0b22886ac6b74409ba0bf54529191def, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:56.601473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:56.657843 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1882/3760] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:52:56 2022] PUT /identity/v3/projects/43b9f4b7c2924cffbb089ef27fdc96c7/users/0b22886ac6b74409ba0bf54529191def/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:52:56.677623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9abfc2-319e-4de5-9354-fa06e2ba5c87 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:56.678127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9abfc2-319e-4de5-9354-fa06e2ba5c87 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:56.678585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9abfc2-319e-4de5-9354-fa06e2ba5c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:56.790808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e9abfc2-319e-4de5-9354-fa06e2ba5c87 None None] MFA Rules not processed for user `0b22886ac6b74409ba0bf54529191def`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:52:56.793069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e9abfc2-319e-4de5-9354-fa06e2ba5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:57.225429 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1879/3761] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:52:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:52:57.231621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:57.282063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2331c-67d3-41ec-86ca-56f57d7b4803 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:57.302382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:57.308594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:57.310247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:57.311405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:57.313080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:57.329364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:57.501513 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1883/3762] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 14:52:57 2022] POST /identity/v3/projects => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:52:57.506163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9abfc2-319e-4de5-9354-fa06e2ba5c87 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:57.539900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9abfc2-319e-4de5-9354-fa06e2ba5c87 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:57.604326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:57.813737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:57.816337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:57.817102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:57.817822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:57.819404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:57.826190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:57.925065 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1880/3763] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:52:57 2022] POST /identity/v3/projects => generated 350 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:52:57.926702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:57.978448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919c453-fe30-42f2-8705-80c40df60639 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:58.246126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:58.248896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:58.249781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:58.251893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/users/02f251dfe887419aa326fcaee4780de4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:58.264655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:get_user(user_id=02f251dfe887419aa326fcaee4780de4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:58.269773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:58.273523 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1884/3764] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:52:57 2022] GET /identity/v3/users/02f251dfe887419aa326fcaee4780de4 => generated 288 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:52:58.283682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:58.313929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323396c-1a79-4662-81f3-5cc3b59b95e4 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:58.325066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:58.326441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:58.328181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:58.328181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:58.329496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:58.336309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:58.442871 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1881/3765] 10.222.0.98 () {60 vars in 1161 bytes} [Thu Jul 14 14:52:58 2022] POST /identity/v3/credentials => generated 431 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:52:58.445968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:58.493598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13885b44-2520-4ce1-b9ed-1805ba932945 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:58.522400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:58.528387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:58.529781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:58.532349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials/806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:58.545137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:58.550229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:58.572787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:58.588905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:58.673798 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1885/3766] 10.222.0.98 () {60 vars in 1357 bytes} [Thu Jul 14 14:52:58 2022] PATCH /identity/v3/credentials/806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94 => generated 435 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:52:58.680765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:58.735401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27579a83-6d83-46d3-ad52-23434565ddf9 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:58.757535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:58.761708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:58.762185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:58.767622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials/806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:58.775579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:58.778935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:58.795434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1882/3767] 10.222.0.98 () {58 vars in 1334 bytes} [Thu Jul 14 14:52:58 2022] GET /identity/v3/credentials/806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94 => generated 435 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:52:58.799411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:58.837551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998750ba-dad9-4297-9282-ba29469a31a6 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:58.858736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:58.860418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:58.860805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:58.864475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials/806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:58.875357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:58.885097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:58.972862 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1886/3768] 10.222.0.98 () {58 vars in 1337 bytes} [Thu Jul 14 14:52:58 2022] DELETE /identity/v3/credentials/806af3b37aaba6b5b22a6202a91b421657b16f76ee961b2f5ecd599e3fc9cf94 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:58.979731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:59.024497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dddff-f443-4334-985c-1f0d9db27c7b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:59.052238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:59.053477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:59.054261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:59.055000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:59.057541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.066592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.112512 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1883/3769] 10.222.0.98 () {60 vars in 1161 bytes} [Thu Jul 14 14:52:58 2022] POST /identity/v3/credentials => generated 431 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:52:59.113524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:59.162205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3d3ac-c627-41da-bfff-3bf523bff618 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:59.183757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:59.185138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:59.188155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:59.188542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:59.190127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.201220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.286736 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1887/3770] 10.222.0.98 () {60 vars in 1161 bytes} [Thu Jul 14 14:52:59 2022] POST /identity/v3/credentials => generated 429 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:52:59.289331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:59.323555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993735c-869f-4a09-bb7e-bdd6f68e2e5b tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:59.349720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:59.352023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:59.352623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:59.353131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:59.354649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.357889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.405132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.415840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.420315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.429391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.437692 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1884/3771] 10.222.0.98 () {58 vars in 1139 bytes} [Thu Jul 14 14:52:59 2022] GET /identity/v3/credentials => generated 945 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:52:59.442870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:59.467354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67714-e0cb-4f31-98e3-b1631db59c16 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:59.491012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:59.497493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:59.498498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:59.499640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials/0ec43694ce642f9cb6dd138c6ae6bde6703d6be65802669822497d0b84d8a292` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:59.504613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=0ec43694ce642f9cb6dd138c6ae6bde6703d6be65802669822497d0b84d8a292)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.510015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.547292 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1888/3772] 10.222.0.98 () {58 vars in 1337 bytes} [Thu Jul 14 14:52:59 2022] DELETE /identity/v3/credentials/0ec43694ce642f9cb6dd138c6ae6bde6703d6be65802669822497d0b84d8a292 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:59.557753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:59.589154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad15c4-4c7b-4c96-b8ba-0be26b1be671 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:59.621077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:59.622872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:59.623404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:59.623911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/credentials/8d9940064f7067ab4f9332e94da7a80c55cb5a9a57cb6f3b691a38f367701589` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:59.627927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=8d9940064f7067ab4f9332e94da7a80c55cb5a9a57cb6f3b691a38f367701589)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.631254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.697359 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1885/3773] 10.222.0.98 () {58 vars in 1337 bytes} [Thu Jul 14 14:52:59 2022] DELETE /identity/v3/credentials/8d9940064f7067ab4f9332e94da7a80c55cb5a9a57cb6f3b691a38f367701589 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:59.707379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:59.737035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd91b-f42a-47eb-bf83-b6d3aa7eb875 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:59.747644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:59.748578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:59.748870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:59.749146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/projects/f32d2dde510b4f5998fd984b13b275a3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:59.750707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f32d2dde510b4f5998fd984b13b275a3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:59.752875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:59.861137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:59.900351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32d2dde510b4f5998fd984b13b275a3', 'request_id': 'req-f7e0022a-7daa-4865-a6f9-a2287718ee2c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:59.917960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32d2dde510b4f5998fd984b13b275a3', 'request_id': 'req-f7e0022a-7daa-4865-a6f9-a2287718ee2c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:59.933848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32d2dde510b4f5998fd984b13b275a3', 'request_id': 'req-f7e0022a-7daa-4865-a6f9-a2287718ee2c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:59.963780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] The token cache is being invalidate because project f32d2dde510b4f5998fd984b13b275a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:52:59.964082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:59.967194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:52:59.970425 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1889/3774] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:52:59 2022] DELETE /identity/v3/projects/f32d2dde510b4f5998fd984b13b275a3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:52:59.977025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:59.980100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:00.045496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0eec9-114c-4dc3-b718-7657e9ee1592 tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:00.367944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b22886ac6b74409ba0bf54529191def', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43b9f4b7c2924cffbb089ef27fdc96c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:00.376472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:00.377214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:00.377604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] PATH_INFO: `/v3/projects/69c55552363f41928b2ece29304937b2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:00.392297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69c55552363f41928b2ece29304937b2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:00.396358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:00.650873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:00.657850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c55552363f41928b2ece29304937b2', 'request_id': 'req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:00.695103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c55552363f41928b2ece29304937b2', 'request_id': 'req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:00.736626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c55552363f41928b2ece29304937b2', 'request_id': 'req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:00.811860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] The token cache is being invalidate because project 69c55552363f41928b2ece29304937b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:00.814989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:00.821836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3ab8b77-9a3f-401b-bcbe-bddc733c913e tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:00.843233 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1886/3775] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:52:59 2022] DELETE /identity/v3/projects/69c55552363f41928b2ece29304937b2 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:00.844979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:00.846727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:01.203556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0022a-7daa-4865-a6f9-a2287718ee2c tempest-CredentialsTestJSON-1584786303 tempest-CredentialsTestJSON-1584786303-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:01.388929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:01.390268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:01.390694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:01.391235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] PATH_INFO: `/v3/users/02f251dfe887419aa326fcaee4780de4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:01.393749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f251dfe887419aa326fcaee4780de4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:01.397431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:01.539969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f251dfe887419aa326fcaee4780de4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:01.576848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f251dfe887419aa326fcaee4780de4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:01.582476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:01.605500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f251dfe887419aa326fcaee4780de4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:01.611533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f251dfe887419aa326fcaee4780de4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:01.627426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f251dfe887419aa326fcaee4780de4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:01.652712 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1890/3776] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:00 2022] DELETE /identity/v3/users/02f251dfe887419aa326fcaee4780de4 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:01.654825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:01.655715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:01.656837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:01.749723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:01.751977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:01.996547 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1887/3777] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:02.042978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:02.051473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:02.311638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a70e01-440f-43d8-b04a-b57c00621750 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:02.320442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:02.321788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:02.322404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:02.323061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:02.343143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:02.346622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:02.368716 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1891/3778] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:04.994699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:04.997732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:05.041693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cda82-9130-4ba9-a43c-30e395884099 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:05.060124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:05.061607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:05.062054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:05.062539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] PATH_INFO: `/v3/projects/619a7e9d667841b4acb15e624d9866cd` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:05.077180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=619a7e9d667841b4acb15e624d9866cd)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:05.081677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:05.274485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619a7e9d667841b4acb15e624d9866cd', 'request_id': 'req-7bac140b-71b0-4561-a908-58dde5f6f4ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.314183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619a7e9d667841b4acb15e624d9866cd', 'request_id': 'req-7bac140b-71b0-4561-a908-58dde5f6f4ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.362410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619a7e9d667841b4acb15e624d9866cd', 'request_id': 'req-7bac140b-71b0-4561-a908-58dde5f6f4ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.419826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] The token cache is being invalidate because project 619a7e9d667841b4acb15e624d9866cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:05.420172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.427975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.430423 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1888/3779] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:04 2022] DELETE /identity/v3/projects/619a7e9d667841b4acb15e624d9866cd => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:05.436978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:05.448821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a8b4-1d62-4af8-907d-25b2bc220a07 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:05.620761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:05.621768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:05.622088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:05.622335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] PATH_INFO: `/v3/users/0b22886ac6b74409ba0bf54529191def` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:05.623786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b22886ac6b74409ba0bf54529191def)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:05.636427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:05.745574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b22886ac6b74409ba0bf54529191def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.777681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b22886ac6b74409ba0bf54529191def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.811979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b22886ac6b74409ba0bf54529191def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.813970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b22886ac6b74409ba0bf54529191def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.817436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:05.835325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b22886ac6b74409ba0bf54529191def'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:05.857445 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1892/3780] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:05 2022] DELETE /identity/v3/users/0b22886ac6b74409ba0bf54529191def => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:06.109359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:06.111118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:06.336218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac140b-71b0-4561-a908-58dde5f6f4ff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:06.379015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:06.444708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:06.445998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:06.446590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:06.447088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:06.452682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:06.658113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:06.661379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:06.727520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1889/3781] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:06.745022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:06.748371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:06.994429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:06.995972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:06.997874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e348-ce52-4818-bc5e-157300bcefbb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:07.007847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:07.008601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:07.010011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:07.010532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:07.013989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:07.050595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:07.052580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:07.086673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1893/3782] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:07.124491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42ff6b-524a-4111-86d6-6530f2b9a189 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:07.134982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:07.135718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:07.136007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:07.136365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:07.144359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:07.167912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:07.171082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:07.192832 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1890/3783] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:07.815045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:07.836642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a9f1-1fe5-4192-9cf9-bd36fd4ba3f2 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:07.846225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9d59c-e48f-439e-8155-c55834185d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:07.847314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9d59c-e48f-439e-8155-c55834185d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:07.848069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9d59c-e48f-439e-8155-c55834185d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:07.848788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9d59c-e48f-439e-8155-c55834185d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:07.852481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82b9d59c-e48f-439e-8155-c55834185d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:07.885967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9d59c-e48f-439e-8155-c55834185d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:07.889256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9d59c-e48f-439e-8155-c55834185d89 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:07.907012 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1894/3784] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:08.035403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:08.038432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:08.363039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a33c-9b98-4135-8072-dc7869e2185a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:08.387691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:08.388770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:08.389157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:08.389698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] PATH_INFO: `/v3/projects/43b9f4b7c2924cffbb089ef27fdc96c7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:08.391780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b9f4b7c2924cffbb089ef27fdc96c7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:08.396015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:08.404421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:08.586076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b9f4b7c2924cffbb089ef27fdc96c7', 'request_id': 'req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:08.618572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b9f4b7c2924cffbb089ef27fdc96c7', 'request_id': 'req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:08.642717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b9f4b7c2924cffbb089ef27fdc96c7', 'request_id': 'req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:08.694566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] The token cache is being invalidate because project 43b9f4b7c2924cffbb089ef27fdc96c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:08.699490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:08.702322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5ab034d-45e1-4a72-8cf3-2ec5bfaeac2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:08.709435 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1891/3785] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:08 2022] DELETE /identity/v3/projects/43b9f4b7c2924cffbb089ef27fdc96c7 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:08.719221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97718060-ed82-4247-857a-848e9c103ebb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:08.720250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97718060-ed82-4247-857a-848e9c103ebb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:08.720994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97718060-ed82-4247-857a-848e9c103ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:08.878876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97718060-ed82-4247-857a-848e9c103ebb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:08.887096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97718060-ed82-4247-857a-848e9c103ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:09.177634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1895/3786] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:09.193329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59cc5c-f844-469c-b3cc-22a36898e795 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:09.194956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59cc5c-f844-469c-b3cc-22a36898e795 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:09.196324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59cc5c-f844-469c-b3cc-22a36898e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:09.261305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8f59cc5c-f844-469c-b3cc-22a36898e795 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:09.264810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8f59cc5c-f844-469c-b3cc-22a36898e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:09.287859 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1892/3787] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:09.293180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97718060-ed82-4247-857a-848e9c103ebb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:09.323625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97718060-ed82-4247-857a-848e9c103ebb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:09.337410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:09.341324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:09.343135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:09.344025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:09.345827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:09.348923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:09.355777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:09.399497 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1896/3788] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:09.407611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59cc5c-f844-469c-b3cc-22a36898e795 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:09.422249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59cc5c-f844-469c-b3cc-22a36898e795 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:09.430345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:09.431507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:09.432277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:09.432719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:09.433803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:09.437823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:09.485021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1893/3789] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:09 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:09.485600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:09.503358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7a2c-83c3-4a0e-9b20-340d64039752 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:09.628239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:09.729895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:09.730681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:09.731805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:09.731805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:09.732603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:09.736372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:09.789207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1897/3790] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:09 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:09.794550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:09.809497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced603b-66bd-4f26-ba38-e5e98082f5ee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:09.824557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:09.826296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:09.828507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:09.828926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:09.829753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:09.835523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:09.866926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1894/3791] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:09.873283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:09.903628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2f29f-30d8-46a0-928d-799567964e6b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:09.910257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73774a-22db-4a3a-8da4-2280176eedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:09.911233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73774a-22db-4a3a-8da4-2280176eedde admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:09.911759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73774a-22db-4a3a-8da4-2280176eedde admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:09.912189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73774a-22db-4a3a-8da4-2280176eedde admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:09.913383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73774a-22db-4a3a-8da4-2280176eedde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:09.917174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73774a-22db-4a3a-8da4-2280176eedde admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:09.950206 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1898/3792] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:09.951255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:09.968529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c859d3-473f-4ea9-a9d7-0691a20db173 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:09.984323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:09.985354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:09.985832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:09.986424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] PATH_INFO: `/v3/projects/a6afe3b91262410aaf0e32c43d78cf80/users/ac4a751c80a1441881505a807e50270f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:10.032749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6afe3b91262410aaf0e32c43d78cf80, user_id=ac4a751c80a1441881505a807e50270f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:10.041457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:10.101028 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1895/3793] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:09 2022] PUT /identity/v3/projects/a6afe3b91262410aaf0e32c43d78cf80/users/ac4a751c80a1441881505a807e50270f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:10.183593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c832-3816-4054-895e-03fc547d9693 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:10.184348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c832-3816-4054-895e-03fc547d9693 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:10.184803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c832-3816-4054-895e-03fc547d9693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:10.234604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9d11c832-3816-4054-895e-03fc547d9693 None None] MFA Rules not processed for user `ac4a751c80a1441881505a807e50270f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:10.237506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d11c832-3816-4054-895e-03fc547d9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:10.421601 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1899/3794] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:10.426436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:10.611636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d6071-ac5a-44ab-94ac-ea15deccb180 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:10.625556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:10.632274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:10.632931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:10.633612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:10.645095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:10.649561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:10.743624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c832-3816-4054-895e-03fc547d9693 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:10.752771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1896/3795] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:10 2022] POST /identity/v3/projects => generated 371 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:10.764343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c832-3816-4054-895e-03fc547d9693 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:10.878835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:10.879732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:10.880029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:10.880316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:10.881048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:10.883099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:10.931244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1900/3796] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:10 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:10.937028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:10.963991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3a96f-d780-4272-9662-ffaab1c8c38d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:10.989552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:10.991662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:10.992491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:10.993310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:10.995112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:10.998851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:11.032429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:11.065369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:11.069907 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1897/3797] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:11.080050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069364b9-3f30-43ec-91e3-a3410e955d57 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:11.086712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:11.088039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:11.088504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:11.088976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] PATH_INFO: `/v3/projects/99f1640894944575a5f56dd3b08d298d/users/5e17cf5c9a644fafbc622d6e1d496290/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:11.112489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f1640894944575a5f56dd3b08d298d, user_id=5e17cf5c9a644fafbc622d6e1d496290, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:11.116895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:11.143368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:11.157117 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1901/3798] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:11 2022] PUT /identity/v3/projects/99f1640894944575a5f56dd3b08d298d/users/5e17cf5c9a644fafbc622d6e1d496290/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:11.163402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:11.185207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945173c-652e-43c9-b6be-23683ad574ff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:11.344147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1038-564b-4499-a5db-fa98c487203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:11.344828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1038-564b-4499-a5db-fa98c487203e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:11.345190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1038-564b-4499-a5db-fa98c487203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:11.346571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1038-564b-4499-a5db-fa98c487203e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:11.348495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df1038-564b-4499-a5db-fa98c487203e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:11.362353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df1038-564b-4499-a5db-fa98c487203e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:11.394323 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1898/3799] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:11.395627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:11.410576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dcf28-c216-4a17-a70b-46f1aa7a6443 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:11.424797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:11.425938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:11.426230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:11.426513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] PATH_INFO: `/v3/projects/99f1640894944575a5f56dd3b08d298d/users/5e17cf5c9a644fafbc622d6e1d496290/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:11.429365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f1640894944575a5f56dd3b08d298d, user_id=5e17cf5c9a644fafbc622d6e1d496290, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:11.433494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:11.451811 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1902/3800] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:11 2022] PUT /identity/v3/projects/99f1640894944575a5f56dd3b08d298d/users/5e17cf5c9a644fafbc622d6e1d496290/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:11.462517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d937-3c81-495e-9644-b4e45b25d304 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:11.463085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d937-3c81-495e-9644-b4e45b25d304 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:11.463085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d937-3c81-495e-9644-b4e45b25d304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:11.506355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-04d6d937-3c81-495e-9644-b4e45b25d304 None None] MFA Rules not processed for user `5e17cf5c9a644fafbc622d6e1d496290`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:11.509148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-04d6d937-3c81-495e-9644-b4e45b25d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:11.622484 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1899/3801] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:11.626867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:11.647516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bcc63-7d83-43f4-8517-627be3191fc4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:11.659766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:11.661009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:11.661514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:11.662029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:11.663876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:11.666882 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:11.666882 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:11.666882 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:11.669823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:11.707864 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1903/3802] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:11 2022] POST /identity/v3/services => generated 289 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:11.709877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d937-3c81-495e-9644-b4e45b25d304 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:11.736328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d937-3c81-495e-9644-b4e45b25d304 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:11.775916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:11.777100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:11.778277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:11.778823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:11.780806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:11.782746 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:11.782746 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:11.782746 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:11.785725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:11.870401 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-883889329. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:11.870401 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:11.870401 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:12.039355 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1900/3803] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 14:53:11 2022] POST /identity/v3/endpoints => generated 359 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:12.045643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.114852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51c97c-9a44-429c-aa0b-60ac59a3758f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.180790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.182144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.182683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.183182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-883889329` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.184155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-883889329)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.185580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.188715 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1904/3804] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 14:53:12 2022] GET /identity/v3/regions/tempest-region-883889329 => generated 178 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:12.192649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.207994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a2abf-95cf-4f78-8eb0-7432e6bed2f4 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.221782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.223825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.225078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.226430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.227649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.233148 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:12.233148 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:12.233148 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:12.235554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.291682 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1901/3805] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:12 2022] POST /identity/v3/services => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:12.292913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.323460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d248c-9fd1-42d9-8197-730fdd76ea72 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.372774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.373554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.373848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.374188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.375001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.376184 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:12.376184 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:12.376184 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:12.377183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.438579 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1244039884. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:12.438579 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:12.438579 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:12.538791 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1905/3806] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 14:53:12 2022] POST /identity/v3/endpoints => generated 363 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:12.545087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.572510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20636da5-069a-4551-a0e1-ad72f33f0566 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.584645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.589291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:12.616179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.617229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.618227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.618227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-1244039884` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.618574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1244039884)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.619737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.629070 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1902/3807] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 14:53:12 2022] GET /identity/v3/regions/tempest-region-1244039884 => generated 180 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:53:12.633718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.669172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778e832-ce76-41f2-9384-ced989985956 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.688092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.688795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.689089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.689375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.690150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.693588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.717103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:12.749890 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-642860749. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:12.749890 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:12.749890 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:12.800253 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1903/3808] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 14:53:12 2022] POST /identity/v3/endpoints => generated 359 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:12.801513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.850344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe99ee-9d8a-49f5-b773-1b1b723cc1c0 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.863874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.867842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.868211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.868511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-642860749` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.869414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-642860749)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.875291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.884248 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1904/3809] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 14:53:12 2022] GET /identity/v3/regions/tempest-region-642860749 => generated 178 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:12.886829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:12.904084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17db85-08db-4296-8086-618806ee0421 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.911395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541bfc-d671-4f80-a6cb-64eb86abb60a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:12.956741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.960246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.964073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.966141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.967075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.973507 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:12.973507 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:12.973507 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:12.975400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:12.976996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.978463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:12.983838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:12.984923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] PATH_INFO: `/v3/users/a7edefb2896948e39ac7aed5a3884233` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:12.990787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7edefb2896948e39ac7aed5a3884233)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:12.994769 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1905/3810] 10.222.0.98 () {58 vars in 1133 bytes} [Thu Jul 14 14:53:12 2022] GET /identity/v3/endpoints => generated 4385 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:12.996706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:12.999389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.025018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ff7f-b15c-4f08-9b3c-aff6178c1564 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.039420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.040451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.042728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.042728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints/7893e59b72f9423db9b2d01e8b60aa9e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.058712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=7893e59b72f9423db9b2d01e8b60aa9e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.060990 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:13.060990 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:13.060990 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:13.063958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.066140 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1906/3811] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:12 2022] GET /identity/v3/endpoints/7893e59b72f9423db9b2d01e8b60aa9e => generated 359 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:13.076094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.114379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40939744-4fb7-4232-a6f6-63e090fae760 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.128531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7edefb2896948e39ac7aed5a3884233'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:13.136061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.137030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.137374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.137681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints/7893e59b72f9423db9b2d01e8b60aa9e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.143842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7893e59b72f9423db9b2d01e8b60aa9e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.144994 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:13.144994 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:13.144994 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:13.145954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.149977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:13.163813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7edefb2896948e39ac7aed5a3884233'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:13.170860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7893e59b72f9423db9b2d01e8b60aa9e', 'request_id': 'req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:13.187543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7edefb2896948e39ac7aed5a3884233'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:13.191138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7edefb2896948e39ac7aed5a3884233'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:13.206234 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1907/3812] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:13 2022] DELETE /identity/v3/endpoints/7893e59b72f9423db9b2d01e8b60aa9e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:13.218297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.226301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7edefb2896948e39ac7aed5a3884233'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:13.259001 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1906/3813] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:12 2022] DELETE /identity/v3/users/a7edefb2896948e39ac7aed5a3884233 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:13.318581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f2ec6-5e42-4998-aa9e-5d84ecce118a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.479740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.481566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.481566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.481851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.482646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.484502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.514752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1908/3814] 10.222.0.98 () {58 vars in 1133 bytes} [Thu Jul 14 14:53:13 2022] GET /identity/v3/endpoints => generated 4039 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:13.519320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.521908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:13.537848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1d7b-0732-4723-9776-e4405dcad2e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.543921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.544802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.545097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.545447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints/7893e59b72f9423db9b2d01e8b60aa9e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.562597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Could not find endpoint: 7893e59b72f9423db9b2d01e8b60aa9e.: keystone.exception.EndpointNotFound: Could not find endpoint: 7893e59b72f9423db9b2d01e8b60aa9e. Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._iter().one() Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._only_one_row( Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:53:13.586498 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 7893e59b72f9423db9b2d01e8b60aa9e. Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:53:13.587730 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:53:13.588803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 7893e59b72f9423db9b2d01e8b60aa9e. Jul 14 14:53:13.589820 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:53:13.597996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.607095 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1907/3815] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:13 2022] DELETE /identity/v3/endpoints/7893e59b72f9423db9b2d01e8b60aa9e => generated 114 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:53:13.612186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71f52a-4165-43ce-88ff-372033a33ddf tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.623692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.624683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.625055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.625449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-642860749` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.626212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-642860749)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.628706 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:13.628706 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:13.628706 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:13.632433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.683141 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1909/3816] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 14:53:13 2022] DELETE /identity/v3/regions/tempest-region-642860749 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:13.687496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.702983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5795c-d500-4a2a-a958-ac14fc7a6f1f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.735209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.736726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.737306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.737723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.740205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.741974 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:13.741974 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:13.741974 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:13.743475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.759192 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1908/3817] 10.222.0.98 () {58 vars in 1133 bytes} [Thu Jul 14 14:53:13 2022] GET /identity/v3/endpoints => generated 4039 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:13.761110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.784724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cb244-3eb1-456c-97d3-2168f17ac209 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.791227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.793042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.793790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.794194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.797279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Adding query filter params (service_id=486d55b7877e44caa2beed71ab2e28e9) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:13.797758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.800173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.814218 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1910/3818] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:53:13 2022] GET /identity/v3/endpoints?service_id=486d55b7877e44caa2beed71ab2e28e9 => generated 501 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:53:13.815640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.829025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c827bd-6d86-4324-95c1-40b35cf6d2ea tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.835443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.836359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.836819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.837214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.851650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Adding query filter params (service_id=c5555256d3384c1799d6f9b7e85a391f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:13.852716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.858490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.890865 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1909/3819] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:53:13 2022] GET /identity/v3/endpoints?service_id=c5555256d3384c1799d6f9b7e85a391f => generated 505 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:13.892337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.901950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.904527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:13.910472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f89c-d8be-4952-a3cd-3bf1de96c2a8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.922852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.923881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.924366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.924751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.925921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:13.926352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:13.928630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:13.944920 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1911/3820] 10.222.0.98 () {58 vars in 1166 bytes} [Thu Jul 14 14:53:13 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:13.946291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:13.968286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b4f02-41b4-4223-8eca-789a744b51ab tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:13.992537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:13.994007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:13.994670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:13.995527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:13.997247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:13.997971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:14.001161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:14.016145 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1912/3821] 10.222.0.98 () {58 vars in 1170 bytes} [Thu Jul 14 14:53:13 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:14.018341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:14.037319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342ad69-4c4a-46e1-9394-685837cb636c tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:14.052536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:14.055532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:14.058472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:14.058859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:14.059875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:14.063017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:14.100791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1913/3822] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:14 2022] POST /identity/v3/services => generated 287 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:14.101920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:14.118623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:14.140710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135096b-f7e2-43d1-b084-58b6726106b5 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:14.148866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837796e9-2917-4ab7-a592-ae01a35e3ad2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:14.164417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:14.165700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:14.166258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:14.166810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:14.167896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:14.170096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:14.203935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:14.205433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:14.205993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:14.206483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] PATH_INFO: `/v3/projects/f30b8cc1b9254cca90487359e0872a93` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:14.217329 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1083448208. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:14.217329 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:14.217329 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:14.218129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30b8cc1b9254cca90487359e0872a93)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:14.222304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:14.287930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1914/3823] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 14:53:14 2022] POST /identity/v3/endpoints => generated 360 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:14.288937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:14.368272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706de55d-2aa1-41bf-a9f9-186682b60fb8 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:14.389903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30b8cc1b9254cca90487359e0872a93', 'request_id': 'req-a6bc42c2-d391-47ca-9fb5-1492dae57124'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:14.400321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30b8cc1b9254cca90487359e0872a93', 'request_id': 'req-a6bc42c2-d391-47ca-9fb5-1492dae57124'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:14.411036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30b8cc1b9254cca90487359e0872a93', 'request_id': 'req-a6bc42c2-d391-47ca-9fb5-1492dae57124'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:14.444358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] The token cache is being invalidate because project f30b8cc1b9254cca90487359e0872a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:14.444652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:14.448883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a6bc42c2-d391-47ca-9fb5-1492dae57124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:14.453734 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1910/3824] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:13 2022] DELETE /identity/v3/projects/f30b8cc1b9254cca90487359e0872a93 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:14.480045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:14.480626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:14.481898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:14.523934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:14.525245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:14.525625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:14.526129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-1083448208` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:14.526924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1083448208)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:14.528454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:14.539794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1915/3825] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 14:53:14 2022] GET /identity/v3/regions/tempest-region-1083448208 => generated 180 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:14.541687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:14.544099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:14.599378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:14.613682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:14.639703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:14.833779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf29a-834f-4042-bfb8-1ad82137e06f tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:14.875378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afee543-6e33-43f9-8ab0-23675082d760 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:14.876584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afee543-6e33-43f9-8ab0-23675082d760 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:14.877102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afee543-6e33-43f9-8ab0-23675082d760 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:14.877557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afee543-6e33-43f9-8ab0-23675082d760 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:14.892164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6afee543-6e33-43f9-8ab0-23675082d760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:14.897052 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1911/3826] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:14 2022] POST /identity/v3/auth/tokens => generated 4179 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:53:14.898575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:14.906482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:14.952843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afee543-6e33-43f9-8ab0-23675082d760 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:14.956002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afee543-6e33-43f9-8ab0-23675082d760 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:14.969549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ebf26-d288-4bb9-b74d-5918c5fd8098 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:14.995710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:14.997296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:14.997754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:14.998218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints/7304d412c0ff42198eca3a95ef6e09a3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:15.008319 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1916/3827] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:14 2022] GET /identity/v3/auth/tokens => generated 4248 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:15.010717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e9d7-dec7-4edc-9c84-351c8cb0e728 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:15.011201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e9d7-dec7-4edc-9c84-351c8cb0e728 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:15.011733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e9d7-dec7-4edc-9c84-351c8cb0e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:15.022417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=7304d412c0ff42198eca3a95ef6e09a3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:15.026733 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:15.026733 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:15.026733 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:15.028449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:15.099536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-34d3e9d7-dec7-4edc-9c84-351c8cb0e728 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:15.101635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-34d3e9d7-dec7-4edc-9c84-351c8cb0e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:15.113568 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1257250509. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:15.113568 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:15.113568 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:15.206423 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1917/3828] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:15 2022] POST /identity/v3/auth/tokens => generated 4179 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:15.211830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e9d7-dec7-4edc-9c84-351c8cb0e728 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:15.235447 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1912/3829] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 14:53:14 2022] PATCH /identity/v3/endpoints/7304d412c0ff42198eca3a95ef6e09a3 => generated 363 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:15.237868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:15.255939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e9d7-dec7-4edc-9c84-351c8cb0e728 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:15.377592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:15.378552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d047286-1cc4-4ba8-8a6f-2bce0633aabe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:15.378807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:15.379332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:15.379861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:15.381386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:15.381978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:15.394078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:15.397508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:15.400655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:15.401292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:15.403664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-1257250509` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:15.404654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1257250509)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:15.419996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:15.423346 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1913/3830] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 14:53:15 2022] GET /identity/v3/regions/tempest-region-1257250509 => generated 180 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:15.434820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:15.451741 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1918/3831] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:15.454067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:15.466674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:15.476641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3594-8305-46bc-8b49-bceb8c32e92a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:15.487019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180964d-9edd-4fcd-956a-58d8ec1f56f3 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:15.493184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:15.496688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:15.496980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:15.497263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:15.500006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:15.502289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:15.518728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:15.525877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:15.532320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:15.533517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints/7304d412c0ff42198eca3a95ef6e09a3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:15.570214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7304d412c0ff42198eca3a95ef6e09a3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:15.573181 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:15.573181 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:15.573181 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:15.593365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:15.606965 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1919/3832] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:15 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:15.609140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:15.631811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7304d412c0ff42198eca3a95ef6e09a3', 'request_id': 'req-35ea92ec-289a-439c-82ae-dfc45a3f08d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:15.679886 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1914/3833] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:15 2022] DELETE /identity/v3/endpoints/7304d412c0ff42198eca3a95ef6e09a3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:15.714426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:15.838589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea92ec-289a-439c-82ae-dfc45a3f08d7 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:15.909144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28105fa5-61a3-48d3-b148-54c01f027381 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:15.967250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:15.968442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:15.968744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:15.969005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:15.971395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:15.982324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.101852 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1920/3834] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:15 2022] POST /identity/v3/users => generated 289 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:16.104627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:16.116100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.126631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.128408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.128886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-1257250509` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.130221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1257250509)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.132489 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:16.132489 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:16.132489 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:16.133693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.136634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827a65e-a062-4818-bd52-1fc8c0d818e4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:16.155556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.159358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:16.160250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.160892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.163772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.165612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.174584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.187170 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1915/3835] 10.222.0.98 () {58 vars in 1208 bytes} [Thu Jul 14 14:53:15 2022] DELETE /identity/v3/regions/tempest-region-1257250509 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:16.192929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:16.248021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5d7a1-90a2-4ce6-9b0b-08b483d37c59 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:16.251156 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1921/3836] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:16.256596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:16.271113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.272110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.272314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.272602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-1083448208` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.273283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1083448208)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.274967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.303195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d072ce-7074-4a86-a2ed-315d513b8a9f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:16.327420 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1083448208. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:16.327420 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:16.327420 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:16.362199 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1916/3837] 10.222.0.98 () {58 vars in 1208 bytes} [Thu Jul 14 14:53:16 2022] DELETE /identity/v3/regions/tempest-region-1083448208 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:16.366991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:16.415238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.431685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.436083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.437719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.446022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.458031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee29e6-a36c-4c16-9556-57072af9b26a tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:16.459529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.485936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.487398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.488174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.488824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/services/f5f09e9be2604bbfac67a966934cd0c5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.490196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f5f09e9be2604bbfac67a966934cd0c5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.492955 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:16.492955 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:16.492955 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:16.494622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.565484 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1922/3838] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:16.572217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:16.596333 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1917/3839] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:16 2022] DELETE /identity/v3/services/f5f09e9be2604bbfac67a966934cd0c5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:16.601613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdc7f-bf0c-400c-b0f8-754206d7b73d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:16.604349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:16.654308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64fb6-9fbf-43b9-a5e8-9adc112d81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.655286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64fb6-9fbf-43b9-a5e8-9adc112d81c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.655593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64fb6-9fbf-43b9-a5e8-9adc112d81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.655880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64fb6-9fbf-43b9-a5e8-9adc112d81c1 admin admin] PATH_INFO: `/v3/projects/19d9bbcda6704f11af30fedcc7e5a295/users/136f061873624ac4a28fbe80de7c7363/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.678033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f3bda-824c-4ec4-8ef7-71b9f76b9d38 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:16.690249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.691156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.695721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.696092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints/273d1fc71cba4945ac82781c4b1921e4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.701862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac64fb6-9fbf-43b9-a5e8-9adc112d81c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d9bbcda6704f11af30fedcc7e5a295, user_id=136f061873624ac4a28fbe80de7c7363, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.712301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac64fb6-9fbf-43b9-a5e8-9adc112d81c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.717056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=273d1fc71cba4945ac82781c4b1921e4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.733264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:16.763604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '273d1fc71cba4945ac82781c4b1921e4', 'request_id': 'req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:16.771945 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1923/3840] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:16 2022] PUT /identity/v3/projects/19d9bbcda6704f11af30fedcc7e5a295/users/136f061873624ac4a28fbe80de7c7363/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:16.777088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f448029-5c93-45d9-93f1-100b8132c81f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.781134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f448029-5c93-45d9-93f1-100b8132c81f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.781687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f448029-5c93-45d9-93f1-100b8132c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.784953 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1918/3841] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:16 2022] DELETE /identity/v3/endpoints/273d1fc71cba4945ac82781c4b1921e4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:16.792022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:16.820934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6f448029-5c93-45d9-93f1-100b8132c81f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:16.824002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6f448029-5c93-45d9-93f1-100b8132c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:16.876162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bba2f-d3d4-4403-be8f-f62a12a0d104 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:16.890865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:16.961710 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1924/3842] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:16 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:16.982521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:16.987118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:16.987564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:16.988008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-1244039884` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:16.988846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1244039884)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:16.991003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:17.034529 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1919/3843] 10.222.0.98 () {58 vars in 1208 bytes} [Thu Jul 14 14:53:16 2022] DELETE /identity/v3/regions/tempest-region-1244039884 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:17.037036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f448029-5c93-45d9-93f1-100b8132c81f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:17.061299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f448029-5c93-45d9-93f1-100b8132c81f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:17.069714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:17.072547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:17.086852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:17.088634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:17.089051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:17.089447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/services/c5555256d3384c1799d6f9b7e85a391f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:17.092236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c5555256d3384c1799d6f9b7e85a391f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:17.115214 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:17.115214 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:17.115214 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:17.122012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:17.130889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:17.202596 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1925/3844] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:17 2022] DELETE /identity/v3/services/c5555256d3384c1799d6f9b7e85a391f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:17.205392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba49bf-f943-405b-9348-a7ff7ea03042 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:17.207793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:17.255819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:17.256739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:17.256911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:17.258719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:17.298501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:17.300074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:17.312760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7784-98c7-4743-9967-ddb024d0c232 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:17.356400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:17.359680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:17.360428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:17.360622 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1920/3845] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3544 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:53:17.362781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/endpoints/c9984449393546debf6d03dc80fb9a4f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:17.397701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c9984449393546debf6d03dc80fb9a4f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:17.401345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:17.435178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c9984449393546debf6d03dc80fb9a4f', 'request_id': 'req-0b347253-b037-48d8-bbe4-d617cd2754f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:17.458156 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1926/3846] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:17 2022] DELETE /identity/v3/endpoints/c9984449393546debf6d03dc80fb9a4f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:17.466653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:17.521272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61ccb6-94e6-4ab1-aae1-ef3f810063a8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:17.625009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:17.626731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:17.627256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:17.630068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/regions/tempest-region-883889329` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:17.631435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-883889329)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:17.639550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:17.686037 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-883889329. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:17.686037 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:17.686037 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:17.697136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:17.700644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:17.723818 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1921/3847] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 14:53:17 2022] DELETE /identity/v3/regions/tempest-region-883889329 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:17.725512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:17.768580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b347253-b037-48d8-bbe4-d617cd2754f6 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:17.786954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ff517-0222-410c-9fce-93f3a8f17cd2 tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:17.800665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:17.802522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:17.802973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:17.804451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] PATH_INFO: `/v3/users/7ef211f562144656a4a95f4e0df02341` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:17.813506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e17cf5c9a644fafbc622d6e1d496290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f1640894944575a5f56dd3b08d298d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:17.813870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef211f562144656a4a95f4e0df02341)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:17.816333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:17.819909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:17.821066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:17.821993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] PATH_INFO: `/v3/services/486d55b7877e44caa2beed71ab2e28e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:17.827260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorizing `identity:delete_service(service_id=486d55b7877e44caa2beed71ab2e28e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:17.832492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:17.947405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef211f562144656a4a95f4e0df02341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:17.969102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1922/3848] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:17 2022] DELETE /identity/v3/services/486d55b7877e44caa2beed71ab2e28e9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:17.971166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:17.987688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:17.988045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef211f562144656a4a95f4e0df02341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:17.988876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef211f562144656a4a95f4e0df02341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.010037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef211f562144656a4a95f4e0df02341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.024268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9db315ac-a2d8-4af8-8358-14210a6fdf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef211f562144656a4a95f4e0df02341'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.054357 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1927/3849] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:17 2022] DELETE /identity/v3/users/7ef211f562144656a4a95f4e0df02341 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:18.080863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037692-4562-4237-813b-a2a4b361bffe tempest-EndPointsTestJSON-1989741408 tempest-EndPointsTestJSON-1989741408-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:18.234665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:18.236753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:18.236753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:18.236753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] PATH_INFO: `/v3/users/ac4a751c80a1441881505a807e50270f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:18.271938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4a751c80a1441881505a807e50270f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:18.274043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:18.370530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:18.382668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4a751c80a1441881505a807e50270f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.404256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4a751c80a1441881505a807e50270f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.415672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4a751c80a1441881505a807e50270f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.417097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4a751c80a1441881505a807e50270f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.430932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4a751c80a1441881505a807e50270f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:18.442480 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1923/3850] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:17 2022] DELETE /identity/v3/users/ac4a751c80a1441881505a807e50270f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:18.449265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:18.450879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:18.451463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:18.482434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:18.484017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:18.540921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:18.591070 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1928/3851] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:18.634886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:18.637406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:18.899390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86ead6-c1fa-41f7-b057-ba22e42314d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:18.920108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b663a-6a5f-44ed-88f8-cb8742d3bc5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:18.922293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b663a-6a5f-44ed-88f8-cb8742d3bc5c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:18.925752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b663a-6a5f-44ed-88f8-cb8742d3bc5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:18.926914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b663a-6a5f-44ed-88f8-cb8742d3bc5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:18.959460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:18.962190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:18.974970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b663a-6a5f-44ed-88f8-cb8742d3bc5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:18.978729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b663a-6a5f-44ed-88f8-cb8742d3bc5c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:18.998357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9ce20-52a0-4c79-9d6a-6f19ae25d234 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:19.033413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1924/3852] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:53:19.048183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:19.052210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:19.053358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:19.054215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] PATH_INFO: `/v3/projects/1a307dcb18fe4909bc0421fb1fb18892` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:19.062242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a307dcb18fe4909bc0421fb1fb18892)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:19.066560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:19.219851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a307dcb18fe4909bc0421fb1fb18892', 'request_id': 'req-5baba794-c3ed-4a42-bbdd-9f19a35afda5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:19.234278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a307dcb18fe4909bc0421fb1fb18892', 'request_id': 'req-5baba794-c3ed-4a42-bbdd-9f19a35afda5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:19.245955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a307dcb18fe4909bc0421fb1fb18892', 'request_id': 'req-5baba794-c3ed-4a42-bbdd-9f19a35afda5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:19.286736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] The token cache is being invalidate because project 1a307dcb18fe4909bc0421fb1fb18892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:19.287032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:19.287877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5baba794-c3ed-4a42-bbdd-9f19a35afda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:19.294956 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1929/3853] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:18 2022] DELETE /identity/v3/projects/1a307dcb18fe4909bc0421fb1fb18892 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:19.298335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc132-333f-40df-862f-0171b62d4a24 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:19.299035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc132-333f-40df-862f-0171b62d4a24 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:19.299723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc132-333f-40df-862f-0171b62d4a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:19.369397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e12dc132-333f-40df-862f-0171b62d4a24 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:19.372822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e12dc132-333f-40df-862f-0171b62d4a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:19.523449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1925/3854] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:19.531813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457ff1-b1ae-4ccc-9591-f46599042c7c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:19.532083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457ff1-b1ae-4ccc-9591-f46599042c7c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:19.532392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457ff1-b1ae-4ccc-9591-f46599042c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:19.564661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3c457ff1-b1ae-4ccc-9591-f46599042c7c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:19.566031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c457ff1-b1ae-4ccc-9591-f46599042c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:19.588346 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1930/3855] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:19.594850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dc132-333f-40df-862f-0171b62d4a24 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:19.641698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dc132-333f-40df-862f-0171b62d4a24 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:19.656785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:19.661783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:19.662813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:19.664071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:19.670152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:19.672746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:19.689334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:19.715540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1926/3856] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:19.722074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457ff1-b1ae-4ccc-9591-f46599042c7c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:19.734524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:19.739782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:19.753501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457ff1-b1ae-4ccc-9591-f46599042c7c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:19.771326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:19.772549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:19.773075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:19.773295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c400a11-767f-438c-8486-8a20a343e0cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:19.773590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:19.774908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:19.778915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:19.784313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:19.786326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:19.787632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:19.788579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] PATH_INFO: `/v3/projects/a6afe3b91262410aaf0e32c43d78cf80` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:19.791560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6afe3b91262410aaf0e32c43d78cf80)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:19.799448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:19.883113 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1931/3857] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:19 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:19.889605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:19.931634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:19.978315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6afe3b91262410aaf0e32c43d78cf80', 'request_id': 'req-3b41752c-1f78-4fe6-9656-64f1a861ef0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.002366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6afe3b91262410aaf0e32c43d78cf80', 'request_id': 'req-3b41752c-1f78-4fe6-9656-64f1a861ef0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.030897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6afe3b91262410aaf0e32c43d78cf80', 'request_id': 'req-3b41752c-1f78-4fe6-9656-64f1a861ef0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.070472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] The token cache is being invalidate because project a6afe3b91262410aaf0e32c43d78cf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:20.071142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.072355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.076449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1927/3858] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:19 2022] DELETE /identity/v3/projects/a6afe3b91262410aaf0e32c43d78cf80 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:20.077878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:20.080191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:20.123970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac082-6dd8-4ebb-8513-dbb240c1a1b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:20.229426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:20.300077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:20.302975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:20.303420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:20.303843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:20.304748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:20.309446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:20.328880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41752c-1f78-4fe6-9656-64f1a861ef0f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:20.344735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:20.346015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:20.346656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:20.347239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:20.350818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:20.416872 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1932/3859] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:19 2022] POST /identity/v3/users => generated 288 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:20.419120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:20.431070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:20.483425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe37b-5e13-45b0-ab77-c3c39d961a65 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:20.503217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:20.504946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:20.505353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:20.505866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] PATH_INFO: `/v3/users/5e17cf5c9a644fafbc622d6e1d496290` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:20.516278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e17cf5c9a644fafbc622d6e1d496290)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:20.520188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:20.632568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:20.634423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:20.676591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e17cf5c9a644fafbc622d6e1d496290'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.717942 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1928/3860] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:20.719688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:20.727611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:20.736394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e17cf5c9a644fafbc622d6e1d496290'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.739556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e17cf5c9a644fafbc622d6e1d496290'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.796745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ba70-9628-4b88-be84-e391abe17998 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:20.798450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e17cf5c9a644fafbc622d6e1d496290'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.799690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e17cf5c9a644fafbc622d6e1d496290'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:20.807837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:20.808703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:20.809825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:20.810985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:20.813165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:20.815978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:20.836161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1933/3861] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:20 2022] DELETE /identity/v3/users/5e17cf5c9a644fafbc622d6e1d496290 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:20.837742 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1929/3862] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:20.844024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:20.850527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:20.998057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506a3a5-5b97-4d7f-b6fa-6c908955f202 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:21.005836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fdbd3-8b3f-409d-bc74-728b1df364da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:21.007932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fdbd3-8b3f-409d-bc74-728b1df364da admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:21.009812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fdbd3-8b3f-409d-bc74-728b1df364da admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:21.011115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fdbd3-8b3f-409d-bc74-728b1df364da admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:21.013133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fdbd3-8b3f-409d-bc74-728b1df364da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:21.019981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fdbd3-8b3f-409d-bc74-728b1df364da admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:21.064674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1934/3863] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:21.067613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:21.115791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d25bc-c6a2-45bf-9375-55114f9b9788 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:21.148038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:21.149565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:21.150051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:21.163076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] PATH_INFO: `/v3/projects/5db5c93660ef41728634e8e57039da1a/users/126f8683e55647bc9605e05c7aa654fd/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:21.216085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db5c93660ef41728634e8e57039da1a, user_id=126f8683e55647bc9605e05c7aa654fd, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:21.227623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:21.298068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1930/3864] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:21 2022] PUT /identity/v3/projects/5db5c93660ef41728634e8e57039da1a/users/126f8683e55647bc9605e05c7aa654fd/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:21.303912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:21.304462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:21.304462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:21.355514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:21.361706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:21.459998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:21.473804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:21.478411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:21.487125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:21.588529 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1935/3865] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:21.608827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:21.610632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:21.735441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a977b7-4f11-4fb0-8902-52195bbff1f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:21.743616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:21.745274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:21.747505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:21.748048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:21.751830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:21.774999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db59813-1dbe-4c31-8ddc-d31949b21c6d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:21.778646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:21.782024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:21.787326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdbeca-89fb-48ef-9ae6-c8462ea587e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:21.788060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbeca-89fb-48ef-9ae6-c8462ea587e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:21.788353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbeca-89fb-48ef-9ae6-c8462ea587e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:21.788642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbeca-89fb-48ef-9ae6-c8462ea587e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:21.806327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1931/3866] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:21.817811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdbeca-89fb-48ef-9ae6-c8462ea587e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:21.820766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdbeca-89fb-48ef-9ae6-c8462ea587e3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:21.858371 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1936/3867] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:22.123082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:22.145252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ca443-7821-460b-83b3-e7c6100ca84a service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:22.153862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da8d1-8a2c-4caf-a9ff-4d71b00427ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:22.155472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da8d1-8a2c-4caf-a9ff-4d71b00427ff service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:22.156199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da8d1-8a2c-4caf-a9ff-4d71b00427ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:22.156727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da8d1-8a2c-4caf-a9ff-4d71b00427ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:22.161450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f98da8d1-8a2c-4caf-a9ff-4d71b00427ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:22.186545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da8d1-8a2c-4caf-a9ff-4d71b00427ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:22.188618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da8d1-8a2c-4caf-a9ff-4d71b00427ff service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:22.213566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1932/3868] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:22.475561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0b12-63ba-445a-acfb-b042b674ec6c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:22.477540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0b12-63ba-445a-acfb-b042b674ec6c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:22.478230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0b12-63ba-445a-acfb-b042b674ec6c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:22.482494 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1937/3869] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 14:53:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:53:22.487730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e644-e492-4510-827b-da91693582e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:22.488303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e644-e492-4510-827b-da91693582e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:22.488417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e644-e492-4510-827b-da91693582e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:22.503322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0b12-63ba-445a-acfb-b042b674ec6c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:22.506251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-baee0b12-63ba-445a-acfb-b042b674ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:22.528878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0b12-63ba-445a-acfb-b042b674ec6c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:22.534882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ac73e644-e492-4510-827b-da91693582e1 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:22.538983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ac73e644-e492-4510-827b-da91693582e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:22.539973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:22.541334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:22.541879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:22.542404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] PATH_INFO: `/v3/projects/99f1640894944575a5f56dd3b08d298d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:22.544880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f1640894944575a5f56dd3b08d298d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:22.548816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:22.568530 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1933/3870] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:22.594919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73e644-e492-4510-827b-da91693582e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:22.612766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73e644-e492-4510-827b-da91693582e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:22.630989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8bdc0-6b97-486c-877c-b9960464f877 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:22.631932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8bdc0-6b97-486c-877c-b9960464f877 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:22.632234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8bdc0-6b97-486c-877c-b9960464f877 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:22.632524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8bdc0-6b97-486c-877c-b9960464f877 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:22.654858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8bdc0-6b97-486c-877c-b9960464f877 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:22.661964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8bdc0-6b97-486c-877c-b9960464f877 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:22.707800 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1934/3871] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:22.766642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f1640894944575a5f56dd3b08d298d', 'request_id': 'req-c408e71b-08df-4324-af4b-eace0640c699'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:22.784050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f1640894944575a5f56dd3b08d298d', 'request_id': 'req-c408e71b-08df-4324-af4b-eace0640c699'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:22.794340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f1640894944575a5f56dd3b08d298d', 'request_id': 'req-c408e71b-08df-4324-af4b-eace0640c699'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:22.828366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] The token cache is being invalidate because project 99f1640894944575a5f56dd3b08d298d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:22.828693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:22.829769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c408e71b-08df-4324-af4b-eace0640c699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:22.837127 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1938/3872] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:22 2022] DELETE /identity/v3/projects/99f1640894944575a5f56dd3b08d298d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:22.845869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cd35-63ac-440f-be79-c00e70d9b6cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:22.846095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cd35-63ac-440f-be79-c00e70d9b6cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:22.846387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cd35-63ac-440f-be79-c00e70d9b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:22.875147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4804cd35-63ac-440f-be79-c00e70d9b6cc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:22.877039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4804cd35-63ac-440f-be79-c00e70d9b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:22.996610 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1935/3873] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:22.999602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914cdd-e5c3-4c1c-906b-ecf162f0718b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:22.999905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914cdd-e5c3-4c1c-906b-ecf162f0718b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:23.000210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914cdd-e5c3-4c1c-906b-ecf162f0718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:23.065070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-94914cdd-e5c3-4c1c-906b-ecf162f0718b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:23.069404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94914cdd-e5c3-4c1c-906b-ecf162f0718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:23.099918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1939/3874] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:53:23.100381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cd35-63ac-440f-be79-c00e70d9b6cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:23.154691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cd35-63ac-440f-be79-c00e70d9b6cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:23.179394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:23.181713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:23.184101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:23.184723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:23.187253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:23.188958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:23.196783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:23.234860 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1936/3875] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:23.242507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94914cdd-e5c3-4c1c-906b-ecf162f0718b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:23.297324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94914cdd-e5c3-4c1c-906b-ecf162f0718b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:23.321001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:23.322079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:23.322471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:23.322778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:23.323684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:23.329937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:23.399255 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1940/3876] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:23 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:53:23.406062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:23.450686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3040dc-b7a4-46ea-b6ae-a353c8b241f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:23.539374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:23.574496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:23.576137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:23.576435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:23.576725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:23.577450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:23.579633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:23.610676 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1937/3877] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:23 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:53:23.617179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:23.640078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:23.642990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:23.651025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90803f3-1968-439b-9d4b-06b8643f7fed admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:23.667207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:23.669585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:23.669585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:23.670075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:23.675175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:23.696341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:23.769286 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1941/3878] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:53:23.776831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:23.777135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9a4b0-e1c4-4898-a547-374ce05b10dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:23.786758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07bd35-b5a3-417b-9913-e16a7f4b3bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:23.789332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07bd35-b5a3-417b-9913-e16a7f4b3bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:23.789332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07bd35-b5a3-417b-9913-e16a7f4b3bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:23.789652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07bd35-b5a3-417b-9913-e16a7f4b3bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:23.798632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d07bd35-b5a3-417b-9913-e16a7f4b3bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:23.853219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca762b-1fdc-4f9b-a4e7-7d674ff9be6d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:23.899779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:23.901034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:23.901540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:23.902051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:23.904039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:23.908526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:23.973834 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1942/3879] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:23.975958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:24.019593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408111c-e3c1-4f33-984c-9dc1187f151c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:24.043869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:24.046024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:24.046852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:24.053691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] PATH_INFO: `/v3/projects/75d3d3245e4b4ac1978127941ceb12e3/users/1fd687ae1693491b8801a624bbc7aad4/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:24.099447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:24.110710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d3d3245e4b4ac1978127941ceb12e3, user_id=1fd687ae1693491b8801a624bbc7aad4, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:24.113653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07bd35-b5a3-417b-9913-e16a7f4b3bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:24.115494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07bd35-b5a3-417b-9913-e16a7f4b3bc3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:24.119788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:24.151182 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1938/3880] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:24.180847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1943/3881] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:23 2022] PUT /identity/v3/projects/75d3d3245e4b4ac1978127941ceb12e3/users/1fd687ae1693491b8801a624bbc7aad4/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:24.193337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f9bfb-9c4f-4c5d-a2f6-d9d432a52269 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:24.193646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f9bfb-9c4f-4c5d-a2f6-d9d432a52269 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:24.193969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f9bfb-9c4f-4c5d-a2f6-d9d432a52269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:24.252686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-449f9bfb-9c4f-4c5d-a2f6-d9d432a52269 None None] MFA Rules not processed for user `1fd687ae1693491b8801a624bbc7aad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:24.263555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-449f9bfb-9c4f-4c5d-a2f6-d9d432a52269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:24.350850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:24.430696 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1939/3882] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:24.431313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:24.657910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0976c-110e-4a58-9145-640eef50fdf1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:24.670413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:24.671987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:24.672504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:24.673079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:24.674935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:24.682972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:24.811166 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1944/3883] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:24 2022] POST /identity/v3/projects => generated 371 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:53:24.816353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f9bfb-9c4f-4c5d-a2f6-d9d432a52269 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:24.836175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f9bfb-9c4f-4c5d-a2f6-d9d432a52269 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:25.087146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:25.089741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:25.091252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:25.092033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:25.093322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:25.097171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:25.145882 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1940/3884] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:24 2022] POST /identity/v3/users => generated 292 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:53:25.150114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:25.172173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae2422-817e-49e3-a86a-2700b2664c12 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:25.189787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:25.196123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:25.197633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:25.197946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:25.202769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:25.208188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:25.249768 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1945/3885] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:25.251336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:25.314669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c710-082f-4977-881b-5d96adc24637 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:25.326164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:25.329883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:25.330847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:25.331622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] PATH_INFO: `/v3/projects/1fd5dde8cc524401a6173339642f6bb1/users/cb4c0490ccae4adc9488cf8c47d9e578/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:25.420947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd5dde8cc524401a6173339642f6bb1, user_id=cb4c0490ccae4adc9488cf8c47d9e578, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:25.432447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:25.505529 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1941/3886] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:25 2022] PUT /identity/v3/projects/1fd5dde8cc524401a6173339642f6bb1/users/cb4c0490ccae4adc9488cf8c47d9e578/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:25.508584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:25.536434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4f6b9-05da-47db-b372-2f43b144aa38 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:25.763730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f7b3a-8bac-472c-a152-f7d81619a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:25.765604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f7b3a-8bac-472c-a152-f7d81619a7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:25.767027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f7b3a-8bac-472c-a152-f7d81619a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:25.767548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f7b3a-8bac-472c-a152-f7d81619a7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:25.769388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f7b3a-8bac-472c-a152-f7d81619a7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:25.780147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f7b3a-8bac-472c-a152-f7d81619a7e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:25.817264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1946/3887] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:53:25.820555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:25.841116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841e1ea-b22a-40a3-bd3c-4e3f38251974 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:25.856888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:25.857699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:25.858031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:25.858368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] PATH_INFO: `/v3/projects/1fd5dde8cc524401a6173339642f6bb1/users/cb4c0490ccae4adc9488cf8c47d9e578/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:25.862766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd5dde8cc524401a6173339642f6bb1, user_id=cb4c0490ccae4adc9488cf8c47d9e578, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:25.865723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:25.895941 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1942/3888] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:25 2022] PUT /identity/v3/projects/1fd5dde8cc524401a6173339642f6bb1/users/cb4c0490ccae4adc9488cf8c47d9e578/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:25.900295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb43922-635d-4555-bc3e-fbb41bd1389d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:25.900960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb43922-635d-4555-bc3e-fbb41bd1389d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:25.901710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb43922-635d-4555-bc3e-fbb41bd1389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:26.023946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-afb43922-635d-4555-bc3e-fbb41bd1389d None None] MFA Rules not processed for user `cb4c0490ccae4adc9488cf8c47d9e578`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:26.029805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-afb43922-635d-4555-bc3e-fbb41bd1389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:26.174220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:26.267235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1947/3889] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:26.267495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:26.280316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8183a-2800-4fc6-ad5a-56547f98393c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:26.290092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:26.291977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:26.293404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:26.295133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:26.297207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:26.300362 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:26.300362 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:26.300362 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:26.303306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:26.366000 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1943/3890] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:53:26 2022] POST /identity/v3/domains => generated 276 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:26.375962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb43922-635d-4555-bc3e-fbb41bd1389d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:26.409258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb43922-635d-4555-bc3e-fbb41bd1389d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:26.562734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:26.564340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:26.564991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:26.565650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:26.568531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:26.571058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:26.631587 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1948/3891] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:26 2022] POST /identity/v3/projects => generated 402 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:26.633510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:26.672181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3b890-7c16-4bf1-889a-ca0fdd8b3228 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:26.795058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:26.796417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:26.797063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:26.797623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:26.800906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:26.802378 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:26.802378 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:26.802378 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:26.804183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:26.828306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:26.830184 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1944/3892] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:53:26 2022] POST /identity/v3/groups => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:26.845211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d425a4-ccc7-42b9-a839-876b8daf664c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:26.868083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:26.868806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:26.869100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:26.869386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:26.870265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:26.873564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:26.940725 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1949/3893] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:26 2022] POST /identity/v3/users => generated 442 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:26.946850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:26.964992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b794c-e60d-413b-835b-e4675137e620 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:26.970989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:26.971809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:26.972062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:26.972350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:26.973123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:26.974931 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:26.974931 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:26.974931 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:26.976201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:26.991210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:27.022164 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1945/3894] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:53:26 2022] POST /identity/v3/roles => generated 240 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:27.026961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:27.043602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22318f-a69a-4011-98e3-9b8142d388fc tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:27.051548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:27.054420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:27.055158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:27.056167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/groups/e674b31de5f94314a19b1f818fd6f400/roles/803862f98296405f8199d063fe7ada04/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:27.070404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c304284ca4a345c39183aa5150cb364b, group_id=e674b31de5f94314a19b1f818fd6f400, role_id=803862f98296405f8199d063fe7ada04)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:27.074612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:27.103742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:27.104488 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1950/3895] 10.222.0.98 () {60 vars in 1584 bytes} [Thu Jul 14 14:53:27 2022] PUT /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/groups/e674b31de5f94314a19b1f818fd6f400/roles/803862f98296405f8199d063fe7ada04/inherited_to_projects => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:27.119050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7576-0e81-4719-abdb-916f4b456245 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:27.241537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:27.242671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:27.243295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:27.244273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/groups/e674b31de5f94314a19b1f818fd6f400/roles/803862f98296405f8199d063fe7ada04/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:27.252182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c304284ca4a345c39183aa5150cb364b, group_id=e674b31de5f94314a19b1f818fd6f400, role_id=803862f98296405f8199d063fe7ada04)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:27.253474 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:27.253474 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:27.253474 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:27.256692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:27.271382 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1946/3896] 10.222.0.98 () {58 vars in 1566 bytes} [Thu Jul 14 14:53:27 2022] HEAD /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/groups/e674b31de5f94314a19b1f818fd6f400/roles/803862f98296405f8199d063fe7ada04/inherited_to_projects => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:27.273457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:27.287502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3fd92-a84e-4874-91e2-b26c80f9201a tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:27.295103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:27.296617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:27.296617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:27.297043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/groups/e674b31de5f94314a19b1f818fd6f400/roles/803862f98296405f8199d063fe7ada04/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:27.299919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c304284ca4a345c39183aa5150cb364b, group_id=e674b31de5f94314a19b1f818fd6f400, role_id=803862f98296405f8199d063fe7ada04)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:27.302158 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:27.302158 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:27.302158 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:27.304665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:27.317424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 803862f98296405f8199d063fe7ada04 was removed from group e674b31de5f94314a19b1f818fd6f400 on project c304284ca4a345c39183aa5150cb364b. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:27.317424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:27.318437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:27.359637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:27.362281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:27.363334 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1951/3897] 10.222.0.98 () {58 vars in 1568 bytes} [Thu Jul 14 14:53:27 2022] DELETE /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/groups/e674b31de5f94314a19b1f818fd6f400/roles/803862f98296405f8199d063fe7ada04/inherited_to_projects => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:27.384446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f39cb-3f0b-473a-a431-ee6ce8125e1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:27.585804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:27.588580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:27.589295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:27.590428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles/803862f98296405f8199d063fe7ada04` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:27.594730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_role(role_id=803862f98296405f8199d063fe7ada04)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:27.598861 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:27.598861 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:27.598861 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:27.601279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:27.712204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 803862f98296405f8199d063fe7ada04 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:27.713083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:27.714983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:27.720936 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1947/3898] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:27 2022] DELETE /identity/v3/roles/803862f98296405f8199d063fe7ada04 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:27.726158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:27.743566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119529e-3d2e-4adf-a7f1-be00b55d4c7f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:27.856385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:27.857568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:27.857568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:27.857835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:27.859100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:27.860736 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:27.860736 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:27.860736 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:27.861898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:27.885687 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1952/3899] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:53:27 2022] POST /identity/v3/roles => generated 239 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:27.891792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:27.893670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:27.914793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7b79e-8d97-44df-b144-93915d00b231 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:27.922924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:27.925944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:27.935922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:27.936362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/6cbf054d2a8748428dcaaf6b20f89e35/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:27.979806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c304284ca4a345c39183aa5150cb364b, user_id=fa2c41978f1a482ba905571ad040033e, role_id=6cbf054d2a8748428dcaaf6b20f89e35)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:27.984181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:28.014967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:28.015690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1948/3900] 10.222.0.98 () {60 vars in 1581 bytes} [Thu Jul 14 14:53:27 2022] PUT /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/6cbf054d2a8748428dcaaf6b20f89e35/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:28.025590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:28.036721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff377984-84c4-427f-b4b7-5e46fc2d4f36 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:28.184532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a9f9-2955-40b7-b7c1-fd51c9cb62d9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:28.198788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a9f9-2955-40b7-b7c1-fd51c9cb62d9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:28.199124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a9f9-2955-40b7-b7c1-fd51c9cb62d9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:28.199990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a9f9-2955-40b7-b7c1-fd51c9cb62d9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/6cbf054d2a8748428dcaaf6b20f89e35/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:28.204883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a9f9-2955-40b7-b7c1-fd51c9cb62d9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c304284ca4a345c39183aa5150cb364b, user_id=fa2c41978f1a482ba905571ad040033e, role_id=6cbf054d2a8748428dcaaf6b20f89e35)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:28.205972 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-5317a9f9-2955-40b7-b7c1-fd51c9cb62d9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:28.205972 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:28.205972 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:28.213290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a9f9-2955-40b7-b7c1-fd51c9cb62d9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:28.243455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:28.243753 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1953/3901] 10.222.0.98 () {58 vars in 1563 bytes} [Thu Jul 14 14:53:28 2022] HEAD /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/6cbf054d2a8748428dcaaf6b20f89e35/inherited_to_projects => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:28.260789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e0ef-1059-4939-9af7-13f60b7b7541 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:28.267779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:28.278892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:28.278892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:28.278892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/6cbf054d2a8748428dcaaf6b20f89e35/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:28.278892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c304284ca4a345c39183aa5150cb364b, user_id=fa2c41978f1a482ba905571ad040033e, role_id=6cbf054d2a8748428dcaaf6b20f89e35)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:28.280637 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:28.280637 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:28.280637 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:28.280637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:28.307900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 6cbf054d2a8748428dcaaf6b20f89e35 was removed from user fa2c41978f1a482ba905571ad040033e on project c304284ca4a345c39183aa5150cb364b. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:28.308510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:28.310489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:28.328179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:28.328500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:28.329077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:28.381670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1949/3902] 10.222.0.98 () {58 vars in 1565 bytes} [Thu Jul 14 14:53:28 2022] DELETE /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/6cbf054d2a8748428dcaaf6b20f89e35/inherited_to_projects => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:28.385476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:28.391217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:28.392629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:28.392824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:28.509348 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1954/3903] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:28.544335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:28.677147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:28.678712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:28.729195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4197-c0ab-4b25-8218-9dcccc988b12 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:28.780010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:28.791014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:28.794481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:28.795008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles/6cbf054d2a8748428dcaaf6b20f89e35` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:28.800948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6cbf054d2a8748428dcaaf6b20f89e35)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:28.807141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:28.896137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69ebd-516e-46d0-b78d-8f142894b3a9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:28.917755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:28.919452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:28.919814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:28.920156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:28.950482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 6cbf054d2a8748428dcaaf6b20f89e35 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:28.951084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:28.951780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:28.960864 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1950/3904] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:28 2022] DELETE /identity/v3/roles/6cbf054d2a8748428dcaaf6b20f89e35 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:28.961889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:28.977186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:28.983620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:28.986512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:29.031431 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1955/3905] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:53:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:53:29.180696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb80b6c-1e9b-47d7-b998-12adfb26eae9 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:29.194647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:29.195714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:29.197112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:29.197580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:29.200957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:29.204625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:29.253979 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1951/3906] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:53:28 2022] POST /identity/v3/roles => generated 240 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:29.256501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:29.340373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a05727-dcae-4636-b36e-7e39f51b5d22 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:29.385142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:29.386743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:29.387879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:29.400773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/aa249a9deba741bc9c5f655b6794da02/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:29.418422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, group_id=e674b31de5f94314a19b1f818fd6f400, role_id=aa249a9deba741bc9c5f655b6794da02)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:29.442380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:29.527753 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1956/3907] 10.222.0.98 () {60 vars in 1581 bytes} [Thu Jul 14 14:53:29 2022] PUT /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/aa249a9deba741bc9c5f655b6794da02/inherited_to_projects => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:29.529141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:29.543117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eafd2c-7e4f-453b-8102-0152a8c2e1cd tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:29.711981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:29.712972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:29.713336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:29.713706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:29.719154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2d30f68205164e3d9281834ac453bb6a, group_id=e674b31de5f94314a19b1f818fd6f400)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:29.720591 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:29.720591 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:29.720591 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:29.722614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:29.762946 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1952/3908] 10.222.0.98 () {58 vars in 1463 bytes} [Thu Jul 14 14:53:29 2022] GET /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/inherited_to_projects => generated 448 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:29.768925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:29.799807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:29.812117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81b53-6005-41f3-9433-54b756059873 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:29.839335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:29.840963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:29.841477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:29.841978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/aa249a9deba741bc9c5f655b6794da02/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:29.867565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, group_id=e674b31de5f94314a19b1f818fd6f400, role_id=aa249a9deba741bc9c5f655b6794da02)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:29.898503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:29.943032 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1957/3909] 10.222.0.98 () {58 vars in 1563 bytes} [Thu Jul 14 14:53:29 2022] HEAD /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/aa249a9deba741bc9c5f655b6794da02/inherited_to_projects => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:29.947442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:29.972416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322df4f-84b9-4abf-984d-a5806d2be83f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:29.978908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:29.980785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:29.980785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:29.980785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/aa249a9deba741bc9c5f655b6794da02/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:30.002663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, group_id=e674b31de5f94314a19b1f818fd6f400, role_id=aa249a9deba741bc9c5f655b6794da02)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:30.005807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:30.022438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role aa249a9deba741bc9c5f655b6794da02 was removed from group e674b31de5f94314a19b1f818fd6f400 on domain 2d30f68205164e3d9281834ac453bb6a. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:30.023052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:30.024358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:30.058282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:30.093245 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1953/3910] 10.222.0.98 () {58 vars in 1565 bytes} [Thu Jul 14 14:53:29 2022] DELETE /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/groups/e674b31de5f94314a19b1f818fd6f400/roles/aa249a9deba741bc9c5f655b6794da02/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:30.098288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:30.103017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:30.154578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc124c6-85bf-4677-af4e-52ceb66f92d7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:30.519079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:30.520748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:30.521322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:30.523214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles/aa249a9deba741bc9c5f655b6794da02` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:30.530947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aa249a9deba741bc9c5f655b6794da02)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:30.533933 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:30.533933 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:30.533933 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:30.545926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:30.711672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role aa249a9deba741bc9c5f655b6794da02 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:30.712028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:30.715406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:30.721148 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1958/3911] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:30 2022] DELETE /identity/v3/roles/aa249a9deba741bc9c5f655b6794da02 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:30.728765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:30.796158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e012-108e-4a70-b7db-ed5a3e20d37f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:30.987385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:30.989560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:30.993141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:30.993855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:30.994964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:30.999679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:31.034817 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1954/3912] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:53:30 2022] POST /identity/v3/roles => generated 238 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:31.038456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:31.041087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:31.068837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ba8a-e30c-4e63-b680-e326b4a681f3 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:31.084748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:31.095065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:31.095065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:31.095065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/94ef032833874059ad9bfad43d766535/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:31.095796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, user_id=fa2c41978f1a482ba905571ad040033e, role_id=94ef032833874059ad9bfad43d766535)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:31.106471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:31.113186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:31.115690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:31.157255 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1959/3913] 10.222.0.98 () {60 vars in 1578 bytes} [Thu Jul 14 14:53:31 2022] PUT /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/94ef032833874059ad9bfad43d766535/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:31.163199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:31.352616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8513-2563-4d61-aba4-ca6db7f170c0 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:31.384454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44795453-97c3-4b6b-a9f8-5aa1f5a347e7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:31.401781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:31.403570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:31.403972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:31.404436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:31.408395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2d30f68205164e3d9281834ac453bb6a, user_id=fa2c41978f1a482ba905571ad040033e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:31.413469 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:31.413469 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:31.413469 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:31.420156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:31.480406 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1960/3914] 10.222.0.98 () {58 vars in 1460 bytes} [Thu Jul 14 14:53:31 2022] GET /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/inherited_to_projects => generated 445 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:31.481690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:31.510008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63b16b-e2f9-4400-92c8-a2980c8b337f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:31.524944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:31.527075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:31.528307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:31.530236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:31.530683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/94ef032833874059ad9bfad43d766535/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:31.531859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:31.533014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:31.534338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] PATH_INFO: `/v3/users/b72083f0df93495194118d6a12088c75` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:31.535212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, user_id=fa2c41978f1a482ba905571ad040033e, role_id=94ef032833874059ad9bfad43d766535)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:31.538356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72083f0df93495194118d6a12088c75)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:31.538764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:31.547222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:31.547670 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1961/3915] 10.222.0.98 () {58 vars in 1560 bytes} [Thu Jul 14 14:53:31 2022] HEAD /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/94ef032833874059ad9bfad43d766535/inherited_to_projects => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:31.551475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:31.580558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491161c-9e71-4d45-9c9e-f1903dabe5ff tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:31.595584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:31.601545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:31.602109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:31.602523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/94ef032833874059ad9bfad43d766535/inherited_to_projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:31.606346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, user_id=fa2c41978f1a482ba905571ad040033e, role_id=94ef032833874059ad9bfad43d766535)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:31.616064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:31.631545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 94ef032833874059ad9bfad43d766535 was removed from user fa2c41978f1a482ba905571ad040033e on domain 2d30f68205164e3d9281834ac453bb6a. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:31.633738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:31.635487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:31.666226 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1962/3916] 10.222.0.98 () {58 vars in 1562 bytes} [Thu Jul 14 14:53:31 2022] DELETE /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/94ef032833874059ad9bfad43d766535/inherited_to_projects => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:31.670861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:31.673687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:31.693576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:31.718233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72083f0df93495194118d6a12088c75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:31.723899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:31.770668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72083f0df93495194118d6a12088c75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:31.793409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72083f0df93495194118d6a12088c75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:31.794189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72083f0df93495194118d6a12088c75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:31.813030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72083f0df93495194118d6a12088c75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:31.832842 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1955/3917] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:31 2022] DELETE /identity/v3/users/b72083f0df93495194118d6a12088c75 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:31.990881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7c828-00fd-485a-9dbb-664892db4e9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:32.236170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:32.241910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:32.241910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:32.241910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles/94ef032833874059ad9bfad43d766535` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:32.246875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_role(role_id=94ef032833874059ad9bfad43d766535)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:32.253324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:32.392107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 94ef032833874059ad9bfad43d766535 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:32.392107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:32.396519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:32.400671 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1963/3918] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:31 2022] DELETE /identity/v3/roles/94ef032833874059ad9bfad43d766535 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:32.410070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:32.412563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:32.483173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bef90-baeb-4d84-ae4c-ea1efc919f92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:33.153179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:33.154427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:33.154745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:33.155145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:33.156321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:33.158823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:33.196820 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1956/3919] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:53:32 2022] POST /identity/v3/roles => generated 239 bytes in 783 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:33.199049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:33.199831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:33.225083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8dabb-54ed-48b4-ab79-73ad840c1000 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:33.236811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:33.239719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:33.240110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:33.240381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:33.241097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:33.243148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:33.336136 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1964/3920] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:33 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:33.337371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:33.352908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a48b-49d3-4014-8ae9-8cd78c35955d tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:33.515007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:33.516076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:33.516370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:33.516658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/ec60e44f33f643af8433e0515f9460d1/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:33.521552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, user_id=fa2c41978f1a482ba905571ad040033e, role_id=ec60e44f33f643af8433e0515f9460d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:33.530455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:33.560657 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1957/3921] 10.222.0.98 () {60 vars in 1578 bytes} [Thu Jul 14 14:53:33 2022] PUT /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/ec60e44f33f643af8433e0515f9460d1/inherited_to_projects => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:33.567376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:33.594346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6ffc-9157-4004-ac81-c438944966cf tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:33.745242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:33.760160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:33.762922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:33.763152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:33.763708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:33.764611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Adding query filter params (scope.project.id=c304284ca4a345c39183aa5150cb364b, user.id=fa2c41978f1a482ba905571ad040033e) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:33.772220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:33.776714 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:33.776714 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:33.776714 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:33.778694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:33.969956 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1965/3922] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 14:53:33 2022] GET /identity/v3/role_assignments?scope.project.id=c304284ca4a345c39183aa5150cb364b&user.id=fa2c41978f1a482ba905571ad040033e&effective => generated 648 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:33.976685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:33.998680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfef32-ceba-477d-a479-6600e9f7be9f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:34.025592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:34.026592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:34.027049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:34.027761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:34.028647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Adding query filter params (scope.project.id=994c1e3f402e4bdbb7d9525c632302a1, user.id=fa2c41978f1a482ba905571ad040033e) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:34.028964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:34.030195 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:34.030195 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:34.030195 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:34.038666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:34.154472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:34.174142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:34.176719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:34.231177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1958/3923] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 14:53:33 2022] GET /identity/v3/role_assignments?scope.project.id=994c1e3f402e4bdbb7d9525c632302a1&user.id=fa2c41978f1a482ba905571ad040033e&effective => generated 648 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:34.236556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:34.264437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1cb7-8928-4bae-8ae3-0d2b6e9c76ab tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:34.305181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:34.306175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:34.306460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:34.306725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/ec60e44f33f643af8433e0515f9460d1/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:34.315812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2d30f68205164e3d9281834ac453bb6a, user_id=fa2c41978f1a482ba905571ad040033e, role_id=ec60e44f33f643af8433e0515f9460d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:34.318783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:34.357433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role ec60e44f33f643af8433e0515f9460d1 was removed from user fa2c41978f1a482ba905571ad040033e on domain 2d30f68205164e3d9281834ac453bb6a. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:34.357752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:34.358605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:34.393828 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1959/3924] 10.222.0.98 () {58 vars in 1562 bytes} [Thu Jul 14 14:53:34 2022] DELETE /identity/v3/OS-INHERIT/domains/2d30f68205164e3d9281834ac453bb6a/users/fa2c41978f1a482ba905571ad040033e/roles/ec60e44f33f643af8433e0515f9460d1/inherited_to_projects => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:34.400439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:34.404219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:34.470288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377fb5-0824-4bd4-a18d-8eed1dde5406 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:34.635116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:34.636347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:34.636895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:34.637228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] PATH_INFO: `/v3/projects/4381d698f8624ab2b1e932305ea8b67a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:34.644284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4381d698f8624ab2b1e932305ea8b67a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:34.652973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:34.703965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c056-4efa-474a-84b4-728e494fde71 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:34.732614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:34.735984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:34.736630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:34.737191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:34.739078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Adding query filter params (scope.project.id=c304284ca4a345c39183aa5150cb364b, user.id=fa2c41978f1a482ba905571ad040033e) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:34.742073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:34.748051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:34.806153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4381d698f8624ab2b1e932305ea8b67a', 'request_id': 'req-2f455d73-8c55-4467-b148-50d0592ee193'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:34.841312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4381d698f8624ab2b1e932305ea8b67a', 'request_id': 'req-2f455d73-8c55-4467-b148-50d0592ee193'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:34.856636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4381d698f8624ab2b1e932305ea8b67a', 'request_id': 'req-2f455d73-8c55-4467-b148-50d0592ee193'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:34.866312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:34.890084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] The token cache is being invalidate because project 4381d698f8624ab2b1e932305ea8b67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:34.890397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:34.891300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f455d73-8c55-4467-b148-50d0592ee193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:34.893459 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1960/3925] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 14:53:34 2022] GET /identity/v3/role_assignments?scope.project.id=c304284ca4a345c39183aa5150cb364b&user.id=fa2c41978f1a482ba905571ad040033e&effective => generated 228 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:34.897814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:34.905551 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1966/3926] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:34 2022] DELETE /identity/v3/projects/4381d698f8624ab2b1e932305ea8b67a => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:34.907987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ccb4-5402-4482-a2c4-a3c5157630d8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:34.908448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ccb4-5402-4482-a2c4-a3c5157630d8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:34.908814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ccb4-5402-4482-a2c4-a3c5157630d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:34.909411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:34.994326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17fb4e-ab16-4c9a-8f08-61182d681937 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:34.996484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5b12ccb4-5402-4482-a2c4-a3c5157630d8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:34.997770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b12ccb4-5402-4482-a2c4-a3c5157630d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:35.183247 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1967/3927] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:35.194026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c020-796c-4c2e-ad54-be9cefa9a80c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:35.196241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c020-796c-4c2e-ad54-be9cefa9a80c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:35.199578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c020-796c-4c2e-ad54-be9cefa9a80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:35.254350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-53f8c020-796c-4c2e-ad54-be9cefa9a80c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:35.256640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:35.256920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53f8c020-796c-4c2e-ad54-be9cefa9a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:35.257356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:35.257699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:35.257986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:35.258860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Adding query filter params (scope.project.id=994c1e3f402e4bdbb7d9525c632302a1, user.id=fa2c41978f1a482ba905571ad040033e) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:35.259177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:35.268477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:35.334746 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1968/3928] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:35.336835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c020-796c-4c2e-ad54-be9cefa9a80c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:35.397254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c020-796c-4c2e-ad54-be9cefa9a80c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:35.417769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:35.432855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:35.439510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:35.440366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:35.444496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:35.446582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:35.455301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:35.464363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:35.483011 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1961/3929] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 14:53:34 2022] GET /identity/v3/role_assignments?scope.project.id=994c1e3f402e4bdbb7d9525c632302a1&user.id=fa2c41978f1a482ba905571ad040033e&effective => generated 228 bytes in 586 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:35.493094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:35.544971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19904358-658f-4ec3-ba91-c6ea2b3aed18 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:35.570841 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1969/3930] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:35.576643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:35.578860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:35.579936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:35.589456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:35.590974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/projects/994c1e3f402e4bdbb7d9525c632302a1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:35.596153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_project(project_id=994c1e3f402e4bdbb7d9525c632302a1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:35.601754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:35.697670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1f94e-1e5c-4f90-8432-9a9cce4149ab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:35.728692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:35.730315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:35.737309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:35.738926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:35.740574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:35.746391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:35.837864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994c1e3f402e4bdbb7d9525c632302a1', 'request_id': 'req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:35.858285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994c1e3f402e4bdbb7d9525c632302a1', 'request_id': 'req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:35.877245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994c1e3f402e4bdbb7d9525c632302a1', 'request_id': 'req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:35.910821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] The token cache is being invalidate because project 994c1e3f402e4bdbb7d9525c632302a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:35.911747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:35.913901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:35.920234 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1962/3931] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:35 2022] DELETE /identity/v3/projects/994c1e3f402e4bdbb7d9525c632302a1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:35.926550 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1970/3932] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:35 2022] POST /identity/v3/projects => generated 375 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:35.927393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:35.930946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:35.943572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:35.948821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:36.235993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eefd9c-8d33-4bf8-9bc7-ce41e220f498 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:36.383771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e466c0-d3aa-4365-b2f7-77934c28ff06 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:36.404875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:36.405228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:36.405844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.406090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.406376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.406570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.406745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles/ec60e44f33f643af8433e0515f9460d1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.407062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.408132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:36.410568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:36.411000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ec60e44f33f643af8433e0515f9460d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:36.413266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:36.466712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:36.467656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1971/3933] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:35 2022] POST /identity/v3/users => generated 288 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:36.474114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:36.500937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703f84-97b5-43a6-a086-00c7c0b31adc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:36.508019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role ec60e44f33f643af8433e0515f9460d1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:36.508373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:36.510596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:36.516032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1963/3934] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:35 2022] DELETE /identity/v3/roles/ec60e44f33f643af8433e0515f9460d1 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:36.519084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:36.520219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.520811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.521324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.523164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:36.523659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:36.525767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:36.531879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:36.564529 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1972/3935] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:53:36.570483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:36.575746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:36.609635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c4455-3156-4707-abe7-6b86b3761a33 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:36.682387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:36.719480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d80239-3a2c-4bda-9874-cb65a053b22c tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:36.738483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:36.739655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.739951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.740237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.745481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:36.747397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:36.784368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:36.784879 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1964/3936] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:53:36 2022] POST /identity/v3/roles => generated 240 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:36.785444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.785842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.786231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.786773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:36.787203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:36.789228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:36.803077 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1973/3937] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:36 2022] GET /identity/v3/roles => generated 1651 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:36.809566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:36.814190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9ef84-a675-429d-8794-f82c4efd4e63 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:36.832200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:36.833679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.835360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.835808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.837293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf00b7-e7cd-4e98-b8ef-6fb176f667c6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:36.837868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:36.840542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:36.855049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0d44-b555-4120-beef-794e88d95964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:36.856774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d44-b555-4120-beef-794e88d95964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.857182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d44-b555-4120-beef-794e88d95964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.857577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d44-b555-4120-beef-794e88d95964 admin admin] PATH_INFO: `/v3/projects/8bc64c6200fc44c1a310da04279013c4/users/a17530aa8b8a42f19d738bf4aacf3c07/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.901445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0d44-b555-4120-beef-794e88d95964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc64c6200fc44c1a310da04279013c4, user_id=a17530aa8b8a42f19d738bf4aacf3c07, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:36.905252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0d44-b555-4120-beef-794e88d95964 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:36.935379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1974/3938] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:36 2022] PUT /identity/v3/projects/8bc64c6200fc44c1a310da04279013c4/users/a17530aa8b8a42f19d738bf4aacf3c07/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:36.943126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:36.943606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:36.944002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:36.982502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:36.987671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:37.038353 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1965/3939] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:36 2022] POST /identity/v3/projects => generated 408 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:37.041102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:37.289960 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1975/3940] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:53:37.371607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:37.373462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:37.374231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ab5ae-f3a7-4f94-8e6a-4a2a286f5837 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:37.394664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:37.395170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:37.395615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:37.396014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/98a5c55fb073490c940da9f9deab2334/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:37.402795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c304284ca4a345c39183aa5150cb364b, user_id=fa2c41978f1a482ba905571ad040033e, role_id=98a5c55fb073490c940da9f9deab2334)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:37.413444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:37.442400 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1966/3941] 10.222.0.98 () {60 vars in 1581 bytes} [Thu Jul 14 14:53:37 2022] PUT /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/98a5c55fb073490c940da9f9deab2334/inherited_to_projects => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:37.443700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:37.618775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:37.634832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f782c-1cae-4f5c-944a-b51586f70313 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:37.661905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e953ac-21af-4e66-b33f-c8384e1aba1f tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:37.689205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:37.689919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:37.697862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:37.702101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:37.703213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Adding query filter params (scope.project.id=e9d89e6e601c46a29a842b27130a1dec, user.id=fa2c41978f1a482ba905571ad040033e) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:37.703727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:37.705799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:37.869141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:37.894171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:37.895009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:37.895335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:37.895621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:37.926025 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1967/3942] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 14:53:37 2022] GET /identity/v3/role_assignments?scope.project.id=e9d89e6e601c46a29a842b27130a1dec&user.id=fa2c41978f1a482ba905571ad040033e&effective => generated 649 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:37.929968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:37.971386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75c809-e2ea-4ed9-8fd9-0c1ab38cd753 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:37.994652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:37.994652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:37.994652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:37.996082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/98a5c55fb073490c940da9f9deab2334/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:38.005295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c304284ca4a345c39183aa5150cb364b, user_id=fa2c41978f1a482ba905571ad040033e, role_id=98a5c55fb073490c940da9f9deab2334)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:38.014350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:38.043149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 98a5c55fb073490c940da9f9deab2334 was removed from user fa2c41978f1a482ba905571ad040033e on project c304284ca4a345c39183aa5150cb364b. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:38.043904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:38.046702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:38.094525 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1968/3943] 10.222.0.98 () {58 vars in 1565 bytes} [Thu Jul 14 14:53:37 2022] DELETE /identity/v3/OS-INHERIT/projects/c304284ca4a345c39183aa5150cb364b/users/fa2c41978f1a482ba905571ad040033e/roles/98a5c55fb073490c940da9f9deab2334/inherited_to_projects => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:38.095603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:38.095887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:38.097312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:38.104373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:38.130285 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1976/3944] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:38.305460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c489-0816-4f5f-8d15-847e844d746e tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:38.314838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:38.315681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:38.316076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:38.317008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:38.317508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Adding query filter params (scope.project.id=e9d89e6e601c46a29a842b27130a1dec, user.id=fa2c41978f1a482ba905571ad040033e) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:38.317962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:38.323114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:38.471767 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1969/3945] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 14:53:38 2022] GET /identity/v3/role_assignments?scope.project.id=e9d89e6e601c46a29a842b27130a1dec&user.id=fa2c41978f1a482ba905571ad040033e&effective => generated 228 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:38.475934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:38.498024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866aa14-b992-4bea-bca4-780e154abf92 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:38.506251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:38.510478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:38.511054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:38.511643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/projects/e9d89e6e601c46a29a842b27130a1dec` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:38.514004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9d89e6e601c46a29a842b27130a1dec)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:38.517329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:38.638893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d89e6e601c46a29a842b27130a1dec', 'request_id': 'req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:38.664885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d89e6e601c46a29a842b27130a1dec', 'request_id': 'req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:38.673266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d89e6e601c46a29a842b27130a1dec', 'request_id': 'req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:38.701692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] The token cache is being invalidate because project e9d89e6e601c46a29a842b27130a1dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:38.702193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:38.704572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:38.707426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1977/3946] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:38 2022] DELETE /identity/v3/projects/e9d89e6e601c46a29a842b27130a1dec => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:38.711601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:38.714344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:38.735767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e629838-0153-4abc-a784-8872374dfcaa tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:38.857283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:38.930743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:38.936100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:38.936391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:38.941152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/roles/98a5c55fb073490c940da9f9deab2334` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:38.942987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_role(role_id=98a5c55fb073490c940da9f9deab2334)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:38.944700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:39.073124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invalidating the token cache because role 98a5c55fb073490c940da9f9deab2334 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:39.073369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.074980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.086083 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1970/3947] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:38 2022] DELETE /identity/v3/roles/98a5c55fb073490c940da9f9deab2334 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:39.091476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:39.114072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b5a52-00aa-4af2-93f4-ae058b95b0a7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:39.342662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:39.343609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:39.343918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:39.344251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/users/fa2c41978f1a482ba905571ad040033e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:39.348015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fa2c41978f1a482ba905571ad040033e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:39.350261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:39.408800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:39.432446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:39.437721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:39.495487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2c41978f1a482ba905571ad040033e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.540592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2c41978f1a482ba905571ad040033e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.542439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2c41978f1a482ba905571ad040033e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.579949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2c41978f1a482ba905571ad040033e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.582534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2c41978f1a482ba905571ad040033e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.680399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319548-cd5b-4e3f-bce3-1b27ba711bf7 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:39.687174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:39.696238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:39.696763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:39.697201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] PATH_INFO: `/v3/users/3323669591584736b1e19db6da8fa08f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:39.701376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3323669591584736b1e19db6da8fa08f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:39.705857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:39.721444 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1978/3948] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:39 2022] DELETE /identity/v3/users/fa2c41978f1a482ba905571ad040033e => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:39.727676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:39.749249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:39.804752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3323669591584736b1e19db6da8fa08f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.829322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3323669591584736b1e19db6da8fa08f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.864097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3323669591584736b1e19db6da8fa08f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.866624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3323669591584736b1e19db6da8fa08f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.894771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3323669591584736b1e19db6da8fa08f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:39.927053 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1971/3949] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:39 2022] DELETE /identity/v3/users/3323669591584736b1e19db6da8fa08f => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:40.209257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03a559-d863-4a41-bfa9-7fbd401c9870 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:40.453798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:40.455064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:40.455651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:40.456261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/groups/e674b31de5f94314a19b1f818fd6f400` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:40.459095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e674b31de5f94314a19b1f818fd6f400)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:40.460654 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:40.460654 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:40.460654 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:40.462441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:40.660780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:40.713863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1979/3950] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 14:53:39 2022] DELETE /identity/v3/groups/e674b31de5f94314a19b1f818fd6f400 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:40.716671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:40.722094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:40.792149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be45dc5-f29a-492a-a0a7-1582597fb606 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:40.930894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:41.100654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:41.102104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:41.102609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:41.103100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/projects/c304284ca4a345c39183aa5150cb364b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:41.108642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c304284ca4a345c39183aa5150cb364b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:41.112528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:41.378655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c304284ca4a345c39183aa5150cb364b', 'request_id': 'req-027ea9ed-f4df-4131-a74b-5def903d4d7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:41.404960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c304284ca4a345c39183aa5150cb364b', 'request_id': 'req-027ea9ed-f4df-4131-a74b-5def903d4d7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:41.414062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c304284ca4a345c39183aa5150cb364b', 'request_id': 'req-027ea9ed-f4df-4131-a74b-5def903d4d7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:41.460092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] The token cache is being invalidate because project c304284ca4a345c39183aa5150cb364b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:41.460450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:41.461781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:41.468762 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1972/3951] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:40 2022] DELETE /identity/v3/projects/c304284ca4a345c39183aa5150cb364b => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:41.472897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:41.477477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:41.550620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f469ccf-49a3-4cfb-a2e2-7e95300a7442 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:41.717900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:41.719108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:41.719497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:41.719784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/domains/2d30f68205164e3d9281834ac453bb6a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:41.726967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2d30f68205164e3d9281834ac453bb6a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:41.728138 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:41.728138 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:53:41.728138 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:41.735692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:41.869251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2d30f68205164e3d9281834ac453bb6a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:41.873669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2d30f68205164e3d9281834ac453bb6a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:42.013066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2d30f68205164e3d9281834ac453bb6a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:42.016952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2d30f68205164e3d9281834ac453bb6a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:42.026786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1980/3952] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:53:41 2022] PATCH /identity/v3/domains/2d30f68205164e3d9281834ac453bb6a => generated 277 bytes in 556 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:42.032774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:42.062125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea9ed-f4df-4131-a74b-5def903d4d7b tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:42.421277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb4c0490ccae4adc9488cf8c47d9e578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd5dde8cc524401a6173339642f6bb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:42.422794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:42.423178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:42.423441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] PATH_INFO: `/v3/domains/2d30f68205164e3d9281834ac453bb6a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:42.440396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:42.442926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:42.495513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2d30f68205164e3d9281834ac453bb6a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:42.496637 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:53:42.496637 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:53:42.496637 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:53:42.497565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:42.627714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2d30f68205164e3d9281834ac453bb6a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:42.660220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2d30f68205164e3d9281834ac453bb6a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:42.903847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:43.009554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d30f68205164e3d9281834ac453bb6a', 'request_id': 'req-7bc535c1-f897-43d8-9527-659d0971fb22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.039013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d30f68205164e3d9281834ac453bb6a', 'request_id': 'req-7bc535c1-f897-43d8-9527-659d0971fb22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.061834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d30f68205164e3d9281834ac453bb6a', 'request_id': 'req-7bc535c1-f897-43d8-9527-659d0971fb22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.110791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] The token cache is being invalidate because project 2d30f68205164e3d9281834ac453bb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:43.115690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.123535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.167484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2d30f68205164e3d9281834ac453bb6a', 'request_id': 'req-7bc535c1-f897-43d8-9527-659d0971fb22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.181613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2d30f68205164e3d9281834ac453bb6a', 'request_id': 'req-7bc535c1-f897-43d8-9527-659d0971fb22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.184514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bc535c1-f897-43d8-9527-659d0971fb22 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2d30f68205164e3d9281834ac453bb6a', 'request_id': 'req-7bc535c1-f897-43d8-9527-659d0971fb22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.215152 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1973/3953] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:53:42 2022] DELETE /identity/v3/domains/2d30f68205164e3d9281834ac453bb6a => generated 0 bytes in 1183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:43.217089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:43.217847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:43.218395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:43.287427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91e78-9e17-4ee4-9ea4-af52c343f723 tempest-InheritsV3TestJSON-153292479 tempest-InheritsV3TestJSON-153292479-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:43.392870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] MFA Rules not processed for user `136f061873624ac4a28fbe80de7c7363`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:43.407413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:43.494603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:43.497735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:43.498046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:43.500064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] PATH_INFO: `/v3/projects/adc60bcb471e44fb8787afd9f5b623ab` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:43.502802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc60bcb471e44fb8787afd9f5b623ab)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:43.504897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:43.559563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:43.675876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc60bcb471e44fb8787afd9f5b623ab', 'request_id': 'req-e882c202-39c8-48d9-ae56-e09404c51546'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.701595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc60bcb471e44fb8787afd9f5b623ab', 'request_id': 'req-e882c202-39c8-48d9-ae56-e09404c51546'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.706362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1974/3954] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:43.707400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:43.709373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:43.722064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc60bcb471e44fb8787afd9f5b623ab', 'request_id': 'req-e882c202-39c8-48d9-ae56-e09404c51546'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.753162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] The token cache is being invalidate because project adc60bcb471e44fb8787afd9f5b623ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:43.753424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.754322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:43.759002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea67a49-df7b-4388-9b30-3896a9fa0b3b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:43.761088 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1981/3955] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:42 2022] DELETE /identity/v3/projects/adc60bcb471e44fb8787afd9f5b623ab => generated 0 bytes in 1322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:43.762208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:43.764636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:43.967719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:43.968703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:43.970840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:43.971239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] PATH_INFO: `/v3/users/1fd687ae1693491b8801a624bbc7aad4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:43.973366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd687ae1693491b8801a624bbc7aad4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:43.981433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:44.024728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882c202-39c8-48d9-ae56-e09404c51546 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:44.044997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299191-c0fe-4d44-a6cb-c5fe513eb85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:44.045705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299191-c0fe-4d44-a6cb-c5fe513eb85d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:44.046090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299191-c0fe-4d44-a6cb-c5fe513eb85d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:44.046441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299191-c0fe-4d44-a6cb-c5fe513eb85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:44.049052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:44.052862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b299191-c0fe-4d44-a6cb-c5fe513eb85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:44.146232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd687ae1693491b8801a624bbc7aad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:44.187739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd687ae1693491b8801a624bbc7aad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:44.221363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd687ae1693491b8801a624bbc7aad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:44.223535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd687ae1693491b8801a624bbc7aad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:44.249925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aeea674a-1262-46a0-8aa4-e1cb0f9302e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd687ae1693491b8801a624bbc7aad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:44.274088 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1975/3956] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:43 2022] DELETE /identity/v3/users/1fd687ae1693491b8801a624bbc7aad4 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:44.275733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a06eec-c3c5-48bc-9d94-e10eb0c69540 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:44.276009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a06eec-c3c5-48bc-9d94-e10eb0c69540 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:44.276347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a06eec-c3c5-48bc-9d94-e10eb0c69540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:44.308212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299191-c0fe-4d44-a6cb-c5fe513eb85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:44.311045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299191-c0fe-4d44-a6cb-c5fe513eb85d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:44.329776 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1982/3957] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:44.331656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:44.332012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:44.332339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:44.405922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e0a06eec-c3c5-48bc-9d94-e10eb0c69540 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:44.408325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0a06eec-c3c5-48bc-9d94-e10eb0c69540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:44.413479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:44.415180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:44.604607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:44.682845 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1976/3958] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:44.684962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71bc4-5562-471e-8fb5-04bb57486a3a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:44.685443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71bc4-5562-471e-8fb5-04bb57486a3a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:44.685843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71bc4-5562-471e-8fb5-04bb57486a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:44.692213 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1983/3959] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:44.740261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-61a71bc4-5562-471e-8fb5-04bb57486a3a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:44.741773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61a71bc4-5562-471e-8fb5-04bb57486a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:44.777955 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1977/3960] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:53:44.779172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:44.779602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71bc4-5562-471e-8fb5-04bb57486a3a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:44.781292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:44.794477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71bc4-5562-471e-8fb5-04bb57486a3a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:44.803675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:44.806408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:44.806999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:44.807441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:44.808426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:44.808859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:44.810806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:44.835419 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1978/3961] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:44.836809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:44.862920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9cfa9-1bab-4335-b791-2840c7d1e9d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:44.873563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:44.875217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:44.876805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:44.877116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:44.879622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:44.885856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:44.937163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecc42b-83c2-4080-8374-5632df0ff994 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:44.949890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:44.956222 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1979/3962] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:44 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:44.957523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:44.962327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:44.963258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:44.964101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:44.988698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:44.995553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:45.042054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1984/3963] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:45.084658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:45.153919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cb7cb-3663-4a81-9193-9ed08eb44422 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:45.176544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:45.177777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:45.178272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:45.178758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:45.184083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:45.187783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:45.269327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1980/3964] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:44 2022] POST /identity/v3/users => generated 290 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:45.275166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:45.320834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f0245-2f43-441b-8053-1a1f7929f45e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:45.348169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:45.350981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:45.367777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:45.374971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:45.377822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:45.380042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:45.448870 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1985/3965] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:45.449196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:45.468009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518451a5-7f68-4834-9b9b-ab1027e216ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:45.494671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1523093-dee3-49d6-ac07-08d61b0c340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:45.497369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523093-dee3-49d6-ac07-08d61b0c340c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:45.501720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523093-dee3-49d6-ac07-08d61b0c340c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:45.506051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523093-dee3-49d6-ac07-08d61b0c340c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:45.513331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1523093-dee3-49d6-ac07-08d61b0c340c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:45.519014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1523093-dee3-49d6-ac07-08d61b0c340c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:45.558999 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1981/3966] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:45.561422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:45.598539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c9cc-5bc6-4730-a684-d2bc5b074eea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:45.622497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:45.627091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:45.632655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:45.632655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] PATH_INFO: `/v3/projects/95bb8113735e4903aa5919ec567b0b5c/users/4813aa5acf744a8dac42de00d7e5a519/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:45.703508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95bb8113735e4903aa5919ec567b0b5c, user_id=4813aa5acf744a8dac42de00d7e5a519, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:45.720118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:45.785282 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1986/3967] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:45 2022] PUT /identity/v3/projects/95bb8113735e4903aa5919ec567b0b5c/users/4813aa5acf744a8dac42de00d7e5a519/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:45.786691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b59ed-86f7-461d-9701-65894375cb50 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:45.787050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b59ed-86f7-461d-9701-65894375cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:45.787464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b59ed-86f7-461d-9701-65894375cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:45.835792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-462b59ed-86f7-461d-9701-65894375cb50 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:45.840853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-462b59ed-86f7-461d-9701-65894375cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:46.036255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1982/3968] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:53:46.052768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:46.057495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:46.341381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b0a13-c4ae-4438-9a95-a002201fb91e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:46.360010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:46.364589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:46.365351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:46.370063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:46.415058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:46.418036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:46.474025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1987/3969] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:47.914885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c48a17-de4a-4589-b8dc-02b9b6cfd59b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:47.914885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c48a17-de4a-4589-b8dc-02b9b6cfd59b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:47.915995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c48a17-de4a-4589-b8dc-02b9b6cfd59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:47.972504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0c48a17-de4a-4589-b8dc-02b9b6cfd59b None None] MFA Rules not processed for user `126f8683e55647bc9605e05c7aa654fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:47.974612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0c48a17-de4a-4589-b8dc-02b9b6cfd59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:48.137999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:48.140564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:48.208075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce1172-b367-4a9b-b629-0b7c8a7810cf service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:48.242823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:48.244875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:48.247472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:48.249305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] PATH_INFO: `/v3/projects/75d3d3245e4b4ac1978127941ceb12e3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:48.256630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d3d3245e4b4ac1978127941ceb12e3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:48.264719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:48.292138 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1983/3970] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:48.301124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c48a17-de4a-4589-b8dc-02b9b6cfd59b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:48.357510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c48a17-de4a-4589-b8dc-02b9b6cfd59b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:48.383758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:48.386287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:48.387003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:48.387526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:48.459078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:48.467254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:48.521900 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1984/3971] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:48.534964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:48.541091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d3d3245e4b4ac1978127941ceb12e3', 'request_id': 'req-e2900d6b-449c-4461-b2cd-0d5405b919b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:48.555971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d3d3245e4b4ac1978127941ceb12e3', 'request_id': 'req-e2900d6b-449c-4461-b2cd-0d5405b919b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:48.574679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d3d3245e4b4ac1978127941ceb12e3', 'request_id': 'req-e2900d6b-449c-4461-b2cd-0d5405b919b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:48.637261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] The token cache is being invalidate because project 75d3d3245e4b4ac1978127941ceb12e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:48.640226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:48.643335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:48.657722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:48.658051 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1988/3972] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:48 2022] DELETE /identity/v3/projects/75d3d3245e4b4ac1978127941ceb12e3 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:48.691523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f921f3-d0b7-46ec-b56d-f6483aa30856 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:48.823382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:48.882387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:48.883492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:48.883784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:48.884070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] PATH_INFO: `/v3/users/cb4c0490ccae4adc9488cf8c47d9e578` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:48.885797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4c0490ccae4adc9488cf8c47d9e578)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:48.888295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:49.019739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4c0490ccae4adc9488cf8c47d9e578'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:49.056686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4c0490ccae4adc9488cf8c47d9e578'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:49.080076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4c0490ccae4adc9488cf8c47d9e578'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:49.080806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4c0490ccae4adc9488cf8c47d9e578'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:49.098640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f15f244-2076-4ccc-80b7-855ec2607d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4c0490ccae4adc9488cf8c47d9e578'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:49.109774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1985/3973] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:48 2022] DELETE /identity/v3/users/cb4c0490ccae4adc9488cf8c47d9e578 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:51.231576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:51.235048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:51.266019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900d6b-449c-4461-b2cd-0d5405b919b0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:51.446850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:51.446850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:51.446850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:51.446850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] PATH_INFO: `/v3/projects/1fd5dde8cc524401a6173339642f6bb1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:51.447989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd5dde8cc524401a6173339642f6bb1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:51.450793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:51.591146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd5dde8cc524401a6173339642f6bb1', 'request_id': 'req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:51.620558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd5dde8cc524401a6173339642f6bb1', 'request_id': 'req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:51.637209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd5dde8cc524401a6173339642f6bb1', 'request_id': 'req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:51.658441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] The token cache is being invalidate because project 1fd5dde8cc524401a6173339642f6bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:51.659514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:51.660647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4f2b9fa-42a2-4139-b59d-ffd7661dee16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:51.663024 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1989/3974] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:51 2022] DELETE /identity/v3/projects/1fd5dde8cc524401a6173339642f6bb1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:51.671353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414afb47-3476-4f31-a447-99a6964062c0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:51.672429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414afb47-3476-4f31-a447-99a6964062c0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:51.672894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414afb47-3476-4f31-a447-99a6964062c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:51.726900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-414afb47-3476-4f31-a447-99a6964062c0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:51.731672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-414afb47-3476-4f31-a447-99a6964062c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:51.882911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1986/3975] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:51.896531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268004-82ab-4231-b7c2-d0782fbda253 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:51.897052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268004-82ab-4231-b7c2-d0782fbda253 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:51.897699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268004-82ab-4231-b7c2-d0782fbda253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:51.946401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fe268004-82ab-4231-b7c2-d0782fbda253 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:51.956505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe268004-82ab-4231-b7c2-d0782fbda253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:51.995065 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1990/3976] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:51.997309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414afb47-3476-4f31-a447-99a6964062c0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:52.019572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414afb47-3476-4f31-a447-99a6964062c0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:52.029636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:52.030359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:52.030813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:52.031106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:52.032071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:53:52.032389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:52.036107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:52.071452 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1987/3977] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:53:52.079965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe268004-82ab-4231-b7c2-d0782fbda253 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:52.107207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe268004-82ab-4231-b7c2-d0782fbda253 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:52.116955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:52.118095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:52.119154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:52.119479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:52.120842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:52.124713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:52.208322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:52.210314 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1991/3978] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:52 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:52.227108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c2b8-8890-485c-b3ec-1253a53597bb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:52.418267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:52.490855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:52.491969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:52.492420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:52.492858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:52.493763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:52.503826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:52.590577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:52.592459 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1988/3979] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:52 2022] POST /identity/v3/users => generated 293 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:52.613142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedfe11-07b6-41c2-b599-57b235cdd84f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:52.643063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:52.643678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:52.643967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:52.644247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:52.645006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:52.646675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:52.680878 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1992/3980] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:52.685358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:52.712314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8292b-d936-4ba2-b2e5-0b48a15fd7b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:52.727227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ad67-e5ac-4ded-a3e9-299bcdeca8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:52.729237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ad67-e5ac-4ded-a3e9-299bcdeca8bd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:52.729632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ad67-e5ac-4ded-a3e9-299bcdeca8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:52.731103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ad67-e5ac-4ded-a3e9-299bcdeca8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:52.731988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8ad67-e5ac-4ded-a3e9-299bcdeca8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:52.733667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8ad67-e5ac-4ded-a3e9-299bcdeca8bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:52.770242 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1989/3981] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:52.787316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:52.808708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0df42-e975-4ed9-a164-e387cd7347e7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:52.824473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:52.825924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:52.826531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:52.827629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] PATH_INFO: `/v3/projects/c806e41c89a14b98b6fa6837b495311c/users/2af056478a734f1eb1b8ec4f3d2dabbc/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:52.880439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c806e41c89a14b98b6fa6837b495311c, user_id=2af056478a734f1eb1b8ec4f3d2dabbc, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:52.883401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:52.927828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:52.933527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1993/3982] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:52 2022] PUT /identity/v3/projects/c806e41c89a14b98b6fa6837b495311c/users/2af056478a734f1eb1b8ec4f3d2dabbc/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:52.936097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c8e78-d9ce-4c36-bf85-8e7ba841605f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:52.936576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c8e78-d9ce-4c36-bf85-8e7ba841605f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:52.937251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c8e78-d9ce-4c36-bf85-8e7ba841605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:53.048342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aa7c8e78-d9ce-4c36-bf85-8e7ba841605f None None] MFA Rules not processed for user `2af056478a734f1eb1b8ec4f3d2dabbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:53.049858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa7c8e78-d9ce-4c36-bf85-8e7ba841605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:53.374466 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1990/3983] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:53.379209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:53.568055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e318e-b0b5-4fd6-955f-9e146a201a4a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:53.579067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:53.580093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:53.580534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:53.580963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:53.581826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:53.585039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:53.663408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1994/3984] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:53 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:53.665688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c8e78-d9ce-4c36-bf85-8e7ba841605f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:53.710460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c8e78-d9ce-4c36-bf85-8e7ba841605f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:53.853795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:53.858014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:53.859688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:53.860276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:53.863827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:53.872323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:53.951665 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1991/3985] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:53:53 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:53.955527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:53.989135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed6c6-eeef-4ad9-b8c5-9bd1ee225ff5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:54.023421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:54.029207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:54.030101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:54.036986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:54.038024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:54.049202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:54.071411 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1995/3986] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:53:54.076815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:54.111258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56f84-72ba-4f0a-b106-45a3d7ef3664 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:54.133870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:54.139869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:54.140820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:54.142948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] PATH_INFO: `/v3/projects/e78181f133154bfbbb3ae7573e6759b5/users/b5bd18a88757452fa90ecc8786e22eb2/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:54.222563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78181f133154bfbbb3ae7573e6759b5, user_id=b5bd18a88757452fa90ecc8786e22eb2, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:54.231236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:54.275125 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1992/3987] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:54 2022] PUT /identity/v3/projects/e78181f133154bfbbb3ae7573e6759b5/users/b5bd18a88757452fa90ecc8786e22eb2/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:54.277540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:54.309880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5e38-c8c8-404d-989d-c1fb7d47d439 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:54.657087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92015428-8b96-4090-9a32-3d067405d2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:54.662869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92015428-8b96-4090-9a32-3d067405d2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:54.663904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92015428-8b96-4090-9a32-3d067405d2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:54.665491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92015428-8b96-4090-9a32-3d067405d2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:54.668307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92015428-8b96-4090-9a32-3d067405d2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:54.673655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92015428-8b96-4090-9a32-3d067405d2c2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:54.734743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:54.739120 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1996/3988] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:53:54.797192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ad08a-58f2-4eb6-98f3-c0f432670e3c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:54.824467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:54.833749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:54.834252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:54.834699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] PATH_INFO: `/v3/projects/e78181f133154bfbbb3ae7573e6759b5/users/b5bd18a88757452fa90ecc8786e22eb2/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:54.842796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78181f133154bfbbb3ae7573e6759b5, user_id=b5bd18a88757452fa90ecc8786e22eb2, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:54.863430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:54.949798 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1993/3989] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:53:54 2022] PUT /identity/v3/projects/e78181f133154bfbbb3ae7573e6759b5/users/b5bd18a88757452fa90ecc8786e22eb2/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:54.962668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904f2f-2285-49e0-91b9-761511d3c10b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:54.963101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904f2f-2285-49e0-91b9-761511d3c10b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:54.963565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904f2f-2285-49e0-91b9-761511d3c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:55.079547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-90904f2f-2285-49e0-91b9-761511d3c10b None None] MFA Rules not processed for user `b5bd18a88757452fa90ecc8786e22eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:55.093115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90904f2f-2285-49e0-91b9-761511d3c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:55.436411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:55.484535 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1997/3990] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:55.488026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:55.518359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:55.546894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be164693-4698-4262-ba8a-4993d6ecaf6b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:55.557371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:55.561016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:55.561955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:55.562772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:55.564819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:55.578450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:55.717509 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1994/3991] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:53:55 2022] POST /identity/v3/projects => generated 360 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:53:55.718681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904f2f-2285-49e0-91b9-761511d3c10b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:55.734239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904f2f-2285-49e0-91b9-761511d3c10b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:55.921661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:55.923880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:55.926406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:55.927113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-561068142` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:55.930343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=7fa88ced8d634e56b65797cf745a3d6e, value=tempest-tag-561068142)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:55.936563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:56.083069 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-561068142. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:56.083069 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:56.083069 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:56.103313 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1998/3992] 10.222.0.98 () {60 vars in 1329 bytes} [Thu Jul 14 14:53:55 2022] PUT /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-561068142 => generated 0 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Jul 14 14:53:56.123819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:56.146528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feef1f-6070-49cf-b516-5b300caf4ebf tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:56.155256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:56.156372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:56.156730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:56.157269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-561068142` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:56.177319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=7fa88ced8d634e56b65797cf745a3d6e, value=tempest-tag-561068142)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:56.181074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:56.202144 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1995/3993] 10.222.0.98 () {58 vars in 1310 bytes} [Thu Jul 14 14:53:56 2022] GET /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-561068142 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:56.207810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:56.222239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfff27-fbe2-4003-958f-3d7ea09bd46b tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:56.231999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:56.233023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:56.233422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:56.233976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:56.235869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=7fa88ced8d634e56b65797cf745a3d6e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:56.238690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:56.356271 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1999/3994] 10.222.0.98 () {60 vars in 1264 bytes} [Thu Jul 14 14:53:56 2022] PUT /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags => generated 142 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:53:56.361668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:56.379470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d09ea3-85f5-4574-b471-603420337942 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:56.387180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:56.388544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:56.388937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:56.390184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:56.408979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=7fa88ced8d634e56b65797cf745a3d6e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:56.412027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:56.431836 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1996/3995] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:53:56 2022] GET /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags => generated 142 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:53:56.438513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:56.462922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa887-f3ba-4530-9684-d469901838f1 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:56.476318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:56.478109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:56.479014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:56.479152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-1139855096` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:56.482192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=7fa88ced8d634e56b65797cf745a3d6e, value=tempest-tag-1139855096)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:56.488348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:56.602883 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1139855096. To ensure interoperability, identifiers should be a valid uuid. Jul 14 14:53:56.602883 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 14:53:56.602883 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:53:56.610837 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2000/3996] 10.222.0.98 () {58 vars in 1316 bytes} [Thu Jul 14 14:53:56 2022] DELETE /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-1139855096 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:56.616309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:56.631022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f17e6d-234d-4bb2-bc44-2c5b6e7cfddc tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:56.641172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:56.642119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:56.643092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:56.643577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-1139855096` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:56.676917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=7fa88ced8d634e56b65797cf745a3d6e, value=tempest-tag-1139855096)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:56.681579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Could not find project tag: tempest-tag-1139855096.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1139855096. Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 14 14:53:56.731548 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 14 14:53:56.732535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:53:56.732535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:53:56.732535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 14 14:53:56.732535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 14 14:53:56.732535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1139855096. Jul 14 14:53:56.732535 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:53:56.734588 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1997/3997] 10.222.0.98 () {58 vars in 1313 bytes} [Thu Jul 14 14:53:56 2022] GET /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags/tempest-tag-1139855096 => generated 107 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:53:56.740626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:56.763969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cdd9e-0640-4d18-aabe-56d37baaacc3 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:56.778364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:56.780783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:56.782685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:56.784278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:56.788677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=7fa88ced8d634e56b65797cf745a3d6e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:56.796776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:56.890744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:56.933771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2001/3998] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:53:56 2022] DELETE /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:56.944038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:56.992378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0eb83-62c4-4e99-b480-2e378aef51e6 tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:57.013736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b028ab-38e8-4929-8a6d-072ca17ddbee tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:57.014808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b028ab-38e8-4929-8a6d-072ca17ddbee tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:57.018801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b028ab-38e8-4929-8a6d-072ca17ddbee tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:57.019234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b028ab-38e8-4929-8a6d-072ca17ddbee tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:57.064732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b028ab-38e8-4929-8a6d-072ca17ddbee tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=7fa88ced8d634e56b65797cf745a3d6e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:57.070725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b028ab-38e8-4929-8a6d-072ca17ddbee tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:57.117248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1998/3999] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:53:56 2022] GET /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e/tags => generated 66 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 14:53:57.118697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:57.133853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0962-c6da-4db6-9f7d-a11f33acdc9c tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:57.146154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bd18a88757452fa90ecc8786e22eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e78181f133154bfbbb3ae7573e6759b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:57.148236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:57.148767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:57.149394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] PATH_INFO: `/v3/projects/7fa88ced8d634e56b65797cf745a3d6e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:57.152913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7fa88ced8d634e56b65797cf745a3d6e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:57.155331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:57.316957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa88ced8d634e56b65797cf745a3d6e', 'request_id': 'req-3c5c7561-1262-469d-b3a7-08f3698f8cce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:57.343761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa88ced8d634e56b65797cf745a3d6e', 'request_id': 'req-3c5c7561-1262-469d-b3a7-08f3698f8cce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:57.407568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf909e4-c6da-4b00-8128-d4de782a6f64 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:57.408185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf909e4-c6da-4b00-8128-d4de782a6f64 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:57.408460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf909e4-c6da-4b00-8128-d4de782a6f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:57.432552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa88ced8d634e56b65797cf745a3d6e', 'request_id': 'req-3c5c7561-1262-469d-b3a7-08f3698f8cce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:57.487715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] The token cache is being invalidate because project 7fa88ced8d634e56b65797cf745a3d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:53:57.492219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:57.496150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:57.505668 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2002/4000] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:57 2022] DELETE /identity/v3/projects/7fa88ced8d634e56b65797cf745a3d6e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:53:57.514438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:57.529517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9cf909e4-c6da-4b00-8128-d4de782a6f64 None None] MFA Rules not processed for user `136f061873624ac4a28fbe80de7c7363`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:57.531039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:57.532051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cf909e4-c6da-4b00-8128-d4de782a6f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:57.712788 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1999/4001] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:57.828284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c7561-1262-469d-b3a7-08f3698f8cce tempest-IdentityV3ProjectTagsTest-197244426 tempest-IdentityV3ProjectTagsTest-197244426-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:57.837016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:57.843452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:57.844099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:57.850029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] PATH_INFO: `/v3/users/2af056478a734f1eb1b8ec4f3d2dabbc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:57.852451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af056478a734f1eb1b8ec4f3d2dabbc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:57.862728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:57.992697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af056478a734f1eb1b8ec4f3d2dabbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:58.022919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af056478a734f1eb1b8ec4f3d2dabbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:58.024291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af056478a734f1eb1b8ec4f3d2dabbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:58.050017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af056478a734f1eb1b8ec4f3d2dabbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:58.051691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af056478a734f1eb1b8ec4f3d2dabbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:53:58.062207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:58.095018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2003/4002] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:53:57 2022] DELETE /identity/v3/users/2af056478a734f1eb1b8ec4f3d2dabbc => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:53:58.099946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23296-601c-430d-9af9-3220d4153aae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:58.100227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23296-601c-430d-9af9-3220d4153aae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:58.100422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23296-601c-430d-9af9-3220d4153aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:58.141490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a5a23296-601c-430d-9af9-3220d4153aae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:58.143364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5a23296-601c-430d-9af9-3220d4153aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:58.287847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:58.320067 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2000/4003] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:58.392005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:58.395729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:58.643762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a5bc-8380-42d6-b131-f9220f433d19 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:58.658413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe8154-21d3-4d5e-b075-94c87d18d711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:58.660621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8154-21d3-4d5e-b075-94c87d18d711 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:58.661278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8154-21d3-4d5e-b075-94c87d18d711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:58.662197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8154-21d3-4d5e-b075-94c87d18d711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:58.688183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe8154-21d3-4d5e-b075-94c87d18d711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:58.700296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe8154-21d3-4d5e-b075-94c87d18d711 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:58.740910 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2004/4004] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:59.576391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23296-601c-430d-9af9-3220d4153aae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:59.613601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23296-601c-430d-9af9-3220d4153aae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:59.633843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:59.635055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06d66f-7fe9-40b8-afd2-0d0bab850942 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:59.635832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:59.635988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06d66f-7fe9-40b8-afd2-0d0bab850942 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:59.636630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:59.636729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06d66f-7fe9-40b8-afd2-0d0bab850942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:59.636828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:59.642826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:59.676807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:59.677990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ba06d66f-7fe9-40b8-afd2-0d0bab850942 None None] MFA Rules not processed for user `126f8683e55647bc9605e05c7aa654fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:53:59.679089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:53:59.687019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba06d66f-7fe9-40b8-afd2-0d0bab850942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:59.692538 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2001/4005] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:53:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:53:59.807078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2005/4006] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:53:59.889095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:53:59.890590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:53:59.914345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab95e-0245-4ac5-ac8e-27f85c64cc29 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:53:59.929470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:53:59.933459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:53:59.933996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:53:59.934516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] PATH_INFO: `/v3/projects/c806e41c89a14b98b6fa6837b495311c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:53:59.937087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c806e41c89a14b98b6fa6837b495311c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:53:59.944982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:00.046636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c806e41c89a14b98b6fa6837b495311c', 'request_id': 'req-c3415497-b06c-4470-b291-ade3c61a7636'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.061602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c806e41c89a14b98b6fa6837b495311c', 'request_id': 'req-c3415497-b06c-4470-b291-ade3c61a7636'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.072225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c806e41c89a14b98b6fa6837b495311c', 'request_id': 'req-c3415497-b06c-4470-b291-ade3c61a7636'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.141213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] The token cache is being invalidate because project c806e41c89a14b98b6fa6837b495311c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:00.143645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.154858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3415497-b06c-4470-b291-ade3c61a7636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.174880 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2002/4007] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:53:59 2022] DELETE /identity/v3/projects/c806e41c89a14b98b6fa6837b495311c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:00.179053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06d66f-7fe9-40b8-afd2-0d0bab850942 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:00.202008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06d66f-7fe9-40b8-afd2-0d0bab850942 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:00.385787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:00.386754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:00.387037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:00.387363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] PATH_INFO: `/v3/users/b5bd18a88757452fa90ecc8786e22eb2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:00.392431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bd18a88757452fa90ecc8786e22eb2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:00.404756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:00.581653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:00.598593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bd18a88757452fa90ecc8786e22eb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.714932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bd18a88757452fa90ecc8786e22eb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.724677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bd18a88757452fa90ecc8786e22eb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.822404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bd18a88757452fa90ecc8786e22eb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.824792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bd18a88757452fa90ecc8786e22eb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:00.851871 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2006/4008] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:00 2022] DELETE /identity/v3/users/b5bd18a88757452fa90ecc8786e22eb2 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:03.800333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b943d-6beb-4891-b963-b84a2b893abe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:03.806355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b943d-6beb-4891-b963-b84a2b893abe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:03.811422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b943d-6beb-4891-b963-b84a2b893abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:03.965576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b92b943d-6beb-4891-b963-b84a2b893abe None None] MFA Rules not processed for user `a17530aa8b8a42f19d738bf4aacf3c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:03.978176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b92b943d-6beb-4891-b963-b84a2b893abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:04.311164 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2003/4009] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:05.219023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:05.222396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:05.482105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d732b6-9fcd-4fe7-aed9-14ecd4eb0c97 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:05.498695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:05.500379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:05.500866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:05.501336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] PATH_INFO: `/v3/projects/e78181f133154bfbbb3ae7573e6759b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:05.503622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78181f133154bfbbb3ae7573e6759b5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:05.510115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:05.785741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78181f133154bfbbb3ae7573e6759b5', 'request_id': 'req-f4d053c1-84e7-4dde-9648-521ba6b40c1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:05.812846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78181f133154bfbbb3ae7573e6759b5', 'request_id': 'req-f4d053c1-84e7-4dde-9648-521ba6b40c1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:05.830640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78181f133154bfbbb3ae7573e6759b5', 'request_id': 'req-f4d053c1-84e7-4dde-9648-521ba6b40c1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:05.868756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] The token cache is being invalidate because project e78181f133154bfbbb3ae7573e6759b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:05.870889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:05.871792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:05.875828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2007/4010] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:05 2022] DELETE /identity/v3/projects/e78181f133154bfbbb3ae7573e6759b5 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:05.882181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930bc7a-7e1b-4bdb-b161-0ba1759369d3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:05.883634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930bc7a-7e1b-4bdb-b161-0ba1759369d3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:05.884643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930bc7a-7e1b-4bdb-b161-0ba1759369d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:05.959104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b930bc7a-7e1b-4bdb-b161-0ba1759369d3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:05.966385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b930bc7a-7e1b-4bdb-b161-0ba1759369d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:06.290945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:06.297770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:06.345604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:06.401187 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2004/4011] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:06.406287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82751a7-cf11-4bfb-bec6-1e564a0410b0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:06.406841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82751a7-cf11-4bfb-bec6-1e564a0410b0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:06.407558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82751a7-cf11-4bfb-bec6-1e564a0410b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:06.482787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e82751a7-cf11-4bfb-bec6-1e564a0410b0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:06.489934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e82751a7-cf11-4bfb-bec6-1e564a0410b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:06.527994 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2005/4012] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:06.530070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:06.533212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82751a7-cf11-4bfb-bec6-1e564a0410b0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:06.568708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82751a7-cf11-4bfb-bec6-1e564a0410b0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:06.594193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:06.610502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:06.611400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:06.611930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:06.613450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:54:06.613981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:06.622120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:06.651408 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2006/4013] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:06.657059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:06.667422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d053c1-84e7-4dde-9648-521ba6b40c1e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:06.696495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:06.697586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49ce4-66a5-4baa-aacb-e76ddae550a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:06.697801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:06.702584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:06.703203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:06.708695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:06.708972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:06.710732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:06.711409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:06.712035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:06.714947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:06.721391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:06.841505 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2007/4014] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:06 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:06.843238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:06.973181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:06.975314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:07.018897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2008/4015] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:54:07.020426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc442a-ee46-4b9c-8d17-b0fd841f3923 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:07.036647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:07.038944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:07.040786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:07.041428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:07.043543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:07.048457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:07.103454 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2008/4016] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:06 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:07.108665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:07.152497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418793-bff5-444d-a521-3829e3b1cb85 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:07.205964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:07.207204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:07.216009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:07.223101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:07.232787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:07.242345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:07.279456 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2009/4017] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:07.294337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:07.346119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916c85-90f6-49e9-92cf-85c099a6e233 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:07.380387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162b46c-ca0f-4155-8c59-c646a2ec5d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:07.385255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b46c-ca0f-4155-8c59-c646a2ec5d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:07.385517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b46c-ca0f-4155-8c59-c646a2ec5d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:07.387700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b46c-ca0f-4155-8c59-c646a2ec5d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:07.392271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162b46c-ca0f-4155-8c59-c646a2ec5d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:07.396843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162b46c-ca0f-4155-8c59-c646a2ec5d7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:07.438537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2009/4018] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:07.440000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:07.457303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418421-1f4d-4817-b5ea-f09b48375ebb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:07.464865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:07.467328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:07.469100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:07.469379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] PATH_INFO: `/v3/projects/786b84940e914b9ab460bf29f60d5e97/users/c5e8f3705f624b22a3d26befe1cf52cb/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:07.514715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=786b84940e914b9ab460bf29f60d5e97, user_id=c5e8f3705f624b22a3d26befe1cf52cb, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:07.520030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:07.556436 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2010/4019] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:07 2022] PUT /identity/v3/projects/786b84940e914b9ab460bf29f60d5e97/users/c5e8f3705f624b22a3d26befe1cf52cb/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:07.569899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437bf3-61fe-414b-bec3-5e5f914ed2f3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:07.570245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437bf3-61fe-414b-bec3-5e5f914ed2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:07.573810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437bf3-61fe-414b-bec3-5e5f914ed2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:07.705935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da437bf3-61fe-414b-bec3-5e5f914ed2f3 None None] MFA Rules not processed for user `c5e8f3705f624b22a3d26befe1cf52cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:07.712766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da437bf3-61fe-414b-bec3-5e5f914ed2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:07.983621 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2010/4020] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:07.995703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:08.335385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793e94-b2ff-4369-aa6c-5f0ba6053a0f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:08.365810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:08.366931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:08.367475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:08.367986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:08.369611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:08.379884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:08.479700 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2011/4021] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:07 2022] POST /identity/v3/projects => generated 371 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:08.484930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437bf3-61fe-414b-bec3-5e5f914ed2f3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:08.516734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437bf3-61fe-414b-bec3-5e5f914ed2f3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:08.597894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:08.706133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:08.706949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:08.707421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:08.707715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:08.708432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:08.710422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:08.761535 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2011/4022] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:08 2022] POST /identity/v3/users => generated 292 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:54:08.766465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:08.801832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ee35-c9c3-45c2-b6c9-337a97ce8131 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:08.820040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:08.821257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:08.823585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:08.824283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:08.827122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:08.831599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:08.869210 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2012/4023] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:08.874195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:08.889455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa74a-aeb6-41d7-afd2-87bb06780987 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:08.903695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:08.905082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:08.907133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:08.909719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] PATH_INFO: `/v3/projects/8c5dfb47ec964eba87c958ee166a9ed6/users/c766397f9837422590f852e860a77101/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:08.957724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5dfb47ec964eba87c958ee166a9ed6, user_id=c766397f9837422590f852e860a77101, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:08.960921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:09.004810 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2012/4024] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:08 2022] PUT /identity/v3/projects/8c5dfb47ec964eba87c958ee166a9ed6/users/c766397f9837422590f852e860a77101/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:09.005412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:09.021707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ee13-d5c0-46eb-8306-79f725067909 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:09.078978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:09.195526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcb0a0-0762-4724-81cb-640b429d102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:09.196616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcb0a0-0762-4724-81cb-640b429d102a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:09.197064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcb0a0-0762-4724-81cb-640b429d102a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:09.197508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcb0a0-0762-4724-81cb-640b429d102a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:09.204815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcb0a0-0762-4724-81cb-640b429d102a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:09.211207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcb0a0-0762-4724-81cb-640b429d102a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:09.248401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2013/4025] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:54:09.248986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:09.267761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e9cb-789d-4a40-9911-a92d24b37526 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:09.287387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:09.288322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:09.288612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:09.288969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] PATH_INFO: `/v3/projects/8c5dfb47ec964eba87c958ee166a9ed6/users/c766397f9837422590f852e860a77101/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:09.291576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5dfb47ec964eba87c958ee166a9ed6, user_id=c766397f9837422590f852e860a77101, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:09.298983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:09.342882 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2013/4026] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:09 2022] PUT /identity/v3/projects/8c5dfb47ec964eba87c958ee166a9ed6/users/c766397f9837422590f852e860a77101/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:54:09.355656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dac2a-9180-4c0c-a688-30d57fd9d75c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:09.355656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dac2a-9180-4c0c-a688-30d57fd9d75c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:09.355908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dac2a-9180-4c0c-a688-30d57fd9d75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:09.444344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0c6dac2a-9180-4c0c-a688-30d57fd9d75c None None] MFA Rules not processed for user `c766397f9837422590f852e860a77101`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:09.446113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c6dac2a-9180-4c0c-a688-30d57fd9d75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:09.715749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:09.729886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2014/4027] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:09.739294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb5817-7595-49d5-89ad-1dc6a3d70861 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:09.754565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c766397f9837422590f852e860a77101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5dfb47ec964eba87c958ee166a9ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:09.755992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:09.756503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:09.757007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:09.759191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:09.766459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:09.895839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2014/4028] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:09 2022] POST /identity/v3/projects => generated 358 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:09.897366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dac2a-9180-4c0c-a688-30d57fd9d75c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:09.977321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dac2a-9180-4c0c-a688-30d57fd9d75c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:10.322586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7e30-5f50-43e8-ad36-24ad4465d62d tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c766397f9837422590f852e860a77101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5dfb47ec964eba87c958ee166a9ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:10.324281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7e30-5f50-43e8-ad36-24ad4465d62d tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:10.325054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7e30-5f50-43e8-ad36-24ad4465d62d tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:10.325575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7e30-5f50-43e8-ad36-24ad4465d62d tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:10.326993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7e30-5f50-43e8-ad36-24ad4465d62d tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:10.335121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7e30-5f50-43e8-ad36-24ad4465d62d tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:10.423139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:10.439159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2015/4029] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:09 2022] POST /identity/v3/users => generated 373 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:10.441892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff6f42-a026-4d1e-a315-d966d1d2a028 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:10.477863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c766397f9837422590f852e860a77101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5dfb47ec964eba87c958ee166a9ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:10.480704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:10.482587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:10.483438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:10.488173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:54:10.491170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:10.499885 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:54:10.499885 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:54:10.499885 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:54:10.508611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:10.610674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99568e-1874-4017-81a8-cc673c2e20ad None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:10.610899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99568e-1874-4017-81a8-cc673c2e20ad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:10.611786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99568e-1874-4017-81a8-cc673c2e20ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:10.654590 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2015/4030] 10.222.0.98 () {58 vars in 1156 bytes} [Thu Jul 14 14:54:10 2022] GET /identity/v3/users?domain_id=default => generated 8004 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:10.660136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:10.684841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ba99568e-1874-4017-81a8-cc673c2e20ad None None] MFA Rules not processed for user `4813aa5acf744a8dac42de00d7e5a519`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:10.689530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba99568e-1874-4017-81a8-cc673c2e20ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:10.707918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134277-117b-40ac-8de3-b8471d098b7e tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:10.728623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c766397f9837422590f852e860a77101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5dfb47ec964eba87c958ee166a9ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:10.732060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:10.732930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:10.733672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] PATH_INFO: `/v3/users/83958c0708084f13906120d39fe290e7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:10.800408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorizing `identity:update_user(user_id=83958c0708084f13906120d39fe290e7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:10.802654 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:54:10.802654 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:54:10.802654 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:54:10.805201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:10.836370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:10.935680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83958c0708084f13906120d39fe290e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:10.968427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invalidating the token cache because user 83958c0708084f13906120d39fe290e7 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:10.968917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:10.970327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b865eb59-f8c2-49cc-99d5-ad6b44a2ff1b tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:10.978160 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2016/4031] 10.222.0.98 () {60 vars in 1243 bytes} [Thu Jul 14 14:54:10 2022] PATCH /identity/v3/users/83958c0708084f13906120d39fe290e7 => generated 488 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:54:10.985113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:10.986749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:10.988291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:11.073805 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2016/4032] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:11.084319 n-d-768852-23 devstack@keystone.service[80581]: WARNING keystone.auth.plugins.core [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] User is disabled: 83958c0708084f13906120d39fe290e7: AssertionError: User is disabled: 83958c0708084f13906120d39fe290e7 Jul 14 14:54:11.104261 n-d-768852-23 devstack@keystone.service[80581]: WARNING keystone.server.flask.application [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.98: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 14 14:54:11.110025 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2017/4033] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:10 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 128 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 14 14:54:11.117330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99568e-1874-4017-81a8-cc673c2e20ad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:11.164881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99568e-1874-4017-81a8-cc673c2e20ad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:11.187208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c766397f9837422590f852e860a77101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5dfb47ec964eba87c958ee166a9ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:11.195605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:11.200365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:11.201043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] PATH_INFO: `/v3/users/83958c0708084f13906120d39fe290e7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:11.277195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorizing `identity:delete_user(user_id=83958c0708084f13906120d39fe290e7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:11.280262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:11.299719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:11.305659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:11.430265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83958c0708084f13906120d39fe290e7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:11.456653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83958c0708084f13906120d39fe290e7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:11.457980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83958c0708084f13906120d39fe290e7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:11.480947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83958c0708084f13906120d39fe290e7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:11.482646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-940c3525-c241-4a23-8920-ea6dec105511 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83958c0708084f13906120d39fe290e7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:11.513822 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2017/4034] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:11 2022] DELETE /identity/v3/users/83958c0708084f13906120d39fe290e7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:11.515410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:11.515825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:11.516218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:11.596265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:11.597688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:11.647455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:11.714692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79e69e-def4-4a20-aafb-62679f1ea38b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:11.745794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2018/4035] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:11.748298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:11.753313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:11.855742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:11.961379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:11.964749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:11.965639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:11.966308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:11.970235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:11.983037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97a37d-7f14-497b-9693-1328ae1a4139 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:12.004472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c766397f9837422590f852e860a77101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5dfb47ec964eba87c958ee166a9ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:12.005453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:12.005744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:12.007522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] PATH_INFO: `/v3/projects/ba8886f304fe4a7d957b6271040660b4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:12.012821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba8886f304fe4a7d957b6271040660b4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:12.018388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:12.200325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8886f304fe4a7d957b6271040660b4', 'request_id': 'req-fd7d198e-d967-44ff-b1af-1341c61a77bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:12.221976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8886f304fe4a7d957b6271040660b4', 'request_id': 'req-fd7d198e-d967-44ff-b1af-1341c61a77bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:12.225227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:12.227708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:12.239185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8886f304fe4a7d957b6271040660b4', 'request_id': 'req-fd7d198e-d967-44ff-b1af-1341c61a77bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:12.268663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] The token cache is being invalidate because project ba8886f304fe4a7d957b6271040660b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:12.269143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:12.270068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:12.283971 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2019/4036] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:11 2022] DELETE /identity/v3/projects/ba8886f304fe4a7d957b6271040660b4 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:12.288814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:12.293823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:12.311569 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2018/4037] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 1003 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:54:12.316972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:12.369117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2f5e1-e534-45db-9927-a98e94c35985 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:12.491724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d198e-d967-44ff-b1af-1341c61a77bb tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:12.506037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:12.506887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:12.507182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:12.507547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:12.516439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:12.688474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:12.690360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:12.696850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:12.706398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e83f0-ef18-4070-8105-7b97a2ef2413 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c766397f9837422590f852e860a77101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5dfb47ec964eba87c958ee166a9ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:12.711834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e83f0-ef18-4070-8105-7b97a2ef2413 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:12.712444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e83f0-ef18-4070-8105-7b97a2ef2413 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:12.717574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e83f0-ef18-4070-8105-7b97a2ef2413 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:12.727201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e83f0-ef18-4070-8105-7b97a2ef2413 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:12.741632 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2020/4038] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:12.743119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e83f0-ef18-4070-8105-7b97a2ef2413 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-698e83f0-ef18-4070-8105-7b97a2ef2413 tempest-UsersNegativeTest-1848836669 tempest-UsersNegativeTest-1848836669-project-admin] Could not find domain: d4e57ee968294c49821763ca839261dc.: keystone.exception.DomainNotFound: Could not find domain: d4e57ee968294c49821763ca839261dc. Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d4e57ee968294c49821763ca839261dc. Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:54:12.807257 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:54:12.809033 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:54:12.810091 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:54:12.811147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:54:12.811147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:54:12.811147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d4e57ee968294c49821763ca839261dc. Jul 14 14:54:12.811147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:54:12.813630 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2019/4039] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:12 2022] POST /identity/v3/users => generated 112 bytes in 500 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:54:12.818956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:12.821000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:13.094800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea60e-a532-42d4-ba2a-22541fb58e51 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:13.127066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:13.129389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:13.129913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:13.132955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] PATH_INFO: `/v3/users/c5e8f3705f624b22a3d26befe1cf52cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:13.139735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e8f3705f624b22a3d26befe1cf52cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:13.149344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:13.372978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e8f3705f624b22a3d26befe1cf52cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:13.425330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e8f3705f624b22a3d26befe1cf52cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:13.426861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e8f3705f624b22a3d26befe1cf52cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:13.456957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e8f3705f624b22a3d26befe1cf52cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:13.465125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e8f3705f624b22a3d26befe1cf52cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:13.528790 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2021/4040] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:12 2022] DELETE /identity/v3/users/c5e8f3705f624b22a3d26befe1cf52cb => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:54:13.534972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a407-6049-4cfd-8de9-09530cc7e037 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:13.535724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a407-6049-4cfd-8de9-09530cc7e037 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:13.535724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a407-6049-4cfd-8de9-09530cc7e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:13.598933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0a3a407-6049-4cfd-8de9-09530cc7e037 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:13.601154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0a3a407-6049-4cfd-8de9-09530cc7e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:13.690069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:13.765993 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2020/4041] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:13.835140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:13.837641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:14.153066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed271-b90a-4ee5-b4e2-2e540a30fc75 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:14.165770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:14.166476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:14.167556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:14.172053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:14.197230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:14.202607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:14.253862 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2022/4042] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:14.788616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:14.789182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:14.789873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:14.861251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] MFA Rules not processed for user `a17530aa8b8a42f19d738bf4aacf3c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:14.868436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:15.100584 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2021/4043] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:16.496023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:16.516559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c6368-5cc6-4ccf-9b30-145cb2a0defc service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:16.540144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:16.543219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:16.544159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:16.544564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:16.553231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:16.612314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:16.617273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:16.657487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2023/4044] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:16.696007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:16.701436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:16.757595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6c848-58b4-4d4e-b4e8-8cf13783a908 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:16.779726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:16.794370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:16.794929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:16.795469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] PATH_INFO: `/v3/projects/786b84940e914b9ab460bf29f60d5e97` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:16.806894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] RBAC: Authorizing `identity:delete_project(project_id=786b84940e914b9ab460bf29f60d5e97)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:16.820643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:17.033909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786b84940e914b9ab460bf29f60d5e97', 'request_id': 'req-9170de99-b9e6-4dc9-a439-4be31e20515c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.056780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786b84940e914b9ab460bf29f60d5e97', 'request_id': 'req-9170de99-b9e6-4dc9-a439-4be31e20515c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.078511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786b84940e914b9ab460bf29f60d5e97', 'request_id': 'req-9170de99-b9e6-4dc9-a439-4be31e20515c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.113413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] The token cache is being invalidate because project 786b84940e914b9ab460bf29f60d5e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:17.113826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.115000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9170de99-b9e6-4dc9-a439-4be31e20515c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.123300 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2022/4045] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:16 2022] DELETE /identity/v3/projects/786b84940e914b9ab460bf29f60d5e97 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:17.125445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:17.174981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b127b3-15c9-4944-a777-f000a4f637f3 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:17.227361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:17.531758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:17.533916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:17.534469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:17.535937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] PATH_INFO: `/v3/users/c766397f9837422590f852e860a77101` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:17.539284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c766397f9837422590f852e860a77101)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:17.544220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:17.874161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c766397f9837422590f852e860a77101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.928391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c766397f9837422590f852e860a77101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.929796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c766397f9837422590f852e860a77101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.963079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c766397f9837422590f852e860a77101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:17.964905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c766397f9837422590f852e860a77101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:18.029272 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2024/4046] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:17 2022] DELETE /identity/v3/users/c766397f9837422590f852e860a77101 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:18.228523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc598943-549a-4175-a36c-a0206a6353fa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:18.229172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc598943-549a-4175-a36c-a0206a6353fa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:18.229515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc598943-549a-4175-a36c-a0206a6353fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:18.309357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bc598943-549a-4175-a36c-a0206a6353fa None None] MFA Rules not processed for user `4813aa5acf744a8dac42de00d7e5a519`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:18.311517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc598943-549a-4175-a36c-a0206a6353fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:18.482460 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2023/4047] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:20.102145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:20.108257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:20.258935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175570c1-deac-43b7-8126-c2cf6638a5a9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:20.271634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:20.273054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:20.273759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:20.274322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] PATH_INFO: `/v3/projects/8c5dfb47ec964eba87c958ee166a9ed6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:20.276767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5dfb47ec964eba87c958ee166a9ed6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:20.280925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:20.361829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:20.403229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5dfb47ec964eba87c958ee166a9ed6', 'request_id': 'req-9d134727-5752-4842-94b1-9bd6c73f6f78'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:20.439595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5dfb47ec964eba87c958ee166a9ed6', 'request_id': 'req-9d134727-5752-4842-94b1-9bd6c73f6f78'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:20.456596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5dfb47ec964eba87c958ee166a9ed6', 'request_id': 'req-9d134727-5752-4842-94b1-9bd6c73f6f78'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:20.490365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] The token cache is being invalidate because project 8c5dfb47ec964eba87c958ee166a9ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:20.490668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:20.494235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9d134727-5752-4842-94b1-9bd6c73f6f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:20.506213 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2025/4048] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:20 2022] DELETE /identity/v3/projects/8c5dfb47ec964eba87c958ee166a9ed6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:20.507646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b30c9-f10a-43d3-a805-fc2e6543c009 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:20.509652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b30c9-f10a-43d3-a805-fc2e6543c009 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:20.509953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b30c9-f10a-43d3-a805-fc2e6543c009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:20.541244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:20.570253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c67b30c9-f10a-43d3-a805-fc2e6543c009 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:20.575392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c67b30c9-f10a-43d3-a805-fc2e6543c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:20.794924 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2024/4049] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:20.795163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00162ff-64f4-4d10-887e-d02ee88a6bf7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:20.795338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00162ff-64f4-4d10-887e-d02ee88a6bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:20.795570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00162ff-64f4-4d10-887e-d02ee88a6bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:20.820194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b00162ff-64f4-4d10-887e-d02ee88a6bf7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:20.821974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b00162ff-64f4-4d10-887e-d02ee88a6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:20.847021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b30c9-f10a-43d3-a805-fc2e6543c009 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:20.855478 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2026/4050] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:20.860526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b30c9-f10a-43d3-a805-fc2e6543c009 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:20.867667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:20.868643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:20.869060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:20.870445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:20.871018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:54:20.871548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:20.873479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:20.895053 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2025/4051] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:20.900357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00162ff-64f4-4d10-887e-d02ee88a6bf7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:20.915841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00162ff-64f4-4d10-887e-d02ee88a6bf7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:20.930321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:20.931023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:20.931543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:20.933694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:20.935215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:20.940733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:21.010116 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2027/4052] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:20 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:21.014630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:21.035300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bd7b-98fa-44d4-890e-11dc7579f037 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:21.152670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:21.154084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.154556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.155165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.156102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:21.159320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:21.196735 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2026/4053] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:21 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:21.201556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:21.216661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d91a9-fcfa-41e1-abc1-0e4403e99d2c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:21.223127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:21.223890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.224179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.224464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.225682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:21.227398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:21.258374 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2028/4054] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:21.260076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:21.274936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf61593-699d-43ac-a824-d627356aa0f6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:21.285711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5462795-518d-4856-9460-485ed42b143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:21.287414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5462795-518d-4856-9460-485ed42b143e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.288526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5462795-518d-4856-9460-485ed42b143e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.289014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5462795-518d-4856-9460-485ed42b143e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.290177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5462795-518d-4856-9460-485ed42b143e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:21.293505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5462795-518d-4856-9460-485ed42b143e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:21.314434 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2027/4055] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:21.319927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:21.336984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42886-cdde-49c4-8d51-e5787c634624 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:21.355573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:21.357381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.357381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.357381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] PATH_INFO: `/v3/projects/1370eb2f545342f7ab337f502be31a88/users/d947b622e09d4f1facd0c5f72fc6f094/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.403663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1370eb2f545342f7ab337f502be31a88, user_id=d947b622e09d4f1facd0c5f72fc6f094, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:21.412002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:21.447345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2029/4056] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:21 2022] PUT /identity/v3/projects/1370eb2f545342f7ab337f502be31a88/users/d947b622e09d4f1facd0c5f72fc6f094/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:21.463164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d20ce-09f2-4b2e-93db-8c922dc8f4c9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.464049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d20ce-09f2-4b2e-93db-8c922dc8f4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.464340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d20ce-09f2-4b2e-93db-8c922dc8f4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.537806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-845d20ce-09f2-4b2e-93db-8c922dc8f4c9 None None] MFA Rules not processed for user `d947b622e09d4f1facd0c5f72fc6f094`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:21.541415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-845d20ce-09f2-4b2e-93db-8c922dc8f4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:21.723016 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2028/4057] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:21.730326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:21.753403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbca95-46b0-482b-80c1-40df6db8b0d3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:21.758692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc61ba-ec13-4842-9f57-37ac8ce961f3 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd947b622e09d4f1facd0c5f72fc6f094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1370eb2f545342f7ab337f502be31a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:21.759960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc61ba-ec13-4842-9f57-37ac8ce961f3 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.759960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc61ba-ec13-4842-9f57-37ac8ce961f3 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.761300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc61ba-ec13-4842-9f57-37ac8ce961f3 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] PATH_INFO: `/v3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.769952 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2030/4058] 10.222.0.98 () {58 vars in 1103 bytes} [Thu Jul 14 14:54:21 2022] GET /identity/v3 => generated 255 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:21.774589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d20ce-09f2-4b2e-93db-8c922dc8f4c9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:21.780626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:21.790599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d20ce-09f2-4b2e-93db-8c922dc8f4c9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:21.800283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7137-f396-4b72-9455-c3c13107d376 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd947b622e09d4f1facd0c5f72fc6f094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1370eb2f545342f7ab337f502be31a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:21.801213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7137-f396-4b72-9455-c3c13107d376 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.801613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7137-f396-4b72-9455-c3c13107d376 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.802196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7137-f396-4b72-9455-c3c13107d376 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] PATH_INFO: `/v3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.810384 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2029/4059] 10.222.0.98 () {58 vars in 1103 bytes} [Thu Jul 14 14:54:21 2022] GET /identity/v3 => generated 255 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:21.810626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc61ba-ec13-4842-9f57-37ac8ce961f3 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:21.843079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc61ba-ec13-4842-9f57-37ac8ce961f3 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:21.859566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bd4f3-ca71-41e9-a2e9-c36b4aec22b5 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd947b622e09d4f1facd0c5f72fc6f094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1370eb2f545342f7ab337f502be31a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:21.861376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bd4f3-ca71-41e9-a2e9-c36b4aec22b5 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.861911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bd4f3-ca71-41e9-a2e9-c36b4aec22b5 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.862378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bd4f3-ca71-41e9-a2e9-c36b4aec22b5 tempest-TestApiDiscovery-815607009 tempest-TestApiDiscovery-815607009-project] PATH_INFO: `/v3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.871587 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2031/4060] 10.222.0.98 () {58 vars in 1103 bytes} [Thu Jul 14 14:54:21 2022] GET /identity/v3 => generated 255 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:21.873007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094af1a-d240-471c-8c55-37060e5da75c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.873554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094af1a-d240-471c-8c55-37060e5da75c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.873964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094af1a-d240-471c-8c55-37060e5da75c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.881227 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2030/4061] 10.222.0.98 () {56 vars in 894 bytes} [Thu Jul 14 14:54:21 2022] GET /identity/ => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:54:21.892229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc0dbd-b299-46b2-a5af-a3f80a2f0450 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:21.892823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc0dbd-b299-46b2-a5af-a3f80a2f0450 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:21.893276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc0dbd-b299-46b2-a5af-a3f80a2f0450 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:21.895594 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2032/4062] 10.222.0.98 () {56 vars in 894 bytes} [Thu Jul 14 14:54:21 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:54:21.901748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094af1a-d240-471c-8c55-37060e5da75c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:22.005225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094af1a-d240-471c-8c55-37060e5da75c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:22.011938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:22.013249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:22.014451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:22.014451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] PATH_INFO: `/v3/users/d947b622e09d4f1facd0c5f72fc6f094` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:22.016699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d947b622e09d4f1facd0c5f72fc6f094)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:22.020239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:22.124178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd947b622e09d4f1facd0c5f72fc6f094'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:22.207023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd947b622e09d4f1facd0c5f72fc6f094'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:22.246285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd947b622e09d4f1facd0c5f72fc6f094'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:22.247532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd947b622e09d4f1facd0c5f72fc6f094'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:22.271423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd947b622e09d4f1facd0c5f72fc6f094'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:22.293339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:22.294841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:22.295473 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2031/4063] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:21 2022] DELETE /identity/v3/users/d947b622e09d4f1facd0c5f72fc6f094 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:22.295951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:22.358251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:22.370671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:22.592429 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2033/4064] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:22.660803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:22.663345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:22.962230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa086d7-e01c-438a-8b1a-e4690db21c6f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:22.977236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1932cea-71fe-4218-a2a7-87ce908b006e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:22.978772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1932cea-71fe-4218-a2a7-87ce908b006e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:22.979658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1932cea-71fe-4218-a2a7-87ce908b006e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:22.980269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1932cea-71fe-4218-a2a7-87ce908b006e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:23.005403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1932cea-71fe-4218-a2a7-87ce908b006e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:23.008440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1932cea-71fe-4218-a2a7-87ce908b006e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:23.023670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2032/4065] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:25.389080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:25.391679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:25.472404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f9a30-9fca-4221-abb0-f61d3b7f58ab None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:25.503206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:25.505358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:25.521232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:25.523944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] PATH_INFO: `/v3/projects/1370eb2f545342f7ab337f502be31a88` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:25.532541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1370eb2f545342f7ab337f502be31a88)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:25.549664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:25.694023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:25.716739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1370eb2f545342f7ab337f502be31a88', 'request_id': 'req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:25.738366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1370eb2f545342f7ab337f502be31a88', 'request_id': 'req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:25.750635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1370eb2f545342f7ab337f502be31a88', 'request_id': 'req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:25.785077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] The token cache is being invalidate because project 1370eb2f545342f7ab337f502be31a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:25.785377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:25.786078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fa4dc4d9-a703-472b-b7eb-59a6e45cd96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:25.788263 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2034/4066] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:25 2022] DELETE /identity/v3/projects/1370eb2f545342f7ab337f502be31a88 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:25.795662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581172d-39fe-4fee-a09e-bcd74cac305b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:25.798600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581172d-39fe-4fee-a09e-bcd74cac305b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:25.801007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581172d-39fe-4fee-a09e-bcd74cac305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:25.847151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a581172d-39fe-4fee-a09e-bcd74cac305b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:25.852148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a581172d-39fe-4fee-a09e-bcd74cac305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:25.920052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:26.046229 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2033/4067] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:26.058835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3112b-a77a-4119-98fb-3ac4de50a146 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:26.058835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3112b-a77a-4119-98fb-3ac4de50a146 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:26.059333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3112b-a77a-4119-98fb-3ac4de50a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:26.128849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84b3112b-a77a-4119-98fb-3ac4de50a146 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:26.130833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84b3112b-a77a-4119-98fb-3ac4de50a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:26.158875 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2035/4068] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:26.165218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581172d-39fe-4fee-a09e-bcd74cac305b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:26.208789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581172d-39fe-4fee-a09e-bcd74cac305b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:26.228942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:26.233213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:26.233924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:26.234934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:26.238789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:54:26.243216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:26.248051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:26.295872 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2034/4069] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:26.302051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3112b-a77a-4119-98fb-3ac4de50a146 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:26.330423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3112b-a77a-4119-98fb-3ac4de50a146 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:26.354087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:26.355406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:26.356685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:26.357167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:26.358450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:26.371014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:26.455054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2036/4070] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:26 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:26.461805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:26.484371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a180f83-6afe-4a3e-8789-584538616e8a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:26.784290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:26.786473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:26.789673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:26.790205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:26.794320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:26.807250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:26.924059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2035/4071] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:26 2022] POST /identity/v3/users => generated 306 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:26.929447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:26.969260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aceed-fb79-40dc-ba58-999eec74b383 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:26.992326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:26.993496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:26.994175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:26.995306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:26.996660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:26.999687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:27.052189 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2037/4072] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:54:27.059650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:27.079776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e6e7-e57a-407d-9ca2-738c8f4ee6de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:27.089161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:27.092793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:27.093295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:27.093788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] PATH_INFO: `/v3/projects/7fb38f6322c84e8ea94dc49f707b6be2/users/5f66c3f566c742be987cfb1661562d13/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:27.129469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb38f6322c84e8ea94dc49f707b6be2, user_id=5f66c3f566c742be987cfb1661562d13, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:27.136404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:27.170875 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2036/4073] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:27 2022] PUT /identity/v3/projects/7fb38f6322c84e8ea94dc49f707b6be2/users/5f66c3f566c742be987cfb1661562d13/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:27.177217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:27.199027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d11b7-659d-4680-93d4-9bbee34684ef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:27.374727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72fa37-4f1a-4c77-b1ca-5ba631280ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:27.377769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72fa37-4f1a-4c77-b1ca-5ba631280ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:27.380127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72fa37-4f1a-4c77-b1ca-5ba631280ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:27.381162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72fa37-4f1a-4c77-b1ca-5ba631280ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:27.383497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72fa37-4f1a-4c77-b1ca-5ba631280ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:27.388724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72fa37-4f1a-4c77-b1ca-5ba631280ff9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:27.426098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2038/4074] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:27.428522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:27.461224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3244e-da10-4814-8402-76ebb1161e50 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:27.496994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:27.498461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:27.498935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:27.499423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] PATH_INFO: `/v3/projects/7fb38f6322c84e8ea94dc49f707b6be2/users/5f66c3f566c742be987cfb1661562d13/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:27.507954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb38f6322c84e8ea94dc49f707b6be2, user_id=5f66c3f566c742be987cfb1661562d13, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:27.530915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:27.573401 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2037/4075] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:27 2022] PUT /identity/v3/projects/7fb38f6322c84e8ea94dc49f707b6be2/users/5f66c3f566c742be987cfb1661562d13/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:54:27.598702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12704-15a4-4721-a12e-a255d542bd95 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:27.599784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12704-15a4-4721-a12e-a255d542bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:27.599784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12704-15a4-4721-a12e-a255d542bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:27.713054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bba12704-15a4-4721-a12e-a255d542bd95 None None] MFA Rules not processed for user `5f66c3f566c742be987cfb1661562d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:27.715792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bba12704-15a4-4721-a12e-a255d542bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:28.062874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2039/4076] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:28.064071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:28.311925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e19624-2b0e-4aa0-ab99-e87cdf0ccf10 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:28.322236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:28.324896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:28.325842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:28.326641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:28.328424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:28.332990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:28.341201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:28.428207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba12704-15a4-4721-a12e-a255d542bd95 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:28.437319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2038/4077] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:28 2022] POST /identity/v3/projects => generated 397 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:54:28.451667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba12704-15a4-4721-a12e-a255d542bd95 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:28.462391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:28.594592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:28.595585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:28.596111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:28.596586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:28.598194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:28.604336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:28.664593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:28.674604 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2040/4078] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:28 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:28.692037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c946ff6-5731-4ba9-a4c9-64548d810b9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:28.711431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:28.712460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:28.712893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:28.713800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:28.715170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:28.726805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:28.767885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2039/4079] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:28.771208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:28.787475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c602b3-5a0e-4686-a656-462d3f40abd5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:28.816159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94352bc3-ea0a-4977-b2a6-18a75c40a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:28.818185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94352bc3-ea0a-4977-b2a6-18a75c40a1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:28.819950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94352bc3-ea0a-4977-b2a6-18a75c40a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:28.821561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94352bc3-ea0a-4977-b2a6-18a75c40a1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:28.825002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94352bc3-ea0a-4977-b2a6-18a75c40a1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:28.828391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94352bc3-ea0a-4977-b2a6-18a75c40a1c9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:28.860349 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2041/4080] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:54:28.866556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:28.893327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec38b6d-6284-4e9b-ac8e-334f41a43020 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:28.903341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:28.904472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:28.904891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:28.905283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] PATH_INFO: `/v3/projects/daeed096a16744fea8d676a273a7a05f/users/6e4406c9050446d5966fce185050833c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:28.945749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeed096a16744fea8d676a273a7a05f, user_id=6e4406c9050446d5966fce185050833c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:28.949303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:28.977616 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2040/4081] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:28 2022] PUT /identity/v3/projects/daeed096a16744fea8d676a273a7a05f/users/6e4406c9050446d5966fce185050833c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:28.999746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1636f-fa67-4611-a074-f9f85463a469 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:29.000227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1636f-fa67-4611-a074-f9f85463a469 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:29.000626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1636f-fa67-4611-a074-f9f85463a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:29.088848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9df1636f-fa67-4611-a074-f9f85463a469 None None] MFA Rules not processed for user `6e4406c9050446d5966fce185050833c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:29.090305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9df1636f-fa67-4611-a074-f9f85463a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:29.280101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2042/4082] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:29.297650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:29.299875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:29.528138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9dd82-5953-4252-adae-57f5a9edd3be admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:29.542808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbce33-8130-45f6-8b34-974f115e1cd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:29.543556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbce33-8130-45f6-8b34-974f115e1cd8 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:29.543844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbce33-8130-45f6-8b34-974f115e1cd8 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:29.544126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbce33-8130-45f6-8b34-974f115e1cd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:29.747045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbce33-8130-45f6-8b34-974f115e1cd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:29.749759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbce33-8130-45f6-8b34-974f115e1cd8 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:29.782102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2041/4083] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:30.682979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1636f-fa67-4611-a074-f9f85463a469 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:30.828666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1636f-fa67-4611-a074-f9f85463a469 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:30.849600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:30.851220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:30.851796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:30.852302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] PATH_INFO: `/v3/users/5f66c3f566c742be987cfb1661562d13` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:30.860999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f66c3f566c742be987cfb1661562d13)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:30.867042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:30.918801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:30.987934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f66c3f566c742be987cfb1661562d13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:31.019290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f66c3f566c742be987cfb1661562d13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:31.022021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f66c3f566c742be987cfb1661562d13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:31.043716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f66c3f566c742be987cfb1661562d13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:31.044492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f66c3f566c742be987cfb1661562d13'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:31.087359 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2043/4084] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:30 2022] DELETE /identity/v3/users/5f66c3f566c742be987cfb1661562d13 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:31.089739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:31.090602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:31.090602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:31.156932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:31.159727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:31.263874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:31.292619 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2042/4085] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:31.316805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:31.324108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:31.445740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a3a64-e7de-48bd-82e0-ba84917c4177 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:31.462503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:31.464032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:31.464911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:31.465551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:31.507586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:31.511085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:31.554107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2044/4086] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:32.961247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:32.963061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:32.992090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163029-feb3-4b9c-b414-6b6f5fa91166 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:33.000055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:33.001508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:33.002304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:33.002905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] PATH_INFO: `/v3/projects/7fb38f6322c84e8ea94dc49f707b6be2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:33.006559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb38f6322c84e8ea94dc49f707b6be2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:33.018105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:33.114646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb38f6322c84e8ea94dc49f707b6be2', 'request_id': 'req-aede5b28-9304-4177-8a32-245b752ee4cc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.136945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb38f6322c84e8ea94dc49f707b6be2', 'request_id': 'req-aede5b28-9304-4177-8a32-245b752ee4cc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.152514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb38f6322c84e8ea94dc49f707b6be2', 'request_id': 'req-aede5b28-9304-4177-8a32-245b752ee4cc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.176944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] The token cache is being invalidate because project 7fb38f6322c84e8ea94dc49f707b6be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:33.177246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.181661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.192002 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2043/4087] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:32 2022] DELETE /identity/v3/projects/7fb38f6322c84e8ea94dc49f707b6be2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:33.192970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:33.208524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d254903-5cde-4b84-96a7-456a02b80a59 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:33.408749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:33.410523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:33.411326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:33.411981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] PATH_INFO: `/v3/users/6e4406c9050446d5966fce185050833c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:33.414365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4406c9050446d5966fce185050833c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:33.424755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:33.569850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:33.593875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4406c9050446d5966fce185050833c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.616384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4406c9050446d5966fce185050833c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.617276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4406c9050446d5966fce185050833c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.629139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4406c9050446d5966fce185050833c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.630079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5bf56524-87e7-4c9a-a74f-51dc8c334f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4406c9050446d5966fce185050833c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:33.657148 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2045/4088] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:33 2022] DELETE /identity/v3/users/6e4406c9050446d5966fce185050833c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:36.157865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:36.159548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:36.176382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5b28-9304-4177-8a32-245b752ee4cc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:36.306488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:36.312397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:36.312611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:36.312792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] PATH_INFO: `/v3/projects/daeed096a16744fea8d676a273a7a05f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:36.315577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] RBAC: Authorizing `identity:delete_project(project_id=daeed096a16744fea8d676a273a7a05f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:36.316730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:36.486958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daeed096a16744fea8d676a273a7a05f', 'request_id': 'req-6682fe3c-7886-48d3-829b-73403561574b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:36.513050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daeed096a16744fea8d676a273a7a05f', 'request_id': 'req-6682fe3c-7886-48d3-829b-73403561574b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:36.545384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daeed096a16744fea8d676a273a7a05f', 'request_id': 'req-6682fe3c-7886-48d3-829b-73403561574b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:36.596277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] The token cache is being invalidate because project daeed096a16744fea8d676a273a7a05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:36.597039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:36.601126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6682fe3c-7886-48d3-829b-73403561574b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:36.608935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2044/4089] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:36 2022] DELETE /identity/v3/projects/daeed096a16744fea8d676a273a7a05f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:54:36.622668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b920-fd0b-4319-89e7-bebeb7394d73 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:36.623231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b920-fd0b-4319-89e7-bebeb7394d73 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:36.624926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b920-fd0b-4319-89e7-bebeb7394d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:36.689693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9c56b920-fd0b-4319-89e7-bebeb7394d73 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:36.700722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9c56b920-fd0b-4319-89e7-bebeb7394d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:36.921667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2046/4090] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:36.922587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948619b-9176-4486-9854-21aa13c9b874 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:36.923100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948619b-9176-4486-9854-21aa13c9b874 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:36.923620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948619b-9176-4486-9854-21aa13c9b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:36.959296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:37.010846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b948619b-9176-4486-9854-21aa13c9b874 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:37.018587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b948619b-9176-4486-9854-21aa13c9b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:37.056830 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2045/4091] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:37.066424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b920-fd0b-4319-89e7-bebeb7394d73 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:37.104858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b920-fd0b-4319-89e7-bebeb7394d73 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:37.129483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:37.133677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:37.137526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:37.139184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:37.144152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:54:37.144870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:37.153413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:37.201770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2047/4092] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:37.208190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948619b-9176-4486-9854-21aa13c9b874 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:37.248841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948619b-9176-4486-9854-21aa13c9b874 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:37.272925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:37.276394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:37.282736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:37.283456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:37.289343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:37.298050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:37.413221 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2046/4093] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:37 2022] POST /identity/v3/projects => generated 389 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:37.414406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:37.439003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fac855-2bb5-4a6a-97a0-47b7ef87412f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:37.674788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:37.677826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:37.678802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:37.680710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:37.683804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:37.689599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:37.750519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2048/4094] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:37 2022] POST /identity/v3/users => generated 295 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:54:37.755799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:37.808411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6386-7df3-488c-beac-be58fc4ba09e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:37.826157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:37.827601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:37.828597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:37.829225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:37.831747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:37.835795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:37.864123 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2047/4095] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:37.870899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:37.903742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c6936-fd8c-4889-8225-697e23422790 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:37.916088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5412b5-153a-4c7a-a4ce-f801f8e75916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:37.919601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5412b5-153a-4c7a-a4ce-f801f8e75916 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:37.920585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5412b5-153a-4c7a-a4ce-f801f8e75916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:37.921207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5412b5-153a-4c7a-a4ce-f801f8e75916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:37.924689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5412b5-153a-4c7a-a4ce-f801f8e75916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:37.931380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5412b5-153a-4c7a-a4ce-f801f8e75916 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:37.964408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2049/4096] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:37.966003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:37.995132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f141df-d91e-4b26-a106-7ea71861cf14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:38.010606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:38.011851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:38.011851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:38.012583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] PATH_INFO: `/v3/projects/dde32d45d04345f8821127f1b39eea95/users/3ecb8269197d4cf1a7000446add35450/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:38.060722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde32d45d04345f8821127f1b39eea95, user_id=3ecb8269197d4cf1a7000446add35450, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:38.063757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:38.096394 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2048/4097] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:37 2022] PUT /identity/v3/projects/dde32d45d04345f8821127f1b39eea95/users/3ecb8269197d4cf1a7000446add35450/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:54:38.122451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3079-72bb-48aa-b46f-c9ce61f4b278 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:38.123040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3079-72bb-48aa-b46f-c9ce61f4b278 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:38.123718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3079-72bb-48aa-b46f-c9ce61f4b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:38.191343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-73ce3079-72bb-48aa-b46f-c9ce61f4b278 None None] MFA Rules not processed for user `3ecb8269197d4cf1a7000446add35450`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:38.193780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-73ce3079-72bb-48aa-b46f-c9ce61f4b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:38.224971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:38.431509 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2050/4098] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:38.434879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:38.609125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07741313-9003-484c-b1be-12ee0f4fc3e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:38.621273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:38.622603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:38.623488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:38.624099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:38.626289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:38.643215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:38.710474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2049/4099] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:38 2022] POST /identity/v3/projects => generated 391 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:38.713152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3079-72bb-48aa-b46f-c9ce61f4b278 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:38.732411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3079-72bb-48aa-b46f-c9ce61f4b278 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:38.878063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:38.879590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:38.880206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:38.880819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:38.882200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:38.886694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:38.955734 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2051/4100] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:38 2022] POST /identity/v3/users => generated 302 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:38.961989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:38.983837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089e9de-6371-4ed3-923e-1a1de6784925 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:38.994868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:38.996473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:38.997063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:38.997735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:38.999219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:39.004898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:39.038926 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2050/4101] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:39.047097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:39.059678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd2c3c-4370-4424-b8d3-16a3394c3680 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:39.066581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:39.067090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:39.067430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:39.067612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] PATH_INFO: `/v3/projects/d71e1f949ce54c58a6ddf5d328cc6ba1/users/86e19e3675ed474fb3c539a026c350f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:39.130767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71e1f949ce54c58a6ddf5d328cc6ba1, user_id=86e19e3675ed474fb3c539a026c350f7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:39.136626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:39.181555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2052/4102] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:39 2022] PUT /identity/v3/projects/d71e1f949ce54c58a6ddf5d328cc6ba1/users/86e19e3675ed474fb3c539a026c350f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:39.183597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:39.214794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e05e2-62c2-4731-a10c-6f84f1ee5c43 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:39.483158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12681e-799b-488d-a530-9d799e47c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:39.484658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12681e-799b-488d-a530-9d799e47c24e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:39.485242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12681e-799b-488d-a530-9d799e47c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:39.485813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12681e-799b-488d-a530-9d799e47c24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:39.487509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12681e-799b-488d-a530-9d799e47c24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:39.493916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12681e-799b-488d-a530-9d799e47c24e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:39.570050 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2051/4103] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:39.571744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:39.605088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3097df-7c17-4e90-b6ec-c212eeb615fa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:39.623123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:39.624758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:39.625254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:39.625753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] PATH_INFO: `/v3/projects/d71e1f949ce54c58a6ddf5d328cc6ba1/users/86e19e3675ed474fb3c539a026c350f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:39.638263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71e1f949ce54c58a6ddf5d328cc6ba1, user_id=86e19e3675ed474fb3c539a026c350f7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:39.652095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:39.700519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2053/4104] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:39 2022] PUT /identity/v3/projects/d71e1f949ce54c58a6ddf5d328cc6ba1/users/86e19e3675ed474fb3c539a026c350f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:39.706729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:39.708317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:39.709273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:39.759360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:39.829397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] MFA Rules not processed for user `86e19e3675ed474fb3c539a026c350f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:39.833937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:40.100610 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2052/4105] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:40.126038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:40.140151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:40.278402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3026f-bea3-4362-a013-bcd3b315a00f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:40.284368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:40.287646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:40.288065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:40.288468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:40.319583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:40.397979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:40.401227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:40.417014 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2054/4106] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:47.837367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:47.841278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:47.913123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8171c-1ae6-42c8-8043-ef6a58b27fbc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:47.946186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:47.958304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:47.960516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:47.961821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:48.018926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:48.019995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:48.057679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2053/4107] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:54:50.410585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=18 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:54.641587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:54.644146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:54.740998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:54.740998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:54.835939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348da731-7152-4192-9350-d4b86961e048 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:54.853709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e97eb5-77ea-4c0a-956d-eecce14de65e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:54.854762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97eb5-77ea-4c0a-956d-eecce14de65e service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:54.857729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97eb5-77ea-4c0a-956d-eecce14de65e service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:54.858292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97eb5-77ea-4c0a-956d-eecce14de65e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:54.866346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-56e97eb5-77ea-4c0a-956d-eecce14de65e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:54.918508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e97eb5-77ea-4c0a-956d-eecce14de65e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:54.923735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e97eb5-77ea-4c0a-956d-eecce14de65e service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:54.982414 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2055/4108] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:55.006774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518d9b-eded-4cf7-940f-afff0f266c52 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:55.015956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:55.017612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:55.017989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:55.018493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] PATH_INFO: `/v3/users/a185fa24374c417aa2bb9302a608cbcd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:55.021168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a185fa24374c417aa2bb9302a608cbcd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:55.025777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:55.136275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a185fa24374c417aa2bb9302a608cbcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:55.171768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a185fa24374c417aa2bb9302a608cbcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:55.195113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a185fa24374c417aa2bb9302a608cbcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:55.196369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a185fa24374c417aa2bb9302a608cbcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:55.218324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a185fa24374c417aa2bb9302a608cbcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:55.228032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2054/4109] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:54 2022] DELETE /identity/v3/users/a185fa24374c417aa2bb9302a608cbcd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:55.233577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:55.234063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:55.234536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:55.296096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:55.298125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:55.413140 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2056/4110] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:55.453690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:55.457223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:55.500682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:55.587298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d729-42c2-4b35-abb5-b8aa4938d128 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:55.602008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:55.603036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:55.603605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:55.604130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:55.616281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:55.618377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:55.635669 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2055/4111] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:56.460418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:56.462077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:56.487495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c31fa-90a3-47ad-8a55-6ade83b33d9d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:56.511722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:56.513110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:56.513412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:56.515585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] PATH_INFO: `/v3/projects/e29ad9c0a3664715b0a8384bc9840b7b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:56.521225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29ad9c0a3664715b0a8384bc9840b7b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:56.526112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:56.685648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29ad9c0a3664715b0a8384bc9840b7b', 'request_id': 'req-bfb33192-1f3e-4c08-aee6-87687cd84657'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:56.709717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29ad9c0a3664715b0a8384bc9840b7b', 'request_id': 'req-bfb33192-1f3e-4c08-aee6-87687cd84657'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:56.788010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29ad9c0a3664715b0a8384bc9840b7b', 'request_id': 'req-bfb33192-1f3e-4c08-aee6-87687cd84657'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:56.845418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] The token cache is being invalidate because project e29ad9c0a3664715b0a8384bc9840b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:56.845963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:56.846950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:56.849451 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2057/4112] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:56 2022] DELETE /identity/v3/projects/e29ad9c0a3664715b0a8384bc9840b7b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:56.855362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:56.908284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e25c-a3b1-47e7-ba1c-1e41bf3fa1b0 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:56.989047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:56.990088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:57.021149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:57.062984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:57.063956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:57.064291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:57.064601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] PATH_INFO: `/v3/users/f2cdc02847a74ce6adf37f360f247ade` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:57.066142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cdc02847a74ce6adf37f360f247ade)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:57.069904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:57.146595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33192-1f3e-4c08-aee6-87687cd84657 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:57.154315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:57.155308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:57.155604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:57.155924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] PATH_INFO: `/v3/users/3ecb8269197d4cf1a7000446add35450` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:57.165995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecb8269197d4cf1a7000446add35450)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:57.170452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:57.182817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cdc02847a74ce6adf37f360f247ade'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.214110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cdc02847a74ce6adf37f360f247ade'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.230124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cdc02847a74ce6adf37f360f247ade'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.230863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cdc02847a74ce6adf37f360f247ade'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.256379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2002f05-1eb2-43b7-a042-75791a6bd3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cdc02847a74ce6adf37f360f247ade'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.276763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2056/4113] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:56 2022] DELETE /identity/v3/users/f2cdc02847a74ce6adf37f360f247ade => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:57.297901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecb8269197d4cf1a7000446add35450'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.325914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecb8269197d4cf1a7000446add35450'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.326703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecb8269197d4cf1a7000446add35450'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.355289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecb8269197d4cf1a7000446add35450'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.363493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecb8269197d4cf1a7000446add35450'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:57.427914 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2058/4114] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:56 2022] DELETE /identity/v3/users/3ecb8269197d4cf1a7000446add35450 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:54:57.435146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:57.435499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:57.435830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:57.475744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:57.479372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:57.552333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:57.718444 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2057/4115] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:54:57.736820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:57.747003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:57.846126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0ef21-622b-479a-bef8-480076b54d95 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:57.850874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:57.851948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:57.852556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:57.853159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:57.865123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:57.867049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:57.884940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2059/4116] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:54:57.954236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:57.958687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:58.029440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a73d9-3628-4ea6-b1d6-f0bf143e4efd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:58.092561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:58.094543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:58.095455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:58.096297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] PATH_INFO: `/v3/projects/c954b5add82d484393972d3762652312` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:58.099017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c954b5add82d484393972d3762652312)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:58.104272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:58.284555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c954b5add82d484393972d3762652312', 'request_id': 'req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.305648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c954b5add82d484393972d3762652312', 'request_id': 'req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.325103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c954b5add82d484393972d3762652312', 'request_id': 'req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.351170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:58.353845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:58.372519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] The token cache is being invalidate because project c954b5add82d484393972d3762652312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:58.373185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.374510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb2f8c48-c42b-4668-8ef8-7d341a13b79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.380069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81503543-4511-4df3-a863-46901163b2f0 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:58.380815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2058/4117] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:57 2022] DELETE /identity/v3/projects/c954b5add82d484393972d3762652312 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:58.387033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247846e5-4899-4e04-b74d-61a2e04ed0aa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:58.388030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247846e5-4899-4e04-b74d-61a2e04ed0aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:58.388407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247846e5-4899-4e04-b74d-61a2e04ed0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:58.438545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-247846e5-4899-4e04-b74d-61a2e04ed0aa None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:58.441998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-247846e5-4899-4e04-b74d-61a2e04ed0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:58.472599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:58.536909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:58.537930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:58.538210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:58.538746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] PATH_INFO: `/v3/projects/dde32d45d04345f8821127f1b39eea95` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:58.542046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde32d45d04345f8821127f1b39eea95)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:58.544239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:58.614766 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2059/4118] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:58.628242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a48c-74dc-4774-a477-657b1c960125 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:58.628733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a48c-74dc-4774-a477-657b1c960125 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:58.629318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a48c-74dc-4774-a477-657b1c960125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:58.645093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde32d45d04345f8821127f1b39eea95', 'request_id': 'req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.663304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde32d45d04345f8821127f1b39eea95', 'request_id': 'req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.680729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2476a48c-74dc-4774-a477-657b1c960125 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:54:58.682088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2476a48c-74dc-4774-a477-657b1c960125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:58.688682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde32d45d04345f8821127f1b39eea95', 'request_id': 'req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.723241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] The token cache is being invalidate because project dde32d45d04345f8821127f1b39eea95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:54:58.723587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.724301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:58.727986 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2060/4119] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:54:58 2022] DELETE /identity/v3/projects/dde32d45d04345f8821127f1b39eea95 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:54:58.734075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:58.736251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:58.798753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:58.883651 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2060/4120] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:54:58.889823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a48c-74dc-4774-a477-657b1c960125 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:58.954365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a48c-74dc-4774-a477-657b1c960125 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:58.966362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac4d0-b4a9-4ca6-8c6e-059e25a36261 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:58.983053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:58.984331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:58.984895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:58.985397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:58.987828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:54:58.987828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:58.990764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:58.992399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:58.993116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:58.993636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] PATH_INFO: `/v3/users/86e19e3675ed474fb3c539a026c350f7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:58.998905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e19e3675ed474fb3c539a026c350f7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:59.002666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:59.015518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:59.076304 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2061/4121] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:54:59.077493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:59.109461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d5df-95a4-43d4-8695-a6516335aa4e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:59.120337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:59.121391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:59.121907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:59.122397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:59.123688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:59.127954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:59.226738 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2062/4122] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:54:59 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:54:59.232800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e19e3675ed474fb3c539a026c350f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:59.234908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:59.301276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e19e3675ed474fb3c539a026c350f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:59.302896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e19e3675ed474fb3c539a026c350f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:59.310253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:59.336905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e19e3675ed474fb3c539a026c350f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:59.338474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e19e3675ed474fb3c539a026c350f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:54:59.427421 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2061/4123] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:54:58 2022] DELETE /identity/v3/users/86e19e3675ed474fb3c539a026c350f7 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:54:59.482800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438781f-10c7-4f09-8d92-40baa494c632 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:59.716987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:59.720349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:59.721973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:59.724377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:59.730957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:59.737537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:59.780681 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2063/4124] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:54:59 2022] POST /identity/v3/users => generated 292 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:54:59.782269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:59.784048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:54:59.810051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856079-231c-4a6c-938a-f01356f68e35 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:59.830511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:59.831365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:59.831853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:59.832151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:59.832944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:59.834660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:59.856574 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2062/4125] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:59.863867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:59.903998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbad15-a001-415c-8657-3a8543fc45dc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:59.909757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fb779-f7b9-4364-b77f-826e7c6a3fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:59.912285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fb779-f7b9-4364-b77f-826e7c6a3fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:59.912823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fb779-f7b9-4364-b77f-826e7c6a3fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:59.913304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fb779-f7b9-4364-b77f-826e7c6a3fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:54:59.916252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fb779-f7b9-4364-b77f-826e7c6a3fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:54:59.919963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fb779-f7b9-4364-b77f-826e7c6a3fdd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:54:59.948107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:54:59.949240 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2064/4126] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:54:59.964622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d04c46-ff30-48c6-9e7a-84a5d17197e8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:54:59.975934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:54:59.977606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:54:59.979104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:54:59.979671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] PATH_INFO: `/v3/projects/e94ba6f2b9e142fda529155186d7bc67/users/8b5926ae01df40cdb973634e6ce466e0/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.011933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94ba6f2b9e142fda529155186d7bc67, user_id=8b5926ae01df40cdb973634e6ce466e0, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.015046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.036387 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2063/4127] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:54:59 2022] PUT /identity/v3/projects/e94ba6f2b9e142fda529155186d7bc67/users/8b5926ae01df40cdb973634e6ce466e0/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:00.049168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2f01-a483-4b16-823f-1b8a6d3db3af None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.049740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2f01-a483-4b16-823f-1b8a6d3db3af None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.049740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb2f01-a483-4b16-823f-1b8a6d3db3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.081099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.083004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:00.084300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13cb2f01-a483-4b16-823f-1b8a6d3db3af None None] MFA Rules not processed for user `8b5926ae01df40cdb973634e6ce466e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:00.085569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13cb2f01-a483-4b16-823f-1b8a6d3db3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:00.142625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:00.208713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d367-fc30-4d99-95df-12f4d8f18ff2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.219052 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2065/4128] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:00.219423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.220390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.220678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.221215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] PATH_INFO: `/v3/projects/d71e1f949ce54c58a6ddf5d328cc6ba1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.223209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71e1f949ce54c58a6ddf5d328cc6ba1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.226292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.229604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb2f01-a483-4b16-823f-1b8a6d3db3af None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.269840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb2f01-a483-4b16-823f-1b8a6d3db3af None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.281949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.283029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.283388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.283586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.284484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.286839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.301229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71e1f949ce54c58a6ddf5d328cc6ba1', 'request_id': 'req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.312336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71e1f949ce54c58a6ddf5d328cc6ba1', 'request_id': 'req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.321726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71e1f949ce54c58a6ddf5d328cc6ba1', 'request_id': 'req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.323456 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2066/4129] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:00 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:00.324793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.328320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:00.337006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] The token cache is being invalidate because project d71e1f949ce54c58a6ddf5d328cc6ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:00.337300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.338700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.340931 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2064/4130] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:00 2022] DELETE /identity/v3/projects/d71e1f949ce54c58a6ddf5d328cc6ba1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:00.341387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.344403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:00.408221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:00.462096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7a8fe-9c74-4b77-b7d8-14e0831842f1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.470642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0cd17-7432-4eab-b1f9-0daa2de5773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.470956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474d24b-06d6-4461-8891-48d6737c4b55 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.472079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0cd17-7432-4eab-b1f9-0daa2de5773a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.472582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0cd17-7432-4eab-b1f9-0daa2de5773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.472993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0cd17-7432-4eab-b1f9-0daa2de5773a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.473968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0cd17-7432-4eab-b1f9-0daa2de5773a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.476169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.476871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0cd17-7432-4eab-b1f9-0daa2de5773a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.477338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.477338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.477669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] PATH_INFO: `/v3/users/a17530aa8b8a42f19d738bf4aacf3c07` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.479323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17530aa8b8a42f19d738bf4aacf3c07)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.481344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.507898 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2065/4131] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:00 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:00.510036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566c671-916f-4ecf-bf75-c43760933a75 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.510427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566c671-916f-4ecf-bf75-c43760933a75 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.510971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566c671-916f-4ecf-bf75-c43760933a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.539666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c566c671-916f-4ecf-bf75-c43760933a75 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:00.542679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c566c671-916f-4ecf-bf75-c43760933a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:00.555462 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2066/4132] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:00.555462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566c671-916f-4ecf-bf75-c43760933a75 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.567316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17530aa8b8a42f19d738bf4aacf3c07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.578953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566c671-916f-4ecf-bf75-c43760933a75 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.584090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17530aa8b8a42f19d738bf4aacf3c07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.588346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb560e07-b73a-45b6-b58c-8b80cb298a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.589376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560e07-b73a-45b6-b58c-8b80cb298a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.589822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560e07-b73a-45b6-b58c-8b80cb298a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.590304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560e07-b73a-45b6-b58c-8b80cb298a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.591173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb560e07-b73a-45b6-b58c-8b80cb298a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.593155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb560e07-b73a-45b6-b58c-8b80cb298a9d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.598752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17530aa8b8a42f19d738bf4aacf3c07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.600030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17530aa8b8a42f19d738bf4aacf3c07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.607322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2067/4133] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:00.612379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347d43-1f22-42b2-aecd-8bb42b23ec65 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.612954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347d43-1f22-42b2-aecd-8bb42b23ec65 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.613353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347d43-1f22-42b2-aecd-8bb42b23ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.616394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17530aa8b8a42f19d738bf4aacf3c07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:00.628748 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2067/4134] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:00 2022] DELETE /identity/v3/users/a17530aa8b8a42f19d738bf4aacf3c07 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:00.630658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.638395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e347d43-1f22-42b2-aecd-8bb42b23ec65 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:00.640871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e347d43-1f22-42b2-aecd-8bb42b23ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:00.646057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:00.726204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:00.772253 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2068/4135] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:00.777708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347d43-1f22-42b2-aecd-8bb42b23ec65 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.791732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347d43-1f22-42b2-aecd-8bb42b23ec65 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.804862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.805819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.806229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.807478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.808352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:00.808741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.810530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.826080 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2069/4136] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:55:00.833064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.837911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e13616-a1ec-4ec6-8f70-cb6c09f0979c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.849715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.851212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.851405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57c12-af50-4dfb-9ee8-9b3b63e68425 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:00.851795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.852304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] PATH_INFO: `/v3/projects/f89968da76af4260b6d467027326dd3b/users/2844cd1a0b99480b93e642b893e44f1b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.859357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:00.860464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:00.861011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:00.861362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:00.862179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.864300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.880265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89968da76af4260b6d467027326dd3b, user_id=2844cd1a0b99480b93e642b893e44f1b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:00.885863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:00.904781 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2070/4137] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:00 2022] POST /identity/v3/projects => generated 411 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:00.909085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:00.917815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2068/4138] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:00 2022] PUT /identity/v3/projects/f89968da76af4260b6d467027326dd3b/users/2844cd1a0b99480b93e642b893e44f1b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:00.921719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.016205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523642ec-36e1-4523-8c67-ea020da1ffa0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.022119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.022984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.023300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.023605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.024368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.026949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.042756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e4f84-21cc-42f3-8993-ddcadd1ddb9c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.049865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.050803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.050930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.051403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.052197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.054217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.054828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2071/4139] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:00 2022] POST /identity/v3/users => generated 306 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:01.055910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.060769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:01.067065 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2069/4140] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:01.067962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.077350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f754df-4792-44fa-a6aa-8ebff808a5ae admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.079074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfed8-5bf4-40b2-bd56-1456eadafb5a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.084615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.084892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.085563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.085671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.085855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.086099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.086200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.086463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] PATH_INFO: `/v3/projects/8bc64c6200fc44c1a310da04279013c4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.086899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.088581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc64c6200fc44c1a310da04279013c4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.089142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.091571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.094852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:01.101733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2070/4141] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:01.102629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.118500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7476b-323a-4a0b-ba75-35fc07c1d7b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.124937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.125902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.126197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.126503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] PATH_INFO: `/v3/projects/f89968da76af4260b6d467027326dd3b/users/2844cd1a0b99480b93e642b893e44f1b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.128761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89968da76af4260b6d467027326dd3b, user_id=2844cd1a0b99480b93e642b893e44f1b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.132013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.145621 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2071/4142] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:01 2022] PUT /identity/v3/projects/f89968da76af4260b6d467027326dd3b/users/2844cd1a0b99480b93e642b893e44f1b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:01.146517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.159638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc64c6200fc44c1a310da04279013c4', 'request_id': 'req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:01.171941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc64c6200fc44c1a310da04279013c4', 'request_id': 'req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:01.185564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc64c6200fc44c1a310da04279013c4', 'request_id': 'req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:01.205988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] The token cache is being invalidate because project 8bc64c6200fc44c1a310da04279013c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:01.206492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:01.207619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf4540a1-2fc0-40a3-a8d7-ee47c82f90de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:01.210544 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2072/4143] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:01 2022] DELETE /identity/v3/projects/8bc64c6200fc44c1a310da04279013c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:01.213164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818fe35-9dee-434a-bede-9230f16ca456 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.213666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818fe35-9dee-434a-bede-9230f16ca456 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.216097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818fe35-9dee-434a-bede-9230f16ca456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.251135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d44c-7512-4164-8500-a867365c5b4c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.270983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1818fe35-9dee-434a-bede-9230f16ca456 None None] MFA Rules not processed for user `2844cd1a0b99480b93e642b893e44f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:01.273023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1818fe35-9dee-434a-bede-9230f16ca456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:01.289634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:01.342278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a67b8-c312-4f90-be9d-5fd01c3ddc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.344681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a67b8-c312-4f90-be9d-5fd01c3ddc63 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.345177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a67b8-c312-4f90-be9d-5fd01c3ddc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.345486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a67b8-c312-4f90-be9d-5fd01c3ddc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.346392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a67b8-c312-4f90-be9d-5fd01c3ddc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.348554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a67b8-c312-4f90-be9d-5fd01c3ddc63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.365125 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2072/4144] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:01.366691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.366986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.367302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.390843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:01.392423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:01.408662 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2073/4145] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:01.409652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.411765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:01.425119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24193650-193a-4cdb-abaf-b525c55a164e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.431068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.432104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.432389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.434219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] PATH_INFO: `/v3/projects/5f57ddb2b91c4d3a990940c4981b1027/users/15a3f20609fe44efb15c000d3dd106a3/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.456740 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2073/4146] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:01.459494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a755-ccb6-4f0e-8de5-3593da3a5f10 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.460033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a755-ccb6-4f0e-8de5-3593da3a5f10 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.460638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a755-ccb6-4f0e-8de5-3593da3a5f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.466725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f57ddb2b91c4d3a990940c4981b1027, user_id=15a3f20609fe44efb15c000d3dd106a3, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.473596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.491551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6488a755-ccb6-4f0e-8de5-3593da3a5f10 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:01.493398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6488a755-ccb6-4f0e-8de5-3593da3a5f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:01.500536 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2074/4147] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:01 2022] PUT /identity/v3/projects/5f57ddb2b91c4d3a990940c4981b1027/users/15a3f20609fe44efb15c000d3dd106a3/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:01.508462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.516322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:01.590727 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2074/4148] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:01.590727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6614d04-4de5-4d63-8728-a7a937174aeb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.590727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6614d04-4de5-4d63-8728-a7a937174aeb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.591105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6614d04-4de5-4d63-8728-a7a937174aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.641595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e9ec-e95f-442f-a4d1-99742df0289f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.644248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c6614d04-4de5-4d63-8728-a7a937174aeb None None] MFA Rules not processed for user `15a3f20609fe44efb15c000d3dd106a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:01.646231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c6614d04-4de5-4d63-8728-a7a937174aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:01.647925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.648672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.648968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.649259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.653887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:01.746485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.749908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.752371 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2075/4149] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:01.753328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6614d04-4de5-4d63-8728-a7a937174aeb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.768456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6614d04-4de5-4d63-8728-a7a937174aeb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.769967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2075/4150] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:01.771584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.776943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.777653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.777977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.779851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.781155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:01.781666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.784206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.791249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed0e37-0b31-4fb1-8d62-889c2ac796c9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.801147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.802283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.802745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.803208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.804743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.809166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.817459 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2076/4151] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:01.824019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.845987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db24f9-77b5-4ea7-88d6-5222b08cfb04 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:01.855674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:01.856824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:01.857341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:01.857853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:01.859216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:01.863073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:01.877208 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2076/4152] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/projects => generated 411 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:01.882002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.889015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:01.922171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2077/4153] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:01.923987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:01.982102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447326d-ef62-4074-ae1d-0264d02a307f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.079720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57bc3b-fd87-4066-814a-4cb6b31a2e8e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.096972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.100734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.101369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.101983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.103635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.112189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.161606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.162557 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2078/4154] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:02.163236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.163837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.164405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.165884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.167802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.170919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.180412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458bb2f-6cc2-4834-828c-aa89ca834b7b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.192534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.192534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.192534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.192534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.193841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.194916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.220712 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2079/4155] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:02.220712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.240076 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2077/4156] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:01 2022] POST /identity/v3/users => generated 312 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:02.246832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.274760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3c9a-4991-4131-8a67-10e63157abef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.280605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162af9-4fed-48c1-a255-c5074aa043cc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.284132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.285107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.285416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.285715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.288112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.292005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.301503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.302831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.303407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.303920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.305819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.310242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.312644 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2080/4157] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:02.316919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.334708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3e3c-0bc7-4052-87e2-37b2ad0644b0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.337332 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2078/4158] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:02.342919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd289321-5c09-4b54-a25e-702e26ba2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.344595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd289321-5c09-4b54-a25e-702e26ba2702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.344896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd289321-5c09-4b54-a25e-702e26ba2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.345721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd289321-5c09-4b54-a25e-702e26ba2702 admin admin] PATH_INFO: `/v3/projects/158b74e5a163458cb9b6249e9076c7ca/users/2547a4f7fa834940b3deb6ac2a4f595d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.345911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.367976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c1c4f-a41e-422f-b618-d81a8106d6de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.374194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.375146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.375474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.375765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] PATH_INFO: `/v3/projects/734af38208bb4c3f8943c63b356b7128/users/05698a0044cb4fec94d6c7f6f7f90ec9/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.380739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd289321-5c09-4b54-a25e-702e26ba2702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158b74e5a163458cb9b6249e9076c7ca, user_id=2547a4f7fa834940b3deb6ac2a4f595d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.387491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd289321-5c09-4b54-a25e-702e26ba2702 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.404593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734af38208bb4c3f8943c63b356b7128, user_id=05698a0044cb4fec94d6c7f6f7f90ec9, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.408709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.418051 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2081/4159] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:02 2022] PUT /identity/v3/projects/158b74e5a163458cb9b6249e9076c7ca/users/2547a4f7fa834940b3deb6ac2a4f595d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:02.431146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46946-39f8-40d0-a97a-b1dd36132838 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.431550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46946-39f8-40d0-a97a-b1dd36132838 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.432230 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2079/4160] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:02 2022] PUT /identity/v3/projects/734af38208bb4c3f8943c63b356b7128/users/05698a0044cb4fec94d6c7f6f7f90ec9/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:02.432458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46946-39f8-40d0-a97a-b1dd36132838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.433478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.435573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:02.507408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:02.514078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fde46946-39f8-40d0-a97a-b1dd36132838 None None] MFA Rules not processed for user `2547a4f7fa834940b3deb6ac2a4f595d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:02.518141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fde46946-39f8-40d0-a97a-b1dd36132838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:02.566170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ec28d-b491-4553-92cf-cd35f0313252 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:02.572270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:02.573920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:02.574211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:02.574760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] PATH_INFO: `/v3/users/8b5926ae01df40cdb973634e6ce466e0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:02.576515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5926ae01df40cdb973634e6ce466e0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:02.578977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:02.590595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:02.684866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5926ae01df40cdb973634e6ce466e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:02.723733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5926ae01df40cdb973634e6ce466e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:02.741510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5926ae01df40cdb973634e6ce466e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:02.743146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5926ae01df40cdb973634e6ce466e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:02.773667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2082/4161] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:02.773667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46946-39f8-40d0-a97a-b1dd36132838 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.780368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5926ae01df40cdb973634e6ce466e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:02.800702 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2080/4162] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:02 2022] DELETE /identity/v3/users/8b5926ae01df40cdb973634e6ce466e0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:02.802831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:02.808795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:02.840180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46946-39f8-40d0-a97a-b1dd36132838 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:03.067670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58796e-467e-4d5c-a649-deec41100c0d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:03.074602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ccf1c-0b2e-49e9-b475-e4685fdd790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:03.075875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ccf1c-0b2e-49e9-b475-e4685fdd790e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:03.076379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ccf1c-0b2e-49e9-b475-e4685fdd790e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:03.076878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ccf1c-0b2e-49e9-b475-e4685fdd790e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:03.078526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ccf1c-0b2e-49e9-b475-e4685fdd790e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:03.091092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5febb-412e-4e0a-aa0e-07f0ef8f7e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:03.092518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ccf1c-0b2e-49e9-b475-e4685fdd790e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:03.095761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5febb-412e-4e0a-aa0e-07f0ef8f7e5b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:03.096403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5febb-412e-4e0a-aa0e-07f0ef8f7e5b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:03.096924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5febb-412e-4e0a-aa0e-07f0ef8f7e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:03.110201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e6f5febb-412e-4e0a-aa0e-07f0ef8f7e5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:03.137519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2083/4163] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:03.137519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:03.137519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:03.145273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:03.207619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:03.211615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:03.230968 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2084/4164] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:03.233209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:03.236278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:03.266754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a783b8-8dea-4a6b-bda2-39a1a1514d60 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:03.279126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:03.281639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:03.284126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:03.284994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] PATH_INFO: `/v3/projects/734af38208bb4c3f8943c63b356b7128/users/05698a0044cb4fec94d6c7f6f7f90ec9/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:03.289548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734af38208bb4c3f8943c63b356b7128, user_id=05698a0044cb4fec94d6c7f6f7f90ec9, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:03.296939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:03.363113 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2085/4165] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:03 2022] PUT /identity/v3/projects/734af38208bb4c3f8943c63b356b7128/users/05698a0044cb4fec94d6c7f6f7f90ec9/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:03.373904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:03.376037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:03.419885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5febb-412e-4e0a-aa0e-07f0ef8f7e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:03.429224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5febb-412e-4e0a-aa0e-07f0ef8f7e5b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:03.476151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2081/4166] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:03.479615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d977-f3d8-493a-bc58-e47c74a24074 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:03.480500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d977-f3d8-493a-bc58-e47c74a24074 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:03.481205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d977-f3d8-493a-bc58-e47c74a24074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:03.482340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0885cd-17f2-4f51-bd67-42df6c40ced3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:03.486699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:03.487424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:03.487713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:03.487995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:03.533469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5cf3d977-f3d8-493a-bc58-e47c74a24074 None None] MFA Rules not processed for user `05698a0044cb4fec94d6c7f6f7f90ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:03.537141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5cf3d977-f3d8-493a-bc58-e47c74a24074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:03.545348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:03.562213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:03.646913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:03.655910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:03.696531 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2082/4167] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:03.715581 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2086/4168] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:55:03.812636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d977-f3d8-493a-bc58-e47c74a24074 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:03.858813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d977-f3d8-493a-bc58-e47c74a24074 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:03.879598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:03.881403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:03.882257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:03.883048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:03.932573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:03.938476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:03.984730 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2083/4169] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:05.364176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:05.366142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:05.390880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8782-1b3c-4762-8e94-178c91393e31 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:05.404257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:05.407113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:05.407813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:05.408403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] PATH_INFO: `/v3/projects/e94ba6f2b9e142fda529155186d7bc67` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:05.412488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94ba6f2b9e142fda529155186d7bc67)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:05.417779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:05.549503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94ba6f2b9e142fda529155186d7bc67', 'request_id': 'req-8a03b05b-780c-40c2-b9c5-a5eab8934726'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.573438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94ba6f2b9e142fda529155186d7bc67', 'request_id': 'req-8a03b05b-780c-40c2-b9c5-a5eab8934726'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.595634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94ba6f2b9e142fda529155186d7bc67', 'request_id': 'req-8a03b05b-780c-40c2-b9c5-a5eab8934726'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.632902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] The token cache is being invalidate because project e94ba6f2b9e142fda529155186d7bc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:05.634221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.636234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.639918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2087/4170] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:05 2022] DELETE /identity/v3/projects/e94ba6f2b9e142fda529155186d7bc67 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:05.644946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:05.661143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5a14-f6cf-4930-b67a-955a396e78cc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:05.842606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:05.843593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:05.843917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:05.844209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] PATH_INFO: `/v3/users/2844cd1a0b99480b93e642b893e44f1b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:05.845678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2844cd1a0b99480b93e642b893e44f1b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:05.848867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:05.925621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2844cd1a0b99480b93e642b893e44f1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.951726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2844cd1a0b99480b93e642b893e44f1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.965641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2844cd1a0b99480b93e642b893e44f1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:05.966738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2844cd1a0b99480b93e642b893e44f1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:06.036275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9724dd0b-737b-4c72-bd4a-9429dfa9cc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2844cd1a0b99480b93e642b893e44f1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:06.086772 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2084/4171] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:05 2022] DELETE /identity/v3/users/2844cd1a0b99480b93e642b893e44f1b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:07.663357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:07.668795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:07.751446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b05b-780c-40c2-b9c5-a5eab8934726 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:08.086347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:08.089091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:08.089602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:08.090086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] PATH_INFO: `/v3/projects/f89968da76af4260b6d467027326dd3b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:08.092782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89968da76af4260b6d467027326dd3b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:08.111701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:08.320144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89968da76af4260b6d467027326dd3b', 'request_id': 'req-3c3aa265-b374-466a-b66b-6652c4a30454'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:08.340008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:08.360847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89968da76af4260b6d467027326dd3b', 'request_id': 'req-3c3aa265-b374-466a-b66b-6652c4a30454'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:08.388513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89968da76af4260b6d467027326dd3b', 'request_id': 'req-3c3aa265-b374-466a-b66b-6652c4a30454'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:08.433262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] The token cache is being invalidate because project f89968da76af4260b6d467027326dd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:08.433570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:08.436015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c3aa265-b374-466a-b66b-6652c4a30454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:08.441702 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2088/4172] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:07 2022] DELETE /identity/v3/projects/f89968da76af4260b6d467027326dd3b => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:08.449201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662d20c-645a-424e-ba73-cb1db308e924 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:08.450337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662d20c-645a-424e-ba73-cb1db308e924 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:08.450337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662d20c-645a-424e-ba73-cb1db308e924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:08.471114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d662d20c-645a-424e-ba73-cb1db308e924 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:08.472573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d662d20c-645a-424e-ba73-cb1db308e924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:08.488539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:08.695205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2085/4173] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:08.698538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a303f-ecd7-41bb-a415-4005ae35031c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:08.699852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a303f-ecd7-41bb-a415-4005ae35031c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:08.700491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a303f-ecd7-41bb-a415-4005ae35031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:08.738343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-251a303f-ecd7-41bb-a415-4005ae35031c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:08.739946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-251a303f-ecd7-41bb-a415-4005ae35031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:08.760461 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2089/4174] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:08.762916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662d20c-645a-424e-ba73-cb1db308e924 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:08.786541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662d20c-645a-424e-ba73-cb1db308e924 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:08.797647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:08.799579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:08.800040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:08.800428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:08.801649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:08.803603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:08.805480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:08.842845 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2086/4175] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:08.843885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a303f-ecd7-41bb-a415-4005ae35031c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:08.866172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a303f-ecd7-41bb-a415-4005ae35031c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:08.897322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:08.898514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:08.899047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:08.899621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:08.901108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:08.905080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:09.026955 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2090/4176] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:08 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:09.029604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:09.049280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8bf3b-d05d-4399-a9ea-c0ab8479deb4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:09.159134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:09.159873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:09.160159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:09.160450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:09.161157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:09.163809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:09.197510 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2087/4177] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:09 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:09.207910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:09.240891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfda01-f5f0-4d20-90b2-4b968ba132dc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:09.261758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:09.262903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:09.263402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:09.263890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:09.265241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:09.272038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:09.323435 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2091/4178] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:09.326287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:09.350135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246432-ef29-459b-a12d-361b1c1c19b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:09.363141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d40a9-64d7-49be-9885-cac4010f9b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:09.368397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d40a9-64d7-49be-9885-cac4010f9b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:09.368397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d40a9-64d7-49be-9885-cac4010f9b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:09.368796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d40a9-64d7-49be-9885-cac4010f9b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:09.372462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d40a9-64d7-49be-9885-cac4010f9b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:09.374174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d40a9-64d7-49be-9885-cac4010f9b27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:09.401986 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2088/4179] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:09.403234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:09.433496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e31fe-14c5-40bb-b67c-5e2a87bf1fb9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:09.450726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:09.450726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:09.450726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:09.450726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] PATH_INFO: `/v3/projects/af17cfa3990045af8264821d2cdf201c/users/f61474aa06ee4d27a9ee93419d6b157e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:09.495192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af17cfa3990045af8264821d2cdf201c, user_id=f61474aa06ee4d27a9ee93419d6b157e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:09.507547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:09.560356 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2092/4180] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:09 2022] PUT /identity/v3/projects/af17cfa3990045af8264821d2cdf201c/users/f61474aa06ee4d27a9ee93419d6b157e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:09.572089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27d0e-2282-4f54-b7ac-98bcd71f8269 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:09.572925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27d0e-2282-4f54-b7ac-98bcd71f8269 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:09.572925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27d0e-2282-4f54-b7ac-98bcd71f8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:09.649102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-62e27d0e-2282-4f54-b7ac-98bcd71f8269 None None] MFA Rules not processed for user `f61474aa06ee4d27a9ee93419d6b157e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:09.652632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62e27d0e-2282-4f54-b7ac-98bcd71f8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:09.806194 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2089/4181] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:09.810724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:09.956835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277b183-e6ab-466b-b410-bc4fb19b9528 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:09.963589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:09.964923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:09.965230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:09.966186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:09.966881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:09.969775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:10.024331 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2093/4182] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:09 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:10.029441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27d0e-2282-4f54-b7ac-98bcd71f8269 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:10.043981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27d0e-2282-4f54-b7ac-98bcd71f8269 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:10.051260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:10.065867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:10.071113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:10.129908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:10.130623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:10.130910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:10.131193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:10.132206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:10.134640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:10.185662 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2090/4183] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:10 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:10.186789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:10.226094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8b34-32a7-4de7-a4ff-07a3e783e888 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:10.230502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:10.252499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d74c-9bff-4e0f-9c4c-a05d809a2137 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:10.256403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:10.257536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:10.258020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:10.258926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:10.260037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:10.263383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:10.271984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:10.274766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:10.274766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:10.276223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] PATH_INFO: `/v3/users/15a3f20609fe44efb15c000d3dd106a3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:10.280320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a3f20609fe44efb15c000d3dd106a3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:10.284366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:10.313836 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2091/4184] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:10.318569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:10.340222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05c2b6-c566-4622-85f1-e3e469664264 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:10.349792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:10.352003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:10.352724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:10.353090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] PATH_INFO: `/v3/projects/8dc466f99af0406fb17a593609151fe2/users/0d45318372c34c469c2c705303ac94d9/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:10.389011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc466f99af0406fb17a593609151fe2, user_id=0d45318372c34c469c2c705303ac94d9, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:10.396131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:10.434160 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2092/4185] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:10 2022] PUT /identity/v3/projects/8dc466f99af0406fb17a593609151fe2/users/0d45318372c34c469c2c705303ac94d9/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:10.440505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:10.502558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a3f20609fe44efb15c000d3dd106a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:10.535236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a3f20609fe44efb15c000d3dd106a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:10.538418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a3f20609fe44efb15c000d3dd106a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:10.540952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49f7e-da63-4f45-8592-e428d79bbe72 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:10.547904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:10.548620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:10.549042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:10.549315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:10.550079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:10.551912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:10.568322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a3f20609fe44efb15c000d3dd106a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:10.578943 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2093/4186] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:10.582252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a3f20609fe44efb15c000d3dd106a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:10.585465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:10.589399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:10.614993 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2094/4187] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:10 2022] DELETE /identity/v3/users/15a3f20609fe44efb15c000d3dd106a3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:10.616443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:10.620676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:10.940646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:10.959427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356d523-af7c-4cae-b28a-7afa29b47006 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:10.986002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f187b05-0a62-4344-9f64-0c639a22afbd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:11.002443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370304a-7900-4b1b-b556-e3c44da64363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:11.003760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370304a-7900-4b1b-b556-e3c44da64363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:11.004295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370304a-7900-4b1b-b556-e3c44da64363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:11.005389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370304a-7900-4b1b-b556-e3c44da64363 admin admin] PATH_INFO: `/v3/projects/8dc466f99af0406fb17a593609151fe2/users/0d45318372c34c469c2c705303ac94d9/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:11.007931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370304a-7900-4b1b-b556-e3c44da64363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc466f99af0406fb17a593609151fe2, user_id=0d45318372c34c469c2c705303ac94d9, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:11.011372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370304a-7900-4b1b-b556-e3c44da64363 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:11.063743 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2095/4188] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:10 2022] PUT /identity/v3/projects/8dc466f99af0406fb17a593609151fe2/users/0d45318372c34c469c2c705303ac94d9/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:11.063743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:11.063743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:11.063743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:11.102689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204689a-d292-4ea0-abbc-f0cb7979c608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:11.104275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204689a-d292-4ea0-abbc-f0cb7979c608 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:11.104761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204689a-d292-4ea0-abbc-f0cb7979c608 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:11.107299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204689a-d292-4ea0-abbc-f0cb7979c608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:11.108540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:11.110701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e204689a-d292-4ea0-abbc-f0cb7979c608 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:11.110890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:11.134272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204689a-d292-4ea0-abbc-f0cb7979c608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:11.137380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204689a-d292-4ea0-abbc-f0cb7979c608 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:11.164574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2094/4189] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:11.166490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:11.173927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:11.174131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:11.265120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] MFA Rules not processed for user `0d45318372c34c469c2c705303ac94d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:11.269018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:11.317774 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2096/4190] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:11.332852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:11.335128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:11.352936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:11.475106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098faf-4f84-4e54-ba0c-6e118848ea33 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:11.485510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:11.487880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:11.488666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:11.491167 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2095/4191] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:11.493809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:11.507677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:11.510100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:11.528159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:11.531611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:11.557539 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2097/4192] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:55:11.662164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb60fd-b38c-422f-8c57-40bd3feb1f92 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:11.674384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:11.675601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:11.675981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:11.676476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:11.694478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:11.698208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:11.719575 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2096/4193] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:55:12.218513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:12.222133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:12.290466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcc8bc-b2c4-4262-aaf7-ccfa884e877d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:12.305534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:12.311848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:12.311848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:12.313990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] PATH_INFO: `/v3/projects/5f57ddb2b91c4d3a990940c4981b1027` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:12.318454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f57ddb2b91c4d3a990940c4981b1027)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:12.333511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:12.487088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f57ddb2b91c4d3a990940c4981b1027', 'request_id': 'req-0fe08de8-3e9a-404a-b154-e9336b7d82f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:12.514724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f57ddb2b91c4d3a990940c4981b1027', 'request_id': 'req-0fe08de8-3e9a-404a-b154-e9336b7d82f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:12.532680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f57ddb2b91c4d3a990940c4981b1027', 'request_id': 'req-0fe08de8-3e9a-404a-b154-e9336b7d82f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:12.589603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] The token cache is being invalidate because project 5f57ddb2b91c4d3a990940c4981b1027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:12.591357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:12.592984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:12.599407 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2098/4194] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:12 2022] DELETE /identity/v3/projects/5f57ddb2b91c4d3a990940c4981b1027 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:12.604019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:12.613488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:12.640845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84ec99-8c06-4c6e-88e5-2d22775fbf9f service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:12.825657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:12.828800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:12.954300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:12.955921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:12.956438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:12.956953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] PATH_INFO: `/v3/users/05698a0044cb4fec94d6c7f6f7f90ec9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:12.976861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05698a0044cb4fec94d6c7f6f7f90ec9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:12.990780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:13.064529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe08de8-3e9a-404a-b154-e9336b7d82f2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:13.085033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:13.091020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:13.091398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:13.091688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] PATH_INFO: `/v3/users/f61474aa06ee4d27a9ee93419d6b157e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:13.095124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61474aa06ee4d27a9ee93419d6b157e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:13.104788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:13.179949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05698a0044cb4fec94d6c7f6f7f90ec9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.189097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:13.204105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61474aa06ee4d27a9ee93419d6b157e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.222937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05698a0044cb4fec94d6c7f6f7f90ec9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.226869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61474aa06ee4d27a9ee93419d6b157e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.229192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61474aa06ee4d27a9ee93419d6b157e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.246983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05698a0044cb4fec94d6c7f6f7f90ec9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.251645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05698a0044cb4fec94d6c7f6f7f90ec9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.255342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61474aa06ee4d27a9ee93419d6b157e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.256680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f95db451-7d76-4372-8b82-49227ef628bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61474aa06ee4d27a9ee93419d6b157e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.288142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05698a0044cb4fec94d6c7f6f7f90ec9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:13.296665 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2099/4195] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:12 2022] DELETE /identity/v3/users/f61474aa06ee4d27a9ee93419d6b157e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:13.309048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:13.309563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:13.310089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:13.326718 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2097/4196] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:12 2022] DELETE /identity/v3/users/05698a0044cb4fec94d6c7f6f7f90ec9 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:13.403225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:13.409026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:13.637212 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2100/4197] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:13.661297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:13.666339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:13.878844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1387b2-2bde-46e6-ba7a-efbb28c11370 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:13.890456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f46e0a-84af-4036-b70c-20a1a31e887d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:13.893875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f46e0a-84af-4036-b70c-20a1a31e887d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:13.895229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f46e0a-84af-4036-b70c-20a1a31e887d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:13.896149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f46e0a-84af-4036-b70c-20a1a31e887d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:13.927457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f46e0a-84af-4036-b70c-20a1a31e887d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:13.933623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f46e0a-84af-4036-b70c-20a1a31e887d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:13.958404 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2098/4198] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:14.814518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:14.817208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:14.838525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e329-7795-41a8-9b70-c2e8d87093f4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:14.844777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:14.845991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:14.846479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:14.847076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] PATH_INFO: `/v3/projects/734af38208bb4c3f8943c63b356b7128` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:14.848897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734af38208bb4c3f8943c63b356b7128)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:14.851139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:14.955881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734af38208bb4c3f8943c63b356b7128', 'request_id': 'req-d6957164-3f9e-4f27-9dce-d3f3aebdc955'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:14.998561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734af38208bb4c3f8943c63b356b7128', 'request_id': 'req-d6957164-3f9e-4f27-9dce-d3f3aebdc955'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:15.036421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734af38208bb4c3f8943c63b356b7128', 'request_id': 'req-d6957164-3f9e-4f27-9dce-d3f3aebdc955'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:15.146004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] The token cache is being invalidate because project 734af38208bb4c3f8943c63b356b7128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:15.146526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:15.152558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6957164-3f9e-4f27-9dce-d3f3aebdc955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:15.159369 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2101/4199] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:14 2022] DELETE /identity/v3/projects/734af38208bb4c3f8943c63b356b7128 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:15.167333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa01a-09a5-4be7-8f07-24b3a86ec11a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:15.168024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa01a-09a5-4be7-8f07-24b3a86ec11a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:15.168485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa01a-09a5-4be7-8f07-24b3a86ec11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:15.242754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f07fa01a-09a5-4be7-8f07-24b3a86ec11a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:15.250692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f07fa01a-09a5-4be7-8f07-24b3a86ec11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:15.332004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:15.488380 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2099/4200] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:15.508308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778912-7b56-436c-a3e0-818ab4cca522 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:15.511072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778912-7b56-436c-a3e0-818ab4cca522 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:15.515657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778912-7b56-436c-a3e0-818ab4cca522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:15.589179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b4778912-7b56-436c-a3e0-818ab4cca522 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:15.592062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b4778912-7b56-436c-a3e0-818ab4cca522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:15.612538 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2102/4201] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:15.619903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fa01a-09a5-4be7-8f07-24b3a86ec11a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:15.654183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fa01a-09a5-4be7-8f07-24b3a86ec11a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:15.665196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:15.666227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:15.666954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:15.667160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:15.669965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:15.670456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:15.677787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:15.716010 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2100/4202] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:15.723214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4778912-7b56-436c-a3e0-818ab4cca522 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:15.745487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4778912-7b56-436c-a3e0-818ab4cca522 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:15.773717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2640f-06be-46c1-80c2-3476956a2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:15.783896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2640f-06be-46c1-80c2-3476956a2bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:15.784669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2640f-06be-46c1-80c2-3476956a2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:15.785298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2640f-06be-46c1-80c2-3476956a2bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:15.788809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2640f-06be-46c1-80c2-3476956a2bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:15.799799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2640f-06be-46c1-80c2-3476956a2bc5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:15.850200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:15.854446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:15.895136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037af81-6c25-433f-bbb1-b234a509df74 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:15.900593 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2103/4203] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:15 2022] POST /identity/v3/projects => generated 391 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:15.902693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:15.902995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:15.903307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:15.910178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:15.913057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:15.916896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:15.917178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] PATH_INFO: `/v3/projects/af17cfa3990045af8264821d2cdf201c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:15.918777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af17cfa3990045af8264821d2cdf201c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:15.920697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:15.970546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] MFA Rules not processed for user `126f8683e55647bc9605e05c7aa654fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:15.971876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:15.989335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:16.087818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af17cfa3990045af8264821d2cdf201c', 'request_id': 'req-1c5ca222-a7b5-48a6-a734-17fcb712a903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.106244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af17cfa3990045af8264821d2cdf201c', 'request_id': 'req-1c5ca222-a7b5-48a6-a734-17fcb712a903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.127204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af17cfa3990045af8264821d2cdf201c', 'request_id': 'req-1c5ca222-a7b5-48a6-a734-17fcb712a903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.155747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] The token cache is being invalidate because project af17cfa3990045af8264821d2cdf201c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:16.155972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.161173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.163660 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2101/4204] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:15 2022] DELETE /identity/v3/projects/af17cfa3990045af8264821d2cdf201c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:16.164679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:16.166820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:16.272657 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2104/4205] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:16.275101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:16.280644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:16.317825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ca222-a7b5-48a6-a734-17fcb712a903 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:16.328351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:16.328947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:16.329249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:16.329678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:16.330419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:16.332486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:16.395060 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2102/4206] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:16 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:16.401696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:16.462250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baee9b-c733-461d-884b-1f8bfbe15b7a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:16.499711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:16.501970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:16.503376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:16.505262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:16.511066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:16.522454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:16.596334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caab84-5982-49c3-a041-b03e63077c83 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:16.601752 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2103/4207] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:16.608738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:16.613816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:16.614918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:16.615221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:16.615514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] PATH_INFO: `/v3/users/0d45318372c34c469c2c705303ac94d9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:16.618456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d45318372c34c469c2c705303ac94d9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:16.629142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:16.655345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ad06d-2497-4bdb-9f21-d042df68d7fa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:16.679076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:16.680248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:16.680716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:16.681335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:16.687115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:16.695196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:16.763261 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2104/4208] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:16.765568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:16.790001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:16.799633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d45318372c34c469c2c705303ac94d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.807608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1c11b-4142-40b7-b2da-4734a61e3151 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:16.825524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d45318372c34c469c2c705303ac94d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.826572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d45318372c34c469c2c705303ac94d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.833100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:16.834928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:16.835466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:16.835976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] PATH_INFO: `/v3/projects/e6a8ca97fef54df591fa4cca8c464fff/users/1668025d16ba420dab2febbd3bcb9f9c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:16.841201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d45318372c34c469c2c705303ac94d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.842527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7d4b4a58-0b69-4d80-a01a-8f58be61177e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d45318372c34c469c2c705303ac94d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:16.881314 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2105/4209] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:16 2022] DELETE /identity/v3/users/0d45318372c34c469c2c705303ac94d9 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:16.911124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a8ca97fef54df591fa4cca8c464fff, user_id=1668025d16ba420dab2febbd3bcb9f9c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:16.917754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:16.949955 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2105/4210] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:16 2022] PUT /identity/v3/projects/e6a8ca97fef54df591fa4cca8c464fff/users/1668025d16ba420dab2febbd3bcb9f9c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:16.972858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da21f78-0957-439c-a8dd-626175f00234 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:16.973473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da21f78-0957-439c-a8dd-626175f00234 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:16.973794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da21f78-0957-439c-a8dd-626175f00234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:17.036898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3da21f78-0957-439c-a8dd-626175f00234 None None] MFA Rules not processed for user `1668025d16ba420dab2febbd3bcb9f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:17.044366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3da21f78-0957-439c-a8dd-626175f00234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:17.162939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:17.374359 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2106/4211] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:17.383430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:17.386661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:17.545083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486b1bf-f4d0-4dd8-97c8-a0d8335e5ba1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:17.545843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486b1bf-f4d0-4dd8-97c8-a0d8335e5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:17.545843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486b1bf-f4d0-4dd8-97c8-a0d8335e5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:17.589096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4486b1bf-f4d0-4dd8-97c8-a0d8335e5ba1 None None] MFA Rules not processed for user `2625ce3aa5034d048494fca0dc403c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:17.602535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637892dc-2451-4334-a6b9-8375d2f37725 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:17.604779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4486b1bf-f4d0-4dd8-97c8-a0d8335e5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:17.621557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:17.622259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:17.622546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:17.622834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:17.623624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:17.625654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:17.697939 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2106/4212] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:17 2022] POST /identity/v3/projects => generated 393 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:17.700108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:17.864762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190864-eb9a-4d4e-8298-8e28ba7a5ecf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:17.879111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:17.880730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:17.881503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:17.882824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:17.901796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:17.924025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:18.003726 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2107/4213] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:17 2022] POST /identity/v3/users => generated 303 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:18.008453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:18.034095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436e2af-eb2a-4ac9-a5e9-a5db2df247e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:18.050201 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2107/4214] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:18.063312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:18.064352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:18.064845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:18.065590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:18.067254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:18.070907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:18.099119 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2108/4215] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:18.105001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486b1bf-f4d0-4dd8-97c8-a0d8335e5ba1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:18.144660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486b1bf-f4d0-4dd8-97c8-a0d8335e5ba1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:18.167563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:18.169331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:18.169645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:18.171100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] PATH_INFO: `/v3/projects/e53e7a6c617344c3ad18e855530dbdc8/users/d600e0863c984f639c4b9561fd7a7dab/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:18.264501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53e7a6c617344c3ad18e855530dbdc8, user_id=d600e0863c984f639c4b9561fd7a7dab, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:18.267785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:18.303603 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2108/4216] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:18 2022] PUT /identity/v3/projects/e53e7a6c617344c3ad18e855530dbdc8/users/d600e0863c984f639c4b9561fd7a7dab/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:18.309996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:18.367981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f463-99bd-4e42-adcf-0b112ee65e84 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:18.559446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:18.573607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:18.579512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:18.601754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:18.602470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:18.603347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:18.603636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:18.604419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:18.609008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:18.638392 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2109/4217] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:18.642735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:18.695244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f66b0-f400-49c0-9522-488b268b6ed2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:18.707878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42b925-e3c7-4c30-879f-0589602a969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:18.708791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42b925-e3c7-4c30-879f-0589602a969a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:18.709083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42b925-e3c7-4c30-879f-0589602a969a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:18.709406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42b925-e3c7-4c30-879f-0589602a969a admin admin] PATH_INFO: `/v3/projects/e53e7a6c617344c3ad18e855530dbdc8/users/d600e0863c984f639c4b9561fd7a7dab/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:18.711666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42b925-e3c7-4c30-879f-0589602a969a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53e7a6c617344c3ad18e855530dbdc8, user_id=d600e0863c984f639c4b9561fd7a7dab, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:18.715117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42b925-e3c7-4c30-879f-0589602a969a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:18.761499 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2110/4218] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:18 2022] PUT /identity/v3/projects/e53e7a6c617344c3ad18e855530dbdc8/users/d600e0863c984f639c4b9561fd7a7dab/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:18.777382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:18.777382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:18.777856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:18.818714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaba92-4f1d-4f27-a9c5-693f27689f37 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:18.888535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] MFA Rules not processed for user `d600e0863c984f639c4b9561fd7a7dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:18.889951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:18.998451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:18.999680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:19.000891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:19.003003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:19.008380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:19.022327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:19.072430 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2111/4219] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:19.072430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:19.072430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:19.228861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ddcf6-bf9e-4784-96a2-6b11fc9c9b6f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:19.237863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:19.238787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:19.239077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:19.239387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] PATH_INFO: `/v3/projects/8dc466f99af0406fb17a593609151fe2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:19.243890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc466f99af0406fb17a593609151fe2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:19.245946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:19.356102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:19.358496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:19.358936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc466f99af0406fb17a593609151fe2', 'request_id': 'req-5d0e360a-bdf8-4e48-9e18-7223643f56b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:19.379396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:19.379396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc466f99af0406fb17a593609151fe2', 'request_id': 'req-5d0e360a-bdf8-4e48-9e18-7223643f56b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:19.393651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc466f99af0406fb17a593609151fe2', 'request_id': 'req-5d0e360a-bdf8-4e48-9e18-7223643f56b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:19.403793 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2109/4220] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:19.405418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:19.413389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:19.424639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] The token cache is being invalidate because project 8dc466f99af0406fb17a593609151fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:19.425007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:19.434450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0e360a-bdf8-4e48-9e18-7223643f56b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:19.436763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2112/4221] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:19 2022] DELETE /identity/v3/projects/8dc466f99af0406fb17a593609151fe2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:19.441674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca581-cbd7-488b-a7b1-68dd498d6b39 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:19.442061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca581-cbd7-488b-a7b1-68dd498d6b39 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:19.442316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca581-cbd7-488b-a7b1-68dd498d6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:19.478659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ac0ca581-cbd7-488b-a7b1-68dd498d6b39 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:19.479967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ac0ca581-cbd7-488b-a7b1-68dd498d6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:19.599724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfaab4-eeda-4b69-90f5-9e1cf9cf90c7 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:19.602485 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2113/4222] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:19.611622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525fc1c-b23c-406e-baef-fc77c3b43cc7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:19.611914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525fc1c-b23c-406e-baef-fc77c3b43cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:19.612187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525fc1c-b23c-406e-baef-fc77c3b43cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:19.652742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6525fc1c-b23c-406e-baef-fc77c3b43cc7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:19.654044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6525fc1c-b23c-406e-baef-fc77c3b43cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:19.683540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2114/4223] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:19.688015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525fc1c-b23c-406e-baef-fc77c3b43cc7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:19.699784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:19.700668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:19.701109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:19.701495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:19.705740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:19.713973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525fc1c-b23c-406e-baef-fc77c3b43cc7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:19.733403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:19.734327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:19.734627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:19.734914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:19.735863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:19.736203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:19.743995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:19.785009 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2115/4224] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:19.790347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:19.815516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e11f7-ccea-4c57-974a-07b9041fbb7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:19.832820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:19.839717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:19.840264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:19.840984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:19.841267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:19.841669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:19.842366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:19.844879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:19.852442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:19.869449 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2110/4225] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:19.915781 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2116/4226] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:19 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:19.921008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:19.968526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c05e4-89aa-43e7-bd72-fcf6aaca5756 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:20.266120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:20.267476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:20.276641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:20.278098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:20.281245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:20.293628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:20.423786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:20.434233 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2111/4227] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:19 2022] POST /identity/v3/users => generated 287 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:20.451145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84dc6-dbf7-4e2a-8fb9-8aa0172283d0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:20.466267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:20.467143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:20.467525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:20.468056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:20.469943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:20.472857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:20.512525 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2117/4228] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:20.517732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:20.596585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b907a-6b33-4fa6-b15f-31bd933718e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:20.640302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25c49e-39f7-4a50-a639-0dfb39c47d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:20.641344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25c49e-39f7-4a50-a639-0dfb39c47d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:20.641803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25c49e-39f7-4a50-a639-0dfb39c47d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:20.642219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25c49e-39f7-4a50-a639-0dfb39c47d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:20.644786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25c49e-39f7-4a50-a639-0dfb39c47d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:20.647477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25c49e-39f7-4a50-a639-0dfb39c47d28 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:20.717350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:20.719534 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2112/4229] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:20.734859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca071-6c60-4e96-b976-09b5674a4d4f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:20.760505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:20.763494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:20.764552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:20.766010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] PATH_INFO: `/v3/projects/aefe9ff4f7f2486f92b7e7557ce0e1f5/users/c8a2d3bf74f04b6ead28e02853b01b95/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:20.863442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefe9ff4f7f2486f92b7e7557ce0e1f5, user_id=c8a2d3bf74f04b6ead28e02853b01b95, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:20.866910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:20.943457 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2118/4230] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:20 2022] PUT /identity/v3/projects/aefe9ff4f7f2486f92b7e7557ce0e1f5/users/c8a2d3bf74f04b6ead28e02853b01b95/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:20.962930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136970-cb5e-4d68-b921-731a3df1ddaf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:20.963459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136970-cb5e-4d68-b921-731a3df1ddaf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:20.963924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136970-cb5e-4d68-b921-731a3df1ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:21.084930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1d136970-cb5e-4d68-b921-731a3df1ddaf None None] MFA Rules not processed for user `c8a2d3bf74f04b6ead28e02853b01b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:21.086248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1d136970-cb5e-4d68-b921-731a3df1ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:21.331258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:21.338333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2113/4231] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:21.465231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94185e-b59a-4c58-b23e-da4c1e04b397 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:21.474326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:21.475072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:21.475860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:21.476226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:21.504586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:21.510476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:21.531110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:21.565203 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2119/4232] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:21 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:21.566079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136970-cb5e-4d68-b921-731a3df1ddaf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:21.590588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136970-cb5e-4d68-b921-731a3df1ddaf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:21.721466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:21.724630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:21.726591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:21.727026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:21.728909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:21.737460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:21.767216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:21.811746 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2114/4233] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:21 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:21.813370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:21.833895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623853e-c541-4433-9d1c-91f1ae143778 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:21.847414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:21.848568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:21.849055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:21.850918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:21.851921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:21.858680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:21.899098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2120/4234] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:21.903788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:21.926404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21841-64a4-452c-8912-ff8e05ed58a1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:21.935916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:21.937958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:21.938553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:21.939182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] PATH_INFO: `/v3/projects/e1570e3155674723b60606737859c7b3/users/d130d10b69d24312980035dfa1ff391e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:22.012037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1570e3155674723b60606737859c7b3, user_id=d130d10b69d24312980035dfa1ff391e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:22.017804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:22.076224 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2115/4235] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:21 2022] PUT /identity/v3/projects/e1570e3155674723b60606737859c7b3/users/d130d10b69d24312980035dfa1ff391e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:22.077528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:22.091567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4c772-84c6-432d-8b30-af417b7d34cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:22.259932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:22.260681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:22.261206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:22.261411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:22.262136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:22.264158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:22.303510 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2121/4236] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:22.307407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:22.343575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed854-1b66-4449-a703-5f838b680847 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:22.360712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac479052-0b0f-4967-9fc4-91472a62cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:22.362364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479052-0b0f-4967-9fc4-91472a62cbab admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:22.362885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479052-0b0f-4967-9fc4-91472a62cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:22.366943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479052-0b0f-4967-9fc4-91472a62cbab admin admin] PATH_INFO: `/v3/projects/e1570e3155674723b60606737859c7b3/users/d130d10b69d24312980035dfa1ff391e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:22.375497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac479052-0b0f-4967-9fc4-91472a62cbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1570e3155674723b60606737859c7b3, user_id=d130d10b69d24312980035dfa1ff391e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:22.394500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac479052-0b0f-4967-9fc4-91472a62cbab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:22.431712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:22.435949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:22.443055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2116/4237] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:22 2022] PUT /identity/v3/projects/e1570e3155674723b60606737859c7b3/users/d130d10b69d24312980035dfa1ff391e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:22.482267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc74ad-e654-4e63-9cf8-0095ce138416 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:22.482772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc74ad-e654-4e63-9cf8-0095ce138416 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:22.483338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc74ad-e654-4e63-9cf8-0095ce138416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:22.576323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6afc74ad-e654-4e63-9cf8-0095ce138416 None None] MFA Rules not processed for user `d130d10b69d24312980035dfa1ff391e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:22.578530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6afc74ad-e654-4e63-9cf8-0095ce138416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:22.794820 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2117/4238] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:22.796912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc74ad-e654-4e63-9cf8-0095ce138416 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:22.815127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc74ad-e654-4e63-9cf8-0095ce138416 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:22.824714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:22.826313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:22.827086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:22.827871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:22.830548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:22.831488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:22.835661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:22.837572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eec345-b76a-480e-956a-db2f72879bac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:22.871934 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2118/4239] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:22.874029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:22.899950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bb1c0-869b-42e1-bb1b-ed32d4e4c203 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:22.910566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:22.912370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:22.913029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:22.913731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:22.919164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:22.925670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:23.034450 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2119/4240] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:22 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:23.037595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:23.040042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3dcec-d032-425d-a27d-70d487b85961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:23.041263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3dcec-d032-425d-a27d-70d487b85961 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:23.041744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3dcec-d032-425d-a27d-70d487b85961 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:23.050290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3dcec-d032-425d-a27d-70d487b85961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:23.059747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79f3dcec-d032-425d-a27d-70d487b85961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:23.188029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d038a-1f20-4fe7-a790-179884fab2d4 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:23.201600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:23.202412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:23.202909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:23.203468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:23.204362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:23.204773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:23.207462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:23.231692 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2120/4241] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:23.253449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:23.444914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3dcec-d032-425d-a27d-70d487b85961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:23.452064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3dcec-d032-425d-a27d-70d487b85961 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:23.481915 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2122/4242] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 1052 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:23.557158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:23.572148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:23.582770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:23.774661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4603e3-cf5a-4dd8-9c16-3e5717680e9e tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:23.791077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:23.794374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:23.795235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:23.798966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:23.824927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:23.832151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:23.874982 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2121/4243] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:55:23.907990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86b97e-9bcd-47fd-b48d-a4a8d12bfdc9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:23.908585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86b97e-9bcd-47fd-b48d-a4a8d12bfdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:23.909026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86b97e-9bcd-47fd-b48d-a4a8d12bfdc9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:23.913781 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2123/4244] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:55:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:55:23.925932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:55:23.969201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:23.997235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d345-f97c-4e00-81c1-f1f7e4352bf2 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:24.011229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ec73f-6479-473f-90fe-8c41e3b6d731 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:24.014011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec73f-6479-473f-90fe-8c41e3b6d731 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:24.014753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec73f-6479-473f-90fe-8c41e3b6d731 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:24.015557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec73f-6479-473f-90fe-8c41e3b6d731 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/projects/a2250626bdcb486496a9d0e0d78009d4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:24.019820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ec73f-6479-473f-90fe-8c41e3b6d731 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2250626bdcb486496a9d0e0d78009d4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:24.025842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ec73f-6479-473f-90fe-8c41e3b6d731 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:24.029525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2122/4245] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:55:23 2022] GET /identity/v3/projects/a2250626bdcb486496a9d0e0d78009d4 => generated 369 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:55:24.329446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86b97e-9bcd-47fd-b48d-a4a8d12bfdc9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:24.342645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf86b97e-9bcd-47fd-b48d-a4a8d12bfdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:24.373332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988617b-878e-4711-879b-f4e6f10b9d53 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:24.374776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988617b-878e-4711-879b-f4e6f10b9d53 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:24.377886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988617b-878e-4711-879b-f4e6f10b9d53 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:24.387670 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2123/4246] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:55:24 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:55:24.400186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988617b-878e-4711-879b-f4e6f10b9d53 None None] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:55:24.519175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988617b-878e-4711-879b-f4e6f10b9d53 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:24.596725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988617b-878e-4711-879b-f4e6f10b9d53 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:24.618850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:24.620501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:24.620501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:24.620501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/projects/a2250626bdcb486496a9d0e0d78009d4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:24.621992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2250626bdcb486496a9d0e0d78009d4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:24.624023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:24.634244 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2124/4247] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:55:24 2022] GET /identity/v3/projects/a2250626bdcb486496a9d0e0d78009d4 => generated 369 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:24.724967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86b97e-9bcd-47fd-b48d-a4a8d12bfdc9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:24.732515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:24.733963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:24.734716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:24.735179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] PATH_INFO: `/v3/users/2547a4f7fa834940b3deb6ac2a4f595d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:24.737068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2547a4f7fa834940b3deb6ac2a4f595d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:24.740443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:24.804049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:24.844837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f75e7-ed16-4735-8ffc-b50984262e6d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:24.869113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:24.871095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:24.871095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:24.871506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:24.873043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:24.896430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:24.900461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:24.935669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2547a4f7fa834940b3deb6ac2a4f595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:24.953561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2547a4f7fa834940b3deb6ac2a4f595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:24.970909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2547a4f7fa834940b3deb6ac2a4f595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:24.970909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2547a4f7fa834940b3deb6ac2a4f595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:24.986161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2125/4248] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:24.988487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2703ce03-0ba7-4c0b-8c78-451098dbcdaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2547a4f7fa834940b3deb6ac2a4f595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:24.990251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:24.997979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:24.998920 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2124/4249] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:24 2022] DELETE /identity/v3/users/2547a4f7fa834940b3deb6ac2a4f595d => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:25.004084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6d17-adab-4047-9c1c-124c9b590ec8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:25.004402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6d17-adab-4047-9c1c-124c9b590ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:25.004659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6d17-adab-4047-9c1c-124c9b590ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:25.056864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e35e0-0d24-4af0-8e9b-43fbdcc1afe6 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:25.058551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9ded6d17-adab-4047-9c1c-124c9b590ec8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:25.063696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ded6d17-adab-4047-9c1c-124c9b590ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:25.148971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:25.216220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:25.218241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:25.219047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:25.219841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:25.221827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:25.226511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:25.243607 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2125/4250] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:25.283365 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2126/4251] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:24 2022] POST /identity/v3/users => generated 383 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:25.285312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded6d17-adab-4047-9c1c-124c9b590ec8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:25.297503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded6d17-adab-4047-9c1c-124c9b590ec8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:25.303086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68c81-f43e-498e-99e1-e9af2d79365a tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:25.303826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68c81-f43e-498e-99e1-e9af2d79365a tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:25.304105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68c81-f43e-498e-99e1-e9af2d79365a tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:25.304401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68c81-f43e-498e-99e1-e9af2d79365a tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:25.305917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68c81-f43e-498e-99e1-e9af2d79365a tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:25.306091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68c81-f43e-498e-99e1-e9af2d79365a tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:25.308018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68c81-f43e-498e-99e1-e9af2d79365a tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:25.328402 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2126/4252] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:25.332140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:25.335636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:25.443457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:25.453941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46747-57c2-40c3-85d6-08ee75ab6236 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:25.464022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:25.465256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:25.465818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:25.466788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:25.488061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:25.490754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:25.534381 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2127/4253] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:25.573397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697055e4-eb7f-4dcb-87fa-358367a54563 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:25.573882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697055e4-eb7f-4dcb-87fa-358367a54563 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:25.574632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697055e4-eb7f-4dcb-87fa-358367a54563 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:25.577477 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2127/4254] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:55:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:55:25.583433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:55:25.586459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:25.709942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:25.729272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c204-8f05-4a78-a204-5682a2170a3d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:25.736672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:25.738178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:25.738735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:25.739380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/projects/a2250626bdcb486496a9d0e0d78009d4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:25.741218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2250626bdcb486496a9d0e0d78009d4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:25.759446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:25.759446 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2128/4255] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:55:25 2022] GET /identity/v3/projects/a2250626bdcb486496a9d0e0d78009d4 => generated 369 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:55:26.017394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f9f7-70a0-4c1f-834c-79bdf142971c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:26.018864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f9f7-70a0-4c1f-834c-79bdf142971c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:26.019386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f9f7-70a0-4c1f-834c-79bdf142971c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:26.021225 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2128/4256] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:55:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:55:26.028471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 14:55:26.067695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:26.090445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1531c0e-4ef7-4962-8e27-0d07e03d0890 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:26.110401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:26.112700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:26.112942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:26.113379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/projects/a2250626bdcb486496a9d0e0d78009d4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:26.116166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2250626bdcb486496a9d0e0d78009d4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:26.121336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:26.124994 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2129/4257] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 14:55:26 2022] GET /identity/v3/projects/a2250626bdcb486496a9d0e0d78009d4 => generated 369 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:26.158956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f9f7-70a0-4c1f-834c-79bdf142971c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:26.183465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f9f7-70a0-4c1f-834c-79bdf142971c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:26.191078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:26.195064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:26.195445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:26.196073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/users/53f254c0ca31441dbde65ecbc6dad8e2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:26.232805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:delete_user(user_id=53f254c0ca31441dbde65ecbc6dad8e2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:26.234887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:26.412413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f254c0ca31441dbde65ecbc6dad8e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.453665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f254c0ca31441dbde65ecbc6dad8e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.478843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f254c0ca31441dbde65ecbc6dad8e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.479526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f254c0ca31441dbde65ecbc6dad8e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.498164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f254c0ca31441dbde65ecbc6dad8e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.517394 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2129/4258] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:26 2022] DELETE /identity/v3/users/53f254c0ca31441dbde65ecbc6dad8e2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:26.537094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:26.542343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:26.589255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5272d7-3298-4a42-92ba-a8b4a6bbc21d tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:26.757429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd130d10b69d24312980035dfa1ff391e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1570e3155674723b60606737859c7b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:26.758957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:26.759487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:26.759970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] PATH_INFO: `/v3/projects/a2250626bdcb486496a9d0e0d78009d4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:26.762008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2250626bdcb486496a9d0e0d78009d4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:26.764072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:26.907084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2250626bdcb486496a9d0e0d78009d4', 'request_id': 'req-1d965847-3ad3-46b0-831d-864e652ffc6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.942584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2250626bdcb486496a9d0e0d78009d4', 'request_id': 'req-1d965847-3ad3-46b0-831d-864e652ffc6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.956827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2250626bdcb486496a9d0e0d78009d4', 'request_id': 'req-1d965847-3ad3-46b0-831d-864e652ffc6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.975236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:26.987898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] The token cache is being invalidate because project a2250626bdcb486496a9d0e0d78009d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:26.990186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:26.992499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.006508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:27.007795 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2130/4259] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:26 2022] DELETE /identity/v3/projects/a2250626bdcb486496a9d0e0d78009d4 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:27.008051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:27.142526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663901-620c-478c-be82-f7b83590ac09 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:27.180135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:27.188651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:27.281514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:27.372490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:27.373806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:27.374023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:27.374252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] PATH_INFO: `/v3/users/c8a2d3bf74f04b6ead28e02853b01b95` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:27.375632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a2d3bf74f04b6ead28e02853b01b95)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:27.385195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:27.563965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a2d3bf74f04b6ead28e02853b01b95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.575854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965847-3ad3-46b0-831d-864e652ffc6b tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:27.601702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:27.604068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:27.604436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a2d3bf74f04b6ead28e02853b01b95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.607789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:27.615072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] PATH_INFO: `/v3/projects/158b74e5a163458cb9b6249e9076c7ca` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:27.616209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=158b74e5a163458cb9b6249e9076c7ca)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:27.623508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a2d3bf74f04b6ead28e02853b01b95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.624655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a2d3bf74f04b6ead28e02853b01b95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.627331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:27.646798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a2d3bf74f04b6ead28e02853b01b95'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.670292 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2130/4260] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:27 2022] DELETE /identity/v3/users/c8a2d3bf74f04b6ead28e02853b01b95 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:27.677648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:27.684511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:27.786701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158b74e5a163458cb9b6249e9076c7ca', 'request_id': 'req-3b1cd177-3528-401f-a881-b46ef77653d2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.803638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158b74e5a163458cb9b6249e9076c7ca', 'request_id': 'req-3b1cd177-3528-401f-a881-b46ef77653d2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.813369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158b74e5a163458cb9b6249e9076c7ca', 'request_id': 'req-3b1cd177-3528-401f-a881-b46ef77653d2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.826375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] The token cache is being invalidate because project 158b74e5a163458cb9b6249e9076c7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:27.826948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.827929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b1cd177-3528-401f-a881-b46ef77653d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:27.830312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2131/4261] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:27 2022] DELETE /identity/v3/projects/158b74e5a163458cb9b6249e9076c7ca => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:27.831984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de857-4d52-4c79-9fec-40a1342763ef None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:27.832454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de857-4d52-4c79-9fec-40a1342763ef None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:27.832896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de857-4d52-4c79-9fec-40a1342763ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:27.867444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-688de857-4d52-4c79-9fec-40a1342763ef None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:27.869094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-688de857-4d52-4c79-9fec-40a1342763ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:27.889947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd90e40-f635-4bd3-8e27-af9865ef859e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:27.951037 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2132/4262] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:27.957002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:27.957002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:27.957002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.002106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:28.003490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:28.024135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:28.028928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2133/4263] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:28.030226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:28.037168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:28.053615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:28.054623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:28.056524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:28.056889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] PATH_INFO: `/v3/users/1668025d16ba420dab2febbd3bcb9f9c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.063329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1668025d16ba420dab2febbd3bcb9f9c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:28.065808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:28.132669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:28.157012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1668025d16ba420dab2febbd3bcb9f9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:28.178001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1668025d16ba420dab2febbd3bcb9f9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:28.197235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1668025d16ba420dab2febbd3bcb9f9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:28.198255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1668025d16ba420dab2febbd3bcb9f9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:28.221486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1cb1e58-5f89-499c-817c-8fcd773c44fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1668025d16ba420dab2febbd3bcb9f9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:28.250999 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2131/4264] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:27 2022] DELETE /identity/v3/users/1668025d16ba420dab2febbd3bcb9f9c => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:28.256221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c84455-d21f-41a6-82c5-f55cea9cc1e6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:28.257436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c84455-d21f-41a6-82c5-f55cea9cc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:28.257735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c84455-d21f-41a6-82c5-f55cea9cc1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.282744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7c519-9c8d-407a-8a69-f1e55d10a0e9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:28.353957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-48c84455-d21f-41a6-82c5-f55cea9cc1e6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:28.353957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48c84455-d21f-41a6-82c5-f55cea9cc1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:28.461160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:28.463078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:28.464634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:28.466817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.470328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:28.565001 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2132/4265] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:28.573475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8b26-fd36-46f7-b1fb-90425548fb68 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:28.573798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8b26-fd36-46f7-b1fb-90425548fb68 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:28.576289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8b26-fd36-46f7-b1fb-90425548fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.626568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-487a8b26-fd36-46f7-b1fb-90425548fb68 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:28.627911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-487a8b26-fd36-46f7-b1fb-90425548fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:28.653909 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2133/4266] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:28.656805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a8b26-fd36-46f7-b1fb-90425548fb68 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:28.699442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:28.700917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:28.702262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a8b26-fd36-46f7-b1fb-90425548fb68 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:28.715791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2134/4267] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:28.716871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:28.718743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:28.728348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:28.729484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:28.730337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:28.731901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.734666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da7a3b-a6a4-4ac3-8ee4-667c49f5273f service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:28.741315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:28.742069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:28.742439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:28.742736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.745272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:28.745776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:28.753617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:28.758528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:28.761204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:28.778126 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2135/4268] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:28.783706 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2134/4269] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:28.789720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:28.808731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238efab-eba5-4f87-b3e4-77d1360c31c5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:28.815051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:28.816231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:28.816688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:28.819174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:28.819951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:28.822583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:28.885822 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2136/4270] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:28 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:28.886719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:28.907770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f63e-98ea-4727-a77e-920f0eea3335 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:29.018236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:29.050091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:29.061234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:29.061570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:29.062188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:29.063192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:29.069733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:29.105199 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2135/4271] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:28 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:29.109146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:29.123986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd78e-b119-4d16-8453-2e99c5eeb342 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:29.138837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:29.139595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:29.139883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:29.140265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:29.140985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:29.142680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:29.177014 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2137/4272] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:29.177390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:29.193380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a4cb-d995-469f-bdf6-fce65850464b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:29.200695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01ea69-ece1-4e77-a374-6000a5e61521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:29.201485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01ea69-ece1-4e77-a374-6000a5e61521 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:29.201844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01ea69-ece1-4e77-a374-6000a5e61521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:29.202228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01ea69-ece1-4e77-a374-6000a5e61521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:29.203261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01ea69-ece1-4e77-a374-6000a5e61521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:29.205155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01ea69-ece1-4e77-a374-6000a5e61521 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:29.222875 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2136/4273] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:29.228286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:29.252898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031722c9-fd4b-4c9d-b43d-4f36449b31e8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:29.275518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:29.280293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:29.280486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:29.281510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] PATH_INFO: `/v3/projects/8005e6d2ee1d4a4cbe541392dc60d7a1/users/96f47b76a4754a7c8d20a3ab2eb24b8a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:29.321262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8005e6d2ee1d4a4cbe541392dc60d7a1, user_id=96f47b76a4754a7c8d20a3ab2eb24b8a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:29.326054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:29.363317 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2138/4274] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:29 2022] PUT /identity/v3/projects/8005e6d2ee1d4a4cbe541392dc60d7a1/users/96f47b76a4754a7c8d20a3ab2eb24b8a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:29.377112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:29.378957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:29.380100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:29.455386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] MFA Rules not processed for user `96f47b76a4754a7c8d20a3ab2eb24b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:29.459196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:29.478675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:29.511169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:29.562380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b3f7-d05f-48f3-b4be-34aaaca459a8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:29.568084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:29.569354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:29.570537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:29.571939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:29.576202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:29.593880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:29.596845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:29.619701 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2139/4275] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:29.626278 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2137/4276] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:29.917024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:29.920100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:30.095625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927227-2f36-4746-8dad-68b418bca510 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:30.104461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:30.105843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:30.106358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:30.106949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:30.119775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:30.122444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:30.136406 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2140/4277] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:55:30.342858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:30.344621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:30.520434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a4ff0-c639-451f-abff-4f93b7b98fb9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:30.527038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:30.528102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:30.528490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:30.528870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] PATH_INFO: `/v3/projects/e6a8ca97fef54df591fa4cca8c464fff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:30.530319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a8ca97fef54df591fa4cca8c464fff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:30.533333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:30.689519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a8ca97fef54df591fa4cca8c464fff', 'request_id': 'req-f2dee914-e744-4fc9-87c9-8b1b817986a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:30.699437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a8ca97fef54df591fa4cca8c464fff', 'request_id': 'req-f2dee914-e744-4fc9-87c9-8b1b817986a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:30.716358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a8ca97fef54df591fa4cca8c464fff', 'request_id': 'req-f2dee914-e744-4fc9-87c9-8b1b817986a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:30.718861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:30.771397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] The token cache is being invalidate because project e6a8ca97fef54df591fa4cca8c464fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:30.771860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:30.776161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:30.781804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:30.786081 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2138/4278] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:30 2022] DELETE /identity/v3/projects/e6a8ca97fef54df591fa4cca8c464fff => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:30.790787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:30.796701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:30.801625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15156c-4b9e-4dec-af44-99846548a92b service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:30.989697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dee914-e744-4fc9-87c9-8b1b817986a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:30.998059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:31.000289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:31.000930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:31.001415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] PATH_INFO: `/v3/users/d600e0863c984f639c4b9561fd7a7dab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:31.004811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d600e0863c984f639c4b9561fd7a7dab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:31.008216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:31.046849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:31.049884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:31.052158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:31.052790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] PATH_INFO: `/v3/users/96f47b76a4754a7c8d20a3ab2eb24b8a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:31.057878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f47b76a4754a7c8d20a3ab2eb24b8a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:31.066653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:31.173953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd600e0863c984f639c4b9561fd7a7dab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.252109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd600e0863c984f639c4b9561fd7a7dab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.273020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd600e0863c984f639c4b9561fd7a7dab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.273768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd600e0863c984f639c4b9561fd7a7dab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.274219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f47b76a4754a7c8d20a3ab2eb24b8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.286704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:31.291817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd600e0863c984f639c4b9561fd7a7dab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.304216 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2139/4279] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:30 2022] DELETE /identity/v3/users/d600e0863c984f639c4b9561fd7a7dab => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:31.304216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:31.305959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:31.329079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f47b76a4754a7c8d20a3ab2eb24b8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.330483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f47b76a4754a7c8d20a3ab2eb24b8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.353167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f47b76a4754a7c8d20a3ab2eb24b8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.354447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf7cfa5a-5eb0-4ba2-900a-ff964c719670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f47b76a4754a7c8d20a3ab2eb24b8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.413026 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2141/4280] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:30 2022] DELETE /identity/v3/users/96f47b76a4754a7c8d20a3ab2eb24b8a => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:31.418313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:31.418852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:31.421922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:31.499001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:31.501444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:31.506019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f047450-416f-469c-bc6d-94c13ee1ebd5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:31.569284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:31.660818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:31.661892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:31.663061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:31.663687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] PATH_INFO: `/v3/projects/aefe9ff4f7f2486f92b7e7557ce0e1f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:31.666886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefe9ff4f7f2486f92b7e7557ce0e1f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:31.670935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:31.704551 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2142/4281] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:31.755073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:31.761046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:31.807035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefe9ff4f7f2486f92b7e7557ce0e1f5', 'request_id': 'req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.817652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefe9ff4f7f2486f92b7e7557ce0e1f5', 'request_id': 'req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.831489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefe9ff4f7f2486f92b7e7557ce0e1f5', 'request_id': 'req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.855818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] The token cache is being invalidate because project aefe9ff4f7f2486f92b7e7557ce0e1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:31.857166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.858428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:31.865301 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2140/4282] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:31 2022] DELETE /identity/v3/projects/aefe9ff4f7f2486f92b7e7557ce0e1f5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:31.867129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:31.869434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:31.884818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412799c-c07d-4a20-b73c-7e51ec02dd1a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:32.009441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:32.009441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:32.009441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:32.010039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:32.013886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:32.020931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5b91d-4a0f-488c-9666-1bc9d35784ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:32.030549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:32.031752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:32.032139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:32.032543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] PATH_INFO: `/v3/users/d130d10b69d24312980035dfa1ff391e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:32.034069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d130d10b69d24312980035dfa1ff391e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:32.038071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:32.049658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:32.077899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:32.114098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2143/4283] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:32.244684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd130d10b69d24312980035dfa1ff391e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.253096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:32.282841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd130d10b69d24312980035dfa1ff391e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.309445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd130d10b69d24312980035dfa1ff391e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.313290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd130d10b69d24312980035dfa1ff391e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.337389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00234d3e-a7a7-4d3c-abf8-7c28eed5bf3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd130d10b69d24312980035dfa1ff391e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.355666 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2141/4284] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:31 2022] DELETE /identity/v3/users/d130d10b69d24312980035dfa1ff391e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:32.429347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:32.436204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:32.470754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6960-d6fe-4591-99d5-bfeec634cdbe service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:32.604411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:32.736165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:32.737244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:32.737768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:32.737994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] PATH_INFO: `/v3/projects/e53e7a6c617344c3ad18e855530dbdc8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:32.744715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e53e7a6c617344c3ad18e855530dbdc8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:32.747130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:32.864936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e53e7a6c617344c3ad18e855530dbdc8', 'request_id': 'req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.883675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e53e7a6c617344c3ad18e855530dbdc8', 'request_id': 'req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.891626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e53e7a6c617344c3ad18e855530dbdc8', 'request_id': 'req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.915752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] The token cache is being invalidate because project e53e7a6c617344c3ad18e855530dbdc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:32.916227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.917132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb853e2d-8d28-4b17-a3c7-ecc0aa3daa1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:32.919025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2144/4285] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:32 2022] DELETE /identity/v3/projects/e53e7a6c617344c3ad18e855530dbdc8 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:32.925745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c32685-7c78-4e99-b73d-06a736fe1743 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:32.926515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c32685-7c78-4e99-b73d-06a736fe1743 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:32.926970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c32685-7c78-4e99-b73d-06a736fe1743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:32.998306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d3c32685-7c78-4e99-b73d-06a736fe1743 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:32.999726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3c32685-7c78-4e99-b73d-06a736fe1743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:33.209219 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2142/4286] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:33.221127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d65e0c-2f9a-49ba-847a-289c1df42543 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:33.222065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d65e0c-2f9a-49ba-847a-289c1df42543 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:33.222872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d65e0c-2f9a-49ba-847a-289c1df42543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:33.329481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d0d65e0c-2f9a-49ba-847a-289c1df42543 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:33.336639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d0d65e0c-2f9a-49ba-847a-289c1df42543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:33.396895 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2145/4287] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:33.402241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c32685-7c78-4e99-b73d-06a736fe1743 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:33.464014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c32685-7c78-4e99-b73d-06a736fe1743 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:33.474531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:33.488973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:33.488973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:33.488973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:33.488973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:33.488973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:33.488973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:33.567750 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2143/4288] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:33.576594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d65e0c-2f9a-49ba-847a-289c1df42543 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:33.619683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d65e0c-2f9a-49ba-847a-289c1df42543 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:33.663089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:33.664652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:33.665169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:33.666643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:33.668000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:33.685922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:33.816110 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2146/4289] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:33 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:33.817590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:33.904243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826035e-7613-4d21-8ff5-fddfa516416f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:34.204805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:34.209746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:34.217165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:34.218169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.218525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.218792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:34.219905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:34.232456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:34.303321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b51e67-2c40-4016-b7de-ef6b14384020 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:34.328289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:34.329842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.330335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.330821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] PATH_INFO: `/v3/projects/8005e6d2ee1d4a4cbe541392dc60d7a1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:34.338813 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2144/4290] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:33 2022] POST /identity/v3/users => generated 293 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:34.339903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:34.347323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8005e6d2ee1d4a4cbe541392dc60d7a1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:34.356438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:34.415961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e3e5-638e-4b87-a929-b1b332f72c4f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:34.443638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57ef43-185e-4e2e-98c7-d4d8a52e39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:34.448220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ef43-185e-4e2e-98c7-d4d8a52e39c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.450016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ef43-185e-4e2e-98c7-d4d8a52e39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.451364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ef43-185e-4e2e-98c7-d4d8a52e39c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:34.460287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57ef43-185e-4e2e-98c7-d4d8a52e39c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:34.474525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57ef43-185e-4e2e-98c7-d4d8a52e39c4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:34.567241 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2145/4291] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:34.576872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8005e6d2ee1d4a4cbe541392dc60d7a1', 'request_id': 'req-36a463fd-b4f8-4c3f-977c-f65a7793d751'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:34.592837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc697a-6ec8-4460-a8e8-a43bc4010945 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.595525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc697a-6ec8-4460-a8e8-a43bc4010945 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.596133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc697a-6ec8-4460-a8e8-a43bc4010945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:34.626489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8005e6d2ee1d4a4cbe541392dc60d7a1', 'request_id': 'req-36a463fd-b4f8-4c3f-977c-f65a7793d751'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:34.667044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8005e6d2ee1d4a4cbe541392dc60d7a1', 'request_id': 'req-36a463fd-b4f8-4c3f-977c-f65a7793d751'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:34.693469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a2cc697a-6ec8-4460-a8e8-a43bc4010945 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:34.695647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2cc697a-6ec8-4460-a8e8-a43bc4010945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:34.697616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] The token cache is being invalidate because project 8005e6d2ee1d4a4cbe541392dc60d7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:34.698226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:34.700652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:34.711197 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2147/4292] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:34 2022] DELETE /identity/v3/projects/8005e6d2ee1d4a4cbe541392dc60d7a1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:34.715148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:34.717434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:34.760222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:34.801224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:34.874756 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2146/4293] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:34.876430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072054b-0ce1-4dce-946f-81c56eb678a7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.876780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072054b-0ce1-4dce-946f-81c56eb678a7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.877045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072054b-0ce1-4dce-946f-81c56eb678a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:34.903625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a463fd-b4f8-4c3f-977c-f65a7793d751 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:34.919292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:34.920514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.921256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.923594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4072054b-0ce1-4dce-946f-81c56eb678a7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:34.925126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4072054b-0ce1-4dce-946f-81c56eb678a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:34.935203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:34.936743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:34.938914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:34.954485 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2147/4294] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:34.964066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.964343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.964846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:34.969508 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2148/4295] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:34.976782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:34.989301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182121e1-0693-4e3b-9d92-5b6f185f691d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:34.995629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:34.997091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:34.997622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:34.998081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] PATH_INFO: `/v3/projects/34f298651f3b4281880dbfb0f71c52b5/users/f941e81d90b74682b8108c9dcdf744c8/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:35.024768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:35.028081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:35.039903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f298651f3b4281880dbfb0f71c52b5, user_id=f941e81d90b74682b8108c9dcdf744c8, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:35.048997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:35.072904 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2148/4296] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:35.072904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:35.077515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:35.082573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2149/4297] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:34 2022] PUT /identity/v3/projects/34f298651f3b4281880dbfb0f71c52b5/users/f941e81d90b74682b8108c9dcdf744c8/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:35.084262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:35.088119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:35.210476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a687e-da8c-473f-9acf-f0c4f3f3e922 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:35.230149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe2ac-66fa-4da4-bd28-607751c17d90 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:35.239411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:35.240380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:35.241563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:35.242052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:35.244693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:35.359255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:35.361168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:35.387497 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2150/4298] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:35.388535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:35.394389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1584b80-9d85-40ea-bb7a-cc045b00ea86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:35.394389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584b80-9d85-40ea-bb7a-cc045b00ea86 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:35.394389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584b80-9d85-40ea-bb7a-cc045b00ea86 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:35.395481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584b80-9d85-40ea-bb7a-cc045b00ea86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:35.477915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:35.583075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1584b80-9d85-40ea-bb7a-cc045b00ea86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:35.586120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1584b80-9d85-40ea-bb7a-cc045b00ea86 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:35.611916 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2149/4299] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:35.615557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee423-a73f-4d5e-9fda-58ce815c80ac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:35.615752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee423-a73f-4d5e-9fda-58ce815c80ac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:35.615963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee423-a73f-4d5e-9fda-58ce815c80ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:35.663122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:35.687650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-880ee423-a73f-4d5e-9fda-58ce815c80ac None None] MFA Rules not processed for user `f941e81d90b74682b8108c9dcdf744c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:35.688940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-880ee423-a73f-4d5e-9fda-58ce815c80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:35.701137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44752e0-8f06-4f22-86fc-a4ecdb9610eb service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:35.749080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:35.750866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:35.751715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:35.753349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:35.754954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:35.760078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:35.768373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:35.823123 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2151/4300] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:35.828511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:35.906503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f324204-70f0-44a5-9914-0f8612130b72 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:35.925322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2150/4301] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:35.926832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ee423-a73f-4d5e-9fda-58ce815c80ac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:35.934764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:35.936388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:35.936918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:35.937440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:35.941589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:35.953444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ee423-a73f-4d5e-9fda-58ce815c80ac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:35.962565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:35.971419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:35.972141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:35.972432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:35.972717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:35.973661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:35.975928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.038877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2151/4302] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:35 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:36.047582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.082682 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2152/4303] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:35 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:36.088811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.237877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa794f-3b4e-455e-9fe0-c35d4ae5ebcb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:36.332194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46287e8e-20e9-489d-8041-1d974c7fc517 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:36.348627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:36.349829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.350415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.350959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.355619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:36.358737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.396115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2153/4304] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:36 2022] POST /identity/v3/users => generated 284 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:36.402027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.427976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf89c9-0857-4a8a-9843-02dc98021252 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:36.433745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:36.434604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.434815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.435173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.436020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:36.438492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.441776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:36.442699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.445112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.445594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.449302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:36.454032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.494088 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2154/4305] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:36.495168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.505266 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2152/4306] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:36 2022] POST /identity/v3/users => generated 298 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:36.507683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.520412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c2bf5-4444-4a0c-9762-6a2b225befd4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:36.533759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:36.534140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.534438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.537092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.537896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:36.540246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.542079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81daf2-c86e-4982-98f4-9c9414bbc436 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:36.559074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:36.561181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.561681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.562132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.563103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:36.565012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.580717 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2155/4307] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:36.587316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.599697 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2153/4308] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:36.606114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.619353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:36.634397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd66b7c-4257-4f33-ae58-42611c50d05c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:36.644369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981526c1-f659-48ca-b831-55ab55988935 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:36.662740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53ce6-5f08-49d8-b106-ee13883ea74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:36.665111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ce6-5f08-49d8-b106-ee13883ea74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.665111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ce6-5f08-49d8-b106-ee13883ea74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.665111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ce6-5f08-49d8-b106-ee13883ea74d admin admin] PATH_INFO: `/v3/projects/6d10ec00b70c42f6b59f09c32c9d2dae/users/719f7f6f45ca4e4398ae37eabcec2c46/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.687098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:36.696733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.699609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.699951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] PATH_INFO: `/v3/projects/e66131d05f3b4cca9312c49aacccd74f/users/b84485cdb2c14a2fb8527839cb5543bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.779624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66131d05f3b4cca9312c49aacccd74f, user_id=b84485cdb2c14a2fb8527839cb5543bb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:36.782025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53ce6-5f08-49d8-b106-ee13883ea74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d10ec00b70c42f6b59f09c32c9d2dae, user_id=719f7f6f45ca4e4398ae37eabcec2c46, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:36.793304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53ce6-5f08-49d8-b106-ee13883ea74d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.798419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:36.826982 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2156/4309] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:36 2022] PUT /identity/v3/projects/6d10ec00b70c42f6b59f09c32c9d2dae/users/719f7f6f45ca4e4398ae37eabcec2c46/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:36.841068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536905-0df8-4f33-8b53-b3ba98388e63 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:36.842017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536905-0df8-4f33-8b53-b3ba98388e63 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:36.842592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536905-0df8-4f33-8b53-b3ba98388e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:36.851307 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2154/4310] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:36 2022] PUT /identity/v3/projects/e66131d05f3b4cca9312c49aacccd74f/users/b84485cdb2c14a2fb8527839cb5543bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:36.858287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:36.918622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-70536905-0df8-4f33-8b53-b3ba98388e63 None None] MFA Rules not processed for user `719f7f6f45ca4e4398ae37eabcec2c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:36.924672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70536905-0df8-4f33-8b53-b3ba98388e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:37.065449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:37.126760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c5a1-f1f0-45b7-a77a-e785df783062 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:37.141609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:37.142674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:37.143147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:37.144720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:37.146115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:37.155096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:37.189632 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2155/4311] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:37.197468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:37.223035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8c311-f254-4a04-b263-b27d961907ed admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:37.245680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:37.246976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:37.247391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:37.249781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] PATH_INFO: `/v3/projects/e66131d05f3b4cca9312c49aacccd74f/users/b84485cdb2c14a2fb8527839cb5543bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:37.254513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66131d05f3b4cca9312c49aacccd74f, user_id=b84485cdb2c14a2fb8527839cb5543bb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:37.263025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2157/4312] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:37.270903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70536905-0df8-4f33-8b53-b3ba98388e63 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:37.283027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:37.310912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2156/4313] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:37 2022] PUT /identity/v3/projects/e66131d05f3b4cca9312c49aacccd74f/users/b84485cdb2c14a2fb8527839cb5543bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:37.324963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:37.327955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:37.345973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70536905-0df8-4f33-8b53-b3ba98388e63 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:37.529708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee86238-0d78-44e5-afb4-0fdfde2a8586 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:37.546332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:37.547335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:37.548086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:37.548086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] PATH_INFO: `/v3/projects/e1570e3155674723b60606737859c7b3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:37.549323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1570e3155674723b60606737859c7b3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:37.555940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:37.592072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9eca5-0794-42ee-aff4-390025d6c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:37.595161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eca5-0794-42ee-aff4-390025d6c22f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:37.599356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eca5-0794-42ee-aff4-390025d6c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:37.599771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eca5-0794-42ee-aff4-390025d6c22f admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:37.601077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9eca5-0794-42ee-aff4-390025d6c22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:37.608064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9eca5-0794-42ee-aff4-390025d6c22f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:37.675378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1570e3155674723b60606737859c7b3', 'request_id': 'req-6da7fdb2-ff9c-400b-b138-aadcffa3c625'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:37.693098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1570e3155674723b60606737859c7b3', 'request_id': 'req-6da7fdb2-ff9c-400b-b138-aadcffa3c625'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:37.710261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1570e3155674723b60606737859c7b3', 'request_id': 'req-6da7fdb2-ff9c-400b-b138-aadcffa3c625'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:37.710871 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2158/4314] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:37 2022] POST /identity/v3/projects => generated 367 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:37.714916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234052c-4eea-46fe-b188-6ee17cac2ceb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:37.715648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234052c-4eea-46fe-b188-6ee17cac2ceb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:37.716944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:37.717181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234052c-4eea-46fe-b188-6ee17cac2ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:37.734034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] The token cache is being invalidate because project e1570e3155674723b60606737859c7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:37.734396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:37.739829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:37.750614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2157/4315] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:37 2022] DELETE /identity/v3/projects/e1570e3155674723b60606737859c7b3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:37.751639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:37.754816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:37.833527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b234052c-4eea-46fe-b188-6ee17cac2ceb None None] MFA Rules not processed for user `b84485cdb2c14a2fb8527839cb5543bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:37.837853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b234052c-4eea-46fe-b188-6ee17cac2ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:37.992023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7fdb2-ff9c-400b-b138-aadcffa3c625 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:38.131828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2159/4316] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:38.138709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801605-6853-4bb6-a66a-61b76b673aec None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.139245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801605-6853-4bb6-a66a-61b76b673aec None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.139800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801605-6853-4bb6-a66a-61b76b673aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.220411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:38.223504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.225883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.226634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.234402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:38.237413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:38.271015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-02801605-6853-4bb6-a66a-61b76b673aec None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:38.276988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02801605-6853-4bb6-a66a-61b76b673aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:38.338406 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2158/4317] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:37 2022] POST /identity/v3/users => generated 290 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:38.340028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:38.352007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:38.381707 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2160/4318] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:38.384086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02801605-6853-4bb6-a66a-61b76b673aec None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:38.465490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02801605-6853-4bb6-a66a-61b76b673aec None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:38.491656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff749a2-a0ba-4b94-8a03-febff664a5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:38.500451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff749a2-a0ba-4b94-8a03-febff664a5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.500986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff749a2-a0ba-4b94-8a03-febff664a5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.502825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff749a2-a0ba-4b94-8a03-febff664a5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.504347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff749a2-a0ba-4b94-8a03-febff664a5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:38.509844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff749a2-a0ba-4b94-8a03-febff664a5c7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:38.567962 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2161/4319] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:38.579042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23423939-7872-4709-a8f4-81df4da1ee99 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.581685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23423939-7872-4709-a8f4-81df4da1ee99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.583844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759db47-f71b-4803-a374-c90413b685af admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:38.584946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23423939-7872-4709-a8f4-81df4da1ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.595143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:38.596163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.596656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.597549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.641565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-23423939-7872-4709-a8f4-81df4da1ee99 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:38.642533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:38.643345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-23423939-7872-4709-a8f4-81df4da1ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:38.644641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:38.663742 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2162/4320] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:38.675384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23423939-7872-4709-a8f4-81df4da1ee99 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:38.678623 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2159/4321] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:38.680362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:38.732375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef821d4-f6e3-4e7a-a8fc-009164123c2f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:38.737083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23423939-7872-4709-a8f4-81df4da1ee99 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:38.749353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:38.750432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.750951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.751471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.752621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:38.753194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:38.754615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:38.755252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.755864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.756828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] PATH_INFO: `/v3/projects/e13635d7a3e44614bf4b372018b8f521/users/420973ac77a846fbae9a05b7ea22ffe4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.761149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:38.795258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:38.814165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13635d7a3e44614bf4b372018b8f521, user_id=420973ac77a846fbae9a05b7ea22ffe4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:38.818339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2160/4322] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:38.822318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:38.823550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:38.850541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7e0bb-82e9-4150-9c5a-3c7a3822cecd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:38.871060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:38.872867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:38.872867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:38.872867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:38.873517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:38.875657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:38.880985 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2163/4323] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:38 2022] PUT /identity/v3/projects/e13635d7a3e44614bf4b372018b8f521/users/420973ac77a846fbae9a05b7ea22ffe4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:38.883193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:38.921531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:38.947203 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2161/4324] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:38 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:38.950781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:39.070285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229561a1-fb47-4ec5-9f34-60ec3cdc4499 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:39.149164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc22d2-6bd2-4769-9cba-265816fb9737 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:39.168401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:39.169360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.169771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.170166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.171099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:39.173761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:39.228645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2162/4325] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:38 2022] POST /identity/v3/users => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:39.233646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:39.270309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414102db-774e-476c-928a-6baaa7000713 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:39.283073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:39.283812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.284117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.284430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.287581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:39.289252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:39.318376 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2163/4326] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:39.325310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:39.351904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609c10-dab9-4506-ac23-d605e199e895 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:39.357562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:39.358270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.358591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.358871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.359759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:39.382031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:39.416123 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2164/4327] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:39.422357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:39.436407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:39.437580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.438093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.438595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.440290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaae298-e68a-4460-8e14-79e97e18eb2a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:39.454677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:39.459945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9bbe-a547-4d9b-9b50-4437ee89c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:39.461122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9bbe-a547-4d9b-9b50-4437ee89c196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.461436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9bbe-a547-4d9b-9b50-4437ee89c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.461743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9bbe-a547-4d9b-9b50-4437ee89c196 admin admin] PATH_INFO: `/v3/projects/b5a7b730114946778d55e6ee517a024a/users/ee88775f240740edacac3598b8901101/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.465006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:39.505283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9bbe-a547-4d9b-9b50-4437ee89c196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a7b730114946778d55e6ee517a024a, user_id=ee88775f240740edacac3598b8901101, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:39.512240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9bbe-a547-4d9b-9b50-4437ee89c196 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:39.516823 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2164/4328] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 632 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:39.519051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:39.542687 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2165/4329] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:39 2022] PUT /identity/v3/projects/b5a7b730114946778d55e6ee517a024a/users/ee88775f240740edacac3598b8901101/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:39.551201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.551201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.551201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.572455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69083c7-01bd-462d-ac3f-641fbc11c0ee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:39.582143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:39.584745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:39.705184 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2166/4330] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:39.751036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:39.752997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:39.788135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e6427-0710-472c-97cf-d148877cb824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:39.789460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6427-0710-472c-97cf-d148877cb824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.791614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6427-0710-472c-97cf-d148877cb824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.792040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6427-0710-472c-97cf-d148877cb824 admin admin] PATH_INFO: `/v3/projects/e13635d7a3e44614bf4b372018b8f521/users/420973ac77a846fbae9a05b7ea22ffe4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.802125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e6427-0710-472c-97cf-d148877cb824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13635d7a3e44614bf4b372018b8f521, user_id=420973ac77a846fbae9a05b7ea22ffe4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:39.807959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e6427-0710-472c-97cf-d148877cb824 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:39.843709 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2165/4331] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:39 2022] PUT /identity/v3/projects/e13635d7a3e44614bf4b372018b8f521/users/420973ac77a846fbae9a05b7ea22ffe4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:39.869945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:39.873730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74630112-0f97-406a-a4b8-a42ae31921a1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:39.874253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74630112-0f97-406a-a4b8-a42ae31921a1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:39.874745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74630112-0f97-406a-a4b8-a42ae31921a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:39.926252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcac8c0-6923-4769-b943-140dbc03944e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:39.931538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-74630112-0f97-406a-a4b8-a42ae31921a1 None None] MFA Rules not processed for user `420973ac77a846fbae9a05b7ea22ffe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:39.938969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74630112-0f97-406a-a4b8-a42ae31921a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:39.980892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:40.111216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:40.112826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:40.113363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:40.113875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:40.231169 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2166/4332] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:40.237395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74630112-0f97-406a-a4b8-a42ae31921a1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:40.270771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74630112-0f97-406a-a4b8-a42ae31921a1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:40.278999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:40.280878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:40.281835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:40.282355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:40.283446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:40.284715 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:40.284715 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:55:40.284715 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:55:40.286149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:40.315417 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2167/4333] 10.222.0.98 () {60 vars in 1149 bytes} [Thu Jul 14 14:55:40 2022] POST /identity/v3/domains => generated 276 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:40.323895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:40.450254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:40.453217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:40.496483 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2167/4334] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:55:40.562752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b784653-76f5-4566-b3de-1aaa8b9fcff3 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:40.579832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:40.580597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:40.580956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:40.581267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:40.582403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:40.584209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:40.656118 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2168/4335] 10.222.0.98 () {60 vars in 1149 bytes} [Thu Jul 14 14:55:40 2022] POST /identity/v3/domains => generated 276 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:40.662398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:40.717656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632e91b-da1f-4b0c-b32c-656e88a0ff20 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:40.921676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:40.923012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:40.923688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:40.924378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:40.926152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:40.931065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:40.966590 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2168/4336] 10.222.0.98 () {60 vars in 1149 bytes} [Thu Jul 14 14:55:40 2022] POST /identity/v3/domains => generated 277 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:40.971967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:41.005333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66e0b-a825-4d17-94b3-847558c21bec tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:41.152310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:41.153341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:41.154335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:41.154335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:41.156143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:41.158403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:41.198725 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2169/4337] 10.222.0.98 () {60 vars in 1149 bytes} [Thu Jul 14 14:55:40 2022] POST /identity/v3/domains => generated 279 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:41.204093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:41.221146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0914c-abaa-45a9-b61b-d636cf3df932 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:41.307658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:41.401706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:41.403578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:41.417212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:41.420047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:41.421403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:41.422279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/43f199b5a70246329087415c7813494f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:41.484401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=43f199b5a70246329087415c7813494f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:41.494924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:41.542254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:41.594453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '43f199b5a70246329087415c7813494f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.604737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '43f199b5a70246329087415c7813494f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.722395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff40fea-0be6-4db7-a980-6a02a0860773 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:41.735093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f199b5a70246329087415c7813494f', 'request_id': 'req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.743905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f199b5a70246329087415c7813494f', 'request_id': 'req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.751981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f199b5a70246329087415c7813494f', 'request_id': 'req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.799898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] The token cache is being invalidate because project 43f199b5a70246329087415c7813494f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:41.800421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.809171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.834383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '43f199b5a70246329087415c7813494f', 'request_id': 'req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.841343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '43f199b5a70246329087415c7813494f', 'request_id': 'req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.848268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '43f199b5a70246329087415c7813494f', 'request_id': 'req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:41.871686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2169/4338] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:55:41 2022] DELETE /identity/v3/domains/43f199b5a70246329087415c7813494f => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:41.879027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:41.881354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:41.952197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:41.953325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:41.953788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:41.954178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] PATH_INFO: `/v3/users/136f061873624ac4a28fbe80de7c7363` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:41.955873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136f061873624ac4a28fbe80de7c7363)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:41.958490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:42.074793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136f061873624ac4a28fbe80de7c7363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.081711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0b58-6806-4d17-8695-4ee68a5c2ea4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:42.091794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:42.093117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:42.093660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:42.094535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:42.096347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:42.100691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:42.120440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136f061873624ac4a28fbe80de7c7363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.121435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136f061873624ac4a28fbe80de7c7363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.134061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136f061873624ac4a28fbe80de7c7363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.142557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136f061873624ac4a28fbe80de7c7363'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.145948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2170/4339] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:55:41 2022] POST /identity/v3/domains => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:42.153229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:42.157894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:42.184950 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2170/4340] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:41 2022] DELETE /identity/v3/users/136f061873624ac4a28fbe80de7c7363 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:42.196148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:42.331488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1984-52ad-406d-bb14-5d25e1a09ee4 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:42.485079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:42.486085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:42.487109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:42.487458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/455db925da5c4fe3af451c04686bcd0a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:42.508944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=455db925da5c4fe3af451c04686bcd0a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:42.510195 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:42.510195 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:55:42.510195 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:55:42.511294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:42.540482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '455db925da5c4fe3af451c04686bcd0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.541548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '455db925da5c4fe3af451c04686bcd0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.639039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '455db925da5c4fe3af451c04686bcd0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.641300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '455db925da5c4fe3af451c04686bcd0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.658347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:42.665053 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2171/4341] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:42 2022] PATCH /identity/v3/domains/455db925da5c4fe3af451c04686bcd0a => generated 250 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:42.677448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ac10-ace1-4d54-833c-a55dfa6f3602 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:42.817258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:42.846865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:42.848471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:42.848764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:42.849051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/455db925da5c4fe3af451c04686bcd0a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:42.876752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=455db925da5c4fe3af451c04686bcd0a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:42.883627 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:42.883627 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:55:42.883627 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:55:42.887629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:42.937244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '455db925da5c4fe3af451c04686bcd0a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:42.946452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '455db925da5c4fe3af451c04686bcd0a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.065137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455db925da5c4fe3af451c04686bcd0a', 'request_id': 'req-9b1fb813-4821-4609-9331-70d21f1e4cca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.081657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455db925da5c4fe3af451c04686bcd0a', 'request_id': 'req-9b1fb813-4821-4609-9331-70d21f1e4cca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.094704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455db925da5c4fe3af451c04686bcd0a', 'request_id': 'req-9b1fb813-4821-4609-9331-70d21f1e4cca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.113741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] The token cache is being invalidate because project 455db925da5c4fe3af451c04686bcd0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:43.114423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.116501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.135416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '455db925da5c4fe3af451c04686bcd0a', 'request_id': 'req-9b1fb813-4821-4609-9331-70d21f1e4cca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.145673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '455db925da5c4fe3af451c04686bcd0a', 'request_id': 'req-9b1fb813-4821-4609-9331-70d21f1e4cca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.146479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '455db925da5c4fe3af451c04686bcd0a', 'request_id': 'req-9b1fb813-4821-4609-9331-70d21f1e4cca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.167330 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2171/4342] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:55:42 2022] DELETE /identity/v3/domains/455db925da5c4fe3af451c04686bcd0a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:43.172148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:43.175105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:43.279845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c4f8a-fd23-4663-b555-11572ab55a1a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:43.438586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:43.451302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:43.451302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:43.451302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:43.456112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:43.460558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:43.531770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:43.533764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:43.545473 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2172/4343] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:55:43 2022] POST /identity/v3/domains => generated 279 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:43.561950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb813-4821-4609-9331-70d21f1e4cca tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:43.699231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:43.701696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:43.702138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:43.702707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/da2363a223ce4f23a97cae3e391713b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:43.725947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:43.728904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:43.734970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=da2363a223ce4f23a97cae3e391713b5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:43.741433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:43.754476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:43.802797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.809158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.813763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:43.903549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.908458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:43.927165 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2172/4344] 10.222.0.98 () {60 vars in 1249 bytes} [Thu Jul 14 14:55:43 2022] PATCH /identity/v3/domains/da2363a223ce4f23a97cae3e391713b5 => generated 278 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:55:43.933990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:43.937237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:44.107683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb96d8-edb6-423d-a0ba-ddd15311bd08 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:44.245126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59894558-edf8-4b96-a773-c06cc66231bd tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:44.246860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:44.248108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:44.248406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:44.248701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/da2363a223ce4f23a97cae3e391713b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:44.293673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:44.298288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:44.298615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:44.302434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] PATH_INFO: `/v3/projects/19d9bbcda6704f11af30fedcc7e5a295` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:44.303016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=da2363a223ce4f23a97cae3e391713b5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:44.307060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:44.308072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d9bbcda6704f11af30fedcc7e5a295)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:44.314035 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2173/4345] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 14:55:43 2022] GET /identity/v3/domains/da2363a223ce4f23a97cae3e391713b5 => generated 278 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:44.316359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:44.316633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:44.344470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fa247-7360-49ff-b896-d8f1dfdea602 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:44.356101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:44.357026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:44.357458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:44.361838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/da2363a223ce4f23a97cae3e391713b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:44.364677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=da2363a223ce4f23a97cae3e391713b5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:44.368785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:44.430106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.436159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.490905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d9bbcda6704f11af30fedcc7e5a295', 'request_id': 'req-284dd16a-2b2e-43af-9d05-29cde3c95046'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.506020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d9bbcda6704f11af30fedcc7e5a295', 'request_id': 'req-284dd16a-2b2e-43af-9d05-29cde3c95046'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.516368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d9bbcda6704f11af30fedcc7e5a295', 'request_id': 'req-284dd16a-2b2e-43af-9d05-29cde3c95046'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.555532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] The token cache is being invalidate because project 19d9bbcda6704f11af30fedcc7e5a295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:44.556066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.557220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-284dd16a-2b2e-43af-9d05-29cde3c95046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.561190 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2173/4346] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:43 2022] DELETE /identity/v3/projects/19d9bbcda6704f11af30fedcc7e5a295 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:44.577812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238401da-013e-48a0-bb63-ca66291baf05 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:44.578840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238401da-013e-48a0-bb63-ca66291baf05 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:44.580543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238401da-013e-48a0-bb63-ca66291baf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:44.627491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5', 'request_id': 'req-f63da8be-f517-4826-bf92-6e6369109f41'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.652514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-238401da-013e-48a0-bb63-ca66291baf05 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:44.655585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-238401da-013e-48a0-bb63-ca66291baf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:44.672013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5', 'request_id': 'req-f63da8be-f517-4826-bf92-6e6369109f41'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.697887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5', 'request_id': 'req-f63da8be-f517-4826-bf92-6e6369109f41'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.733992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] The token cache is being invalidate because project da2363a223ce4f23a97cae3e391713b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:44.734547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.737664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.758824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5', 'request_id': 'req-f63da8be-f517-4826-bf92-6e6369109f41'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.767951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5', 'request_id': 'req-f63da8be-f517-4826-bf92-6e6369109f41'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.768937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'da2363a223ce4f23a97cae3e391713b5', 'request_id': 'req-f63da8be-f517-4826-bf92-6e6369109f41'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:44.778501 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2174/4347] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:55:44 2022] DELETE /identity/v3/domains/da2363a223ce4f23a97cae3e391713b5 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:44.782186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:44.787991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:44.821675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:44.822273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:44.926835 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2174/4348] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:44.941364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d7f00-f0f0-4903-947c-ccb0cbfdfc35 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:44.942862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d7f00-f0f0-4903-947c-ccb0cbfdfc35 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:44.944075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d7f00-f0f0-4903-947c-ccb0cbfdfc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:44.970613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da8be-f517-4826-bf92-6e6369109f41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:44.973215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e4d7f00-f0f0-4903-947c-ccb0cbfdfc35 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:44.974648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e4d7f00-f0f0-4903-947c-ccb0cbfdfc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:44.983772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:44.984705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:44.985130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:44.985525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:44.986408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:44.989023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:44.990363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2175/4349] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:44.996063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d7f00-f0f0-4903-947c-ccb0cbfdfc35 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.013778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d7f00-f0f0-4903-947c-ccb0cbfdfc35 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.035459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.037016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.037498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.041512 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2175/4350] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:55:44 2022] GET /identity/v3/domains => generated 1347 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:45.042178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.042976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.043449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:45.044026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.046073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.062941 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2176/4351] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:55:45.065699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc03c5-4831-460d-9e3d-1d2d459199e7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.069365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.082919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.083961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.084273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.084605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/da2363a223ce4f23a97cae3e391713b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.102944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7b929-fdcc-485d-ac63-66b90591f150 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.105852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:55:45.122982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.128769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find domain: da2363a223ce4f23a97cae3e391713b5.: keystone.exception.DomainNotFound: Could not find domain: da2363a223ce4f23a97cae3e391713b5. Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da2363a223ce4f23a97cae3e391713b5. Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:45.129644 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:45.131378 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da2363a223ce4f23a97cae3e391713b5. Jul 14 14:55:45.132642 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:45.135044 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2176/4352] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:45 2022] PATCH /identity/v3/domains/da2363a223ce4f23a97cae3e391713b5 => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:45.137039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.137556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.140012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.145551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.150954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.161508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d794a3e-cfa8-480b-91e4-28eb981c73ed tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.172183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.174230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.174578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.177111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.178164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.182970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.231784 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2177/4353] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:55:45 2022] POST /identity/v3/domains => generated 277 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:45.250626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.278646 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2177/4354] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:45 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:55:45.280132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.393149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f86b-b49c-4ab2-ba2e-5039961b006b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.408919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.409914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.410153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.410336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.411102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.418254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.458086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c053-ad29-43be-99ac-fbe966b06253 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.515878 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2178/4355] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:45 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:45.532005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.563655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055619f5-fe9f-48dc-a407-3bcb255d59e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.577215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.580175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.580499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.580813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.581644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.583499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.616527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.617432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.618525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.618873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.619731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.624998 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2179/4356] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:45.625283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.628115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.650716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b803ec-e0de-488d-9e93-1ba0598e418b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.670042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.670703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.671043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.671444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.672321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.677555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.707162 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2178/4357] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:45 2022] POST /identity/v3/users => generated 346 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:45.708384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.710527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:45.724162 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2180/4358] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:45.725175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.752751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:45.770053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f4d54-d6f1-423d-ac83-a92593f10b32 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.793979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.794744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.795205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.795577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.797013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.801879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.836946 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2181/4359] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:55:45 2022] POST /identity/v3/groups => generated 324 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:45.838665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.861480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0f9fe-a11d-4106-80b8-3623a3d77fd6 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.869082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f09a9-822b-469c-a426-47fbfe829a41 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:45.873666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.874574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.874882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.875203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.878848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:45.885646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab728391-10be-4359-875b-89e14d73c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:45.887773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab728391-10be-4359-875b-89e14d73c323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:45.887773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab728391-10be-4359-875b-89e14d73c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:45.888270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab728391-10be-4359-875b-89e14d73c323 admin admin] PATH_INFO: `/v3/projects/6ee00daa615a44dca0645ac6735ea176/users/a22f242a85264177b686d8be0a1218c4/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:45.912784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.916354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:45.971858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab728391-10be-4359-875b-89e14d73c323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee00daa615a44dca0645ac6735ea176, user_id=a22f242a85264177b686d8be0a1218c4, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:45.981362 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2179/4360] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:45.981362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:45.986915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab728391-10be-4359-875b-89e14d73c323 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:46.066363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2182/4361] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:45 2022] PUT /identity/v3/projects/6ee00daa615a44dca0645ac6735ea176/users/a22f242a85264177b686d8be0a1218c4/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:46.074880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06232b3e-d293-4fb2-952c-941e43ebe16b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:46.088341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1dbc-51e6-4262-99e6-a9290f9342d4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:46.088880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1dbc-51e6-4262-99e6-a9290f9342d4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:46.091364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1dbc-51e6-4262-99e6-a9290f9342d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:46.180836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e0ed1dbc-51e6-4262-99e6-a9290f9342d4 None None] MFA Rules not processed for user `a22f242a85264177b686d8be0a1218c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:46.188395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0ed1dbc-51e6-4262-99e6-a9290f9342d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:46.309594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:46.313694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:46.314051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:46.315612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/be44863e3b22494689c8b4c9dc89b1b6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:46.321476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=be44863e3b22494689c8b4c9dc89b1b6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:46.326356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:46.343123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:46.425572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:46.428270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:46.486703 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2183/4362] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:46.497940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:46.508850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:46.509712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:46.510360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:46.510719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:46.513703 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2180/4363] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:45 2022] PATCH /identity/v3/domains/be44863e3b22494689c8b4c9dc89b1b6 => generated 278 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:46.519173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:46.522243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:46.565124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] MFA Rules not processed for user `a22f242a85264177b686d8be0a1218c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:46.566403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:46.654488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e59eff-550f-4644-8fe7-ac30f1f96440 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:46.669772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:46.670687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:46.671013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:46.671474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/be44863e3b22494689c8b4c9dc89b1b6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:46.698721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=be44863e3b22494689c8b4c9dc89b1b6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:46.700766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:46.729544 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2184/4364] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:46.729544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:46.729544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:46.765854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:46.772228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:46.783605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:46.908856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35e8d-ae76-434b-9888-c09d931ce660 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:46.938164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:46.941285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:46.942355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:46.943749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] PATH_INFO: `/v3/users/f941e81d90b74682b8108c9dcdf744c8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:46.948215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f941e81d90b74682b8108c9dcdf744c8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:46.955335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:47.185681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f941e81d90b74682b8108c9dcdf744c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.210610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f941e81d90b74682b8108c9dcdf744c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.228720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f941e81d90b74682b8108c9dcdf744c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.230475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f941e81d90b74682b8108c9dcdf744c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.232705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19230f83e75470f9921bfa0dcd207ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.234622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:47.253412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f941e81d90b74682b8108c9dcdf744c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.267634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2185/4365] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:46 2022] DELETE /identity/v3/users/f941e81d90b74682b8108c9dcdf744c8 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:47.268864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:47.271251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:47.299317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19230f83e75470f9921bfa0dcd207ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.300532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19230f83e75470f9921bfa0dcd207ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.329937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19230f83e75470f9921bfa0dcd207ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.337292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19230f83e75470f9921bfa0dcd207ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.419313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6817b3-8932-41b5-b0d9-a463a65e0da2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:47.498920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6', 'request_id': 'req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.509886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6', 'request_id': 'req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.529721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6', 'request_id': 'req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.556304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] The token cache is being invalidate because project be44863e3b22494689c8b4c9dc89b1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:47.558277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.559925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.563133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:47.580215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6', 'request_id': 'req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.585617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6', 'request_id': 'req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.587574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'be44863e3b22494689c8b4c9dc89b1b6', 'request_id': 'req-d12893f4-b78f-47b9-85f5-bcbcf2beb38d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:47.599207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2181/4366] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:55:46 2022] DELETE /identity/v3/domains/be44863e3b22494689c8b4c9dc89b1b6 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:47.600183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:47.601133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:47.601522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:47.601916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:47.603020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:47.603445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:47.603983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:47.614971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:47.632936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:47.632936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:47.738372 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2182/4367] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:47.739562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:47.741472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:47.836034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:47.840268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:47.875944 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2186/4368] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:47.887510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377d416-5a6a-4514-9dfb-f9cca956b1eb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:47.893643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:47.894555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:47.894899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:47.895187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/be44863e3b22494689c8b4c9dc89b1b6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:47.904719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:47.906188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:47.923441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=be44863e3b22494689c8b4c9dc89b1b6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:47.926939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find domain: be44863e3b22494689c8b4c9dc89b1b6.: keystone.exception.DomainNotFound: Could not find domain: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:47.991359 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:47.993218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:47.994681 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:47.999988 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2183/4369] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 14:55:47 2022] GET /identity/v3/domains/be44863e3b22494689c8b4c9dc89b1b6 => generated 112 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:48.010768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:48.143995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:48.152871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa640-1fb7-4f26-87d5-9aaeeecee05c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:48.179108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f73de-c246-40e9-9df2-7f6e9bb05ea2 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:48.194751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:48.197709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:48.198099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:48.200782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/users/d19230f83e75470f9921bfa0dcd207ce` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:48.229983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:get_user(user_id=d19230f83e75470f9921bfa0dcd207ce)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:48.235587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find user: d19230f83e75470f9921bfa0dcd207ce.: keystone.exception.UserNotFound: Could not find user: d19230f83e75470f9921bfa0dcd207ce. Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:55:48.285129 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:48.287090 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: d19230f83e75470f9921bfa0dcd207ce. Jul 14 14:55:48.291543 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:48.302666 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2184/4370] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:55:48 2022] GET /identity/v3/users/d19230f83e75470f9921bfa0dcd207ce => generated 110 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:48.302666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:48.343888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba96d0c-8b0d-43e8-8066-011912bfa348 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:48.393720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:48.394784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:48.395116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:48.395485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/groups/4c1a49d981794210bf2ab96bf29bdc48` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:48.416046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:get_group(group_id=4c1a49d981794210bf2ab96bf29bdc48)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:48.417113 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:48.417113 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:55:48.417113 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:55:48.421007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:48.450522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:48.458189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:48.458708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:48.459213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find group: 4c1a49d981794210bf2ab96bf29bdc48.: keystone.exception.GroupNotFound: Could not find group: 4c1a49d981794210bf2ab96bf29bdc48. Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 14 14:55:48.472843 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:48.474805 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 4c1a49d981794210bf2ab96bf29bdc48. Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:48.476117 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2185/4371] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:48 2022] GET /identity/v3/groups/4c1a49d981794210bf2ab96bf29bdc48 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:48.482436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:48.500062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98425a4-5490-4b39-9b5f-ea0a8e52d345 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:48.502306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:48.505894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:48.517725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:48.521414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:48.521875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:48.522061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/groups/4c1a49d981794210bf2ab96bf29bdc48` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:48.537793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:55:48.544563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2187/4372] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find group: 4c1a49d981794210bf2ab96bf29bdc48.: keystone.exception.GroupNotFound: Could not find group: 4c1a49d981794210bf2ab96bf29bdc48. Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 14 14:55:48.560974 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:48.562977 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 4c1a49d981794210bf2ab96bf29bdc48. Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:48.566626 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2186/4373] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 14:55:48 2022] DELETE /identity/v3/groups/4c1a49d981794210bf2ab96bf29bdc48 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:48.573793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:48.607562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da198b0-b084-44a3-820e-71b7a6fbddcd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:48.640012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:48.645203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:48.646214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:48.649414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/users/d19230f83e75470f9921bfa0dcd207ce` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:48.700131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d19230f83e75470f9921bfa0dcd207ce)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:48.716960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find user: d19230f83e75470f9921bfa0dcd207ce.: keystone.exception.UserNotFound: Could not find user: d19230f83e75470f9921bfa0dcd207ce. Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 14 14:55:48.811754 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:48.812949 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: d19230f83e75470f9921bfa0dcd207ce. Jul 14 14:55:48.814255 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:55:48.819137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:48.828329 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2188/4374] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:48 2022] DELETE /identity/v3/users/d19230f83e75470f9921bfa0dcd207ce => generated 110 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:48.836342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34275-d191-4ebf-97e6-14cd187d3744 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:48.842591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:48.843717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:48.844010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:48.844291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/be44863e3b22494689c8b4c9dc89b1b6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:48.857271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find domain: be44863e3b22494689c8b4c9dc89b1b6.: keystone.exception.DomainNotFound: Could not find domain: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:48.884432 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:48.885829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:48.887186 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:48.894409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:48.924754 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2187/4375] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:48 2022] PATCH /identity/v3/domains/be44863e3b22494689c8b4c9dc89b1b6 => generated 112 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:48.932603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bc790-94d1-4175-9802-20e1bd34104b tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:48.940011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:48.940712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:48.941054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:48.941342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:48.942076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:48.945446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:48.987491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2189/4376] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:55:48 2022] GET /identity/v3/domains => generated 1347 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:48.987729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:49.021502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9407a-266e-4555-8ebf-c68006ca5561 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:49.063085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:49.064772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:49.065549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:49.066340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:49.068653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:49.069489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:49.073592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:49.208433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:49.228129 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2188/4377] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:48 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:49.232514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f990b-edbe-4ccf-8e3e-bd38bfeeab8f tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:49.280130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:49.280857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:49.281191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:49.281517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:49.282388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1108913153) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:49.282703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:49.284444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:49.327323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:49.327566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2190/4378] 10.222.0.98 () {58 vars in 1198 bytes} [Thu Jul 14 14:55:49 2022] GET /identity/v3/domains?name=tempest-test_domain-1108913153 => generated 408 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:55:49.354283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7de75-161e-432d-ae6e-21a1b28ee280 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:49.359698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:49.360731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:49.361021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:49.361305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/be44863e3b22494689c8b4c9dc89b1b6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:49.402135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Could not find domain: be44863e3b22494689c8b4c9dc89b1b6.: keystone.exception.DomainNotFound: Could not find domain: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:55:49.417263 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:55:49.418755 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: be44863e3b22494689c8b4c9dc89b1b6. Jul 14 14:55:49.419960 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:55:49.421233 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2189/4379] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:49 2022] PATCH /identity/v3/domains/be44863e3b22494689c8b4c9dc89b1b6 => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:55:49.426772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:49.449584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b83a91-e33a-4547-9b64-c98435d1b155 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:49.464858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:49.475724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:49.476608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:49.478681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:49.480111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:49.480426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/5021504480e44632806325dba88123c5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:49.507144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:49.520933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5021504480e44632806325dba88123c5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:49.525790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:49.671833 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2191/4380] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:49 2022] PATCH /identity/v3/domains/5021504480e44632806325dba88123c5 => generated 277 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:49.672969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:49.673133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83dd78-cdd7-4758-95cd-c417ffb54c5e tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:49.688997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:49.689731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:49.690026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:49.690313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:49.702914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:49.704878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f4872-b65a-4241-ad45-fcb50bc7e844 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:49.718788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:49.719831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:49.720283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:49.720416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/5021504480e44632806325dba88123c5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:49.735848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:49.737716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:49.760739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5021504480e44632806325dba88123c5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:49.766071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:49.771114 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2190/4381] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:49.863424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5021504480e44632806325dba88123c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:49.878708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5021504480e44632806325dba88123c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:49.940925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:50.066879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5021504480e44632806325dba88123c5', 'request_id': 'req-ce74e3c5-5445-4ce9-84fd-dd6942768282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.083927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5021504480e44632806325dba88123c5', 'request_id': 'req-ce74e3c5-5445-4ce9-84fd-dd6942768282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.098051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5021504480e44632806325dba88123c5', 'request_id': 'req-ce74e3c5-5445-4ce9-84fd-dd6942768282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.137892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] The token cache is being invalidate because project 5021504480e44632806325dba88123c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:50.138208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.144930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.176010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5021504480e44632806325dba88123c5', 'request_id': 'req-ce74e3c5-5445-4ce9-84fd-dd6942768282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.190890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5021504480e44632806325dba88123c5', 'request_id': 'req-ce74e3c5-5445-4ce9-84fd-dd6942768282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.193664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5021504480e44632806325dba88123c5', 'request_id': 'req-ce74e3c5-5445-4ce9-84fd-dd6942768282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.229733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2192/4382] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:55:49 2022] DELETE /identity/v3/domains/5021504480e44632806325dba88123c5 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:50.231188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:50.261046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad035-2b1c-4676-a666-a2c1bffa82b4 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:50.488933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:50.489817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:50.490113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:50.490399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/4779e3a872f74d818b47c424e28c6687` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:50.569934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4779e3a872f74d818b47c424e28c6687)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:50.569934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:50.686068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4779e3a872f74d818b47c424e28c6687'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.686906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4779e3a872f74d818b47c424e28c6687'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.754412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4779e3a872f74d818b47c424e28c6687'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.755180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-82f668f2-e871-4c24-9c74-ff9d849015a1 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4779e3a872f74d818b47c424e28c6687'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:50.759680 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2191/4383] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:50 2022] PATCH /identity/v3/domains/4779e3a872f74d818b47c424e28c6687 => generated 277 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:50.764088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:50.768041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:50.841241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74e3c5-5445-4ce9-84fd-dd6942768282 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:51.180027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:51.182513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:51.183054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:51.183382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:51.183853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:51.183995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:51.186928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/4779e3a872f74d818b47c424e28c6687` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:51.292854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] MFA Rules not processed for user `b06a5d6f31ea4d4a9a7e69f759a3c7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:51.296743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4779e3a872f74d818b47c424e28c6687)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:51.298045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:51.304195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:51.408468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4779e3a872f74d818b47c424e28c6687'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.423685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4779e3a872f74d818b47c424e28c6687'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.532300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:51.551896 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2192/4384] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:51.586951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4779e3a872f74d818b47c424e28c6687', 'request_id': 'req-890d5233-5a36-40a8-a650-eec719fc197a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.610556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:51.615801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4779e3a872f74d818b47c424e28c6687', 'request_id': 'req-890d5233-5a36-40a8-a650-eec719fc197a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.643675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4779e3a872f74d818b47c424e28c6687', 'request_id': 'req-890d5233-5a36-40a8-a650-eec719fc197a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.695139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] The token cache is being invalidate because project 4779e3a872f74d818b47c424e28c6687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:51.698553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.701576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.751537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4779e3a872f74d818b47c424e28c6687', 'request_id': 'req-890d5233-5a36-40a8-a650-eec719fc197a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.770505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4779e3a872f74d818b47c424e28c6687', 'request_id': 'req-890d5233-5a36-40a8-a650-eec719fc197a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.773069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4779e3a872f74d818b47c424e28c6687', 'request_id': 'req-890d5233-5a36-40a8-a650-eec719fc197a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:51.800956 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2193/4385] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:55:50 2022] DELETE /identity/v3/domains/4779e3a872f74d818b47c424e28c6687 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:51.803110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:51.805584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:51.834099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:51.836619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:51.865389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d15945-6c51-4038-9bf8-5c71660dda5c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:52.071444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:52.072976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:52.077279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:52.078167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/e7902fab83f247768143aaed595d737c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:52.110298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e7902fab83f247768143aaed595d737c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:52.112056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:52.168747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5233-5a36-40a8-a650-eec719fc197a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:52.171157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e7902fab83f247768143aaed595d737c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.173967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e7902fab83f247768143aaed595d737c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.194271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:52.196933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:52.204101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:52.205716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] PATH_INFO: `/v3/projects/34f298651f3b4281880dbfb0f71c52b5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:52.224285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f298651f3b4281880dbfb0f71c52b5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:52.242622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:52.251140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e7902fab83f247768143aaed595d737c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.254590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e7902fab83f247768143aaed595d737c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.263792 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2193/4386] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:55:51 2022] PATCH /identity/v3/domains/e7902fab83f247768143aaed595d737c => generated 277 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:52.270527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:52.273090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:52.477723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f298651f3b4281880dbfb0f71c52b5', 'request_id': 'req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.495102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f298651f3b4281880dbfb0f71c52b5', 'request_id': 'req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.502486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d479f-def6-49f5-86f8-b75bb65223f7 tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:52.517744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f298651f3b4281880dbfb0f71c52b5', 'request_id': 'req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.550061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] The token cache is being invalidate because project 34f298651f3b4281880dbfb0f71c52b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:52.550590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.553229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.557203 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2194/4387] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:51 2022] DELETE /identity/v3/projects/34f298651f3b4281880dbfb0f71c52b5 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:55:52.564147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:52.567997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:52.682303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:52.720143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:52.733531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420973ac77a846fbae9a05b7ea22ffe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e13635d7a3e44614bf4b372018b8f521', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:52.736084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:52.736422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:52.736717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] PATH_INFO: `/v3/domains/e7902fab83f247768143aaed595d737c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:52.757650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663e91-6c29-49a8-b0cf-8f922b48cd2d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:52.782923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:52.784060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:52.784260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:52.784435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] PATH_INFO: `/v3/users/b84485cdb2c14a2fb8527839cb5543bb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:52.787999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84485cdb2c14a2fb8527839cb5543bb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:52.790124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:52.793994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e7902fab83f247768143aaed595d737c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:52.801941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:52.923618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e7902fab83f247768143aaed595d737c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.945335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e7902fab83f247768143aaed595d737c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.951917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84485cdb2c14a2fb8527839cb5543bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:52.989880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84485cdb2c14a2fb8527839cb5543bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.011735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84485cdb2c14a2fb8527839cb5543bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.012701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84485cdb2c14a2fb8527839cb5543bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.048697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84485cdb2c14a2fb8527839cb5543bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.086453 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2195/4388] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:52 2022] DELETE /identity/v3/users/b84485cdb2c14a2fb8527839cb5543bb => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:53.166876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7902fab83f247768143aaed595d737c', 'request_id': 'req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.196538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7902fab83f247768143aaed595d737c', 'request_id': 'req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.213977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7902fab83f247768143aaed595d737c', 'request_id': 'req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.282776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] The token cache is being invalidate because project e7902fab83f247768143aaed595d737c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:53.283171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.286393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.306286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e7902fab83f247768143aaed595d737c', 'request_id': 'req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.332419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e7902fab83f247768143aaed595d737c', 'request_id': 'req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.334480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a tempest-DomainsTestJSON-2075428623 tempest-DomainsTestJSON-2075428623-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e7902fab83f247768143aaed595d737c', 'request_id': 'req-13ba9e8d-a30b-4999-8b08-f0bc674edb9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.354509 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2194/4389] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:55:52 2022] DELETE /identity/v3/domains/e7902fab83f247768143aaed595d737c => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:53.358731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:53.360309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:53.562240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902a02-4e85-4077-b120-1cf55ccf2c75 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:53.684170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:53.685017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:53.685302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:53.685647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] PATH_INFO: `/v3/users/719f7f6f45ca4e4398ae37eabcec2c46` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:53.687566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=719f7f6f45ca4e4398ae37eabcec2c46)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:53.689892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:53.752400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:53.845518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719f7f6f45ca4e4398ae37eabcec2c46'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.910987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719f7f6f45ca4e4398ae37eabcec2c46'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.942561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719f7f6f45ca4e4398ae37eabcec2c46'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.944092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719f7f6f45ca4e4398ae37eabcec2c46'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:53.984701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719f7f6f45ca4e4398ae37eabcec2c46'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:54.020690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2196/4390] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:53 2022] DELETE /identity/v3/users/719f7f6f45ca4e4398ae37eabcec2c46 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:54.022555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:54.023409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:54.023409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:54.086360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:54.087696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:54.276329 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2195/4391] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:54.298040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:54.301735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:54.505861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62b2cb-5567-4a65-9242-ac43d7802d58 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:54.537222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83645537-d8f2-4789-8626-cfd1004009e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:54.539537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645537-d8f2-4789-8626-cfd1004009e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:54.539834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645537-d8f2-4789-8626-cfd1004009e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:54.542341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645537-d8f2-4789-8626-cfd1004009e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:54.569142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83645537-d8f2-4789-8626-cfd1004009e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:54.573624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83645537-d8f2-4789-8626-cfd1004009e5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:54.614816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2197/4392] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:54.994911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:55.000413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:55.056925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda1a00-c3aa-42ff-8bed-de49581fb8fe None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:55.085049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:55.086948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:55.089827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:55.093402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] PATH_INFO: `/v3/projects/e66131d05f3b4cca9312c49aacccd74f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:55.099895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66131d05f3b4cca9312c49aacccd74f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:55.108257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:55.356970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:55.502806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66131d05f3b4cca9312c49aacccd74f', 'request_id': 'req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:55.535030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66131d05f3b4cca9312c49aacccd74f', 'request_id': 'req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:55.561030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66131d05f3b4cca9312c49aacccd74f', 'request_id': 'req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:55.653014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] The token cache is being invalidate because project e66131d05f3b4cca9312c49aacccd74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:55.654892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:55.660784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b0a5ab98-833c-4c60-bfa2-1c15e88e4d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:55.675139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2196/4393] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:54 2022] DELETE /identity/v3/projects/e66131d05f3b4cca9312c49aacccd74f => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:55.683006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:55.683966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:55.683966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:55.767361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:55.769040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:56.099327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2198/4394] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:55:56.112095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c4d3-0e51-471f-ab9c-5547e8aacb8d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:56.115512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c4d3-0e51-471f-ab9c-5547e8aacb8d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:56.115512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c4d3-0e51-471f-ab9c-5547e8aacb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:56.119711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:56.124407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:56.165027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c2de-390b-4c20-aefd-f862d8e31f4d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:56.184395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:56.185895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:56.188495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:56.191964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2480c4d3-0e51-471f-ab9c-5547e8aacb8d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:56.193129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] PATH_INFO: `/v3/projects/6d10ec00b70c42f6b59f09c32c9d2dae` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:56.194373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2480c4d3-0e51-471f-ab9c-5547e8aacb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:56.199473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d10ec00b70c42f6b59f09c32c9d2dae)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:56.203597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:56.293926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2197/4395] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:56.302518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c4d3-0e51-471f-ab9c-5547e8aacb8d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:56.324181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:56.369409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c4d3-0e51-471f-ab9c-5547e8aacb8d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:56.385176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d10ec00b70c42f6b59f09c32c9d2dae', 'request_id': 'req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:56.420319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d10ec00b70c42f6b59f09c32c9d2dae', 'request_id': 'req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:56.461233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d10ec00b70c42f6b59f09c32c9d2dae', 'request_id': 'req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:56.531619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] The token cache is being invalidate because project 6d10ec00b70c42f6b59f09c32c9d2dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:56.533568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:56.537059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:56.546732 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2199/4396] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:56 2022] DELETE /identity/v3/projects/6d10ec00b70c42f6b59f09c32c9d2dae => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:56.552992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:56.562260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:56.610066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:56.617911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:56.618892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:56.621514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:56.623492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:55:56.627868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:56.638864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:56.713028 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2198/4397] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:55:56.715188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:56.723487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:56.761149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9960f2-7d38-4e41-aa6c-c718a20e8320 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:56.787585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:56.788693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:56.789738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:56.791077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:56.792126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:56.799076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:56.863712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b4b6-5dd1-4d21-8e5a-0ef806ce1afc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:56.876219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:56.877107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:56.877473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:56.877846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] PATH_INFO: `/v3/users/420973ac77a846fbae9a05b7ea22ffe4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:56.882069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] RBAC: Authorizing `identity:delete_user(user_id=420973ac77a846fbae9a05b7ea22ffe4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:56.890418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:56.903116 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2199/4398] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:55:56 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:56.910848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:57.014632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420973ac77a846fbae9a05b7ea22ffe4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:57.080261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420973ac77a846fbae9a05b7ea22ffe4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:57.094150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f019eb-a035-431e-aac1-0b347de56f73 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:57.107439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420973ac77a846fbae9a05b7ea22ffe4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:57.110125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420973ac77a846fbae9a05b7ea22ffe4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:57.118656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:57.120382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:57.126224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:57.127761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:57.130576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:57.134421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:57.137297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420973ac77a846fbae9a05b7ea22ffe4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:57.154888 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2200/4399] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:55:56 2022] DELETE /identity/v3/users/420973ac77a846fbae9a05b7ea22ffe4 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:57.231638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:57.231929 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2200/4400] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:55:56 2022] POST /identity/v3/users => generated 295 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:55:57.235822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:57.586178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:57.735018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd347c5-2687-4ad9-8d94-c00d8355214b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:57.774215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:57.775447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:57.788574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:57.790487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:57.791126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:57.806358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:57.875070 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2201/4401] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 644 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:55:57.881640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:57.906706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808a371-5660-48eb-bdfd-15d856d63519 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:57.922205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e9412-b546-458d-9562-773ab2c4200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:57.922923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e9412-b546-458d-9562-773ab2c4200a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:57.923218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e9412-b546-458d-9562-773ab2c4200a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:57.923565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e9412-b546-458d-9562-773ab2c4200a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:57.924405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e9412-b546-458d-9562-773ab2c4200a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:57.926370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e9412-b546-458d-9562-773ab2c4200a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:57.970404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2201/4402] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:55:57.974513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:58.006549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805eda7-c08c-4439-b1cf-70287920e097 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:58.080788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:58.091563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:58.095034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:58.095422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] PATH_INFO: `/v3/projects/65169b89647141db8e006d0dcc74e526/users/1010f86e104f4ad6883b5da1ad08d70b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:58.219642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65169b89647141db8e006d0dcc74e526, user_id=1010f86e104f4ad6883b5da1ad08d70b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:58.227832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:58.262810 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2202/4403] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:55:57 2022] PUT /identity/v3/projects/65169b89647141db8e006d0dcc74e526/users/1010f86e104f4ad6883b5da1ad08d70b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:58.274543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:58.274543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:58.274543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:58.280802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:58.410778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] MFA Rules not processed for user `1010f86e104f4ad6883b5da1ad08d70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:58.412478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:58.574702 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2202/4404] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:55:58.718807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:58.721356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:58.947762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ee407-8639-4825-b3b3-edbe14af13c7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:58.970428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0da5d5-8ece-4892-a881-b0ceedbe9ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:58.971320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0da5d5-8ece-4892-a881-b0ceedbe9ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:58.971714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0da5d5-8ece-4892-a881-b0ceedbe9ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:58.971856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0da5d5-8ece-4892-a881-b0ceedbe9ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:59.008337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0da5d5-8ece-4892-a881-b0ceedbe9ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:59.009881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0da5d5-8ece-4892-a881-b0ceedbe9ad1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:59.039639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2203/4405] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:55:59.288671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:55:59.291959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:55:59.542662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816d724-d4f0-4fe3-92e5-489ba891bd4a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:55:59.568816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:55:59.569891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:59.570177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:59.571012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] PATH_INFO: `/v3/projects/e13635d7a3e44614bf4b372018b8f521` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:59.582259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13635d7a3e44614bf4b372018b8f521)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:55:59.584358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:55:59.756662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13635d7a3e44614bf4b372018b8f521', 'request_id': 'req-f38e6ddc-076c-44c6-a577-c4457354e925'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:59.785152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13635d7a3e44614bf4b372018b8f521', 'request_id': 'req-f38e6ddc-076c-44c6-a577-c4457354e925'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:59.796957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13635d7a3e44614bf4b372018b8f521', 'request_id': 'req-f38e6ddc-076c-44c6-a577-c4457354e925'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:59.824525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] The token cache is being invalidate because project e13635d7a3e44614bf4b372018b8f521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:55:59.824824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:59.834462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f38e6ddc-076c-44c6-a577-c4457354e925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:55:59.843817 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2203/4406] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:55:59 2022] DELETE /identity/v3/projects/e13635d7a3e44614bf4b372018b8f521 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:55:59.848731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230039a-b59a-4133-9bd7-cca722052aa1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:55:59.849861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230039a-b59a-4133-9bd7-cca722052aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:55:59.849861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230039a-b59a-4133-9bd7-cca722052aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:55:59.905569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5230039a-b59a-4133-9bd7-cca722052aa1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:55:59.907040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5230039a-b59a-4133-9bd7-cca722052aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:00.132153 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2204/4407] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:00.139800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559ba65-95af-42d0-910b-c9aab565e5af None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:00.140094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559ba65-95af-42d0-910b-c9aab565e5af None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:00.140380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559ba65-95af-42d0-910b-c9aab565e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:00.219023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f559ba65-95af-42d0-910b-c9aab565e5af None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:00.220616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f559ba65-95af-42d0-910b-c9aab565e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:00.270909 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2204/4408] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:00.272404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230039a-b59a-4133-9bd7-cca722052aa1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:00.290760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230039a-b59a-4133-9bd7-cca722052aa1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:00.304485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:00.305884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:00.306178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:00.306458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:00.307239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:56:00.307579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:00.309293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:00.359513 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2205/4409] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:00.363745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559ba65-95af-42d0-910b-c9aab565e5af None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:00.377725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559ba65-95af-42d0-910b-c9aab565e5af None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:00.401911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:00.409164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:00.412115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:00.412824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:00.422536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:00.431669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:00.527592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:00.583304 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2205/4410] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:00 2022] POST /identity/v3/projects => generated 369 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:00.587994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:00.625337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91383032-91ef-494a-9df5-568594df8e06 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:00.829130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:00.875815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:00.877374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:00.877773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:00.878180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:00.879968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:00.882334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:00.925686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:00.926298 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2206/4411] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:00 2022] POST /identity/v3/users => generated 285 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:00.977643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88c724-2d83-469f-8ae7-a262fc29a70e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:01.011410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:01.012709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:01.014816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:01.019255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:01.020583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:01.023806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:01.092419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:01.106762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713100-8add-454e-b1e1-f90467a898b1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:01.115443 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2206/4412] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:56:01.126648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c09163-8a4a-461e-af36-56e5d0367669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:01.127373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09163-8a4a-461e-af36-56e5d0367669 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:01.127669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09163-8a4a-461e-af36-56e5d0367669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:01.127950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09163-8a4a-461e-af36-56e5d0367669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:01.128720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c09163-8a4a-461e-af36-56e5d0367669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:01.131011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c09163-8a4a-461e-af36-56e5d0367669 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:01.166933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:01.183769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d33535-2789-4d21-9e8e-c7c60ee55851 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:01.189755 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2207/4413] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:01.206452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:01.207426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:01.207717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:01.208139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] PATH_INFO: `/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7/users/d98e5e9a27d8460988302e15425b7d81/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:01.253600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09eb2a150f943daa80c3fa4acebb8c7, user_id=d98e5e9a27d8460988302e15425b7d81, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:01.256723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:01.328240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2207/4414] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:01 2022] PUT /identity/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7/users/d98e5e9a27d8460988302e15425b7d81/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:01.333782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0d0a-1721-4085-9d94-7eb1237ff8ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:01.335123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0d0a-1721-4085-9d94-7eb1237ff8ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:01.336979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0d0a-1721-4085-9d94-7eb1237ff8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:01.414794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ff7b0d0a-1721-4085-9d94-7eb1237ff8ab None None] MFA Rules not processed for user `d98e5e9a27d8460988302e15425b7d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:01.416928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff7b0d0a-1721-4085-9d94-7eb1237ff8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:01.608319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2208/4415] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:01.609637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:01.741532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10558e-b4a3-4931-b6f6-42d38fbd3319 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:01.769083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:01.769391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:01.769718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:01.770065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:01.770656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:01.783340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:01.871463 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2208/4416] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:01 2022] POST /identity/v3/projects => generated 367 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:01.873092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0d0a-1721-4085-9d94-7eb1237ff8ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:01.891399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0d0a-1721-4085-9d94-7eb1237ff8ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:02.073530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:02.074746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:02.076248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:02.076973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:02.079068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:02.092096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:02.172355 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2209/4417] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:01 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:02.174490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:02.199766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55dfcb-8687-4aaa-b382-0dee6bac6246 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:02.205968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:02.206964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:02.207261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:02.212589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:02.213794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:02.215640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:02.264874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2209/4418] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:02.269215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:02.292076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd925c-3ddf-4be7-ba99-0121409ab458 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:02.351747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:02.355145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:02.355651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:02.356196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] PATH_INFO: `/v3/projects/ac5796c4b631439f8e8bc9e85f5d6905/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:02.414126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5796c4b631439f8e8bc9e85f5d6905, user_id=55e6b999d32249eb8d29ea887e23b24d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:02.431088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:02.474705 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2210/4419] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:02 2022] PUT /identity/v3/projects/ac5796c4b631439f8e8bc9e85f5d6905/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:02.481239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:02.535479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3233e-afc4-4494-b7a3-f85ca1d969c9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:02.743161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114563fa-d3b2-48f6-9f2d-1b0fb441ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:02.745529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114563fa-d3b2-48f6-9f2d-1b0fb441ba31 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:02.746297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114563fa-d3b2-48f6-9f2d-1b0fb441ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:02.747017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114563fa-d3b2-48f6-9f2d-1b0fb441ba31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:02.750847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114563fa-d3b2-48f6-9f2d-1b0fb441ba31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:02.754323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114563fa-d3b2-48f6-9f2d-1b0fb441ba31 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:02.791285 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2210/4420] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:56:02.792820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:02.813678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069921b-3c29-4c18-9b6f-cc99c3104bd2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:02.823421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:02.825618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:02.826362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:02.827094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] PATH_INFO: `/v3/projects/ac5796c4b631439f8e8bc9e85f5d6905/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:02.838204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5796c4b631439f8e8bc9e85f5d6905, user_id=55e6b999d32249eb8d29ea887e23b24d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:02.848005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:02.873310 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2211/4421] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:02 2022] PUT /identity/v3/projects/ac5796c4b631439f8e8bc9e85f5d6905/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:02.886092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec565-d2dd-4ace-a381-eb7eb615ca4f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:02.886418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec565-d2dd-4ace-a381-eb7eb615ca4f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:02.886865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec565-d2dd-4ace-a381-eb7eb615ca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:02.938882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d17ec565-d2dd-4ace-a381-eb7eb615ca4f None None] MFA Rules not processed for user `55e6b999d32249eb8d29ea887e23b24d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:02.939573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d17ec565-d2dd-4ace-a381-eb7eb615ca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:03.020848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:03.277204 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2211/4422] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:03.279598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:03.306149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:03.472699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677aa5e-d762-4890-994d-ae17fadc6abc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:03.479473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:03.480201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:03.480520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:03.480917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:03.481986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:03.484114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:03.531976 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2212/4423] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:03 2022] POST /identity/v3/projects => generated 369 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:03.532653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec565-d2dd-4ace-a381-eb7eb615ca4f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:03.568466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec565-d2dd-4ace-a381-eb7eb615ca4f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:03.755928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:03.757066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:03.757545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:03.758543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:03.759883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:03.763758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:03.813038 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2212/4424] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:03 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:03.815120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:03.853956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c219a-fe4f-4dd4-8566-305bb9519023 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:03.876641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:03.877605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:03.878126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:03.878603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:03.880083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:03.903179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:03.940300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:03.941400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:03.959981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2213/4425] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:03.970910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:03.995773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cdd0-ae08-467a-bb78-e89f69dff6c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:04.000159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207c56-e66e-49db-8531-bd0def84ee98 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:04.008697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:04.009613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:04.010073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:04.010550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:04.011384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:04.011894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:04.013166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:04.014527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:04.015028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] PATH_INFO: `/v3/users/a22f242a85264177b686d8be0a1218c4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:04.015173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:04.046845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22f242a85264177b686d8be0a1218c4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:04.052723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:04.074673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2214/4426] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:04.079815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:04.141478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa521-d8c8-4d9a-ae59-4bc7bb1eefd9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:04.173255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2466b38-b417-4836-af7b-c8f8596ed6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:04.177514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466b38-b417-4836-af7b-c8f8596ed6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:04.180709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466b38-b417-4836-af7b-c8f8596ed6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:04.181291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466b38-b417-4836-af7b-c8f8596ed6e3 admin admin] PATH_INFO: `/v3/projects/6da7b6f6cf1244bf9db3b16f702e55a9/users/af9c9dc2edcb496080ec178894b7706b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:04.282815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22f242a85264177b686d8be0a1218c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:04.284077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2466b38-b417-4836-af7b-c8f8596ed6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da7b6f6cf1244bf9db3b16f702e55a9, user_id=af9c9dc2edcb496080ec178894b7706b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:04.287484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2466b38-b417-4836-af7b-c8f8596ed6e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:04.326703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22f242a85264177b686d8be0a1218c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:04.327729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22f242a85264177b686d8be0a1218c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:04.343716 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2215/4427] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:04 2022] PUT /identity/v3/projects/6da7b6f6cf1244bf9db3b16f702e55a9/users/af9c9dc2edcb496080ec178894b7706b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:04.355892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:04.356990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:04.357842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:04.365008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22f242a85264177b686d8be0a1218c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:04.365813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64b4cf27-30b0-443e-8c33-0c131c337dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22f242a85264177b686d8be0a1218c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:04.402922 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2213/4428] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:03 2022] DELETE /identity/v3/users/a22f242a85264177b686d8be0a1218c4 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:04.408963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:04.409245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:04.409528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:04.453685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] MFA Rules not processed for user `af9c9dc2edcb496080ec178894b7706b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:04.468102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:04.471548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:04.475481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:04.521251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:04.689699 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2214/4429] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:04.701574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:04.711466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:04.736504 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2216/4430] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:04.741979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:04.743843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:04.858383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:04.878945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2790ba-1338-4e6e-8511-9e5cdb6b2a2c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:04.889439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:04.890419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:04.890913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:04.891434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:04.894540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:04.920090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:04.922067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:04.937824 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2215/4431] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:04.939008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:04.941714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:04.949931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72924b31-60e5-46ee-844f-eb717a301e78 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:04.964673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b5d93-8ca4-4552-9f1c-4ba149b98011 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:04.965470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5d93-8ca4-4552-9f1c-4ba149b98011 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:04.965661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5d93-8ca4-4552-9f1c-4ba149b98011 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:04.967396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5d93-8ca4-4552-9f1c-4ba149b98011 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:04.969142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b5d93-8ca4-4552-9f1c-4ba149b98011 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:04.973185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b5d93-8ca4-4552-9f1c-4ba149b98011 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:05.019407 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2217/4432] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:56:04 2022] POST /identity/v3/domains => generated 275 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:05.021594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b2ea-7b28-40e6-b00c-4f4a9ad443cb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:05.021793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b2ea-7b28-40e6-b00c-4f4a9ad443cb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:05.021989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3b2ea-7b28-40e6-b00c-4f4a9ad443cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:05.063460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-63c3b2ea-7b28-40e6-b00c-4f4a9ad443cb None None] MFA Rules not processed for user `ee88775f240740edacac3598b8901101`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:05.064797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63c3b2ea-7b28-40e6-b00c-4f4a9ad443cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:05.174877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2218/4433] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:05.177748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3b2ea-7b28-40e6-b00c-4f4a9ad443cb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:05.209743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16709f64-8c21-435a-b937-9614052bc251 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:05.383755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3b2ea-7b28-40e6-b00c-4f4a9ad443cb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:05.393296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:05.395847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:05.396926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:05.397106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:05.397857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:05.398913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:05.399666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:05.400132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:05.403493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:05.406166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:05.446572 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2219/4434] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:05 2022] POST /identity/v3/roles => generated 240 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:05.447555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:05.451059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:05.474624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8511804-f3c1-4eff-945a-ac5e689e2925 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:05.487849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:05.488921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:05.489215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:05.489496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f/users/af9c9dc2edcb496080ec178894b7706b/roles/3a6e7e8a9b8c41d7986e85ae2f902eab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:05.595098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0d8d2e22c4b44abfbc3ace8820bb123f, user_id=af9c9dc2edcb496080ec178894b7706b, role_id=3a6e7e8a9b8c41d7986e85ae2f902eab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:05.608575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:05.742621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:05.747087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:05.749569 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2220/4435] 10.222.0.98 () {60 vars in 1479 bytes} [Thu Jul 14 14:56:05 2022] PUT /identity/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f/users/af9c9dc2edcb496080ec178894b7706b/roles/3a6e7e8a9b8c41d7986e85ae2f902eab => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:05.752465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:05.769151 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2216/4436] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:05.889604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:05.893073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:05.923300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:06.084173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad523-3b34-457f-914b-bf68bc379449 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:06.100108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:06.102222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:06.107160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:06.107693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:06.108687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:06.113344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:06.153094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2221/4437] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:56:05 2022] POST /identity/v3/domains => generated 277 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:06.156873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:06.258770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def117c1-200e-4f68-a5cc-661b03a8785c service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:06.414773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4af2e1-b550-4e9c-9614-a04088b4e900 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:06.442588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:06.444645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:06.445004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:06.446713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:06.447563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:06.453039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:06.483066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:06.485760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:06.486837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:06.487333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:06.493533 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2222/4438] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:06 2022] POST /identity/v3/roles => generated 240 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:06.516897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:06.542129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803dea-5f75-4ca3-8f3d-abf47320011f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:06.559786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:06.562928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:06.563318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:06.566411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:06.567487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:06.574016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:06.614921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:06.657547 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2223/4439] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:56:06 2022] POST /identity/v3/groups => generated 326 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:06.671454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:06.672510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:06.676456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:06.706592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315b8f-edb5-41d6-b59b-13922b2dbd15 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:06.717921 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2217/4440] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:56:06.719004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:06.720113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:06.720522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:06.720920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups/2873135dcffd463e9768c29a7bfa983d/users/af9c9dc2edcb496080ec178894b7706b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:06.735541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2873135dcffd463e9768c29a7bfa983d, user_id=af9c9dc2edcb496080ec178894b7706b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:06.736879 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:56:06.736879 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:56:06.736879 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:56:06.738813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:06.798338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2224/4441] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 14:56:06 2022] PUT /identity/v3/groups/2873135dcffd463e9768c29a7bfa983d/users/af9c9dc2edcb496080ec178894b7706b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:06.802483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:06.819022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ef02-e22b-41a8-b297-d0fdb47361f6 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:06.972848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:06.974760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:06.975250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:06.975744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f8fab0e3108340719dc656354de937a5/groups/2873135dcffd463e9768c29a7bfa983d/roles/8b3147bc987a4ede8e2c1357d467c4a1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:06.987107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:06.989464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:06.993053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f8fab0e3108340719dc656354de937a5, group_id=2873135dcffd463e9768c29a7bfa983d, role_id=8b3147bc987a4ede8e2c1357d467c4a1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:06.996348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:07.044505 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2218/4442] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:06 2022] PUT /identity/v3/domains/f8fab0e3108340719dc656354de937a5/groups/2873135dcffd463e9768c29a7bfa983d/roles/8b3147bc987a4ede8e2c1357d467c4a1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:07.045826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:07.213161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64486424-85aa-46fd-9464-c9355057bff9 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:07.218591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cefb5-4791-4555-bcea-4e95fdb1e585 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:07.228543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:07.229322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:07.229623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:07.229909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:07.230678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:07.232531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:07.254287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:07.278528 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2219/4443] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:56:07 2022] POST /identity/v3/domains => generated 276 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:07.279948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:07.464027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:07.464955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:07.465246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:07.465534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] PATH_INFO: `/v3/projects/6ee00daa615a44dca0645ac6735ea176` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:07.467418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee00daa615a44dca0645ac6735ea176)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:07.471818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:07.522151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027bbc2-adec-4223-ba5f-67ccf9ee09bc tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:07.556641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:07.557926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:07.561985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:07.569882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:07.571410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:07.574431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:07.651162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee00daa615a44dca0645ac6735ea176', 'request_id': 'req-de3ad3ee-480f-4136-8299-5ff707dde14b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:07.659160 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2220/4444] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:07 2022] POST /identity/v3/roles => generated 240 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:07.668224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee00daa615a44dca0645ac6735ea176', 'request_id': 'req-de3ad3ee-480f-4136-8299-5ff707dde14b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:07.680676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:07.681313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee00daa615a44dca0645ac6735ea176', 'request_id': 'req-de3ad3ee-480f-4136-8299-5ff707dde14b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:07.697865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:07.713246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] The token cache is being invalidate because project 6ee00daa615a44dca0645ac6735ea176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:07.713531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:07.716119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de3ad3ee-480f-4136-8299-5ff707dde14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:07.717125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15b0e1-a81a-41d1-90f0-6b8588b99024 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:07.727341 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2225/4445] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:06 2022] DELETE /identity/v3/projects/6ee00daa615a44dca0645ac6735ea176 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:07.729874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd749-4326-4573-beac-39fd838a6822 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:07.730258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd749-4326-4573-beac-39fd838a6822 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:07.730554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd749-4326-4573-beac-39fd838a6822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:07.798393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd4cd749-4326-4573-beac-39fd838a6822 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:07.800742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd4cd749-4326-4573-beac-39fd838a6822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:07.998984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:08.013947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:08.013947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:08.013947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6/users/af9c9dc2edcb496080ec178894b7706b/roles/122bd0be14544aaeb62770cd51d88a9b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:08.034224 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2226/4446] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:08.073017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0e66c-5d58-44b0-a098-817497c8a6b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:08.073316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0e66c-5d58-44b0-a098-817497c8a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:08.073608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0e66c-5d58-44b0-a098-817497c8a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:08.103663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a8b94bfba0294a0f9159d8749bd1cce6, user_id=af9c9dc2edcb496080ec178894b7706b, role_id=122bd0be14544aaeb62770cd51d88a9b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:08.109167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:08.254118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4cc0e66c-5d58-44b0-a098-817497c8a6b1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:08.256805 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2221/4447] 10.222.0.98 () {60 vars in 1479 bytes} [Thu Jul 14 14:56:07 2022] PUT /identity/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6/users/af9c9dc2edcb496080ec178894b7706b/roles/122bd0be14544aaeb62770cd51d88a9b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:08.267761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:08.268256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cc0e66c-5d58-44b0-a098-817497c8a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:08.273814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:08.579971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:08.692543 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2227/4448] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 643 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:08.694190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0e66c-5d58-44b0-a098-817497c8a6b1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:08.731055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262541a-85d9-46ed-bca5-9a101d6b4f1c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:08.760542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:08.761684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:08.762248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:08.762817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:08.763908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:08.765923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:08.787124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0e66c-5d58-44b0-a098-817497c8a6b1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:08.813588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:08.814745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:08.815042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:08.815370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:08.816123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:56:08.816516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:08.824274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:08.831823 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2222/4449] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 14:56:08 2022] POST /identity/v3/domains => generated 276 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:08.834654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:08.858231 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2228/4450] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:08.867376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:08.920510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21188c1-19db-49ee-949b-c5fdaf28fc58 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.037890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ee17-ef78-4e57-ba55-2ba2a3c9da4e tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.052996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:09.054016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:09.055387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:09.055387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:09.057805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:09.064635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:09.097776 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2223/4451] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:08 2022] POST /identity/v3/roles => generated 240 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:09.104140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:09.104905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:09.105197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:09.105527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:09.108114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:09.108857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:09.112817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:09.146215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd73bd3-6345-4fba-b90d-7aed63de60bb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.158476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:09.159378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:09.159794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:09.160369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:09.161133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:09.162540 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:56:09.162540 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:56:09.162540 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:56:09.172095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:09.198596 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2229/4452] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:08 2022] POST /identity/v3/projects => generated 381 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:09.199855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:09.220886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:09.252203 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2224/4453] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:56:09 2022] POST /identity/v3/groups => generated 326 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:09.258791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:09.282814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338691-84df-4392-866c-3d9706401d73 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.375582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27233ef-4c56-4958-b975-d8a7a11ebcdd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.392042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:09.392900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:09.394065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:09.394607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:09.396002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:09.401140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:09.454837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2230/4454] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:09 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:09.460122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:09.461826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:09.462442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:09.462730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:09.463226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups/c779c59a4b6d490c81816747a18a3af7/users/af9c9dc2edcb496080ec178894b7706b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:09.489040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484b2c9-29ce-4a2e-8b6a-b9c09fb5442e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.496045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c779c59a4b6d490c81816747a18a3af7, user_id=af9c9dc2edcb496080ec178894b7706b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:09.504654 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:56:09.504654 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:56:09.504654 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:56:09.505702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:09.506441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:09.506895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:09.507212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:09.507485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:09.508126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:09.509806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:09.575636 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2225/4455] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 14:56:09 2022] PUT /identity/v3/groups/c779c59a4b6d490c81816747a18a3af7/users/af9c9dc2edcb496080ec178894b7706b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:09.582086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:09.603766 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2231/4456] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:09 2022] GET /identity/v3/roles => generated 2344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:09.609443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:09.687335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c61bdd-4687-47aa-8018-5bd301a2483c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.743257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632b7c1-de7a-44be-bd2a-add0d52ca41c tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:09.768191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:09.769628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:09.770253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:09.770805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f786c62278fe4a36849427304ccb5ff0/groups/c779c59a4b6d490c81816747a18a3af7/roles/c3f682868a4f4d5eb9d6e6ece2575e0d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:09.774022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f786c62278fe4a36849427304ccb5ff0, group_id=c779c59a4b6d490c81816747a18a3af7, role_id=c3f682868a4f4d5eb9d6e6ece2575e0d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:09.777379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:09.812305 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2226/4457] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:09 2022] PUT /identity/v3/domains/f786c62278fe4a36849427304ccb5ff0/groups/c779c59a4b6d490c81816747a18a3af7/roles/c3f682868a4f4d5eb9d6e6ece2575e0d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:09.818289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:09.820786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:09.967205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:10.023891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:10.066653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e25140-b7ad-48c8-9bb6-59942709889b tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:10.094319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:10.095979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:10.096494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:10.097143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:10.098406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:10.100016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9c9dc2edcb496080ec178894b7706b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da7b6f6cf1244bf9db3b16f702e55a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:10.102569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:10.103109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:10.103655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] PATH_INFO: `/v3/auth/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:10.103995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:10.105042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:10.106586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:10.157720 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2232/4458] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:09 2022] GET /identity/v3/roles => generated 2344 bytes in 552 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:10.161264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:10.190097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c08d8-a7d5-46bd-b518-cc689f906a9f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:10.306118 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2227/4459] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:56:09 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:56:10.314313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:10.473564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3cd59-d7c5-416d-ab14-9b279b0e5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:10.478027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3cd59-d7c5-416d-ab14-9b279b0e5a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:10.478754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3cd59-d7c5-416d-ab14-9b279b0e5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:10.480770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3cd59-d7c5-416d-ab14-9b279b0e5a67 admin admin] PATH_INFO: `/v3/projects/566b2b65030345808ad3011db90e8425/users/e6ddbab17e1b4c47afcd0244006f2c5b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:10.515287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03e8d-497e-4381-b502-ed4f917f0dce tempest-TokensV3TestJSON-1441341295 tempest-TokensV3TestJSON-1441341295-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:10.517945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3cd59-d7c5-416d-ab14-9b279b0e5a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566b2b65030345808ad3011db90e8425, user_id=e6ddbab17e1b4c47afcd0244006f2c5b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:10.523828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3cd59-d7c5-416d-ab14-9b279b0e5a67 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:10.530783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:10.531863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:10.532490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:10.532809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f786c62278fe4a36849427304ccb5ff0/groups/c779c59a4b6d490c81816747a18a3af7/roles/c3f682868a4f4d5eb9d6e6ece2575e0d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:10.539144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f786c62278fe4a36849427304ccb5ff0, group_id=c779c59a4b6d490c81816747a18a3af7, role_id=c3f682868a4f4d5eb9d6e6ece2575e0d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:10.555982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:10.572384 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2233/4460] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:10 2022] PUT /identity/v3/projects/566b2b65030345808ad3011db90e8425/users/e6ddbab17e1b4c47afcd0244006f2c5b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:10.575617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:10.575894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:10.576291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:10.592579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role c3f682868a4f4d5eb9d6e6ece2575e0d was removed from group c779c59a4b6d490c81816747a18a3af7 on domain f786c62278fe4a36849427304ccb5ff0. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:10.594416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:10.595980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:10.618969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:10.620388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:10.638038 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2228/4461] 10.222.0.98 () {58 vars in 1466 bytes} [Thu Jul 14 14:56:10 2022] DELETE /identity/v3/domains/f786c62278fe4a36849427304ccb5ff0/groups/c779c59a4b6d490c81816747a18a3af7/roles/c3f682868a4f4d5eb9d6e6ece2575e0d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:10.639112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:10.644491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:10.890540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2234/4462] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:10.903631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3ec05-30af-43d0-b499-ec5c2f2827b7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:10.924844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:10.926094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:10.926094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:10.926413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups/c779c59a4b6d490c81816747a18a3af7/users/af9c9dc2edcb496080ec178894b7706b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:10.929812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c779c59a4b6d490c81816747a18a3af7, user_id=af9c9dc2edcb496080ec178894b7706b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:10.930897 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:56:10.930897 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:56:10.930897 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:56:10.939374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:10.969804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'af9c9dc2edcb496080ec178894b7706b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:10.994993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:11.005393 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2229/4463] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 14:56:10 2022] DELETE /identity/v3/groups/c779c59a4b6d490c81816747a18a3af7/users/af9c9dc2edcb496080ec178894b7706b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:11.008589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:11.010001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:11.017005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:11.249543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294f52-51ee-408b-8c91-fa915ae000b2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:11.269464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:11.274361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:11.275755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:11.284636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups/c779c59a4b6d490c81816747a18a3af7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:11.286583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c779c59a4b6d490c81816747a18a3af7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:11.289305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:11.299916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c713-5ec6-4c46-9a38-1cb6191ec040 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:11.370978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:11.429728 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2230/4464] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 14:56:11 2022] DELETE /identity/v3/groups/c779c59a4b6d490c81816747a18a3af7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:11.435711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:11.500335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:11.501768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:11.502338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:11.503335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:11.640570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671efd7-0325-4cd9-81a3-35421df34031 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:11.656820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:11.658747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:11.659575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:11.660351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles/c3f682868a4f4d5eb9d6e6ece2575e0d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:11.666346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c3f682868a4f4d5eb9d6e6ece2575e0d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:11.673313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:11.724569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:11.732186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:11.786419 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2235/4465] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 781 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:11.833964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role c3f682868a4f4d5eb9d6e6ece2575e0d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:11.837298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:11.839077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:11.853190 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2231/4466] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:11 2022] DELETE /identity/v3/roles/c3f682868a4f4d5eb9d6e6ece2575e0d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:11.855148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:11.898165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9c71a-41f7-4d7c-918c-cd4e3d8049b7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:12.135064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:12.136786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:12.137091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:12.137440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f786c62278fe4a36849427304ccb5ff0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:12.139015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f786c62278fe4a36849427304ccb5ff0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:12.140977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:12.196040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.196937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.252965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.255367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.267385 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2236/4467] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:11 2022] PATCH /identity/v3/domains/f786c62278fe4a36849427304ccb5ff0 => generated 277 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:12.269464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:12.271900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:12.310282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064fac-6123-4fcd-bdcf-d1d96e31a604 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:12.358380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:12.543507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:12.550262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:12.550861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:12.552293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f786c62278fe4a36849427304ccb5ff0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:12.585892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f786c62278fe4a36849427304ccb5ff0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:12.589963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:12.653674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.664461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.801748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0', 'request_id': 'req-a2c68a22-b8d0-4798-aa49-14d831ec21a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.829532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0', 'request_id': 'req-a2c68a22-b8d0-4798-aa49-14d831ec21a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.840996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0', 'request_id': 'req-a2c68a22-b8d0-4798-aa49-14d831ec21a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.893611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] The token cache is being invalidate because project f786c62278fe4a36849427304ccb5ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:12.893925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.894929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.923212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0', 'request_id': 'req-a2c68a22-b8d0-4798-aa49-14d831ec21a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.933762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0', 'request_id': 'req-a2c68a22-b8d0-4798-aa49-14d831ec21a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.935625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f786c62278fe4a36849427304ccb5ff0', 'request_id': 'req-a2c68a22-b8d0-4798-aa49-14d831ec21a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:12.963929 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2232/4468] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:56:12 2022] DELETE /identity/v3/domains/f786c62278fe4a36849427304ccb5ff0 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:12.966761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:12.969417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:13.018668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b14520-7556-4910-bab4-43d39838529f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:13.154725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:13.245651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:13.245651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:13.245651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:13.246139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6/users/af9c9dc2edcb496080ec178894b7706b/roles/122bd0be14544aaeb62770cd51d88a9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:13.252178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a8b94bfba0294a0f9159d8749bd1cce6, user_id=af9c9dc2edcb496080ec178894b7706b, role_id=122bd0be14544aaeb62770cd51d88a9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:13.256374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:13.267608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role 122bd0be14544aaeb62770cd51d88a9b was removed from user af9c9dc2edcb496080ec178894b7706b on domain a8b94bfba0294a0f9159d8749bd1cce6. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:13.267913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:13.269338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:13.298738 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2237/4469] 10.222.0.98 () {58 vars in 1463 bytes} [Thu Jul 14 14:56:12 2022] DELETE /identity/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6/users/af9c9dc2edcb496080ec178894b7706b/roles/122bd0be14544aaeb62770cd51d88a9b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:13.306191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:13.309325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:13.355258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68a22-b8d0-4798-aa49-14d831ec21a6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:13.528104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:13.529316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:13.529704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:13.530091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles/122bd0be14544aaeb62770cd51d88a9b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:13.532231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_role(role_id=122bd0be14544aaeb62770cd51d88a9b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:13.535713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:13.541194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:13.603508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role 122bd0be14544aaeb62770cd51d88a9b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:13.605777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:13.606915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:13.609811 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2233/4470] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:13 2022] DELETE /identity/v3/roles/122bd0be14544aaeb62770cd51d88a9b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:13.614167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:13.616573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:13.644069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcf5a-7adb-4a40-9c9d-53273a560010 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:13.855720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:13.856637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:13.856929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:13.857221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:13.858822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a8b94bfba0294a0f9159d8749bd1cce6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:13.860676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:13.906845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:13.910929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.009569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.015181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.026803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2238/4471] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:13 2022] PATCH /identity/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6 => generated 277 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:56:14.031736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:14.033843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:14.083461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c481da-7159-44c5-ac90-eab3df6475ba tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:14.307287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:14.309984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:14.312095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:14.314526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:14.348403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a8b94bfba0294a0f9159d8749bd1cce6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:14.357483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:14.464483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.479188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.580677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6', 'request_id': 'req-559cb449-96a9-4cc2-a495-dd709f9b1f61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.595695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6', 'request_id': 'req-559cb449-96a9-4cc2-a495-dd709f9b1f61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.609776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6', 'request_id': 'req-559cb449-96a9-4cc2-a495-dd709f9b1f61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.638249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] The token cache is being invalidate because project a8b94bfba0294a0f9159d8749bd1cce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:14.638842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.640114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.681078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6', 'request_id': 'req-559cb449-96a9-4cc2-a495-dd709f9b1f61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.706976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6', 'request_id': 'req-559cb449-96a9-4cc2-a495-dd709f9b1f61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.708624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a8b94bfba0294a0f9159d8749bd1cce6', 'request_id': 'req-559cb449-96a9-4cc2-a495-dd709f9b1f61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.731355 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2234/4472] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:56:14 2022] DELETE /identity/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:14.736892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:14.740573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:14.785160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2b068-ada5-47bc-b1de-cdd746fc5377 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:14.924044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:14.925753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:14.926440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:14.926957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f8fab0e3108340719dc656354de937a5/groups/2873135dcffd463e9768c29a7bfa983d/roles/8b3147bc987a4ede8e2c1357d467c4a1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:14.936484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f8fab0e3108340719dc656354de937a5, group_id=2873135dcffd463e9768c29a7bfa983d, role_id=8b3147bc987a4ede8e2c1357d467c4a1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:14.957293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:14.987651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role 8b3147bc987a4ede8e2c1357d467c4a1 was removed from group 2873135dcffd463e9768c29a7bfa983d on domain f8fab0e3108340719dc656354de937a5. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:14.988127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:14.994557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:15.018664 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2239/4473] 10.222.0.98 () {58 vars in 1466 bytes} [Thu Jul 14 14:56:14 2022] DELETE /identity/v3/domains/f8fab0e3108340719dc656354de937a5/groups/2873135dcffd463e9768c29a7bfa983d/roles/8b3147bc987a4ede8e2c1357d467c4a1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:15.024608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:15.027415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:15.064521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:15.080103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cb449-96a9-4cc2-a495-dd709f9b1f61 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:15.152491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:15.156019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:15.278782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:15.400068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e9de9-a3af-4b62-abca-50027f583370 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:15.401809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:15.403778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:15.404398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:15.404980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups/2873135dcffd463e9768c29a7bfa983d/users/af9c9dc2edcb496080ec178894b7706b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:15.408403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2873135dcffd463e9768c29a7bfa983d, user_id=af9c9dc2edcb496080ec178894b7706b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:15.410415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:15.411626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:15.412166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:15.413123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:15.414364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:15.418258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:15.431974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'af9c9dc2edcb496080ec178894b7706b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:15.446107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:15.448511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:15.468417 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2240/4474] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:15.470217 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2235/4475] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 14:56:15 2022] DELETE /identity/v3/groups/2873135dcffd463e9768c29a7bfa983d/users/af9c9dc2edcb496080ec178894b7706b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:15.474728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:15.477849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:15.496258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c158542-9530-4826-9c97-3546fb55a372 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:15.626101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:15.627237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:15.627695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:15.628085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/groups/2873135dcffd463e9768c29a7bfa983d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:15.629751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2873135dcffd463e9768c29a7bfa983d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:15.632048 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:56:15.632048 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:56:15.632048 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:56:15.634201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:15.727832 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2241/4476] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 14:56:15 2022] DELETE /identity/v3/groups/2873135dcffd463e9768c29a7bfa983d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:15.734154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:15.755148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972154d-5343-4c91-bd92-0a83252cfdfd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:15.885168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:15.886453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:15.887018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:15.887488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles/8b3147bc987a4ede8e2c1357d467c4a1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:15.890068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8b3147bc987a4ede8e2c1357d467c4a1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:15.894989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:16.006079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role 8b3147bc987a4ede8e2c1357d467c4a1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:16.008019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.009125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.015369 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2236/4477] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:15 2022] DELETE /identity/v3/roles/8b3147bc987a4ede8e2c1357d467c4a1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:16.021783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:16.027014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:16.059536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868fb2c-903d-4676-8233-e3c19bb8ad5d tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:16.160101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:16.161433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:16.161843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:16.162451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f8fab0e3108340719dc656354de937a5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:16.166254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f8fab0e3108340719dc656354de937a5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:16.169634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:16.174836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:16.206460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f8fab0e3108340719dc656354de937a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.207966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f8fab0e3108340719dc656354de937a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.259128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f8fab0e3108340719dc656354de937a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.259893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f8fab0e3108340719dc656354de937a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.274299 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2242/4478] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:16 2022] PATCH /identity/v3/domains/f8fab0e3108340719dc656354de937a5 => generated 278 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:16.277950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:16.296533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03773e93-872e-4c8e-8076-ee26ef4aad92 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:16.408196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:16.430991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:16.432834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:16.433146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:16.433978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f8fab0e3108340719dc656354de937a5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:16.452648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f8fab0e3108340719dc656354de937a5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:16.455421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:16.530189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f8fab0e3108340719dc656354de937a5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.535245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f8fab0e3108340719dc656354de937a5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.644604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fab0e3108340719dc656354de937a5', 'request_id': 'req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.683818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fab0e3108340719dc656354de937a5', 'request_id': 'req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.704990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fab0e3108340719dc656354de937a5', 'request_id': 'req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.730599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] The token cache is being invalidate because project f8fab0e3108340719dc656354de937a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:16.730970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.732234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.759365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f8fab0e3108340719dc656354de937a5', 'request_id': 'req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.765778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f8fab0e3108340719dc656354de937a5', 'request_id': 'req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.766848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f8fab0e3108340719dc656354de937a5', 'request_id': 'req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.779537 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2237/4479] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:56:16 2022] DELETE /identity/v3/domains/f8fab0e3108340719dc656354de937a5 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:16.785620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:16.787202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:16.801977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f14796-5b54-49b8-b5e9-87da173da9c2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:16.877068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:16.878159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:16.878459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:16.878777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f/users/af9c9dc2edcb496080ec178894b7706b/roles/3a6e7e8a9b8c41d7986e85ae2f902eab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:16.884992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0d8d2e22c4b44abfbc3ace8820bb123f, user_id=af9c9dc2edcb496080ec178894b7706b, role_id=3a6e7e8a9b8c41d7986e85ae2f902eab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:16.888334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:16.895822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role 3a6e7e8a9b8c41d7986e85ae2f902eab was removed from user af9c9dc2edcb496080ec178894b7706b on domain 0d8d2e22c4b44abfbc3ace8820bb123f. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:16.896161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.897115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-002509dc-33f0-496d-a698-e0c7211de5b0 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:16.922948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2243/4480] 10.222.0.98 () {58 vars in 1463 bytes} [Thu Jul 14 14:56:16 2022] DELETE /identity/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f/users/af9c9dc2edcb496080ec178894b7706b/roles/3a6e7e8a9b8c41d7986e85ae2f902eab => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:16.929496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:16.931607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:16.963058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c74b8-5a54-4e4f-84a9-cc5d727c66cb tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:17.225326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:17.231739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:17.232489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:17.232849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles/3a6e7e8a9b8c41d7986e85ae2f902eab` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:17.236329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a6e7e8a9b8c41d7986e85ae2f902eab)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:17.243597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:17.354393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:17.359333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:17.360260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:17.360260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:17.364048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role 3a6e7e8a9b8c41d7986e85ae2f902eab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:17.364781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:17.367630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:17.371264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2238/4481] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:16 2022] DELETE /identity/v3/roles/3a6e7e8a9b8c41d7986e85ae2f902eab => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:17.377626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:17.379388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:17.511231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:17.514171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:17.556948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423830-02cd-4094-8aef-1a1d8ca37fb7 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:17.573012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:17.576522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:17.577235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:17.589053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:17.597011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0d8d2e22c4b44abfbc3ace8820bb123f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:17.606152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:17.703942 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2244/4482] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:56:17.744313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:17.746606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:17.747450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:17.750388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:17.889600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:17.893541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:17.934068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:17.958620 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2239/4483] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:17 2022] PATCH /identity/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f => generated 276 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:17.961546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:17.966407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:17.992115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac25ccb-10b5-4b93-b94d-c896ef598359 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:18.130103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:18.130803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:18.131103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:18.131415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:18.139165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:18.147450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf88527-e597-4b7a-be30-c2179a5b9f09 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:18.169859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:18.171922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:18.173130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:18.173391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:18.229850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0d8d2e22c4b44abfbc3ace8820bb123f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:18.234954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:18.351939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:18.357230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:18.377296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.388050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.406785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2245/4484] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:18.521144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:18.560500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f', 'request_id': 'req-ea6554f3-e45a-4c92-a04c-e63a480c3c31'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.577566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f', 'request_id': 'req-ea6554f3-e45a-4c92-a04c-e63a480c3c31'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.588273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f', 'request_id': 'req-ea6554f3-e45a-4c92-a04c-e63a480c3c31'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.615153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] The token cache is being invalidate because project 0d8d2e22c4b44abfbc3ace8820bb123f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:18.615529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.616147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.640243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f', 'request_id': 'req-ea6554f3-e45a-4c92-a04c-e63a480c3c31'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.646736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f', 'request_id': 'req-ea6554f3-e45a-4c92-a04c-e63a480c3c31'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.647707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0d8d2e22c4b44abfbc3ace8820bb123f', 'request_id': 'req-ea6554f3-e45a-4c92-a04c-e63a480c3c31'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:18.666323 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2240/4485] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:56:17 2022] DELETE /identity/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:18.668109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:18.687862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1575bb-995d-4444-86bb-5f25bf7e83f9 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:18.789733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:18.790708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:18.791109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:18.791541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:18.792413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:18.795172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:18.827178 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2246/4486] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:18.830449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:18.832540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:18.865599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6554f3-e45a-4c92-a04c-e63a480c3c31 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:18.886602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:18.888003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:18.889177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:18.890211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:18.896801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b09eb2a150f943daa80c3fa4acebb8c7, user_id=55e6b999d32249eb8d29ea887e23b24d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:18.903687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:18.935487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2241/4487] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:18 2022] PUT /identity/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:18.940179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:18.974133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:19.006053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fad7dc-ad47-41d9-80ad-58624dd527c1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:19.245148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:19.245148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:19.245148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:19.245607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:19.245607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:19.245607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:19.374719 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2247/4488] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:56:18 2022] GET /identity/v3/auth/projects => generated 826 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:19.378165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:19.392726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff8389-f5a2-4f71-a45a-3e6a27c5af9f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:19.411174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:19.412266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:19.412757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:19.413183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:19.421022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b09eb2a150f943daa80c3fa4acebb8c7, user_id=55e6b999d32249eb8d29ea887e23b24d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:19.426759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:19.454641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role ba3e21bde1be4808aa89ff8df9bbb9be was removed from user 55e6b999d32249eb8d29ea887e23b24d on project b09eb2a150f943daa80c3fa4acebb8c7. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:19.454974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:19.461479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:19.518432 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2242/4489] 10.222.0.98 () {58 vars in 1466 bytes} [Thu Jul 14 14:56:19 2022] DELETE /identity/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7/users/55e6b999d32249eb8d29ea887e23b24d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:19.518800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:19.525905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:19.548747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c98f9-9ca6-442a-8e3d-a30a530b85e6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:19.658477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:19.659387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:19.659792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:19.660239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:19.661396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:19.667227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:19.707605 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2248/4490] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:19 2022] POST /identity/v3/users => generated 323 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:19.712643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:19.728813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a25c-c795-48e4-83d6-a5cc47fcd05f tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:19.755020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:19.761541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:19.762067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:19.762460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:19.765201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:19.769657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:19.872670 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2243/4491] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:19 2022] POST /identity/v3/projects => generated 364 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:19.877124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:19.892436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ece39-64f5-4d8d-9336-cc989f86aaf6 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:20.099287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:20.127260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:20.128228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:20.128505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:20.128790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:20.129520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:20.131574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:20.209685 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2249/4492] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:19 2022] POST /identity/v3/projects => generated 363 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:20.216070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:20.229226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadca3b-af3c-4bb2-b4ac-c70ac5332ac3 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:20.471047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:20.482718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:20.482943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:20.485617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:20.489220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:20.501812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:20.596779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:20.597307 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2244/4493] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:20 2022] POST /identity/v3/roles => generated 240 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:20.612156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a622be-171d-4de3-9628-322e95623e88 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:20.643545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba09e0-eed0-4564-9486-f4da518204e2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:20.647716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba09e0-eed0-4564-9486-f4da518204e2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:20.652084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba09e0-eed0-4564-9486-f4da518204e2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:20.655521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba09e0-eed0-4564-9486-f4da518204e2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects/21ef3c75cbf642f7a94390a664b37279/users/57e9aeacb9214569a536c40dc4b05ea7/roles/8a42acc7f00242c9af84493a444fc418` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:20.735459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba09e0-eed0-4564-9486-f4da518204e2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_grant(project_id=21ef3c75cbf642f7a94390a664b37279, user_id=57e9aeacb9214569a536c40dc4b05ea7, role_id=8a42acc7f00242c9af84493a444fc418)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:20.744422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba09e0-eed0-4564-9486-f4da518204e2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:20.798336 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2250/4494] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:20 2022] PUT /identity/v3/projects/21ef3c75cbf642f7a94390a664b37279/users/57e9aeacb9214569a536c40dc4b05ea7/roles/8a42acc7f00242c9af84493a444fc418 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:20.804851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:20.822890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640270ad-7fdf-4e7b-8c76-28acb521beb4 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:20.922787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:20.961125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef79c0f-4f35-4132-9594-f753648777a1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:20.962805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef79c0f-4f35-4132-9594-f753648777a1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:20.963370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef79c0f-4f35-4132-9594-f753648777a1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:20.963774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef79c0f-4f35-4132-9594-f753648777a1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects/74dd4949ebe24d6e8c476c8d4efad717/users/57e9aeacb9214569a536c40dc4b05ea7/roles/8a42acc7f00242c9af84493a444fc418` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:20.967690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef79c0f-4f35-4132-9594-f753648777a1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:create_grant(project_id=74dd4949ebe24d6e8c476c8d4efad717, user_id=57e9aeacb9214569a536c40dc4b05ea7, role_id=8a42acc7f00242c9af84493a444fc418)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:20.971183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef79c0f-4f35-4132-9594-f753648777a1 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:21.048600 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2245/4495] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:20 2022] PUT /identity/v3/projects/74dd4949ebe24d6e8c476c8d4efad717/users/57e9aeacb9214569a536c40dc4b05ea7/roles/8a42acc7f00242c9af84493a444fc418 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:21.053126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580894b4-06aa-48e0-b1c8-be4a5e06e502 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:21.053727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580894b4-06aa-48e0-b1c8-be4a5e06e502 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:21.053727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580894b4-06aa-48e0-b1c8-be4a5e06e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:21.110990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-580894b4-06aa-48e0-b1c8-be4a5e06e502 None None] MFA Rules not processed for user `57e9aeacb9214569a536c40dc4b05ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:21.112558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-580894b4-06aa-48e0-b1c8-be4a5e06e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:21.118043 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2251/4496] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:21 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:56:21.124282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425931f8-b9b9-4623-8480-443c1f233563 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:21.124676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425931f8-b9b9-4623-8480-443c1f233563 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:21.125052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425931f8-b9b9-4623-8480-443c1f233563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:21.139757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-425931f8-b9b9-4623-8480-443c1f233563 None None] MFA Rules not processed for user `57e9aeacb9214569a536c40dc4b05ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:21.141108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-425931f8-b9b9-4623-8480-443c1f233563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:21.292026 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2246/4497] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 14 14:56:21.296422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580894b4-06aa-48e0-b1c8-be4a5e06e502 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:21.463166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580894b4-06aa-48e0-b1c8-be4a5e06e502 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:21.473923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:21.477939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:21.478270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:21.478578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:21.500589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:21.506118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:21.541632 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2252/4498] 10.222.0.98 () {56 vars in 1307 bytes} [Thu Jul 14 14:56:21 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:21.546488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5be2f-5a6d-426a-86bd-8b4ff2905447 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:21.546488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5be2f-5a6d-426a-86bd-8b4ff2905447 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:21.546938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5be2f-5a6d-426a-86bd-8b4ff2905447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:21.575909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4df5be2f-5a6d-426a-86bd-8b4ff2905447 None None] MFA Rules not processed for user `57e9aeacb9214569a536c40dc4b05ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:21.582057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4df5be2f-5a6d-426a-86bd-8b4ff2905447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:21.809310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2247/4499] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 14 14:56:21.813696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:21.830237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6c499-cc18-44ce-a3e1-2fb42190451a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:21.839135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:21.842900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:21.843240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:21.843681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/roles/8a42acc7f00242c9af84493a444fc418` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:21.848658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8a42acc7f00242c9af84493a444fc418)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:21.852560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:21.954849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invalidating the token cache because role 8a42acc7f00242c9af84493a444fc418 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:21.955233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:21.959849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:21.963598 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2253/4500] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:21 2022] DELETE /identity/v3/roles/8a42acc7f00242c9af84493a444fc418 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:21.969040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5be2f-5a6d-426a-86bd-8b4ff2905447 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:21.987494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5be2f-5a6d-426a-86bd-8b4ff2905447 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:22.153919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:22.154925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:22.155379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:22.155862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects/74dd4949ebe24d6e8c476c8d4efad717` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:22.158551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74dd4949ebe24d6e8c476c8d4efad717)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:22.160971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:22.200603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:22.264674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dd4949ebe24d6e8c476c8d4efad717', 'request_id': 'req-1c56d23c-8f9c-42b9-becb-47ba95beffa5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.279498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dd4949ebe24d6e8c476c8d4efad717', 'request_id': 'req-1c56d23c-8f9c-42b9-becb-47ba95beffa5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.302678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dd4949ebe24d6e8c476c8d4efad717', 'request_id': 'req-1c56d23c-8f9c-42b9-becb-47ba95beffa5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.344164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] The token cache is being invalidate because project 74dd4949ebe24d6e8c476c8d4efad717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:22.344695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.348305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.358119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:22.358654 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2248/4501] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:21 2022] DELETE /identity/v3/projects/74dd4949ebe24d6e8c476c8d4efad717 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:22.359754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:22.397028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeef2f-9c9e-4828-8c37-a7e62968937a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:22.598039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:22.631260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:22.632557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:22.633558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:22.634581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects/74dd4949ebe24d6e8c476c8d4efad717` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:22.656904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74dd4949ebe24d6e8c476c8d4efad717)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:22.659128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Could not find project: 74dd4949ebe24d6e8c476c8d4efad717.: keystone.exception.ProjectNotFound: Could not find project: 74dd4949ebe24d6e8c476c8d4efad717. Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 14 14:56:22.684348 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 74dd4949ebe24d6e8c476c8d4efad717. Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:56:22.692392 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2254/4502] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:22 2022] DELETE /identity/v3/projects/74dd4949ebe24d6e8c476c8d4efad717 => generated 113 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:56:22.696677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:22.698994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:22.734244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d23c-8f9c-42b9-becb-47ba95beffa5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:22.762290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:22.774433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:22.774759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:22.775231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/projects/21ef3c75cbf642f7a94390a664b37279` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:22.778864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21ef3c75cbf642f7a94390a664b37279)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:22.786739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:22.912625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ef3c75cbf642f7a94390a664b37279', 'request_id': 'req-96b10a84-7cec-4b19-ac59-54f75ca8fa47'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.929266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ef3c75cbf642f7a94390a664b37279', 'request_id': 'req-96b10a84-7cec-4b19-ac59-54f75ca8fa47'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.941050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ef3c75cbf642f7a94390a664b37279', 'request_id': 'req-96b10a84-7cec-4b19-ac59-54f75ca8fa47'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.985350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] The token cache is being invalidate because project 21ef3c75cbf642f7a94390a664b37279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:22.985853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.988799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:22.991929 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2249/4503] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:22 2022] DELETE /identity/v3/projects/21ef3c75cbf642f7a94390a664b37279 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:22.997592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:23.000488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:23.072599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e280e-9acc-4f6e-8524-406d62ce45a2 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:23.339460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:23.340416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:23.347115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:23.347579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/users/57e9aeacb9214569a536c40dc4b05ea7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:23.351990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorizing `identity:delete_user(user_id=57e9aeacb9214569a536c40dc4b05ea7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:23.354098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:23.495838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e9aeacb9214569a536c40dc4b05ea7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:23.545124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e9aeacb9214569a536c40dc4b05ea7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:23.557871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e9aeacb9214569a536c40dc4b05ea7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:23.558794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e9aeacb9214569a536c40dc4b05ea7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:23.578968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e9aeacb9214569a536c40dc4b05ea7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:23.600869 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2255/4504] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:22 2022] DELETE /identity/v3/users/57e9aeacb9214569a536c40dc4b05ea7 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:23.610236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:23.657015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10a84-7cec-4b19-ac59-54f75ca8fa47 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:23.666902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:23.668651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:23.857672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:23.858790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:23.859086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:23.859862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f786c62278fe4a36849427304ccb5ff0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:23.872951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Could not find domain: f786c62278fe4a36849427304ccb5ff0.: keystone.exception.DomainNotFound: Could not find domain: f786c62278fe4a36849427304ccb5ff0. Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f786c62278fe4a36849427304ccb5ff0. Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:23.887239 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:23.889165 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f786c62278fe4a36849427304ccb5ff0. Jul 14 14:56:23.890398 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:23.891778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2250/4505] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:23 2022] PATCH /identity/v3/domains/f786c62278fe4a36849427304ccb5ff0 => generated 112 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:56:23.895825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:23.899019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:23.942650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277cfd-460f-4dec-9c00-94b141489a6a tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:23.948969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482e9f0-4ec8-4829-a5c3-da722cf4feb5 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:23.953044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:23.953977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:23.954276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:23.956673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:23.958877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:23.961607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:23.963840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:23.964470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:23.969890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:23.986162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:56:24.011660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Could not find domain: a8b94bfba0294a0f9159d8749bd1cce6.: keystone.exception.DomainNotFound: Could not find domain: a8b94bfba0294a0f9159d8749bd1cce6. Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a8b94bfba0294a0f9159d8749bd1cce6. Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:24.024233 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:24.025876 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a8b94bfba0294a0f9159d8749bd1cce6. Jul 14 14:56:24.027218 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.041004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2251/4506] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:23 2022] PATCH /identity/v3/domains/a8b94bfba0294a0f9159d8749bd1cce6 => generated 112 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:56:24.045511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:24.070759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d315b-0579-4407-9e3f-23de8b883410 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:24.087315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:24.091093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:24.091763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:24.092442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/f8fab0e3108340719dc656354de937a5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:24.120241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Could not find domain: f8fab0e3108340719dc656354de937a5.: keystone.exception.DomainNotFound: Could not find domain: f8fab0e3108340719dc656354de937a5. Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f8fab0e3108340719dc656354de937a5. Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:24.149344 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:24.150698 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f8fab0e3108340719dc656354de937a5. Jul 14 14:56:24.151897 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.153401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2252/4507] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:24 2022] PATCH /identity/v3/domains/f8fab0e3108340719dc656354de937a5 => generated 112 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 14 14:56:24.155868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:24.186918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e671571-c9a8-4c33-8a39-2b3bf95d18fd tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:24.206571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:24.213394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:24.218473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6def751-3ed9-44ef-a448-e639f1227c89 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e6b999d32249eb8d29ea887e23b24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac5796c4b631439f8e8bc9e85f5d6905', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:24.219466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def751-3ed9-44ef-a448-e639f1227c89 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:24.219757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def751-3ed9-44ef-a448-e639f1227c89 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:24.222860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def751-3ed9-44ef-a448-e639f1227c89 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] PATH_INFO: `/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:24.238008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2256/4508] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 14:56:23 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:24.249431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6def751-3ed9-44ef-a448-e639f1227c89 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f6def751-3ed9-44ef-a448-e639f1227c89 tempest-TokensV3TestJSON-631674953 tempest-TokensV3TestJSON-631674953-project-admin] Could not find domain: 0d8d2e22c4b44abfbc3ace8820bb123f.: keystone.exception.DomainNotFound: Could not find domain: 0d8d2e22c4b44abfbc3ace8820bb123f. Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0d8d2e22c4b44abfbc3ace8820bb123f. Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:24.277516 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:24.278882 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0d8d2e22c4b44abfbc3ace8820bb123f. Jul 14 14:56:24.280035 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:24.284409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2253/4509] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:56:24 2022] PATCH /identity/v3/domains/0d8d2e22c4b44abfbc3ace8820bb123f => generated 112 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:56:24.284572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:24.284738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:24.443323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be4770-16d4-4228-ad4f-2ae6b2035529 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:24.457273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:24.458315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:24.458611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:24.458893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] PATH_INFO: `/v3/users/d98e5e9a27d8460988302e15425b7d81` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:24.466855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98e5e9a27d8460988302e15425b7d81)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:24.469060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:24.599933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98e5e9a27d8460988302e15425b7d81'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:24.663592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98e5e9a27d8460988302e15425b7d81'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:24.691372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98e5e9a27d8460988302e15425b7d81'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:24.692991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98e5e9a27d8460988302e15425b7d81'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:24.725087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98e5e9a27d8460988302e15425b7d81'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:24.756416 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2257/4510] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:24 2022] DELETE /identity/v3/users/d98e5e9a27d8460988302e15425b7d81 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:24.763350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:24.763700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:24.764069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:24.787316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:24.799400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:24.803594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:24.998992 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2254/4511] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:25.108598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:25.110696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:25.312316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:25.411534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1cdff-27f2-4519-848f-a712468debce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:25.428856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:25.432339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:25.435101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:25.436952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:25.514939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:25.519381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:25.571720 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2258/4512] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:28.601455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:28.602964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:28.620842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6850-b48a-408d-8c94-0fc2c04390a1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:28.626412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:28.627790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:28.628261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:28.628714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] PATH_INFO: `/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:28.630392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09eb2a150f943daa80c3fa4acebb8c7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:28.632939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:28.875421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09eb2a150f943daa80c3fa4acebb8c7', 'request_id': 'req-723a2a50-8c2f-4626-88fa-dcdc37bcd358'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:28.907939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09eb2a150f943daa80c3fa4acebb8c7', 'request_id': 'req-723a2a50-8c2f-4626-88fa-dcdc37bcd358'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:28.991214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09eb2a150f943daa80c3fa4acebb8c7', 'request_id': 'req-723a2a50-8c2f-4626-88fa-dcdc37bcd358'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.038166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] The token cache is being invalidate because project b09eb2a150f943daa80c3fa4acebb8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:29.039719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.044850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.053782 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2255/4513] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:28 2022] DELETE /identity/v3/projects/b09eb2a150f943daa80c3fa4acebb8c7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:29.056109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:29.076253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce07c0-029c-4b77-98d3-853465f1eef6 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:29.225246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:29.228425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:29.229122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:29.229655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] PATH_INFO: `/v3/users/55e6b999d32249eb8d29ea887e23b24d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:29.236058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e6b999d32249eb8d29ea887e23b24d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:29.238477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:29.355165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e6b999d32249eb8d29ea887e23b24d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.385920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e6b999d32249eb8d29ea887e23b24d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.403010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e6b999d32249eb8d29ea887e23b24d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.403860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e6b999d32249eb8d29ea887e23b24d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.415463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e6b999d32249eb8d29ea887e23b24d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:29.434559 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2259/4514] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:29 2022] DELETE /identity/v3/users/55e6b999d32249eb8d29ea887e23b24d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:29.707509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:29.712500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:29.763138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a2a50-8c2f-4626-88fa-dcdc37bcd358 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:29.985075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:29.987357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:29.989067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:29.993978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] PATH_INFO: `/v3/users/ee88775f240740edacac3598b8901101` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:29.997112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee88775f240740edacac3598b8901101)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:30.008104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:30.158213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:30.221604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee88775f240740edacac3598b8901101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:30.283685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee88775f240740edacac3598b8901101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:30.285102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee88775f240740edacac3598b8901101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:30.320983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee88775f240740edacac3598b8901101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:30.322494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee88775f240740edacac3598b8901101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:30.380097 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2256/4515] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:29 2022] DELETE /identity/v3/users/ee88775f240740edacac3598b8901101 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:30.605990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:30.608444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:30.857291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:30.908341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f107ae-2a04-4567-8c73-029a1c1a94a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:31.149200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:31.149903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:31.150203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:31.150508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:31.159769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:31.184609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:31.187207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:31.223190 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2260/4516] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:56:32.443437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:32.446278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:32.597401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92d505-8779-46d4-bf88-a239c24664b8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:32.617475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:32.619810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:32.620328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:32.621386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] PATH_INFO: `/v3/projects/ac5796c4b631439f8e8bc9e85f5d6905` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:32.623395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5796c4b631439f8e8bc9e85f5d6905)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:32.635233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:32.814879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:32.816996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:32.868745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5796c4b631439f8e8bc9e85f5d6905', 'request_id': 'req-0be64cd3-9807-400c-a844-56a48f589a21'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:32.883298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf656ca6-41ec-44ce-ae7c-f1bf00692253 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:32.892663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5796c4b631439f8e8bc9e85f5d6905', 'request_id': 'req-0be64cd3-9807-400c-a844-56a48f589a21'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:32.914162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5796c4b631439f8e8bc9e85f5d6905', 'request_id': 'req-0be64cd3-9807-400c-a844-56a48f589a21'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:32.937960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] The token cache is being invalidate because project ac5796c4b631439f8e8bc9e85f5d6905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:32.939050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:32.939887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:32.946848 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2257/4517] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:32 2022] DELETE /identity/v3/projects/ac5796c4b631439f8e8bc9e85f5d6905 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:32.948014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:32.949871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:33.072043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:33.125853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:33.130269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:33.135799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:33.136284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] PATH_INFO: `/v3/projects/b5a7b730114946778d55e6ee517a024a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:33.142561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a7b730114946778d55e6ee517a024a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:33.148567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:33.203460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64cd3-9807-400c-a844-56a48f589a21 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:33.227561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:33.229218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:33.230060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:33.230848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] PATH_INFO: `/v3/users/af9c9dc2edcb496080ec178894b7706b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:33.236071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9c9dc2edcb496080ec178894b7706b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:33.239110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:33.382812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a7b730114946778d55e6ee517a024a', 'request_id': 'req-2575d48b-efbb-43ad-b699-2fb05e8f666e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.413731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a7b730114946778d55e6ee517a024a', 'request_id': 'req-2575d48b-efbb-43ad-b699-2fb05e8f666e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.436402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a7b730114946778d55e6ee517a024a', 'request_id': 'req-2575d48b-efbb-43ad-b699-2fb05e8f666e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.443721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9c9dc2edcb496080ec178894b7706b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.474580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] The token cache is being invalidate because project b5a7b730114946778d55e6ee517a024a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:33.477379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.479240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2575d48b-efbb-43ad-b699-2fb05e8f666e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.483785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2261/4518] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:32 2022] DELETE /identity/v3/projects/b5a7b730114946778d55e6ee517a024a => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:33.500043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a04a8-2d2a-4287-ac88-63936b7408c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:33.500754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9c9dc2edcb496080ec178894b7706b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.503372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a04a8-2d2a-4287-ac88-63936b7408c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:33.503754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a04a8-2d2a-4287-ac88-63936b7408c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:33.505686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9c9dc2edcb496080ec178894b7706b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.541505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9c9dc2edcb496080ec178894b7706b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.552577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7b60d2e6-0c4c-4394-97a9-a09c5f32350b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9c9dc2edcb496080ec178894b7706b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:33.564669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-269a04a8-2d2a-4287-ac88-63936b7408c4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:33.566325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-269a04a8-2d2a-4287-ac88-63936b7408c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:33.579344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:33.606505 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2258/4519] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:32 2022] DELETE /identity/v3/users/af9c9dc2edcb496080ec178894b7706b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:33.731419 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2262/4520] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:33.738828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6795-46c1-4c8b-88a2-92e5f80ba2d2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:33.740160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6795-46c1-4c8b-88a2-92e5f80ba2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:33.740642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6795-46c1-4c8b-88a2-92e5f80ba2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:33.789309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-83fd6795-46c1-4c8b-88a2-92e5f80ba2d2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:33.799612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-83fd6795-46c1-4c8b-88a2-92e5f80ba2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:33.970879 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2259/4521] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:56:33.975341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a04a8-2d2a-4287-ac88-63936b7408c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:34.005440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a04a8-2d2a-4287-ac88-63936b7408c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:34.025235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:34.025956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:34.026268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:34.026537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:34.027759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:56:34.027759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:34.029985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:34.063229 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2263/4522] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:34.064712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd6795-46c1-4c8b-88a2-92e5f80ba2d2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:34.102385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd6795-46c1-4c8b-88a2-92e5f80ba2d2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:34.118323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:34.119093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:34.119417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:34.120503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:34.122957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:34.128505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:34.213319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:34.221348 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2260/4523] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:34 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:34.225820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3dab0-3d06-406a-bb9d-f5ab3595dd12 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:34.356574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:34.358287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:34.359098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:34.360070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:34.361677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:34.366198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:34.437427 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2264/4524] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:34 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:34.442078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:34.455569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a41394-09a7-4407-b52e-11e2476301f6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:34.462412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:34.466514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:34.466514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:34.466514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:34.466514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:34.469825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:34.487782 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2261/4525] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:34.489837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:34.526424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ceb32-f8a9-4f17-860f-c775917f62b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:34.544284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333257f-fa1d-48d3-a4e3-109f1c0a292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:34.546685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333257f-fa1d-48d3-a4e3-109f1c0a292d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:34.548808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333257f-fa1d-48d3-a4e3-109f1c0a292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:34.549092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333257f-fa1d-48d3-a4e3-109f1c0a292d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:34.550456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333257f-fa1d-48d3-a4e3-109f1c0a292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:34.564722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333257f-fa1d-48d3-a4e3-109f1c0a292d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:34.611503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:34.612398 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2265/4526] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:56:34.629721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4d19b-49aa-4dfa-98f7-6e29c972d071 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:34.639605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:34.641084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:34.641533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:34.642130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] PATH_INFO: `/v3/projects/da0dc51858c64e3589abc68587ab1b40/users/d2cb918769c44026b2b4358f3fcd7cff/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:34.665786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0dc51858c64e3589abc68587ab1b40, user_id=d2cb918769c44026b2b4358f3fcd7cff, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:34.674074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:34.734737 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2262/4527] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:34 2022] PUT /identity/v3/projects/da0dc51858c64e3589abc68587ab1b40/users/d2cb918769c44026b2b4358f3fcd7cff/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:34.737127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:34.737585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:34.738080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:34.805269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:34.807472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:35.034246 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2266/4528] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:35.091225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:35.094617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:35.102639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:35.268466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451465c-d08c-4d21-9bef-5739e1b66288 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:35.280492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715d37a-a459-4a6d-ab43-222fb8b8e5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:35.282141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715d37a-a459-4a6d-ab43-222fb8b8e5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:35.282739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715d37a-a459-4a6d-ab43-222fb8b8e5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:35.283358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715d37a-a459-4a6d-ab43-222fb8b8e5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:35.304897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715d37a-a459-4a6d-ab43-222fb8b8e5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:35.308959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715d37a-a459-4a6d-ab43-222fb8b8e5a1 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:35.332291 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2263/4529] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:35.944419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:35.947323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:36.000004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc744-4fb9-4310-a1e6-37b6b8103577 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:36.023735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:36.025046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:36.025471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:36.026352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] PATH_INFO: `/v3/projects/6da7b6f6cf1244bf9db3b16f702e55a9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:36.036901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da7b6f6cf1244bf9db3b16f702e55a9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:36.042176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:36.096880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:36.261146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da7b6f6cf1244bf9db3b16f702e55a9', 'request_id': 'req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:36.288952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da7b6f6cf1244bf9db3b16f702e55a9', 'request_id': 'req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:36.327355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da7b6f6cf1244bf9db3b16f702e55a9', 'request_id': 'req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:36.378338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] The token cache is being invalidate because project 6da7b6f6cf1244bf9db3b16f702e55a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:36.378998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:36.380629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fac9fe-cf5a-4760-913f-8f0673cf9fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:36.384829 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2267/4530] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:35 2022] DELETE /identity/v3/projects/6da7b6f6cf1244bf9db3b16f702e55a9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:36.392393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966da27-850f-4ed4-9eaf-243942ed9834 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:36.393269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966da27-850f-4ed4-9eaf-243942ed9834 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:36.393453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966da27-850f-4ed4-9eaf-243942ed9834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:36.457492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8966da27-850f-4ed4-9eaf-243942ed9834 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:36.459623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8966da27-850f-4ed4-9eaf-243942ed9834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:36.654700 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2264/4531] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:36.667204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be3ee-20cb-46c8-a219-dc140db820f4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:36.667977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be3ee-20cb-46c8-a219-dc140db820f4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:36.668651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be3ee-20cb-46c8-a219-dc140db820f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:36.731002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-972be3ee-20cb-46c8-a219-dc140db820f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:36.733495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-972be3ee-20cb-46c8-a219-dc140db820f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:36.767217 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2268/4532] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:36.773329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966da27-850f-4ed4-9eaf-243942ed9834 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:36.845393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966da27-850f-4ed4-9eaf-243942ed9834 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:36.868821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:36.870602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:36.873433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:36.874425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:36.876157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:56:36.876880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:36.880764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:36.907684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f337b5-7676-49c4-bfc4-1fa5bacd4124 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:36.908812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f337b5-7676-49c4-bfc4-1fa5bacd4124 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:36.909717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f337b5-7676-49c4-bfc4-1fa5bacd4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:36.978440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2265/4533] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:36.984577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:37.008696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2f337b5-7676-49c4-bfc4-1fa5bacd4124 None None] MFA Rules not processed for user `e6ddbab17e1b4c47afcd0244006f2c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:37.010527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c71148-cf9d-421f-bc5e-bda30ad55fc2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:37.013338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2f337b5-7676-49c4-bfc4-1fa5bacd4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:37.027456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:37.028189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:37.028491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:37.028794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:37.029513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:37.031740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:37.107254 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2266/4534] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:36 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:37.107870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:37.254747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40ab8-524e-478a-ada3-a44f745fffdd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:37.273442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:37.274367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:37.275071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:37.276100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:37.276928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:37.284249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:37.349735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:37.367553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2269/4535] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:37.380374 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2267/4536] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:37 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:37.386070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f337b5-7676-49c4-bfc4-1fa5bacd4124 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:37.396871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:37.405579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:37.448779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f337b5-7676-49c4-bfc4-1fa5bacd4124 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:37.479629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:37.483824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:37.484389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:37.484905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:37.491864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:37.495175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:37.543822 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2270/4537] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:56:37.550497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:37.607406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eed671-3de0-4c96-aea8-2e0b6ffb2a61 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:37.626911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:37.628501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:37.629426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:37.635027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:37.639757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:37.642923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:37.691094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2271/4538] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:37.692760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:37.732729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267201e-4e8e-4200-871c-5b679e9e2256 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:37.762392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f131e-13f2-40a5-aa4c-62f6288bb04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:37.764967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f131e-13f2-40a5-aa4c-62f6288bb04b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:37.765886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f131e-13f2-40a5-aa4c-62f6288bb04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:37.767214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f131e-13f2-40a5-aa4c-62f6288bb04b admin admin] PATH_INFO: `/v3/projects/e2de791a2c3b49f1aafff0f9960d1d92/users/4c653000b9b24b80ae6e80077b955bbf/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:37.769986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ab356-b06a-4aa4-b5ea-d19d2d6aa3a8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:37.781539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:37.782657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:37.783556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:37.784054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:37.826406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f131e-13f2-40a5-aa4c-62f6288bb04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2de791a2c3b49f1aafff0f9960d1d92, user_id=4c653000b9b24b80ae6e80077b955bbf, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:37.837650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f131e-13f2-40a5-aa4c-62f6288bb04b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:37.921135 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2272/4539] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:37 2022] PUT /identity/v3/projects/e2de791a2c3b49f1aafff0f9960d1d92/users/4c653000b9b24b80ae6e80077b955bbf/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:37.935613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c6144-1cb6-42b0-ac85-362f028fecb4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:37.937201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c6144-1cb6-42b0-ac85-362f028fecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:37.938325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c6144-1cb6-42b0-ac85-362f028fecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:37.948386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:37.951606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:37.987046 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2268/4540] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:38.077002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-138c6144-1cb6-42b0-ac85-362f028fecb4 None None] MFA Rules not processed for user `4c653000b9b24b80ae6e80077b955bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:38.078259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-138c6144-1cb6-42b0-ac85-362f028fecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:38.133814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:38.231561 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2273/4541] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:38.236508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:38.267883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57dae0-754a-4572-a102-c790c292cf49 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:38.535867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:38.540865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:38.542216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:38.543138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:38.545421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:38.556229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:38.639377 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2269/4542] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:38 2022] POST /identity/v3/projects => generated 369 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:38.643829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c6144-1cb6-42b0-ac85-362f028fecb4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:38.675130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c6144-1cb6-42b0-ac85-362f028fecb4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:38.872993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:38.874695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:38.875329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:38.875923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:38.878484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:38.883750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:38.956053 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2274/4543] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:38 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:38.962799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:39.021858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8067662-5c78-4fd3-8d8f-de7143f4020c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:39.034302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:39.034995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:39.035348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:39.035626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:39.036516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:39.038138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:39.086053 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2270/4544] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:39.096312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:39.142358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764363c-f131-4bd2-a207-cb98e4540238 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:39.197200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:39.208594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:39.209587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:39.213232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] PATH_INFO: `/v3/projects/71bb02343a1043c19d7f20be2c3ac3e6/users/2d9a189872f74da18d4ae871e16c3776/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:39.308481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bb02343a1043c19d7f20be2c3ac3e6, user_id=2d9a189872f74da18d4ae871e16c3776, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:39.333839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:39.403166 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2275/4545] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:39 2022] PUT /identity/v3/projects/71bb02343a1043c19d7f20be2c3ac3e6/users/2d9a189872f74da18d4ae871e16c3776/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:39.407076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:39.427473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fbb44-4afb-44f2-bbe7-73aa34f41878 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:39.457962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:39.625925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb13644-7ee0-4edc-9903-786f263d3fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:39.627629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13644-7ee0-4edc-9903-786f263d3fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:39.628090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13644-7ee0-4edc-9903-786f263d3fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:39.628586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13644-7ee0-4edc-9903-786f263d3fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:39.629743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb13644-7ee0-4edc-9903-786f263d3fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:39.632635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb13644-7ee0-4edc-9903-786f263d3fe3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:39.657447 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2271/4546] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:39.662464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:39.732428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a131ea-8120-4b7c-94fc-c0750ff03769 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:39.775941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:39.777849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:39.777849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:39.777849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] PATH_INFO: `/v3/projects/71bb02343a1043c19d7f20be2c3ac3e6/users/2d9a189872f74da18d4ae871e16c3776/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:39.780041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bb02343a1043c19d7f20be2c3ac3e6, user_id=2d9a189872f74da18d4ae871e16c3776, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:39.782690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:39.822226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2276/4547] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:39 2022] PUT /identity/v3/projects/71bb02343a1043c19d7f20be2c3ac3e6/users/2d9a189872f74da18d4ae871e16c3776/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:39.836546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5cb6-2e7c-4891-b5a7-429eadca9590 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:39.836857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5cb6-2e7c-4891-b5a7-429eadca9590 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:39.837133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5cb6-2e7c-4891-b5a7-429eadca9590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:39.944130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-845b5cb6-2e7c-4891-b5a7-429eadca9590 None None] MFA Rules not processed for user `2d9a189872f74da18d4ae871e16c3776`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:39.946071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-845b5cb6-2e7c-4891-b5a7-429eadca9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:40.325535 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2272/4548] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:56:40.326846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:40.343952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10f610-6b1c-44b9-9fcc-dafa2d85311f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:40.365522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:40.367163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:40.367680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:40.368316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:40.369268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:40.371853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:40.445698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2277/4549] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 14:56:40 2022] POST /identity/v3/projects => generated 329 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:40.452809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b5cb6-2e7c-4891-b5a7-429eadca9590 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:40.464630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b5cb6-2e7c-4891-b5a7-429eadca9590 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:40.677705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:40.679868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:40.686821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:40.687425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:40.688420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:40.691766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:40.743125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2273/4550] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:40 2022] POST /identity/v3/users => generated 416 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:40.748446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:40.769842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ab7e-d15b-48e6-9bae-f2d95cf74f4a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:40.790357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:40.791250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:40.791590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:40.791876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:40.792648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:40.805948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:40.853388 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2278/4551] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:40 2022] POST /identity/v3/roles => generated 243 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:40.857727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:40.877244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415b4f8-8660-47b8-bf5d-de19e5a3c99d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:40.891792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:40.892518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:40.892832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:40.893109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:40.893905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:40.895697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:40.954536 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2274/4552] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:40 2022] POST /identity/v3/roles => generated 247 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:40.958660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:40.983480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eb5e0-5464-437e-a917-bfcc8e0d452d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:41.006425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:41.007966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:41.008258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:41.008543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/e288205e57444d3aaebb048c0aedbabb/users/0ba5e22e54e74b21a3b7e9476c070d30/roles/78c84893d21840c399f699d80860d859` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:41.070336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e288205e57444d3aaebb048c0aedbabb, user_id=0ba5e22e54e74b21a3b7e9476c070d30, role_id=78c84893d21840c399f699d80860d859)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:41.073191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:41.125850 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2279/4553] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:40 2022] PUT /identity/v3/projects/e288205e57444d3aaebb048c0aedbabb/users/0ba5e22e54e74b21a3b7e9476c070d30/roles/78c84893d21840c399f699d80860d859 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:41.130149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:41.153857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0f4a5-26ea-41c1-a63d-4e9b91e5a974 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:41.174705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:41.437517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6b5d-33e0-4142-951e-b1bc9c8ff9dd tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:41.438469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6b5d-33e0-4142-951e-b1bc9c8ff9dd tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:41.438762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6b5d-33e0-4142-951e-b1bc9c8ff9dd tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:41.439049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6b5d-33e0-4142-951e-b1bc9c8ff9dd tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/e288205e57444d3aaebb048c0aedbabb/users/0ba5e22e54e74b21a3b7e9476c070d30/roles/6dbc74a4e0e44ad49a78f8946fbb118c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:41.450236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc6b5d-33e0-4142-951e-b1bc9c8ff9dd tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e288205e57444d3aaebb048c0aedbabb, user_id=0ba5e22e54e74b21a3b7e9476c070d30, role_id=6dbc74a4e0e44ad49a78f8946fbb118c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:41.453147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc6b5d-33e0-4142-951e-b1bc9c8ff9dd tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:41.479697 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2275/4554] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:41 2022] PUT /identity/v3/projects/e288205e57444d3aaebb048c0aedbabb/users/0ba5e22e54e74b21a3b7e9476c070d30/roles/6dbc74a4e0e44ad49a78f8946fbb118c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:41.484005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:41.499432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34280072-9caa-43cf-b089-9740146bed54 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:41.538532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:41.700732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0b32b-c993-4363-b9a3-bfb455d23d66 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:41.701990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0b32b-c993-4363-b9a3-bfb455d23d66 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:41.702507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0b32b-c993-4363-b9a3-bfb455d23d66 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:41.703027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0b32b-c993-4363-b9a3-bfb455d23d66 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:41.704683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0b32b-c993-4363-b9a3-bfb455d23d66 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:41.710768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0b32b-c993-4363-b9a3-bfb455d23d66 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:41.805720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ae9a-c012-46b8-89b3-85e5179f333d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:41.806308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ae9a-c012-46b8-89b3-85e5179f333d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:41.806308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ae9a-c012-46b8-89b3-85e5179f333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:41.809899 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2280/4555] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:41 2022] GET /identity/v3/users => generated 8060 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:41.909753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-10c7ae9a-c012-46b8-89b3-85e5179f333d None None] MFA Rules not processed for user `0ba5e22e54e74b21a3b7e9476c070d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:41.911154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-10c7ae9a-c012-46b8-89b3-85e5179f333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:42.138156 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2276/4556] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:42.151864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114afc-af75-4a21-bd93-90695f54bb98 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:42.152185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114afc-af75-4a21-bd93-90695f54bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:42.152473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114afc-af75-4a21-bd93-90695f54bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:42.195939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70114afc-af75-4a21-bd93-90695f54bb98 None None] MFA Rules not processed for user `0ba5e22e54e74b21a3b7e9476c070d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:42.197274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70114afc-af75-4a21-bd93-90695f54bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:42.211758 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2281/4557] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:42.216151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7ae9a-c012-46b8-89b3-85e5179f333d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:42.244659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7ae9a-c012-46b8-89b3-85e5179f333d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:42.257561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ba5e22e54e74b21a3b7e9476c070d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e288205e57444d3aaebb048c0aedbabb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-246822141', 'tempest-NotDelegatedRole-1312572730'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:42.258262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:42.258554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:42.258921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:42.259743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] RBAC: Authorizing `identity:create_trust()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:42.261115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:42.438529 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2277/4558] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:56:42 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:42.442838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70114afc-af75-4a21-bd93-90695f54bb98 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:42.468472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70114afc-af75-4a21-bd93-90695f54bb98 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:42.476303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:42.477005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:42.477327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:42.477621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:42.478347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:42.479464 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:56:42.479464 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 14:56:42.479464 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 14:56:42.480417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:42.507395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:42.507714 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2282/4559] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:56:42 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:56:42.535694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a26ba-74dc-4111-bae5-a183e05f3e75 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:42.550325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ba5e22e54e74b21a3b7e9476c070d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e288205e57444d3aaebb048c0aedbabb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-246822141', 'tempest-NotDelegatedRole-1312572730'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:42.552827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:42.554969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:42.556151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] PATH_INFO: `/v3/OS-TRUST/trusts/ab13f17428744877b33a769e6f1f6c07` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:42.588741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] RBAC: Authorizing `identity:delete_trust(trust_id=ab13f17428744877b33a769e6f1f6c07)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:42.593535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:42.603342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:42.664375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ab13f17428744877b33a769e6f1f6c07', 'request_id': 'req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:42.665380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ab13f17428744877b33a769e6f1f6c07', 'request_id': 'req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:42.666105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ab13f17428744877b33a769e6f1f6c07', 'request_id': 'req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:42.700364 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2278/4560] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 14:56:42 2022] DELETE /identity/v3/OS-TRUST/trusts/ab13f17428744877b33a769e6f1f6c07 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:42.701717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:42.703934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:42.744367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bab31d-5734-4ac2-82e8-ed7ee07fb788 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:42.764282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ba5e22e54e74b21a3b7e9476c070d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e288205e57444d3aaebb048c0aedbabb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-246822141', 'tempest-NotDelegatedRole-1312572730'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:42.765472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:42.765952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:42.766608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] PATH_INFO: `/v3/OS-TRUST/trusts/ab13f17428744877b33a769e6f1f6c07` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Could not find trust: ab13f17428744877b33a769e6f1f6c07.: keystone.exception.TrustNotFound: Could not find trust: ab13f17428744877b33a769e6f1f6c07. Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 14 14:56:42.815664 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ab13f17428744877b33a769e6f1f6c07. Jul 14 14:56:42.817582 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:56:42.828502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:42.829775 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2283/4561] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:56:42 2022] GET /identity/v3/OS-TRUST/trusts/ab13f17428744877b33a769e6f1f6c07 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:56:42.830086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:42.877879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc431-6c3c-41eb-b0a1-4f07ff46ec6d tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:42.889560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:42.890562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:42.890852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:42.893381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/6dbc74a4e0e44ad49a78f8946fbb118c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:42.897586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6dbc74a4e0e44ad49a78f8946fbb118c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:42.909806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:43.054865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 6dbc74a4e0e44ad49a78f8946fbb118c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:43.057873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.059649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.072744 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2279/4562] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:42 2022] DELETE /identity/v3/roles/6dbc74a4e0e44ad49a78f8946fbb118c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:43.076800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:43.083200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:43.119390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce23a0-f08d-4e9a-a23a-f39be27b2ea7 tempest-TrustsV3TestJSON-1967680508 tempest-user-1037078136] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:43.271249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:43.273199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:43.273744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:43.274230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/78c84893d21840c399f699d80860d859` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:43.277559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=78c84893d21840c399f699d80860d859)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:43.283139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:43.385156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 78c84893d21840c399f699d80860d859 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:43.386133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.389238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.392783 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2284/4563] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:43 2022] DELETE /identity/v3/roles/78c84893d21840c399f699d80860d859 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:43.398020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:43.419919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7323cce-e969-4e7c-83b7-f42845eb76b3 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:43.672945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:43.676500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:43.677037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:43.677698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users/0ba5e22e54e74b21a3b7e9476c070d30` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:43.683315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ba5e22e54e74b21a3b7e9476c070d30)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:43.685222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:43.831004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba5e22e54e74b21a3b7e9476c070d30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.860452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba5e22e54e74b21a3b7e9476c070d30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.861404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba5e22e54e74b21a3b7e9476c070d30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.870907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba5e22e54e74b21a3b7e9476c070d30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.871896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba5e22e54e74b21a3b7e9476c070d30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:43.899054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2280/4564] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:43 2022] DELETE /identity/v3/users/0ba5e22e54e74b21a3b7e9476c070d30 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:43.910313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:43.912205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:43.927094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be8cd-b956-4703-882c-dc449e759588 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:44.078866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:44.092522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:44.093848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:44.094580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:44.095022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/e288205e57444d3aaebb048c0aedbabb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:44.096840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e288205e57444d3aaebb048c0aedbabb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:44.117127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:44.360935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e288205e57444d3aaebb048c0aedbabb', 'request_id': 'req-93c0ecf9-b692-4acf-842d-52830504741c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:44.391929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e288205e57444d3aaebb048c0aedbabb', 'request_id': 'req-93c0ecf9-b692-4acf-842d-52830504741c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:44.404766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:44.407308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:44.467825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:44.493635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e288205e57444d3aaebb048c0aedbabb', 'request_id': 'req-93c0ecf9-b692-4acf-842d-52830504741c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:44.603300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] The token cache is being invalidate because project e288205e57444d3aaebb048c0aedbabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:44.603834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:44.607974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:44.622251 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2285/4565] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:43 2022] DELETE /identity/v3/projects/e288205e57444d3aaebb048c0aedbabb => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:44.630178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:44.660509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:44.704306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c774aa8-024a-4caf-b6c2-02fcaec0ce4e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:44.933861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:44.934834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:44.935130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:44.935522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] PATH_INFO: `/v3/users/1010f86e104f4ad6883b5da1ad08d70b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:44.940906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1010f86e104f4ad6883b5da1ad08d70b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:44.956106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:45.036593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0ecf9-b692-4acf-842d-52830504741c tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:45.062987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:45.065625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:45.070047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:45.071009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:45.075142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:45.089124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:45.122368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1010f86e104f4ad6883b5da1ad08d70b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:45.159630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1010f86e104f4ad6883b5da1ad08d70b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:45.160454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1010f86e104f4ad6883b5da1ad08d70b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:45.180980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1010f86e104f4ad6883b5da1ad08d70b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:45.181778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15671503-11fb-4518-9798-cfcfe00bb9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1010f86e104f4ad6883b5da1ad08d70b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:45.208746 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2281/4566] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:44 2022] DELETE /identity/v3/users/1010f86e104f4ad6883b5da1ad08d70b => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:45.214589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:45.214893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:45.215185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:45.259239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2286/4567] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 14:56:44 2022] POST /identity/v3/projects => generated 329 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:45.266734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:45.273697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:45.292497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:45.298332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:45.502328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:45.663824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243ea3-1701-4c05-ae70-1f170752a4fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:45.696661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:45.702374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:45.702886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:45.703426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:45.704741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:45.715672 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2282/4568] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:45.734109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:45.817063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:45.844880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:45.847524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:45.847803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2287/4569] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:45 2022] POST /identity/v3/users => generated 413 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:45.857142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:45.935618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196a9f-4095-437b-ac0f-0337ffce5db0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:45.959182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:45.961169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:45.963221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:45.967295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:45.971395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:45.981697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:46.053101 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2288/4570] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:45 2022] POST /identity/v3/roles => generated 243 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:46.058765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:46.106761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf2484-e89a-420e-8007-e85a76e03ca1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:46.135791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:46.137824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:46.138645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:46.139419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:46.149805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:46.155930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:46.214903 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2289/4571] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:46 2022] POST /identity/v3/roles => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:46.220411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:46.248671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846722e5-cd2f-48b2-8351-8a5eacd36d9a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:46.289473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621ad17-a6ec-4ee5-a47c-516956bc21bc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:46.291414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:46.300137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:46.300773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:46.301258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:46.313934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:46.315958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:46.316755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:46.318388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/5743b8f088694de6aff03fb9756cef10/users/fc02eccf82ac44908fa278fb276a9cdc/roles/47a59294cab04722a04a627a02e5f8f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:46.378833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:46.379974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:46.414523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5743b8f088694de6aff03fb9756cef10, user_id=fc02eccf82ac44908fa278fb276a9cdc, role_id=47a59294cab04722a04a627a02e5f8f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:46.417438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:46.451770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2283/4572] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:56:46.477581 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2290/4573] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:46 2022] PUT /identity/v3/projects/5743b8f088694de6aff03fb9756cef10/users/fc02eccf82ac44908fa278fb276a9cdc/roles/47a59294cab04722a04a627a02e5f8f6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:46.482443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:46.532225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19843ad8-9cc8-4057-b9c0-8426b1fa58f6 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:46.757430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34db714-f84f-49a2-9467-845976d2f9a1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:46.758689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34db714-f84f-49a2-9467-845976d2f9a1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:46.759232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34db714-f84f-49a2-9467-845976d2f9a1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:46.759811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34db714-f84f-49a2-9467-845976d2f9a1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/5743b8f088694de6aff03fb9756cef10/users/fc02eccf82ac44908fa278fb276a9cdc/roles/e549185c55994ce2948c434e2ed9a927` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:46.767750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34db714-f84f-49a2-9467-845976d2f9a1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5743b8f088694de6aff03fb9756cef10, user_id=fc02eccf82ac44908fa278fb276a9cdc, role_id=e549185c55994ce2948c434e2ed9a927)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:46.774246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34db714-f84f-49a2-9467-845976d2f9a1 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:46.825490 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2284/4574] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:46 2022] PUT /identity/v3/projects/5743b8f088694de6aff03fb9756cef10/users/fc02eccf82ac44908fa278fb276a9cdc/roles/e549185c55994ce2948c434e2ed9a927 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:46.831919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:46.875026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975422c7-1269-40a5-9971-a885934b7e70 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:47.175626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:47.179073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:47.180170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:47.180937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:47.186850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:47.194098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:47.341118 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2291/4575] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:46 2022] GET /identity/v3/users => generated 7771 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:47.341601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a790-4712-4dcb-ada6-54470fdc4471 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:47.342070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a790-4712-4dcb-ada6-54470fdc4471 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:47.342199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a790-4712-4dcb-ada6-54470fdc4471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:47.528952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7107a790-4712-4dcb-ada6-54470fdc4471 None None] MFA Rules not processed for user `fc02eccf82ac44908fa278fb276a9cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:47.531070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7107a790-4712-4dcb-ada6-54470fdc4471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:47.678290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:47.682298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:47.977595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:47.997417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb123ea-335b-4842-8c87-abc50116aeeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:48.012557 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2285/4576] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 672 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:48.024545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4afa85-e438-4cf6-8120-b2787a1de48d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:48.027208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4afa85-e438-4cf6-8120-b2787a1de48d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:48.028161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4afa85-e438-4cf6-8120-b2787a1de48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:48.035434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:48.045122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:48.045815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:48.046399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] PATH_INFO: `/v3/projects/65169b89647141db8e006d0dcc74e526` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:48.054949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=65169b89647141db8e006d0dcc74e526)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:48.061302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:48.087045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5f4afa85-e438-4cf6-8120-b2787a1de48d None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:48.091844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f4afa85-e438-4cf6-8120-b2787a1de48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:48.254427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:48.261481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65169b89647141db8e006d0dcc74e526', 'request_id': 'req-4191a95d-50cf-490d-af8f-0c218be00e9b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.272881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65169b89647141db8e006d0dcc74e526', 'request_id': 'req-4191a95d-50cf-490d-af8f-0c218be00e9b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.282272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65169b89647141db8e006d0dcc74e526', 'request_id': 'req-4191a95d-50cf-490d-af8f-0c218be00e9b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.287151 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2286/4577] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:48.289630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda9c4-2184-4974-af7d-edd20a26acfc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:48.290834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda9c4-2184-4974-af7d-edd20a26acfc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:48.291126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda9c4-2184-4974-af7d-edd20a26acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:48.301186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] The token cache is being invalidate because project 65169b89647141db8e006d0dcc74e526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:48.302211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.303178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.312664 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2292/4578] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:47 2022] DELETE /identity/v3/projects/65169b89647141db8e006d0dcc74e526 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:56:48.316244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:48.325098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:48.336514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9ddda9c4-2184-4974-af7d-edd20a26acfc None None] MFA Rules not processed for user `fc02eccf82ac44908fa278fb276a9cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:48.343885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9ddda9c4-2184-4974-af7d-edd20a26acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:48.524079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a95d-50cf-490d-af8f-0c218be00e9b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:48.544242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:48.545626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:48.546219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:48.548522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] PATH_INFO: `/v3/users/126f8683e55647bc9605e05c7aa654fd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:48.554669 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2287/4579] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:48.554669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:48.554669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:48.554669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:48.556366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126f8683e55647bc9605e05c7aa654fd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:48.560116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:48.607017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:48.610898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:48.634219 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2288/4580] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:48.635545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:48.637238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:48.674230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126f8683e55647bc9605e05c7aa654fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.721831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126f8683e55647bc9605e05c7aa654fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.739963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126f8683e55647bc9605e05c7aa654fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.741018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126f8683e55647bc9605e05c7aa654fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.758161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126f8683e55647bc9605e05c7aa654fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:48.784310 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2293/4581] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:48 2022] DELETE /identity/v3/users/126f8683e55647bc9605e05c7aa654fd => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:48.786134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:48.790688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:48.927581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd3489-c50e-49e4-89d2-135bac3ed501 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:48.981735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86455c95-6635-4729-ae61-e65bb5f31fb1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:48.999879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc02eccf82ac44908fa278fb276a9cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5743b8f088694de6aff03fb9756cef10', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-657090184', 'tempest-NotDelegatedRole-1875761992'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:49.001903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:49.002515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:49.004892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:49.006240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: Authorizing `identity:create_trust()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:49.012800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:49.021757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:49.059296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:49.124054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713b702-0678-4236-a501-d5bf6daa4267 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:49.124944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713b702-0678-4236-a501-d5bf6daa4267 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:49.125710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713b702-0678-4236-a501-d5bf6daa4267 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:49.126071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713b702-0678-4236-a501-d5bf6daa4267 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:49.132765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c713b702-0678-4236-a501-d5bf6daa4267 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:49.400388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713b702-0678-4236-a501-d5bf6daa4267 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:49.402120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713b702-0678-4236-a501-d5bf6daa4267 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:49.434577 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2289/4582] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:49.436154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3739a4-c700-45ec-86fe-1f08aae2094e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:49.437146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3739a4-c700-45ec-86fe-1f08aae2094e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:49.437146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3739a4-c700-45ec-86fe-1f08aae2094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:49.516807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bb3739a4-c700-45ec-86fe-1f08aae2094e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:49.518600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb3739a4-c700-45ec-86fe-1f08aae2094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:49.548283 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2294/4583] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:56:48 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 763 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:49.561633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:49.596556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eba397-42f7-417e-86f1-240fa49b4664 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:49.617089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc02eccf82ac44908fa278fb276a9cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5743b8f088694de6aff03fb9756cef10', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-657090184', 'tempest-NotDelegatedRole-1875761992'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:49.620900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:49.621431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:49.621949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:49.628954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:49.638336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:49.673115 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2295/4584] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Jul 14 14:56:49 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=fc02eccf82ac44908fa278fb276a9cdc => generated 611 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:49.676210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:49.696491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48113810-3d0c-478a-b53b-d6b4a006a89c tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:49.715662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc02eccf82ac44908fa278fb276a9cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5743b8f088694de6aff03fb9756cef10', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-657090184', 'tempest-NotDelegatedRole-1875761992'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:49.719063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:49.722741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:49.723225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] PATH_INFO: `/v3/OS-TRUST/trusts/a265e616b9d64da5a66258f8e03843d6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:49.761897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: Authorizing `identity:delete_trust(trust_id=a265e616b9d64da5a66258f8e03843d6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:49.768931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:49.931694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a265e616b9d64da5a66258f8e03843d6', 'request_id': 'req-ec5bd034-6462-4dff-b4fa-773acc299454'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:49.942347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a265e616b9d64da5a66258f8e03843d6', 'request_id': 'req-ec5bd034-6462-4dff-b4fa-773acc299454'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:49.962513 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2290/4585] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:49.976287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3739a4-c700-45ec-86fe-1f08aae2094e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:49.981454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a265e616b9d64da5a66258f8e03843d6', 'request_id': 'req-ec5bd034-6462-4dff-b4fa-773acc299454'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:50.009992 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2296/4586] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 14:56:49 2022] DELETE /identity/v3/OS-TRUST/trusts/a265e616b9d64da5a66258f8e03843d6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:50.029630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:50.036515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:50.045502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3739a4-c700-45ec-86fe-1f08aae2094e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:50.073836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:50.075477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:50.084112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:50.084643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:50.086086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:56:50.086624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:50.101483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:50.106218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bd034-6462-4dff-b4fa-773acc299454 tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:50.126661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc02eccf82ac44908fa278fb276a9cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5743b8f088694de6aff03fb9756cef10', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-657090184', 'tempest-NotDelegatedRole-1875761992'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:50.127588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:50.128166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:50.128463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] PATH_INFO: `/v3/OS-TRUST/trusts/a265e616b9d64da5a66258f8e03843d6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:50.167331 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2291/4587] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Could not find trust: a265e616b9d64da5a66258f8e03843d6.: keystone.exception.TrustNotFound: Could not find trust: a265e616b9d64da5a66258f8e03843d6. Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 14 14:56:50.171053 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a265e616b9d64da5a66258f8e03843d6. Jul 14 14:56:50.173434 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:56:50.176856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:50.179324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:50.187255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2297/4588] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:56:50 2022] GET /identity/v3/OS-TRUST/trusts/a265e616b9d64da5a66258f8e03843d6 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:56:50.189725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:50.201421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:50.233169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7a77-8619-4da0-abcd-254798c913e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:50.250543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:50.251861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:50.253845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:50.254340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:50.260426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:50.268029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:50.379792 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2292/4589] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:50 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:56:50.383780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:50.489900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f81eb-1fee-4b64-84cd-e129cc8130ed tempest-TrustsV3TestJSON-1084939349 tempest-user-866095217] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:50.610741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:50.659139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81664a-15ee-40d8-93e3-e709339547e6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:50.687060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:50.694163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:50.696473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:50.697474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:50.698060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:50.699422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:50.707873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:50.754680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:50.759385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:50.760181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:50.760919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/e549185c55994ce2948c434e2ed9a927` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:50.767091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e549185c55994ce2948c434e2ed9a927)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:50.770600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:50.785515 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2293/4590] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:50 2022] POST /identity/v3/users => generated 290 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:50.791057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:50.894494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793c5ba-678a-4018-9b1e-f82b30043612 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:50.937239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:50.942173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:50.947161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:50.947814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:50.953378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:50.971546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:51.021109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role e549185c55994ce2948c434e2ed9a927 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:51.021716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.023617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.033461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2298/4591] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:50 2022] DELETE /identity/v3/roles/e549185c55994ce2948c434e2ed9a927 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:51.035241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:51.040190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:51.063510 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2294/4592] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:50 2022] GET /identity/v3/roles => generated 1892 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:51.067481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:51.077859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:51.158178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11623b1f-3d31-433f-b7df-e2e1cb1a6ab2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:51.369304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da9cc8-9f9e-4709-b2d8-513824b7ae24 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:51.404171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:51.411249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:51.411810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:51.412481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/47a59294cab04722a04a627a02e5f8f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:51.420524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=47a59294cab04722a04a627a02e5f8f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:51.424451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:51.428652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:51.429747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:51.430364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:51.436315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:51.437923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:51.441343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:51.489003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2295/4593] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:51 2022] GET /identity/v3/roles => generated 1654 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:51.492296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:51.497736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:51.599469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 47a59294cab04722a04a627a02e5f8f6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:51.601754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bafba-3d39-44cb-bdef-2bdcf9e83b4e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:51.602745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.604548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.617929 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2299/4594] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:51 2022] DELETE /identity/v3/roles/47a59294cab04722a04a627a02e5f8f6 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:51.622473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:51.626715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:51.638720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:51.639238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:51.640194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:51.640194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] PATH_INFO: `/v3/projects/5db5c93660ef41728634e8e57039da1a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:51.651599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db5c93660ef41728634e8e57039da1a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:51.659364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:51.804753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db5c93660ef41728634e8e57039da1a', 'request_id': 'req-2a9fa0f7-ec66-48b6-825c-42f7195ae481'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.824787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db5c93660ef41728634e8e57039da1a', 'request_id': 'req-2a9fa0f7-ec66-48b6-825c-42f7195ae481'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.840984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db5c93660ef41728634e8e57039da1a', 'request_id': 'req-2a9fa0f7-ec66-48b6-825c-42f7195ae481'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.876777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e3ce0-ebf7-446c-ad2d-795c5977bf58 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:51.914065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] The token cache is being invalidate because project 5db5c93660ef41728634e8e57039da1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:51.914405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.920725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:51.929927 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2296/4595] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:51 2022] DELETE /identity/v3/projects/5db5c93660ef41728634e8e57039da1a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:51.931670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:51.939154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:52.006197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:52.182889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:52.232964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40454b-36ad-4a45-b2dd-dfb820445a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:52.234418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40454b-36ad-4a45-b2dd-dfb820445a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:52.236074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40454b-36ad-4a45-b2dd-dfb820445a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:52.239385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40454b-36ad-4a45-b2dd-dfb820445a06 admin admin] PATH_INFO: `/v3/projects/a55d05eb595540588ed7f78561a35b0c/users/6e6fd9e020654519b5061df41ed34ccf/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:52.260577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa0f7-ec66-48b6-825c-42f7195ae481 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:52.290006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:52.291886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40454b-36ad-4a45-b2dd-dfb820445a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55d05eb595540588ed7f78561a35b0c, user_id=6e6fd9e020654519b5061df41ed34ccf, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:52.294770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:52.295194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:52.295589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40454b-36ad-4a45-b2dd-dfb820445a06 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:52.295737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users/fc02eccf82ac44908fa278fb276a9cdc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:52.300131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fc02eccf82ac44908fa278fb276a9cdc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:52.313416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:52.327444 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2300/4596] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:51 2022] PUT /identity/v3/projects/a55d05eb595540588ed7f78561a35b0c/users/6e6fd9e020654519b5061df41ed34ccf/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:52.329458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87e47-bec9-4833-9c26-349870fcf1a3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:52.332132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87e47-bec9-4833-9c26-349870fcf1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:52.332774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87e47-bec9-4833-9c26-349870fcf1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:52.387440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-60c87e47-bec9-4833-9c26-349870fcf1a3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:52.389179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60c87e47-bec9-4833-9c26-349870fcf1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:52.512278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc02eccf82ac44908fa278fb276a9cdc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:52.548238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc02eccf82ac44908fa278fb276a9cdc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:52.550379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc02eccf82ac44908fa278fb276a9cdc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:52.556994 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2301/4597] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:52.558989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432e046-5421-4e88-a4c1-a15f9015652c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:52.560445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432e046-5421-4e88-a4c1-a15f9015652c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:52.561059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432e046-5421-4e88-a4c1-a15f9015652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:52.574879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc02eccf82ac44908fa278fb276a9cdc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:52.578260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f98b25b-ff02-4566-80df-a5d0b2787165 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc02eccf82ac44908fa278fb276a9cdc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:52.610884 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2297/4598] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:51 2022] DELETE /identity/v3/users/fc02eccf82ac44908fa278fb276a9cdc => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:52.617098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:52.617480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:52.617861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:52.648631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9432e046-5421-4e88-a4c1-a15f9015652c None None] MFA Rules not processed for user `6e6fd9e020654519b5061df41ed34ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:52.655949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9432e046-5421-4e88-a4c1-a15f9015652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:52.663171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:52.664571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:52.846631 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2298/4599] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:52.847755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:52.852460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:53.063161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2f987-5e11-432f-ae39-f26eb3927a0e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:53.064637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2302/4600] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:53.078210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432e046-5421-4e88-a4c1-a15f9015652c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:53.086097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:53.087744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:53.088275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:53.088787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/5743b8f088694de6aff03fb9756cef10` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:53.108936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5743b8f088694de6aff03fb9756cef10)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:53.115530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:53.141282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432e046-5421-4e88-a4c1-a15f9015652c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:53.207801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:53.208992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:53.210044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:53.210581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:53.227595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:56:53.228244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:53.281436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:53.290021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:53.467841 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2303/4601] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:53.470103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:53.490905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:53.597852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5743b8f088694de6aff03fb9756cef10', 'request_id': 'req-44b74ba2-54d3-44c2-8226-b73b37a2b06b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:53.647217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5743b8f088694de6aff03fb9756cef10', 'request_id': 'req-44b74ba2-54d3-44c2-8226-b73b37a2b06b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:53.652788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:53.681981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5743b8f088694de6aff03fb9756cef10', 'request_id': 'req-44b74ba2-54d3-44c2-8226-b73b37a2b06b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:53.753336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] The token cache is being invalidate because project 5743b8f088694de6aff03fb9756cef10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:53.753760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:53.754843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:53.762775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2299/4602] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:56:52 2022] DELETE /identity/v3/projects/5743b8f088694de6aff03fb9756cef10 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:53.763746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:53.776577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:53.889948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98b857-a622-40c1-8330-5298099feb27 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:54.024977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b74ba2-54d3-44c2-8226-b73b37a2b06b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:54.040045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:54.040761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:54.041054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:54.041345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:54.043910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:54.048315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:54.138426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2300/4603] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:56:53 2022] POST /identity/v3/projects => generated 379 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:54.140049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:54.147207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:54.165191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:54.166898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:54.167772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:54.169716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:54.175464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:54.467680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:54.474503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:54.476067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025f6b8-79a3-462e-90c2-6b75b432d045 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:54.495972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:54.497403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:54.497403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:54.497819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:54.498266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:54.506648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:54.511388 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2304/4604] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 1040 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:56:54.511388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:54.535059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872edf-e62c-4734-aaa5-02b275171f34 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:54.603836 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2301/4605] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 14:56:54 2022] POST /identity/v3/projects => generated 328 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:54.609611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:54.666444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:54.865565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:54.870354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:54.873515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:54.881199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:54.885293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:54.901426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:54.989194 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2305/4606] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:54 2022] POST /identity/v3/users => generated 290 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:54.996355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:55.040406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de400b3-eba2-4119-91ce-9f2f47e672c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:55.107740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:55.182757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635109f-fdb2-4ddb-87a2-fa0121179aa5 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:55.195972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:55.196750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.197063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.197326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.198953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:55.202935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:55.240210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:55.240969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.241292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.241525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.242321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:55.254455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:55.285084 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2302/4607] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:56:54 2022] POST /identity/v3/users => generated 416 bytes in 678 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:55.290471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:55.306775 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2306/4608] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:55.325377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:55.367802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6df5f8-e1f8-4c9c-85ed-1e91b1416f02 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:55.377882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9ecfd-8053-4f89-b91c-ccfede706f24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:55.381579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:55.382769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.383301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.383809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.385235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:55.389464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:55.418545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:55.421490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.423779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.432250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.433830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:55.446545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:55.481437 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2303/4609] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:55 2022] POST /identity/v3/roles => generated 244 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:55.488031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:55.527825 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2307/4610] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:55 2022] GET /identity/v3/roles => generated 1655 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:55.529748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:55.563891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3a97-9a0b-4087-9492-250f0d11bf44 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:55.589252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95d34b-4445-462a-ad18-ca5aab3bd76a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:55.596895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:55.599044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.599948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.601953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.603880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:55.608703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:55.617527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef326-413b-4b1c-b17b-c940ac81d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:55.619107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef326-413b-4b1c-b17b-c940ac81d5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.619661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef326-413b-4b1c-b17b-c940ac81d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.620153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef326-413b-4b1c-b17b-c940ac81d5e2 admin admin] PATH_INFO: `/v3/projects/b25ee6783ea3416dbef5c8ae62244367/users/520cc191a5b24d52b73ad4c0c5d4e9a6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.672653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef326-413b-4b1c-b17b-c940ac81d5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25ee6783ea3416dbef5c8ae62244367, user_id=520cc191a5b24d52b73ad4c0c5d4e9a6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:55.675188 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2304/4611] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:56:55 2022] POST /identity/v3/roles => generated 247 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:55.683968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:55.686075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef326-413b-4b1c-b17b-c940ac81d5e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:55.734264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a12b54-8baf-4fd8-b05f-3dfca21676e2 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:55.739141 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2308/4612] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:55 2022] PUT /identity/v3/projects/b25ee6783ea3416dbef5c8ae62244367/users/520cc191a5b24d52b73ad4c0c5d4e9a6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:55.741853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baf09-8f45-4b26-87e7-bbaf462df33f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.742364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baf09-8f45-4b26-87e7-bbaf462df33f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.742853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baf09-8f45-4b26-87e7-bbaf462df33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.813594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-401baf09-8f45-4b26-87e7-bbaf462df33f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:55.815005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-401baf09-8f45-4b26-87e7-bbaf462df33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:55.916424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:55.917755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:55.918755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:55.919351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/78fd39b27a684ad0b54440a6d90fc5bf/users/a108ac040a67460daf2351cd132c63fc/roles/3f0ff6cf0f86423c98b5393912836dc6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:55.997727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78fd39b27a684ad0b54440a6d90fc5bf, user_id=a108ac040a67460daf2351cd132c63fc, role_id=3f0ff6cf0f86423c98b5393912836dc6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:56.012791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:56.063218 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2305/4613] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:55 2022] PUT /identity/v3/projects/78fd39b27a684ad0b54440a6d90fc5bf/users/a108ac040a67460daf2351cd132c63fc/roles/3f0ff6cf0f86423c98b5393912836dc6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:56.071945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:56.182537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2309/4614] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:56.251618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:56.264289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dd3b-1a4c-4918-9109-a8f9e0e0c8fb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:56.281593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:56.284484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:56.285749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:56.286331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/78fd39b27a684ad0b54440a6d90fc5bf/users/a108ac040a67460daf2351cd132c63fc/roles/849e14513f934de798c28b8e1ee9a346` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:56.298121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78fd39b27a684ad0b54440a6d90fc5bf, user_id=a108ac040a67460daf2351cd132c63fc, role_id=849e14513f934de798c28b8e1ee9a346)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:56.301979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:56.335364 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2306/4615] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:56:56 2022] PUT /identity/v3/projects/78fd39b27a684ad0b54440a6d90fc5bf/users/a108ac040a67460daf2351cd132c63fc/roles/849e14513f934de798c28b8e1ee9a346 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:56.342218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baf09-8f45-4b26-87e7-bbaf462df33f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:56.423166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baf09-8f45-4b26-87e7-bbaf462df33f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:56.426741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:56.428855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:56.683022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf050c0-b061-46a5-b163-65e625156dc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:56.708468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee22cd-70fe-403a-91d2-ad815fff027b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:56.710809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee22cd-70fe-403a-91d2-ad815fff027b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:56.711924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee22cd-70fe-403a-91d2-ad815fff027b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:56.712871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee22cd-70fe-403a-91d2-ad815fff027b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:56.718088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182804d-9d66-442a-8111-083254f69d92 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:56.718858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182804d-9d66-442a-8111-083254f69d92 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:56.721575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182804d-9d66-442a-8111-083254f69d92 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:56.722387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182804d-9d66-442a-8111-083254f69d92 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:56.724810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182804d-9d66-442a-8111-083254f69d92 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:56.729210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182804d-9d66-442a-8111-083254f69d92 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:56.815631 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2310/4616] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:56:56 2022] GET /identity/v3/users => generated 8057 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:56:56.821580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d28f5-211d-4a6d-8b56-6ab2cd187189 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:56.821926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d28f5-211d-4a6d-8b56-6ab2cd187189 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:56.821926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d28f5-211d-4a6d-8b56-6ab2cd187189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:56.985139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee22cd-70fe-403a-91d2-ad815fff027b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:56.992874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee22cd-70fe-403a-91d2-ad815fff027b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:57.014428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-528d28f5-211d-4a6d-8b56-6ab2cd187189 None None] MFA Rules not processed for user `a108ac040a67460daf2351cd132c63fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:57.022602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-528d28f5-211d-4a6d-8b56-6ab2cd187189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:57.032302 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2307/4617] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:56:57.047738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:57.421869 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2311/4618] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 597 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:57.423311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06508-983a-4d1e-9d00-1a17119bee7f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:57.423732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06508-983a-4d1e-9d00-1a17119bee7f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:57.423894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06508-983a-4d1e-9d00-1a17119bee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:57.486002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-95e06508-983a-4d1e-9d00-1a17119bee7f None None] MFA Rules not processed for user `a108ac040a67460daf2351cd132c63fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:57.495579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-95e06508-983a-4d1e-9d00-1a17119bee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:57.523604 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2308/4619] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:56:57.527454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d28f5-211d-4a6d-8b56-6ab2cd187189 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:57.541898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d28f5-211d-4a6d-8b56-6ab2cd187189 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:57.569603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859446a-104b-4f89-b386-ff64936ff9df tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:57.569603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859446a-104b-4f89-b386-ff64936ff9df tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:57.571821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859446a-104b-4f89-b386-ff64936ff9df tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:57.572350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859446a-104b-4f89-b386-ff64936ff9df tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:57.573222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859446a-104b-4f89-b386-ff64936ff9df tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:create_trust()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:57.584258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859446a-104b-4f89-b386-ff64936ff9df tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:57.795335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2312/4620] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:56:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:56:57.797474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06508-983a-4d1e-9d00-1a17119bee7f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:57.815322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06508-983a-4d1e-9d00-1a17119bee7f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:57.828198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:57.830153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:57.830984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:57.832222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:57.840929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:57.841468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:57.841959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:57.905580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:get_trust(trust_id=7c66019d5c3047398135ae0c842a0b43)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:57.907094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:57.907971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] MFA Rules not processed for user `d2cb918769c44026b2b4358f3fcd7cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:56:57.909410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:57.933299 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2309/4621] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:56:57 2022] GET /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43 => generated 859 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:57.938854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:57.969615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b095a-d1d9-4656-a5cb-8573fb131d94 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:57.988179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:57.992342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:57.993394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:57.993728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.020511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7c66019d5c3047398135ae0c842a0b43)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.023371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.057112 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2310/4622] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:56:57 2022] GET /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles => generated 371 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:56:58.061172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.097308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c84c2-a194-4829-8116-5e0cc09abb1c tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.119086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.120951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.121419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.121905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/3f0ff6cf0f86423c98b5393912836dc6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.142094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2313/4623] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:56:58.144348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7c66019d5c3047398135ae0c842a0b43, role_id=3f0ff6cf0f86423c98b5393912836dc6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.147336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.164177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.166493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:58.195293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2311/4624] 10.222.0.98 () {58 vars in 1367 bytes} [Thu Jul 14 14:56:58 2022] GET /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/3f0ff6cf0f86423c98b5393912836dc6 => generated 244 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:56:58.200565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.252441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17f28-1bf8-4757-9ac6-24a874f6f2cc tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.284145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.290797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.290797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.291206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/3f0ff6cf0f86423c98b5393912836dc6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.305150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:58.315340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7c66019d5c3047398135ae0c842a0b43, role_id=3f0ff6cf0f86423c98b5393912836dc6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.318055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.356818 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2312/4625] 10.222.0.98 () {58 vars in 1368 bytes} [Thu Jul 14 14:56:58 2022] HEAD /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/3f0ff6cf0f86423c98b5393912836dc6 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 14 14:56:58.359043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.400805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391e4a-4d9e-4147-8802-55e7156fffb6 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.421205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.425419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.426436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.426617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/849e14513f934de798c28b8e1ee9a346` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.456431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7c66019d5c3047398135ae0c842a0b43, role_id=849e14513f934de798c28b8e1ee9a346)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.468717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.504158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b79f29-2c40-4a28-ba8e-aaf170d3d06e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Could not find role: 849e14513f934de798c28b8e1ee9a346.: keystone.exception.RoleNotFound: Could not find role: 849e14513f934de798c28b8e1ee9a346. Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 14 14:56:58.518646 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:56:58.529352 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 849e14513f934de798c28b8e1ee9a346. Jul 14 14:56:58.529352 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:58.529352 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2313/4626] 10.222.0.98 () {58 vars in 1367 bytes} [Thu Jul 14 14:56:58 2022] GET /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/849e14513f934de798c28b8e1ee9a346 => generated 110 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 14 14:56:58.530265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.531694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.532872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.533367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.533855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.542320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:58.548649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bce8-b44d-48a6-8639-a97cc88d76f3 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.558364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.559752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.560322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.560899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/849e14513f934de798c28b8e1ee9a346` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.566147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.571920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.611216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7c66019d5c3047398135ae0c842a0b43, role_id=849e14513f934de798c28b8e1ee9a346)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.615907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.618058 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2314/4627] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:56:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Could not find role: 849e14513f934de798c28b8e1ee9a346.: keystone.exception.RoleNotFound: Could not find role: 849e14513f934de798c28b8e1ee9a346. Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 14 14:56:58.687429 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:56:58.688623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 849e14513f934de798c28b8e1ee9a346. Jul 14 14:56:58.688623 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:56:58.693721 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2314/4628] 10.222.0.98 () {58 vars in 1368 bytes} [Thu Jul 14 14:56:58 2022] HEAD /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43/roles/849e14513f934de798c28b8e1ee9a346 => generated 0 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 14 14:56:58.700921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.741558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188f72b-ab37-4053-b68e-f8455cc0573d service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.761679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.763105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.763626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.764121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.795155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorizing `identity:delete_trust(trust_id=7c66019d5c3047398135ae0c842a0b43)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.798620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.824564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.826650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:58.864306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7c66019d5c3047398135ae0c842a0b43', 'request_id': 'req-fb8f0746-347a-4c0c-9460-0fdfcc087506'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:58.867937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7c66019d5c3047398135ae0c842a0b43', 'request_id': 'req-fb8f0746-347a-4c0c-9460-0fdfcc087506'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:58.886729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cdd95-6413-42db-92f5-0b03d455d1d9 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.888799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7c66019d5c3047398135ae0c842a0b43', 'request_id': 'req-fb8f0746-347a-4c0c-9460-0fdfcc087506'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:58.914666 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2315/4629] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 14:56:58 2022] DELETE /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:58.921086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:58.930741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:58.968758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.973164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.973813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.974177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0746-347a-4c0c-9460-0fdfcc087506 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:58.976364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] PATH_INFO: `/v3/users/e6ddbab17e1b4c47afcd0244006f2c5b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:58.980275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ddbab17e1b4c47afcd0244006f2c5b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:58.990057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:58.990526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a108ac040a67460daf2351cd132c63fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78fd39b27a684ad0b54440a6d90fc5bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1767515506', 'tempest-DelegatedRole-1254395962'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:58.992547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:58.993249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:58.993730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] PATH_INFO: `/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Could not find trust: 7c66019d5c3047398135ae0c842a0b43.: keystone.exception.TrustNotFound: Could not find trust: 7c66019d5c3047398135ae0c842a0b43. Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 14 14:56:59.059221 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7c66019d5c3047398135ae0c842a0b43. Jul 14 14:56:59.061736 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:56:59.080279 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2316/4630] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:56:58 2022] GET /identity/v3/OS-TRUST/trusts/7c66019d5c3047398135ae0c842a0b43 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:56:59.083310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:59.089182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:59.123639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ddbab17e1b4c47afcd0244006f2c5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:59.143523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ddbab17e1b4c47afcd0244006f2c5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:59.144426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ddbab17e1b4c47afcd0244006f2c5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:59.156638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ddbab17e1b4c47afcd0244006f2c5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:59.158460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ddbab17e1b4c47afcd0244006f2c5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:59.169474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dc743-8e69-4f95-adf1-8f0999972194 tempest-TrustsV3TestJSON-516201741 tempest-user-1228967140] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:59.193773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:59.196208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:59.196535 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2315/4631] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:58 2022] DELETE /identity/v3/users/e6ddbab17e1b4c47afcd0244006f2c5b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:59.197211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:59.202813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/849e14513f934de798c28b8e1ee9a346` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:56:59.209782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=849e14513f934de798c28b8e1ee9a346)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:56:59.213631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:56:59.380459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 849e14513f934de798c28b8e1ee9a346 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:56:59.380973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:59.383714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2a9c352-fc92-4dca-b9ef-65b6098ef994 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:56:59.391380 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2317/4632] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:59 2022] DELETE /identity/v3/roles/849e14513f934de798c28b8e1ee9a346 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:56:59.392828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:56:59.395294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:56:59.650728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9ebb-f0c9-4824-b9aa-fdc647e2a73b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:56:59.994717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:56:59.996773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:56:59.999044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:56:59.999609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/3f0ff6cf0f86423c98b5393912836dc6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:00.016862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3f0ff6cf0f86423c98b5393912836dc6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:00.030207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:00.070518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:00.104379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:00.105347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:00.105347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:00.217068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:00.225309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:00.265686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 3f0ff6cf0f86423c98b5393912836dc6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:00.265686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:00.266040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:00.270835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2316/4633] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:56:59 2022] DELETE /identity/v3/roles/3f0ff6cf0f86423c98b5393912836dc6 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:00.279419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:00.290953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:00.573829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325a94-0ebe-4cd3-ba89-593e06268e5a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:00.585521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:00.589158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:00.591108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:00.591750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users/a108ac040a67460daf2351cd132c63fc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:00.595109 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2318/4634] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:00.602179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a108ac040a67460daf2351cd132c63fc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:00.607846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:00.616090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:00.674046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:00.830070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:00.832480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a108ac040a67460daf2351cd132c63fc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:00.884770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a108ac040a67460daf2351cd132c63fc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:00.885741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a108ac040a67460daf2351cd132c63fc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:00.907356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a108ac040a67460daf2351cd132c63fc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:00.908847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a108ac040a67460daf2351cd132c63fc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:00.946575 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2317/4635] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:00 2022] DELETE /identity/v3/users/a108ac040a67460daf2351cd132c63fc => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:00.951365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:00.954154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:01.055035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc21fe-d4ff-4682-9a57-81ab26d3fd1e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:01.104238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:01.148384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68142c-e9c4-4390-9b52-0331e59e3cfa tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:01.169343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:01.170261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:01.170574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:01.170838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] PATH_INFO: `/v3/projects/566b2b65030345808ad3011db90e8425` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:01.174754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566b2b65030345808ad3011db90e8425)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:01.180096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:01.316264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566b2b65030345808ad3011db90e8425', 'request_id': 'req-5f0011f3-b15f-469c-9257-09b71a300097'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:01.338284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566b2b65030345808ad3011db90e8425', 'request_id': 'req-5f0011f3-b15f-469c-9257-09b71a300097'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:01.342078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3108cd2-9091-431e-999d-7ee80b90f153 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:01.345474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108cd2-9091-431e-999d-7ee80b90f153 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:01.346528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108cd2-9091-431e-999d-7ee80b90f153 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:01.349254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108cd2-9091-431e-999d-7ee80b90f153 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:01.361006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3108cd2-9091-431e-999d-7ee80b90f153 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:01.375804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566b2b65030345808ad3011db90e8425', 'request_id': 'req-5f0011f3-b15f-469c-9257-09b71a300097'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:01.447309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] The token cache is being invalidate because project 566b2b65030345808ad3011db90e8425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:01.451535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:01.455127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:01.472054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2318/4636] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:00 2022] DELETE /identity/v3/projects/566b2b65030345808ad3011db90e8425 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:01.480445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:01.494866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:01.755347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3108cd2-9091-431e-999d-7ee80b90f153 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:01.755347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3108cd2-9091-431e-999d-7ee80b90f153 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:01.774048 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2319/4637] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:57:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:01.779679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78e90-6922-4bef-b1f3-017d191a24eb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:01.780492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78e90-6922-4bef-b1f3-017d191a24eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:01.781004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78e90-6922-4bef-b1f3-017d191a24eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:01.849864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bea78e90-6922-4bef-b1f3-017d191a24eb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:01.854817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bea78e90-6922-4bef-b1f3-017d191a24eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:01.939983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0011f3-b15f-469c-9257-09b71a300097 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:01.955489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:01.957919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:01.958839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:01.959963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/78fd39b27a684ad0b54440a6d90fc5bf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:01.964592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78fd39b27a684ad0b54440a6d90fc5bf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:01.980967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:02.117264 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2320/4638] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:02.122467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4f76-eb3c-40d9-8ae0-31ec7b2f312a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:02.127858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4f76-eb3c-40d9-8ae0-31ec7b2f312a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:02.128832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4f76-eb3c-40d9-8ae0-31ec7b2f312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:02.194567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-588d4f76-eb3c-40d9-8ae0-31ec7b2f312a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:02.197307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-588d4f76-eb3c-40d9-8ae0-31ec7b2f312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:02.239383 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2321/4639] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:02.251531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d4f76-eb3c-40d9-8ae0-31ec7b2f312a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:02.272227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:02.310088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d4f76-eb3c-40d9-8ae0-31ec7b2f312a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:02.391783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fd39b27a684ad0b54440a6d90fc5bf', 'request_id': 'req-42d12812-a1af-4a70-a391-c29911703236'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:02.423512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fd39b27a684ad0b54440a6d90fc5bf', 'request_id': 'req-42d12812-a1af-4a70-a391-c29911703236'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:02.449037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fd39b27a684ad0b54440a6d90fc5bf', 'request_id': 'req-42d12812-a1af-4a70-a391-c29911703236'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:02.507731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] The token cache is being invalidate because project 78fd39b27a684ad0b54440a6d90fc5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:02.508238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:02.517848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:02.533018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2319/4640] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:01 2022] DELETE /identity/v3/projects/78fd39b27a684ad0b54440a6d90fc5bf => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:02.544402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:02.546890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:02.589143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:02.620787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:02.622418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:02.623323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:02.623996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:02.626078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:57:02.629758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:02.633596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:02.671239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2322/4641] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:02.677884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:02.685043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:02.816494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bc2c8-e7fe-4d73-9d3d-70578ef61bf3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:02.848715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:02.855668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:02.859634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:02.860596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:02.867542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:02.874600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:02.959538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d12812-a1af-4a70-a391-c29911703236 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:02.976338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:02.979875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:02.980372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:02.980885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:02.986849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:02.992878 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2323/4642] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:57:02 2022] POST /identity/v3/projects => generated 373 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:03.000023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.002086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:03.112987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2320/4643] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 14:57:02 2022] POST /identity/v3/projects => generated 329 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:57:03.118760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.358156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217aaf0-05a7-4e79-900c-22fdfebdc61c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:03.418354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5700b-427b-4e4e-b278-2653efed8376 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:03.451771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:03.452989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:03.453495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:03.453992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:03.455364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:03.458864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:03.583559 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2321/4644] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:03 2022] POST /identity/v3/users => generated 416 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:03.585296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.633645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c218654-ef22-42d4-964b-200544bde0e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:03.655795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:03.657028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:03.657546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:03.658053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:03.659585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:03.662821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:03.688981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:03.691096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:03.696890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:03.697448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:03.711207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:03.711207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:03.729627 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2322/4645] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:57:03 2022] POST /identity/v3/roles => generated 243 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:03.736765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.773776 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2324/4646] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:02 2022] POST /identity/v3/users => generated 287 bytes in 774 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:03.778783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.794884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e50f-5df2-4fd9-a535-48631886ab74 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:03.807541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160276bd-5fb2-4c6c-92ea-0168adcdc14c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:03.826721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:03.828556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:03.829585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:03.830001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:03.830453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:03.831705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:03.831940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:03.832098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:03.832397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:03.833248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:03.835336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:03.845225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:03.859047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:03.878661 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2325/4647] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:03 2022] GET /identity/v3/roles => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:57:03.888853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.920389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8f4b-49e8-4b48-8436-8f1e773c0d4b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:03.923637 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2323/4648] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:57:03 2022] POST /identity/v3/roles => generated 247 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:03.928677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.941746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:03.942457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:03.942753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:03.943016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:03.944354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:03.946806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:03.983904 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2326/4649] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:03 2022] GET /identity/v3/roles => generated 1892 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:03.991003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:03.994148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657202a-ff91-48e3-be97-9b14eec81a1b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:04.019077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:04.025092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c781c-6ce5-4e5a-9e40-de04f5427a9b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:04.026241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:04.026688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:04.027147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/ea6cbdca576c4af5b52e3c0228751419/users/9275428bb09440ed8fa062a2b1720162/roles/98e05808e36544bb991ea666cf7dea0b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:04.060638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a793f-fd38-4872-8e0a-9b08bee2bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:04.064750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a793f-fd38-4872-8e0a-9b08bee2bec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:04.065265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a793f-fd38-4872-8e0a-9b08bee2bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:04.065766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a793f-fd38-4872-8e0a-9b08bee2bec2 admin admin] PATH_INFO: `/v3/projects/5eb5073406d6445bbaaf9ce03f79dab3/users/9fae0a09c9c74d6f95b07606f5ae828b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:04.134462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ea6cbdca576c4af5b52e3c0228751419, user_id=9275428bb09440ed8fa062a2b1720162, role_id=98e05808e36544bb991ea666cf7dea0b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:04.151898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:04.172190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a793f-fd38-4872-8e0a-9b08bee2bec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb5073406d6445bbaaf9ce03f79dab3, user_id=9fae0a09c9c74d6f95b07606f5ae828b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:04.194708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a793f-fd38-4872-8e0a-9b08bee2bec2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:04.226728 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2324/4650] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:03 2022] PUT /identity/v3/projects/ea6cbdca576c4af5b52e3c0228751419/users/9275428bb09440ed8fa062a2b1720162/roles/98e05808e36544bb991ea666cf7dea0b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:04.243117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:04.269257 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2327/4651] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:03 2022] PUT /identity/v3/projects/5eb5073406d6445bbaaf9ce03f79dab3/users/9fae0a09c9c74d6f95b07606f5ae828b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:57:04.280437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:04.280651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:04.281135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:04.383888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:04.395879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:04.452580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:04.551529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e24b-e6c6-41cb-83db-82824223c336 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:04.660059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2328/4652] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:04.758621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:04.759914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:04.760411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:04.760875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/ea6cbdca576c4af5b52e3c0228751419/users/9275428bb09440ed8fa062a2b1720162/roles/0ecd02d97242448396974f2f029a91a1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:04.772762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ea6cbdca576c4af5b52e3c0228751419, user_id=9275428bb09440ed8fa062a2b1720162, role_id=0ecd02d97242448396974f2f029a91a1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:04.783326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:04.830813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:04.832988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:04.847229 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2325/4653] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:04 2022] PUT /identity/v3/projects/ea6cbdca576c4af5b52e3c0228751419/users/9275428bb09440ed8fa062a2b1720162/roles/0ecd02d97242448396974f2f029a91a1 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:57:04.861998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:05.075489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1b7b-e72b-4e8a-a129-8b4ee607c852 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:05.174753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7fc0-ac18-48f9-ab77-d77bd435f6ab tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:05.207519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cded3-d3fb-4dde-a08b-cfc64c546e9f tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:05.209119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cded3-d3fb-4dde-a08b-cfc64c546e9f tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:05.210411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cded3-d3fb-4dde-a08b-cfc64c546e9f tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:05.211209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cded3-d3fb-4dde-a08b-cfc64c546e9f tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:05.214466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cded3-d3fb-4dde-a08b-cfc64c546e9f tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:05.218915 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-ba6cded3-d3fb-4dde-a08b-cfc64c546e9f tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:57:05.218915 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 14:57:05.218915 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 14:57:05.222268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e40aa-3505-4b01-9192-81ace2e31d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:05.222967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e40aa-3505-4b01-9192-81ace2e31d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:05.223259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e40aa-3505-4b01-9192-81ace2e31d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:05.223598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e40aa-3505-4b01-9192-81ace2e31d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:05.226498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cded3-d3fb-4dde-a08b-cfc64c546e9f tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:05.351359 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2326/4654] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:04 2022] GET /identity/v3/users => generated 8053 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:05.361095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e270779-86df-4640-8305-24db76e5181e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:05.361665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e270779-86df-4640-8305-24db76e5181e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:05.362147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e270779-86df-4640-8305-24db76e5181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:05.383802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:05.453864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9e270779-86df-4640-8305-24db76e5181e None None] MFA Rules not processed for user `9275428bb09440ed8fa062a2b1720162`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:05.455546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9e270779-86df-4640-8305-24db76e5181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:05.467970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e40aa-3505-4b01-9192-81ace2e31d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:05.469677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e40aa-3505-4b01-9192-81ace2e31d8b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:05.497288 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2329/4655] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:57:05.672439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:05.711355 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2327/4656] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:05.714668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba98b-d482-4f6e-a2cd-01f1c6fe4af2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:05.716717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba98b-d482-4f6e-a2cd-01f1c6fe4af2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:05.719218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba98b-d482-4f6e-a2cd-01f1c6fe4af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:05.815582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b78ba98b-d482-4f6e-a2cd-01f1c6fe4af2 None None] MFA Rules not processed for user `9275428bb09440ed8fa062a2b1720162`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:05.824410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b78ba98b-d482-4f6e-a2cd-01f1c6fe4af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:05.870138 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2330/4657] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:05.871424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e270779-86df-4640-8305-24db76e5181e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:05.882412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e270779-86df-4640-8305-24db76e5181e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:05.911484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9275428bb09440ed8fa062a2b1720162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6cbdca576c4af5b52e3c0228751419', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-365303795', 'tempest-NotDelegatedRole-1456928949'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:05.912256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:05.912582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:05.912864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:05.913651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] RBAC: Authorizing `identity:create_trust()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:05.914899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 14 14:57:06.217297 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 14 14:57:06.218928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 14 14:57:06.220247 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 14 14:57:06.220247 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 14 14:57:06.220247 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 14 14:57:06.220247 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 14 14:57:06.220247 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 14 14:57:06.220247 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:57:06.227182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ba98b-d482-4f6e-a2cd-01f1c6fe4af2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:06.227477 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2328/4658] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:57:05 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 356 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 14:57:06.306239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ba98b-d482-4f6e-a2cd-01f1c6fe4af2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:06.345005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:06.346416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:06.346926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:06.347466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/0ecd02d97242448396974f2f029a91a1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:06.355071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0ecd02d97242448396974f2f029a91a1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:06.368495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:06.618303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 0ecd02d97242448396974f2f029a91a1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:06.618735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:06.622159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:06.638452 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2331/4659] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:06 2022] DELETE /identity/v3/roles/0ecd02d97242448396974f2f029a91a1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:06.642666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:06.644939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:06.690471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6f148-feca-4644-90bc-6fb36feb47e2 tempest-TrustsV3TestJSON-1467405574 tempest-user-1860478479] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:07.043095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:07.052645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:07.053764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:07.056792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/98e05808e36544bb991ea666cf7dea0b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:07.068444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=98e05808e36544bb991ea666cf7dea0b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:07.081128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:07.334128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 98e05808e36544bb991ea666cf7dea0b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:07.340716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:07.351615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:07.368334 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2329/4660] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:06 2022] DELETE /identity/v3/roles/98e05808e36544bb991ea666cf7dea0b => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:07.373277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:07.438648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24205-a1a3-4d64-9167-4f608e3e8a42 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:07.673542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:07.674654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:07.675061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:07.675508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users/9275428bb09440ed8fa062a2b1720162` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:07.679308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9275428bb09440ed8fa062a2b1720162)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:07.685450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:07.804042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9275428bb09440ed8fa062a2b1720162'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:07.850994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9275428bb09440ed8fa062a2b1720162'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:07.869038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9275428bb09440ed8fa062a2b1720162'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:07.869799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9275428bb09440ed8fa062a2b1720162'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:07.897336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9275428bb09440ed8fa062a2b1720162'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:07.915231 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2332/4661] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:07 2022] DELETE /identity/v3/users/9275428bb09440ed8fa062a2b1720162 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:07.920102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:07.922583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:08.053488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf98da-4ef3-4678-8a67-fa380ed0e7fc tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:08.549725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:08.550942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:08.551156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:08.551363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/ea6cbdca576c4af5b52e3c0228751419` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:08.560353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ea6cbdca576c4af5b52e3c0228751419)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:08.562554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:08.564449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:08.694926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6cbdca576c4af5b52e3c0228751419', 'request_id': 'req-90d55ebb-fdca-4dac-9996-96658b2d0aa9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:08.723548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6cbdca576c4af5b52e3c0228751419', 'request_id': 'req-90d55ebb-fdca-4dac-9996-96658b2d0aa9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:08.747416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6cbdca576c4af5b52e3c0228751419', 'request_id': 'req-90d55ebb-fdca-4dac-9996-96658b2d0aa9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:08.789267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] The token cache is being invalidate because project ea6cbdca576c4af5b52e3c0228751419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:08.789267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:08.789267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:08.808188 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2330/4662] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:07 2022] DELETE /identity/v3/projects/ea6cbdca576c4af5b52e3c0228751419 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:08.816826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:08.819686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:08.860941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:08.890271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e574d2-68c6-4693-bfdf-be9514f1db5e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:09.213661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:09.214387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:09.214685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:09.214975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:09.215740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:09.220806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:09.375648 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2333/4663] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 14:57:08 2022] POST /identity/v3/projects => generated 329 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:09.388995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:09.402646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:09.421808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d55ebb-fdca-4dac-9996-96658b2d0aa9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:09.700279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:09.701143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:09.701293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:09.701572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:09.702310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:09.704367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:09.768486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:09.769019 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2331/4664] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:09 2022] POST /identity/v3/users => generated 413 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:09.786125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053afd8-b563-42aa-8c78-0390401e7aeb tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:09.829016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:09.830558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:09.831032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:09.831543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:09.832543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:09.835510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:09.866785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2334/4665] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:57:09 2022] POST /identity/v3/roles => generated 244 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:09.875903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:09.895668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c65b5d-22a6-45f9-9446-c0acc44c6dc9 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:09.912869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:09.913927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:09.914696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:09.923122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:09.924499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:09.927655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:09.987239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:09.988395 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2332/4666] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:57:09 2022] POST /identity/v3/roles => generated 247 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:10.002341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e528-c475-426d-ade3-e746305e5bb0 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:10.019016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:10.020065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:10.020391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:10.020697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/e17373e1019b4a989a37a0370318a585/users/e95041186d754163b7d358c57c929976/roles/ee3d8c55407441cdbe5fe3d86cde077a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:10.063860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e17373e1019b4a989a37a0370318a585, user_id=e95041186d754163b7d358c57c929976, role_id=ee3d8c55407441cdbe5fe3d86cde077a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:10.066734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:10.117257 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2335/4667] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:09 2022] PUT /identity/v3/projects/e17373e1019b4a989a37a0370318a585/users/e95041186d754163b7d358c57c929976/roles/ee3d8c55407441cdbe5fe3d86cde077a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:10.118385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:10.143461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaca922-934a-4864-ac21-00f215a2637b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:10.358793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0b337-a15a-4f8d-852e-9480ec2270d8 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:10.359777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b337-a15a-4f8d-852e-9480ec2270d8 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:10.360066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b337-a15a-4f8d-852e-9480ec2270d8 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:10.360354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b337-a15a-4f8d-852e-9480ec2270d8 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/e17373e1019b4a989a37a0370318a585/users/e95041186d754163b7d358c57c929976/roles/2a4d273776174543bac8b3f09d2aeca2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:10.369599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0b337-a15a-4f8d-852e-9480ec2270d8 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e17373e1019b4a989a37a0370318a585, user_id=e95041186d754163b7d358c57c929976, role_id=2a4d273776174543bac8b3f09d2aeca2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:10.372486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0b337-a15a-4f8d-852e-9480ec2270d8 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:10.401607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:10.408299 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2333/4668] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:10 2022] PUT /identity/v3/projects/e17373e1019b4a989a37a0370318a585/users/e95041186d754163b7d358c57c929976/roles/2a4d273776174543bac8b3f09d2aeca2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:10.414247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:10.436772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb138-7d61-4f15-afa7-4e7ab69d2b72 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:10.660018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ce04-c50a-429d-82f7-9245428bc765 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:10.660754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ce04-c50a-429d-82f7-9245428bc765 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:10.661103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ce04-c50a-429d-82f7-9245428bc765 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:10.661687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ce04-c50a-429d-82f7-9245428bc765 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:10.663175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ce04-c50a-429d-82f7-9245428bc765 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:10.665144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ce04-c50a-429d-82f7-9245428bc765 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:10.720850 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2336/4669] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:10 2022] GET /identity/v3/users => generated 8050 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:10.730835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1072-5dcd-422d-ab48-bd08cf616362 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:10.731534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1072-5dcd-422d-ab48-bd08cf616362 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:10.731534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1072-5dcd-422d-ab48-bd08cf616362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:10.985761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-da3e1072-5dcd-422d-ab48-bd08cf616362 None None] MFA Rules not processed for user `e95041186d754163b7d358c57c929976`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:10.989312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da3e1072-5dcd-422d-ab48-bd08cf616362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:11.395563 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2334/4670] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 667 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:11.406658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d178b-58e4-4d97-a33c-077955829a41 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:11.407833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d178b-58e4-4d97-a33c-077955829a41 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:11.408311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d178b-58e4-4d97-a33c-077955829a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:11.472595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a4d178b-58e4-4d97-a33c-077955829a41 None None] MFA Rules not processed for user `e95041186d754163b7d358c57c929976`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:11.477318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a4d178b-58e4-4d97-a33c-077955829a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:11.509935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e1072-5dcd-422d-ab48-bd08cf616362 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:11.517904 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2337/4671] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:11.571414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e1072-5dcd-422d-ab48-bd08cf616362 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:11.588724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:11.589620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:11.589918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:11.590393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:11.591536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:create_trust()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:11.592790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:12.045952 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2335/4672] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:57:11 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:12.047801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d178b-58e4-4d97-a33c-077955829a41 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:12.058399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d178b-58e4-4d97-a33c-077955829a41 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:12.074350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:12.076325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:12.079708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:12.080371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:12.106884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:get_trust(trust_id=58ec59745e564a4cb14cc5a8341b25b9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:12.109573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:12.129537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2338/4673] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:57:12 2022] GET /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9 => generated 834 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:57:12.133556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:12.150497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2176a-5282-437d-a4b5-0238c8b54750 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:12.193217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:12.194724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:12.195015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:12.195319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:12.232310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=58ec59745e564a4cb14cc5a8341b25b9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:12.248829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:12.308786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2336/4674] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:57:12 2022] GET /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles => generated 371 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:12.312501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:12.333739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c095-8214-4fe0-a08f-98d0d6626c13 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:12.365008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:12.366141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:12.366495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:12.367006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/ee3d8c55407441cdbe5fe3d86cde077a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:12.396266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ec59745e564a4cb14cc5a8341b25b9, role_id=ee3d8c55407441cdbe5fe3d86cde077a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:12.398677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:12.443865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:12.450733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2339/4675] 10.222.0.98 () {58 vars in 1367 bytes} [Thu Jul 14 14:57:12 2022] GET /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/ee3d8c55407441cdbe5fe3d86cde077a => generated 244 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:12.461379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980d866-1f83-4ef4-be65-715295e705f1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:12.489261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb077c-52ee-4658-8afb-ac0725dce8fd tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:12.490136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb077c-52ee-4658-8afb-ac0725dce8fd tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:12.490605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb077c-52ee-4658-8afb-ac0725dce8fd tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:12.491022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb077c-52ee-4658-8afb-ac0725dce8fd tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/ee3d8c55407441cdbe5fe3d86cde077a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:12.577613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb077c-52ee-4658-8afb-ac0725dce8fd tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ec59745e564a4cb14cc5a8341b25b9, role_id=ee3d8c55407441cdbe5fe3d86cde077a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:12.595396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb077c-52ee-4658-8afb-ac0725dce8fd tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:12.657439 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2337/4676] 10.222.0.98 () {58 vars in 1368 bytes} [Thu Jul 14 14:57:12 2022] HEAD /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/ee3d8c55407441cdbe5fe3d86cde077a => generated 0 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 14 14:57:12.661930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:12.669892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:12.701313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d70f4-d4f7-4bc0-8d33-4c728f3a0db1 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:12.752992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:12.754658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:12.755113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:12.755683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/2a4d273776174543bac8b3f09d2aeca2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:12.864794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ec59745e564a4cb14cc5a8341b25b9, role_id=2a4d273776174543bac8b3f09d2aeca2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:12.881403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:13.037924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaf1f5-1b70-494a-99b0-a8aec0ecd005 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:13.038928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaf1f5-1b70-494a-99b0-a8aec0ecd005 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:13.039557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaf1f5-1b70-494a-99b0-a8aec0ecd005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Could not find role: 2a4d273776174543bac8b3f09d2aeca2.: keystone.exception.RoleNotFound: Could not find role: 2a4d273776174543bac8b3f09d2aeca2. Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 14 14:57:13.059351 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:57:13.060643 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2a4d273776174543bac8b3f09d2aeca2. Jul 14 14:57:13.060643 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:57:13.061381 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2340/4677] 10.222.0.98 () {58 vars in 1367 bytes} [Thu Jul 14 14:57:12 2022] GET /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/2a4d273776174543bac8b3f09d2aeca2 => generated 110 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:57:13.071417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:13.121110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a8aaf1f5-1b70-494a-99b0-a8aec0ecd005 None None] MFA Rules not processed for user `d2cb918769c44026b2b4358f3fcd7cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:13.131552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a8aaf1f5-1b70-494a-99b0-a8aec0ecd005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:13.161055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459a51d-362d-490b-9e6e-096d86adee18 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:13.212271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:13.217528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:13.218755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:13.219768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/2a4d273776174543bac8b3f09d2aeca2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:13.305505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ec59745e564a4cb14cc5a8341b25b9, role_id=2a4d273776174543bac8b3f09d2aeca2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:13.308479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:13.322277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:13.429946 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2338/4678] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Could not find role: 2a4d273776174543bac8b3f09d2aeca2.: keystone.exception.RoleNotFound: Could not find role: 2a4d273776174543bac8b3f09d2aeca2. Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 14 14:57:13.474222 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:57:13.475951 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2a4d273776174543bac8b3f09d2aeca2. Jul 14 14:57:13.475951 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:57:13.482721 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2341/4679] 10.222.0.98 () {58 vars in 1368 bytes} [Thu Jul 14 14:57:13 2022] HEAD /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9/roles/2a4d273776174543bac8b3f09d2aeca2 => generated 0 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 14 14:57:13.484685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaf1f5-1b70-494a-99b0-a8aec0ecd005 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:13.512730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaf1f5-1b70-494a-99b0-a8aec0ecd005 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:13.539906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:13.548916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:13.549637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:13.550178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:13.572319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorizing `identity:delete_trust(trust_id=58ec59745e564a4cb14cc5a8341b25b9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:13.582310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:13.660602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '58ec59745e564a4cb14cc5a8341b25b9', 'request_id': 'req-a7fe02a6-53c5-46a1-9683-934798b1d707'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:13.669304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '58ec59745e564a4cb14cc5a8341b25b9', 'request_id': 'req-a7fe02a6-53c5-46a1-9683-934798b1d707'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:13.673431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '58ec59745e564a4cb14cc5a8341b25b9', 'request_id': 'req-a7fe02a6-53c5-46a1-9683-934798b1d707'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:13.724330 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2339/4680] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 14:57:13 2022] DELETE /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:57:13.726762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:13.730678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:13.815204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088625a4-9198-4ab1-879d-1c623a53b5fe tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:13.844462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e95041186d754163b7d358c57c929976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e17373e1019b4a989a37a0370318a585', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1970905981', 'tempest-DelegatedRole-2007648897'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:13.845961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:13.846475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:13.851794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] PATH_INFO: `/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Could not find trust: 58ec59745e564a4cb14cc5a8341b25b9.: keystone.exception.TrustNotFound: Could not find trust: 58ec59745e564a4cb14cc5a8341b25b9. Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 14 14:57:13.946349 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 58ec59745e564a4cb14cc5a8341b25b9. Jul 14 14:57:13.947805 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:57:13.949279 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2342/4681] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:57:13 2022] GET /identity/v3/OS-TRUST/trusts/58ec59745e564a4cb14cc5a8341b25b9 => generated 111 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:57:13.954056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:13.956514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:14.069485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe02a6-53c5-46a1-9683-934798b1d707 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:14.112455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:14.113392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:14.118404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:14.118788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/2a4d273776174543bac8b3f09d2aeca2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:14.121964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2a4d273776174543bac8b3f09d2aeca2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:14.123760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:14.293960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 2a4d273776174543bac8b3f09d2aeca2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:14.294298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:14.298881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:14.304111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2340/4682] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:13 2022] DELETE /identity/v3/roles/2a4d273776174543bac8b3f09d2aeca2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:14.310333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:14.312334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:14.357021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e80df-6793-4d05-b8b6-5ad8bb3f5641 tempest-TrustsV3TestJSON-1726325829 tempest-user-923693029] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:14.583923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:14.586937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:14.587490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:14.587944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/ee3d8c55407441cdbe5fe3d86cde077a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:14.592498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ee3d8c55407441cdbe5fe3d86cde077a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:14.598120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:14.699020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role ee3d8c55407441cdbe5fe3d86cde077a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:14.699855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:14.701682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:14.704685 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2343/4683] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:14 2022] DELETE /identity/v3/roles/ee3d8c55407441cdbe5fe3d86cde077a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:14.711009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:14.760826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8630f-63e4-4489-ab5f-0dc6f0a9495a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:15.105830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:15.106794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:15.107085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:15.113336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users/e95041186d754163b7d358c57c929976` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:15.115310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e95041186d754163b7d358c57c929976)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:15.118061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:15.367122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95041186d754163b7d358c57c929976'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:15.436212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=13 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:15.441053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95041186d754163b7d358c57c929976'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:15.448059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95041186d754163b7d358c57c929976'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:15.487018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95041186d754163b7d358c57c929976'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:15.504000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95041186d754163b7d358c57c929976'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:15.588469 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2341/4684] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:14 2022] DELETE /identity/v3/users/e95041186d754163b7d358c57c929976 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:15.593011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:15.596631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:15.691423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a660a7-f44a-4e7d-956f-67e943708d49 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:15.971472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:15.972734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:15.973160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:15.973559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/e17373e1019b4a989a37a0370318a585` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:15.978346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e17373e1019b4a989a37a0370318a585)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:15.980571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:16.121671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:16.187131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17373e1019b4a989a37a0370318a585', 'request_id': 'req-435408e8-d561-43db-b5ef-a5f3fff1e08b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:16.213709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17373e1019b4a989a37a0370318a585', 'request_id': 'req-435408e8-d561-43db-b5ef-a5f3fff1e08b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:16.236869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17373e1019b4a989a37a0370318a585', 'request_id': 'req-435408e8-d561-43db-b5ef-a5f3fff1e08b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:16.275448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] The token cache is being invalidate because project e17373e1019b4a989a37a0370318a585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:16.275860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:16.277344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:16.282150 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2344/4685] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:15 2022] DELETE /identity/v3/projects/e17373e1019b4a989a37a0370318a585 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:16.288646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:16.292360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:16.368544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bb92e-3842-4f69-aacd-15390784ddf6 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:16.685066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:16.688499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:16.688921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:16.691446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:16.692389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:16.698058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:16.802606 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2342/4686] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 14:57:16 2022] POST /identity/v3/projects => generated 329 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:16.807750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:16.814676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:16.897227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435408e8-d561-43db-b5ef-a5f3fff1e08b tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:17.520696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:17.522726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:17.523250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:17.526231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:17.532065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:17.549131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:17.628133 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2345/4687] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:16 2022] POST /identity/v3/users => generated 416 bytes in 819 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:17.631598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:17.670258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c143a2-619c-4de4-82a6-fb41ab6c2948 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:17.679855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:17.681582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:17.682487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:17.683370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:17.685240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:17.694659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:17.745255 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2343/4688] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:57:17 2022] POST /identity/v3/roles => generated 244 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:57:17.755503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:17.800726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831526c-4cb6-475e-98ca-f7331ebf0943 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:17.830877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:17.832347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:17.832886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:17.833492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:17.848559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:17.852006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:17.921438 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2346/4689] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 14:57:17 2022] POST /identity/v3/roles => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:17.925925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:17.956931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea5cd-2c80-4c5f-9daf-727b51c67f8d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:18.012642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:18.014924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:18.021131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:18.025821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/45bc28650275482ea9553e99c6c09b29/users/e2e5a97dfda744ae8c908cc3c66e6373/roles/42a85736e7ee46429a1e57f0914d1d28` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:18.087722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=45bc28650275482ea9553e99c6c09b29, user_id=e2e5a97dfda744ae8c908cc3c66e6373, role_id=42a85736e7ee46429a1e57f0914d1d28)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:18.105897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:18.151703 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2344/4690] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:17 2022] PUT /identity/v3/projects/45bc28650275482ea9553e99c6c09b29/users/e2e5a97dfda744ae8c908cc3c66e6373/roles/42a85736e7ee46429a1e57f0914d1d28 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:18.156060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:18.184058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52652e-71cd-43b1-8f53-da8bd979015a tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:18.398171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a590-f9c9-417a-b4cb-ec22cce3b1e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:18.399127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a590-f9c9-417a-b4cb-ec22cce3b1e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:18.399485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a590-f9c9-417a-b4cb-ec22cce3b1e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:18.399704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a590-f9c9-417a-b4cb-ec22cce3b1e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/45bc28650275482ea9553e99c6c09b29/users/e2e5a97dfda744ae8c908cc3c66e6373/roles/312125a48b6745a18dd4e45e982c3a4f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:18.413550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520a590-f9c9-417a-b4cb-ec22cce3b1e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=45bc28650275482ea9553e99c6c09b29, user_id=e2e5a97dfda744ae8c908cc3c66e6373, role_id=312125a48b6745a18dd4e45e982c3a4f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:18.416455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520a590-f9c9-417a-b4cb-ec22cce3b1e7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:18.496277 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2347/4691] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:18 2022] PUT /identity/v3/projects/45bc28650275482ea9553e99c6c09b29/users/e2e5a97dfda744ae8c908cc3c66e6373/roles/312125a48b6745a18dd4e45e982c3a4f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:18.503043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:18.530623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f705e0-6b24-4846-acbb-3a1d6aaf9eda tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:18.874051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0287d-3500-4752-92d8-4280312d3716 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:18.879809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0287d-3500-4752-92d8-4280312d3716 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:18.880692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0287d-3500-4752-92d8-4280312d3716 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:18.881383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0287d-3500-4752-92d8-4280312d3716 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:18.884737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0287d-3500-4752-92d8-4280312d3716 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:18.892448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0287d-3500-4752-92d8-4280312d3716 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:19.121558 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2345/4692] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:18 2022] GET /identity/v3/users => generated 8053 bytes in 619 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:57:19.127788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc414cf-ffcf-42e0-bc29-36050101df86 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:19.128567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc414cf-ffcf-42e0-bc29-36050101df86 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:19.129476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc414cf-ffcf-42e0-bc29-36050101df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:19.327708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0cc414cf-ffcf-42e0-bc29-36050101df86 None None] MFA Rules not processed for user `e2e5a97dfda744ae8c908cc3c66e6373`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:19.327708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0cc414cf-ffcf-42e0-bc29-36050101df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:19.378944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:19.716336 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2348/4693] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 584 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:19.718700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4958f-d47a-43a4-9fac-7fe27612a511 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:19.719594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4958f-d47a-43a4-9fac-7fe27612a511 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:19.720093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4958f-d47a-43a4-9fac-7fe27612a511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:19.779294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-42b4958f-d47a-43a4-9fac-7fe27612a511 None None] MFA Rules not processed for user `e2e5a97dfda744ae8c908cc3c66e6373`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:19.781255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42b4958f-d47a-43a4-9fac-7fe27612a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:19.833045 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2346/4694] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:57:19.839719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc414cf-ffcf-42e0-bc29-36050101df86 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:19.854149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc414cf-ffcf-42e0-bc29-36050101df86 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:19.888766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:19.900162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:19.901255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:19.904086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:19.915764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:create_trust()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:19.918190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:20.444338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2349/4695] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:57:19 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:20.445781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4958f-d47a-43a4-9fac-7fe27612a511 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:20.465918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4958f-d47a-43a4-9fac-7fe27612a511 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:20.481660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:20.482579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:20.482867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:20.483961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:20.532659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:get_trust(trust_id=07e63de711194173b3034509b9843fc1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:20.534384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:20.557148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:20.645182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:20.664357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccc93a-2aed-4e0a-8079-a346c97b92ff tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:20.682232 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2347/4696] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:57:20 2022] GET /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1 => generated 835 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:20.748738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:20.762287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:20.773406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:20.773406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:20.835042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=07e63de711194173b3034509b9843fc1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:20.858926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:20.924997 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2350/4697] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:57:20 2022] GET /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles => generated 371 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:20.942028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:21.006030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572883a-2630-43ef-8751-7eebc2d70d60 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:21.046588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:21.051148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:21.052436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:21.053621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/42a85736e7ee46429a1e57f0914d1d28` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:21.075909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07e63de711194173b3034509b9843fc1, role_id=42a85736e7ee46429a1e57f0914d1d28)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:21.077914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:21.122295 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2348/4698] 10.222.0.98 () {58 vars in 1367 bytes} [Thu Jul 14 14:57:20 2022] GET /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/42a85736e7ee46429a1e57f0914d1d28 => generated 244 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:21.127655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:21.190680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2451bc1-3e12-4a13-915a-4129662b38b3 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:21.224836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:21.228503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:21.237434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:21.259917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/42a85736e7ee46429a1e57f0914d1d28` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:21.300973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07e63de711194173b3034509b9843fc1, role_id=42a85736e7ee46429a1e57f0914d1d28)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:21.310491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:21.377121 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2351/4699] 10.222.0.98 () {58 vars in 1368 bytes} [Thu Jul 14 14:57:21 2022] HEAD /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/42a85736e7ee46429a1e57f0914d1d28 => generated 0 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 14 14:57:21.383426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:21.443023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556bf5-161e-4486-bbf0-e45e3dc8e656 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:21.460835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8b21f-249e-4b23-87a8-706ae00a1ecc tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:21.461994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8b21f-249e-4b23-87a8-706ae00a1ecc tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:21.461994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8b21f-249e-4b23-87a8-706ae00a1ecc tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:21.462365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8b21f-249e-4b23-87a8-706ae00a1ecc tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/312125a48b6745a18dd4e45e982c3a4f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:21.520550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8b21f-249e-4b23-87a8-706ae00a1ecc tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07e63de711194173b3034509b9843fc1, role_id=312125a48b6745a18dd4e45e982c3a4f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:21.539305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8b21f-249e-4b23-87a8-706ae00a1ecc tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6db8b21f-249e-4b23-87a8-706ae00a1ecc tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Could not find role: 312125a48b6745a18dd4e45e982c3a4f.: keystone.exception.RoleNotFound: Could not find role: 312125a48b6745a18dd4e45e982c3a4f. Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 14 14:57:21.604243 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:57:21.605387 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 312125a48b6745a18dd4e45e982c3a4f. Jul 14 14:57:21.605387 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 14:57:21.635999 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2349/4700] 10.222.0.98 () {58 vars in 1367 bytes} [Thu Jul 14 14:57:21 2022] GET /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/312125a48b6745a18dd4e45e982c3a4f => generated 110 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:57:21.638316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:21.673860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76665a-a913-4d37-a332-0e17685fff8d tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:21.711534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:21.713079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:21.715705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:21.716339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/312125a48b6745a18dd4e45e982c3a4f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:21.791539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62e640-a314-4a5d-84b8-537cd9ddb4ab None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:21.791840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62e640-a314-4a5d-84b8-537cd9ddb4ab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:21.792126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62e640-a314-4a5d-84b8-537cd9ddb4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:21.793353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07e63de711194173b3034509b9843fc1, role_id=312125a48b6745a18dd4e45e982c3a4f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:21.796294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Could not find role: 312125a48b6745a18dd4e45e982c3a4f.: keystone.exception.RoleNotFound: Could not find role: 312125a48b6745a18dd4e45e982c3a4f. Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 14 14:57:21.854684 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:57:21.856715 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 312125a48b6745a18dd4e45e982c3a4f. Jul 14 14:57:21.856715 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:57:21.860285 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2352/4701] 10.222.0.98 () {58 vars in 1368 bytes} [Thu Jul 14 14:57:21 2022] HEAD /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1/roles/312125a48b6745a18dd4e45e982c3a4f => generated 0 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 14 14:57:21.866530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:21.886060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9946e-c282-4bb3-b9f8-1cae62c47b6a tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:21.897615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:21.899907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:21.901037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:21.901623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:21.923047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4f62e640-a314-4a5d-84b8-537cd9ddb4ab None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:21.925217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f62e640-a314-4a5d-84b8-537cd9ddb4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:21.932933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorizing `identity:delete_trust(trust_id=07e63de711194173b3034509b9843fc1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:21.935002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:21.991744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '07e63de711194173b3034509b9843fc1', 'request_id': 'req-d928831d-e720-4060-83dd-614920ee5955'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:21.994023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '07e63de711194173b3034509b9843fc1', 'request_id': 'req-d928831d-e720-4060-83dd-614920ee5955'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:22.020119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '07e63de711194173b3034509b9843fc1', 'request_id': 'req-d928831d-e720-4060-83dd-614920ee5955'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:22.048888 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2353/4702] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 14:57:21 2022] DELETE /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:22.055414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:22.057494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:22.100369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:22.124178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928831d-e720-4060-83dd-614920ee5955 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:22.166816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e5a97dfda744ae8c908cc3c66e6373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45bc28650275482ea9553e99c6c09b29', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1332936412', 'tempest-DelegatedRole-1783460777'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:22.168375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:22.168893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:22.169406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] PATH_INFO: `/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Could not find trust: 07e63de711194173b3034509b9843fc1.: keystone.exception.TrustNotFound: Could not find trust: 07e63de711194173b3034509b9843fc1. Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 14 14:57:22.273514 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 07e63de711194173b3034509b9843fc1. Jul 14 14:57:22.275660 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 14:57:22.280335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2354/4703] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:57:22 2022] GET /identity/v3/OS-TRUST/trusts/07e63de711194173b3034509b9843fc1 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 14:57:22.291858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:22.297999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:22.374377 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2350/4704] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 584 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:22.389244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460739a5-bd2b-476e-b8f8-2fd21263a1d1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:22.389768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460739a5-bd2b-476e-b8f8-2fd21263a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:22.390397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460739a5-bd2b-476e-b8f8-2fd21263a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:22.408590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99eb68-0de9-4187-9278-2f06c828ce79 tempest-TrustsV3TestJSON-1421550543 tempest-user-1505858570] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:22.436874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:22.447239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:22.450849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:22.456699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/312125a48b6745a18dd4e45e982c3a4f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:22.474241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=312125a48b6745a18dd4e45e982c3a4f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:22.487326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:22.505304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-460739a5-bd2b-476e-b8f8-2fd21263a1d1 None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:22.515140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-460739a5-bd2b-476e-b8f8-2fd21263a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:22.557386 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2351/4705] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:22.619862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 312125a48b6745a18dd4e45e982c3a4f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:22.620160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:22.620852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:22.623994 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2355/4706] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:22 2022] DELETE /identity/v3/roles/312125a48b6745a18dd4e45e982c3a4f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:22.629615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460739a5-bd2b-476e-b8f8-2fd21263a1d1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:22.672588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460739a5-bd2b-476e-b8f8-2fd21263a1d1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:22.861600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:22.862538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:22.862834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:22.866266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/roles/42a85736e7ee46429a1e57f0914d1d28` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:22.875866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=42a85736e7ee46429a1e57f0914d1d28)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:22.886777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:22.963415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invalidating the token cache because role 42a85736e7ee46429a1e57f0914d1d28 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:22.963721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:22.968104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:22.976641 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2352/4707] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:22 2022] DELETE /identity/v3/roles/42a85736e7ee46429a1e57f0914d1d28 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:22.982066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:22.984467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:23.019594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae143-b0a9-448a-8eb7-41bed7d2db1d tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:23.031400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:23.033307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:23.091637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:23.263046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:23.264790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:23.265315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:23.266042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/users/e2e5a97dfda744ae8c908cc3c66e6373` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:23.270504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e2e5a97dfda744ae8c908cc3c66e6373)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:23.273079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:23.310653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2663e63-1267-47b9-aaab-087e65f904db tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:23.393800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:23.393800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:23.393800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:23.393800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:23.396072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:23.396264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e5a97dfda744ae8c908cc3c66e6373'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:23.435094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e5a97dfda744ae8c908cc3c66e6373'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:23.472542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e5a97dfda744ae8c908cc3c66e6373'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:23.475550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e5a97dfda744ae8c908cc3c66e6373'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:23.511132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e5a97dfda744ae8c908cc3c66e6373'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:23.544304 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2356/4708] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:22 2022] DELETE /identity/v3/users/e2e5a97dfda744ae8c908cc3c66e6373 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:23.545998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:23.559900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:23.677209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:23.684028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:23.727995 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2353/4709] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:57:23.760301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:23.895697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51885-d409-490f-a4c2-910ed80ba56e tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:23.902763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9a189872f74da18d4ae871e16c3776', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71bb02343a1043c19d7f20be2c3ac3e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:23.904682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:23.905087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:23.905494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] PATH_INFO: `/v3/projects/45bc28650275482ea9553e99c6c09b29` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:23.906911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45bc28650275482ea9553e99c6c09b29)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:23.909308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:24.016544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bc28650275482ea9553e99c6c09b29', 'request_id': 'req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:24.028418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bc28650275482ea9553e99c6c09b29', 'request_id': 'req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:24.042177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bc28650275482ea9553e99c6c09b29', 'request_id': 'req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:24.098543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] The token cache is being invalidate because project 45bc28650275482ea9553e99c6c09b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:24.098953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:24.101702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b2f9c7f4-8bd4-4967-95e2-0babc0534cc7 tempest-TrustsV3TestJSON-1848873656 tempest-TrustsV3TestJSON-1848873656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:24.115739 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2357/4710] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:23 2022] DELETE /identity/v3/projects/45bc28650275482ea9553e99c6c09b29 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:24.124322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:24.127132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:24.437613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853ee4-5615-4e1d-8550-1f7d4001ce60 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:24.739027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:24.764956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:24.768402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:24.773501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:24.774231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] PATH_INFO: `/v3/users/4c653000b9b24b80ae6e80077b955bbf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:24.781680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c653000b9b24b80ae6e80077b955bbf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:24.794487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:25.016681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c653000b9b24b80ae6e80077b955bbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:25.114786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c653000b9b24b80ae6e80077b955bbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:25.121299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c653000b9b24b80ae6e80077b955bbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:25.167479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c653000b9b24b80ae6e80077b955bbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:25.169872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c653000b9b24b80ae6e80077b955bbf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:25.250957 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2354/4711] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:24 2022] DELETE /identity/v3/users/4c653000b9b24b80ae6e80077b955bbf => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:25.252468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:25.253245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:25.253245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:25.307005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:25.308619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:25.720072 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2358/4712] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:25.726604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:25.729524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:26.109414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814c1ad-4623-47a8-b471-d02df7db81f5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:26.116450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:26.117631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:26.118135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:26.118650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:26.140317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:26.142729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:26.162833 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2355/4713] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:57:29.860827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:29.862706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:29.896205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060267e-9cfd-4aa5-b6dc-9a6667e2d8dc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:29.913073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:29.915471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:29.916088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:29.916559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] PATH_INFO: `/v3/projects/e2de791a2c3b49f1aafff0f9960d1d92` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:29.933333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2de791a2c3b49f1aafff0f9960d1d92)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:29.941977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:30.128951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2de791a2c3b49f1aafff0f9960d1d92', 'request_id': 'req-78be82c6-588e-453a-8e09-eb02c1eed0ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.139686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:30.145739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2de791a2c3b49f1aafff0f9960d1d92', 'request_id': 'req-78be82c6-588e-453a-8e09-eb02c1eed0ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.167504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2de791a2c3b49f1aafff0f9960d1d92', 'request_id': 'req-78be82c6-588e-453a-8e09-eb02c1eed0ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.208109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] The token cache is being invalidate because project e2de791a2c3b49f1aafff0f9960d1d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:30.209293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.211169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.219014 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2359/4714] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:29 2022] DELETE /identity/v3/projects/e2de791a2c3b49f1aafff0f9960d1d92 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:30.219296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:30.262993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d38ab4-c765-4797-aa0e-c7e2f575fcb5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:30.573388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:30.578309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:30.582810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:30.583703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] PATH_INFO: `/v3/users/2d9a189872f74da18d4ae871e16c3776` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:30.601677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9a189872f74da18d4ae871e16c3776)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:30.615668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:30.716945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:30.800330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9a189872f74da18d4ae871e16c3776'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.855216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9a189872f74da18d4ae871e16c3776'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.857855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9a189872f74da18d4ae871e16c3776'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.888154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9a189872f74da18d4ae871e16c3776'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.892224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cd6458e3-b4b9-42a7-9a96-4e5c18335022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9a189872f74da18d4ae871e16c3776'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:30.962004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2356/4715] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:30 2022] DELETE /identity/v3/users/2d9a189872f74da18d4ae871e16c3776 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:33.427564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:33.429434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:33.497204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be82c6-588e-453a-8e09-eb02c1eed0ad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:33.862901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:33.864401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:33.866491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:33.868719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] PATH_INFO: `/v3/projects/71bb02343a1043c19d7f20be2c3ac3e6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:33.881126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bb02343a1043c19d7f20be2c3ac3e6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:33.891565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:34.078862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bb02343a1043c19d7f20be2c3ac3e6', 'request_id': 'req-ef156548-1911-4298-a11a-f0115757ad96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:34.111537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bb02343a1043c19d7f20be2c3ac3e6', 'request_id': 'req-ef156548-1911-4298-a11a-f0115757ad96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:34.146760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bb02343a1043c19d7f20be2c3ac3e6', 'request_id': 'req-ef156548-1911-4298-a11a-f0115757ad96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:34.188792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] The token cache is being invalidate because project 71bb02343a1043c19d7f20be2c3ac3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:34.189144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:34.195387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef156548-1911-4298-a11a-f0115757ad96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:34.199036 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2360/4716] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:33 2022] DELETE /identity/v3/projects/71bb02343a1043c19d7f20be2c3ac3e6 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:34.209655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129c49-0fb9-4a78-a11c-a7d60587e4fe None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:34.211756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129c49-0fb9-4a78-a11c-a7d60587e4fe None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:34.212603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129c49-0fb9-4a78-a11c-a7d60587e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:34.344445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e1129c49-0fb9-4a78-a11c-a7d60587e4fe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:34.353817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e1129c49-0fb9-4a78-a11c-a7d60587e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:34.850945 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2357/4717] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 643 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:34.856523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0022b-17d1-4624-8066-0ee9996cc106 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:34.856523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0022b-17d1-4624-8066-0ee9996cc106 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:34.857165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0022b-17d1-4624-8066-0ee9996cc106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:35.015568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5bc0022b-17d1-4624-8066-0ee9996cc106 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:35.030420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bc0022b-17d1-4624-8066-0ee9996cc106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:35.114324 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2361/4718] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:35.124052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129c49-0fb9-4a78-a11c-a7d60587e4fe None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:35.158448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129c49-0fb9-4a78-a11c-a7d60587e4fe None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:35.220301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:35.221107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:35.221434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:35.221815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:35.222889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:57:35.223244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:35.225516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:35.292338 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2358/4719] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:57:35.296795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0022b-17d1-4624-8066-0ee9996cc106 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:35.360679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0022b-17d1-4624-8066-0ee9996cc106 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:35.404916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:35.408729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:35.409865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:35.418071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:35.419659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:35.423723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:35.634099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:35.634399 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2362/4720] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:35.655201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0715e5-fe1d-4368-b375-270a4f349563 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:36.406463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:36.407471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:36.407471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:36.407903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:36.408471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:36.410488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:36.457413 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2359/4721] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:35 2022] POST /identity/v3/users => generated 290 bytes in 824 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:57:36.465128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:36.520294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03271cc0-0a12-4547-93a5-83a30a4b1e7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:36.575413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:36.577214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:36.581402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:36.589816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:36.593233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:36.610262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:36.723910 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2363/4722] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:36.724805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:36.780354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9e1c-53b9-4fed-babc-ff1a28388d0c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:36.815005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9c6e9-d001-489e-aa5e-765bfc38a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:36.820607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c6e9-d001-489e-aa5e-765bfc38a7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:36.822533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c6e9-d001-489e-aa5e-765bfc38a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:36.823614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c6e9-d001-489e-aa5e-765bfc38a7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:36.827477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9c6e9-d001-489e-aa5e-765bfc38a7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:36.836218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9c6e9-d001-489e-aa5e-765bfc38a7fd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:36.896860 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2360/4723] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:36.907839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:36.956688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfe073-faaa-4763-9f82-e7bdfb5284e1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:36.989280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:36.992521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:36.995734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:36.996875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] PATH_INFO: `/v3/projects/895f442520fd48949f22eefcbbdf7edb/users/dce67ba5793f46ea854e8721fbe92d4e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:37.081982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f442520fd48949f22eefcbbdf7edb, user_id=dce67ba5793f46ea854e8721fbe92d4e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:37.105696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:37.242018 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2364/4724] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:36 2022] PUT /identity/v3/projects/895f442520fd48949f22eefcbbdf7edb/users/dce67ba5793f46ea854e8721fbe92d4e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:37.250479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46451b-bab7-4bf1-ad24-d80ad856aea1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:37.251553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46451b-bab7-4bf1-ad24-d80ad856aea1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:37.252326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46451b-bab7-4bf1-ad24-d80ad856aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:37.277138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:37.477251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8a46451b-bab7-4bf1-ad24-d80ad856aea1 None None] MFA Rules not processed for user `dce67ba5793f46ea854e8721fbe92d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:37.488310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8a46451b-bab7-4bf1-ad24-d80ad856aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:37.990474 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2361/4725] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 743 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:37.995569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:38.032184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:38.231203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fee4a-80dc-4dd2-bdcb-773aadad3727 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:38.249361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd55c3-a44d-4273-aeb4-43fe35589bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:38.250429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd55c3-a44d-4273-aeb4-43fe35589bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:38.251354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd55c3-a44d-4273-aeb4-43fe35589bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:38.251666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd55c3-a44d-4273-aeb4-43fe35589bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:38.252469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd55c3-a44d-4273-aeb4-43fe35589bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:38.258236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd55c3-a44d-4273-aeb4-43fe35589bd1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:38.325183 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2365/4726] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:57:37 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:38.326158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46451b-bab7-4bf1-ad24-d80ad856aea1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:38.391359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46451b-bab7-4bf1-ad24-d80ad856aea1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:38.560849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c39a8-886a-4cda-a90f-c79a722a35d2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:38.561936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c39a8-886a-4cda-a90f-c79a722a35d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:38.562244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c39a8-886a-4cda-a90f-c79a722a35d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:38.645208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1e2c39a8-886a-4cda-a90f-c79a722a35d2 None None] MFA Rules not processed for user `9fae0a09c9c74d6f95b07606f5ae828b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:38.648460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e2c39a8-886a-4cda-a90f-c79a722a35d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:38.664267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:38.667347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:38.668016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:38.668798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:38.670847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:38.673686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:38.757391 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2362/4727] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:38 2022] POST /identity/v3/users => generated 290 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:57:38.758707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:38.805832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecadd-8dfc-4aea-8736-1caa0ef7ad7c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:38.825846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:38.826748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:38.827337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:38.827625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:38.839784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:38.839784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:38.872517 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2363/4728] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:38.876981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:38.895342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caea7a-6739-40ca-9656-13599b8d0688 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:38.904480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:38.905182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:38.905472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:38.905755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:38.906506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:38.908205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:38.934296 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2364/4729] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:38.936103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:38.980890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109935f8-edfa-46c2-9121-76c0bfa784f9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:39.001220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0d5ff-1659-4586-b092-03223a852640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:39.007059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0d5ff-1659-4586-b092-03223a852640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:39.008462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0d5ff-1659-4586-b092-03223a852640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:39.009158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0d5ff-1659-4586-b092-03223a852640 admin admin] PATH_INFO: `/v3/projects/10cbc65105b04f7aa0a5001f3282c2d6/users/3217078653884c13a3348e35d9bf0240/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:39.026447 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2366/4730] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:39.030322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559420c-6e78-4de3-bfd1-ddb6e7695440 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:39.037187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559420c-6e78-4de3-bfd1-ddb6e7695440 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:39.042074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559420c-6e78-4de3-bfd1-ddb6e7695440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:39.066187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0d5ff-1659-4586-b092-03223a852640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cbc65105b04f7aa0a5001f3282c2d6, user_id=3217078653884c13a3348e35d9bf0240, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:39.077078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0d5ff-1659-4586-b092-03223a852640 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:39.140065 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2365/4731] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:38 2022] PUT /identity/v3/projects/10cbc65105b04f7aa0a5001f3282c2d6/users/3217078653884c13a3348e35d9bf0240/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:39.154718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02047e-0afb-4fdf-b8b4-877a45b19fb2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:39.157650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02047e-0afb-4fdf-b8b4-877a45b19fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:39.159614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02047e-0afb-4fdf-b8b4-877a45b19fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:39.203594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e559420c-6e78-4de3-bfd1-ddb6e7695440 None None] MFA Rules not processed for user `9fae0a09c9c74d6f95b07606f5ae828b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:39.220934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e559420c-6e78-4de3-bfd1-ddb6e7695440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:39.238231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dd02047e-0afb-4fdf-b8b4-877a45b19fb2 None None] MFA Rules not processed for user `3217078653884c13a3348e35d9bf0240`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:39.245010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd02047e-0afb-4fdf-b8b4-877a45b19fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:39.345880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:39.457863 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2367/4732] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:39.512367 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2366/4733] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:39.515236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559420c-6e78-4de3-bfd1-ddb6e7695440 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:39.634194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:39.757954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559420c-6e78-4de3-bfd1-ddb6e7695440 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:39.769144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628f5c4-77b1-437a-a37a-d987cb538f13 tempest-IdentityV3ProjectsTest-482828214 tempest-IdentityV3ProjectsTest-482828214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce67ba5793f46ea854e8721fbe92d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '895f442520fd48949f22eefcbbdf7edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:39.771169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628f5c4-77b1-437a-a37a-d987cb538f13 tempest-IdentityV3ProjectsTest-482828214 tempest-IdentityV3ProjectsTest-482828214-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:39.772020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628f5c4-77b1-437a-a37a-d987cb538f13 tempest-IdentityV3ProjectsTest-482828214 tempest-IdentityV3ProjectsTest-482828214-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:39.772758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628f5c4-77b1-437a-a37a-d987cb538f13 tempest-IdentityV3ProjectsTest-482828214 tempest-IdentityV3ProjectsTest-482828214-project] PATH_INFO: `/v3/users/dce67ba5793f46ea854e8721fbe92d4e/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:39.775774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628f5c4-77b1-437a-a37a-d987cb538f13 tempest-IdentityV3ProjectsTest-482828214 tempest-IdentityV3ProjectsTest-482828214-project] RBAC: Authorizing `identity:list_user_projects(user_id=dce67ba5793f46ea854e8721fbe92d4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:39.779578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628f5c4-77b1-437a-a37a-d987cb538f13 tempest-IdentityV3ProjectsTest-482828214 tempest-IdentityV3ProjectsTest-482828214-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:39.968639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2368/4734] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:57:39 2022] GET /identity/v3/users/dce67ba5793f46ea854e8721fbe92d4e/projects => generated 515 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:39.969108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:39.969855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:39.969855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:40.091439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] MFA Rules not processed for user `dce67ba5793f46ea854e8721fbe92d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:40.092706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:40.138616 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2367/4735] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:57:40.143851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:40.144698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:40.144698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:40.184631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] MFA Rules not processed for user `dce67ba5793f46ea854e8721fbe92d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:40.185642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:40.270453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:40.278305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:40.419366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.models.token_model [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] User dce67ba5793f46ea854e8721fbe92d4e has no access to project 10cbc65105b04f7aa0a5001f3282c2d6 {{(pid=80581) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 14 14:57:40.437956 n-d-768852-23 devstack@keystone.service[80581]: WARNING keystone.server.flask.application [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.98: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 14 14:57:40.464687 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2369/4736] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:40 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 323 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 14 14:57:40.471526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:40.885359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8da56-289c-44ae-a5a8-1d1e67a2f05f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:40.927784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a925d78-40d8-420c-9bb9-0f29f77e473d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:40.928495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925d78-40d8-420c-9bb9-0f29f77e473d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:40.928794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925d78-40d8-420c-9bb9-0f29f77e473d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:40.929082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925d78-40d8-420c-9bb9-0f29f77e473d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:40.982161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a925d78-40d8-420c-9bb9-0f29f77e473d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:40.986780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a925d78-40d8-420c-9bb9-0f29f77e473d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:40.999041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe8ebe-1292-4c67-a0d6-dcce1fd9493d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:41.011580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:41.014292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:41.015357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:41.016355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] PATH_INFO: `/v3/users/dce67ba5793f46ea854e8721fbe92d4e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:41.020051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce67ba5793f46ea854e8721fbe92d4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:41.025282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:41.055500 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2368/4737] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:57:41.215061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce67ba5793f46ea854e8721fbe92d4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:41.238967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:41.266903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce67ba5793f46ea854e8721fbe92d4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:41.285244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce67ba5793f46ea854e8721fbe92d4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:41.285244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce67ba5793f46ea854e8721fbe92d4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:41.290037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce67ba5793f46ea854e8721fbe92d4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:41.312671 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2370/4738] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:40 2022] DELETE /identity/v3/users/dce67ba5793f46ea854e8721fbe92d4e => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:41.316222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:41.317119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:41.319436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:41.359134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:41.360685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:41.524879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:41.526738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:41.530361 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2369/4739] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:41.704008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:41.706311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:41.732305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39999b7e-db14-4c65-8518-67fdcc1c0fba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:41.759540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78cfdc-bc5b-4009-b463-bec6f77b36bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:41.760692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78cfdc-bc5b-4009-b463-bec6f77b36bf service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:41.761221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78cfdc-bc5b-4009-b463-bec6f77b36bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:41.761725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78cfdc-bc5b-4009-b463-bec6f77b36bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:41.786423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78cfdc-bc5b-4009-b463-bec6f77b36bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:41.789625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78cfdc-bc5b-4009-b463-bec6f77b36bf service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:41.809849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:41.812814 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2371/4740] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:57:41.893657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca15f-8503-45bf-9690-52ead0f03e35 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:41.902454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:41.904027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:41.905032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:41.905934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:41.912591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:42.228870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:42.234337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:42.274234 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2370/4741] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:57:43.534778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:43.537394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:43.538153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:43.597063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:43.601256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:43.935261 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2372/4742] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:43.944658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:43.950413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:43.999240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:44.010836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:44.073184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588334e-47df-4807-ab9a-4d8527382068 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:44.131960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:44.138206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:44.138640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:44.141757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] PATH_INFO: `/v3/projects/895f442520fd48949f22eefcbbdf7edb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:44.144577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895f442520fd48949f22eefcbbdf7edb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:44.168237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:44.358027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cec5e-e9b3-4846-b9f7-1160315a09de service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:44.436443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895f442520fd48949f22eefcbbdf7edb', 'request_id': 'req-7a43eb7f-8289-4f48-aefd-974ef25cf784'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:44.480040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895f442520fd48949f22eefcbbdf7edb', 'request_id': 'req-7a43eb7f-8289-4f48-aefd-974ef25cf784'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:44.503006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895f442520fd48949f22eefcbbdf7edb', 'request_id': 'req-7a43eb7f-8289-4f48-aefd-974ef25cf784'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:44.544498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] The token cache is being invalidate because project 895f442520fd48949f22eefcbbdf7edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:44.545180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:44.545512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:44.552663 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2373/4743] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:43 2022] DELETE /identity/v3/projects/895f442520fd48949f22eefcbbdf7edb => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:44.553656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:44.565400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:44.581615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:44.840893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43eb7f-8289-4f48-aefd-974ef25cf784 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:44.866027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83698141-990b-4f7b-a2f0-b1681a088c66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:44.876147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698141-990b-4f7b-a2f0-b1681a088c66 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:44.878947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:44.880515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698141-990b-4f7b-a2f0-b1681a088c66 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:44.881214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698141-990b-4f7b-a2f0-b1681a088c66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:44.882096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:44.882851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:44.884950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] PATH_INFO: `/v3/users/3217078653884c13a3348e35d9bf0240` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:44.890505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3217078653884c13a3348e35d9bf0240)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:44.900515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:44.916407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-83698141-990b-4f7b-a2f0-b1681a088c66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:44.968969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:45.110928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3217078653884c13a3348e35d9bf0240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:45.132766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3217078653884c13a3348e35d9bf0240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:45.150444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3217078653884c13a3348e35d9bf0240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:45.151527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3217078653884c13a3348e35d9bf0240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:45.157597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83698141-990b-4f7b-a2f0-b1681a088c66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:45.159337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83698141-990b-4f7b-a2f0-b1681a088c66 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:45.167643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3217078653884c13a3348e35d9bf0240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:45.184624 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2374/4744] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:44 2022] DELETE /identity/v3/users/3217078653884c13a3348e35d9bf0240 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:45.207409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2371/4745] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:57:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:46.382572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:46.384095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:46.528593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2483c4-c2be-4210-a00e-7db98360bb82 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:46.534619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:46.535815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:46.536132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:46.536449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] PATH_INFO: `/v3/projects/10cbc65105b04f7aa0a5001f3282c2d6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:46.537894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cbc65105b04f7aa0a5001f3282c2d6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:46.539994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:46.587817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:46.626520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cbc65105b04f7aa0a5001f3282c2d6', 'request_id': 'req-eca73b89-593a-4eee-aaa1-a73b05ec5e25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:46.637055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cbc65105b04f7aa0a5001f3282c2d6', 'request_id': 'req-eca73b89-593a-4eee-aaa1-a73b05ec5e25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:46.658100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cbc65105b04f7aa0a5001f3282c2d6', 'request_id': 'req-eca73b89-593a-4eee-aaa1-a73b05ec5e25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:46.695337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] The token cache is being invalidate because project 10cbc65105b04f7aa0a5001f3282c2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:57:46.695696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:46.702791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca73b89-593a-4eee-aaa1-a73b05ec5e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:46.711466 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2375/4746] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:57:46 2022] DELETE /identity/v3/projects/10cbc65105b04f7aa0a5001f3282c2d6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:46.714562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7e46-d34d-48e5-bc5e-9bca685f2676 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:46.721186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7e46-d34d-48e5-bc5e-9bca685f2676 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:46.722217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7e46-d34d-48e5-bc5e-9bca685f2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:46.823618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-01df7e46-d34d-48e5-bc5e-9bca685f2676 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:46.828365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-01df7e46-d34d-48e5-bc5e-9bca685f2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:47.129621 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2372/4747] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:47.143912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b3097-cbf1-4ef6-b913-e40c4d67fe92 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:47.144512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b3097-cbf1-4ef6-b913-e40c4d67fe92 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:47.145153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b3097-cbf1-4ef6-b913-e40c4d67fe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:47.182852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-604b3097-cbf1-4ef6-b913-e40c4d67fe92 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:47.194009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-604b3097-cbf1-4ef6-b913-e40c4d67fe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:47.219898 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2376/4748] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:57:47.226545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7e46-d34d-48e5-bc5e-9bca685f2676 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:47.245555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7e46-d34d-48e5-bc5e-9bca685f2676 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:47.263048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:47.266006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:47.266303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:47.266681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:47.271328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:57:47.272409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:47.275805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:47.309908 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2373/4749] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:57:47.316122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b3097-cbf1-4ef6-b913-e40c4d67fe92 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:47.332809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b3097-cbf1-4ef6-b913-e40c4d67fe92 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:47.352144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fb615-b5ad-4f24-8b2d-489e3d30a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:47.352965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb615-b5ad-4f24-8b2d-489e3d30a828 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:47.353258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb615-b5ad-4f24-8b2d-489e3d30a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:47.353539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb615-b5ad-4f24-8b2d-489e3d30a828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:47.354477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fb615-b5ad-4f24-8b2d-489e3d30a828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:47.357136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fb615-b5ad-4f24-8b2d-489e3d30a828 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:47.431953 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2377/4750] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:57:47 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:47.438031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:47.454110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abde24-e7a4-43a0-8094-ceb90a75cde5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:47.626436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:47.627521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:47.627725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:47.628005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:47.628718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:47.631448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:47.650667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:47.651225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:47.651725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:47.688207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:47.694716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:47.707619 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2374/4751] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:47 2022] POST /identity/v3/users => generated 300 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:57:47.712885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:47.748045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ef6a-6743-490e-a06e-01149b223154 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:47.763687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:47.765779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:47.766928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:47.767904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:47.772869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:47.780190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:47.817682 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2375/4752] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:47.824656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:47.863107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece865e-69e1-406a-91f3-45ed5079cc69 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:47.878286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:47.881549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:47.881836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:47.882124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] PATH_INFO: `/v3/projects/56e17752e84f4059ada0923a0772c56e/users/2c47d525ae5a470998d12a4c02774a59/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:47.965963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e17752e84f4059ada0923a0772c56e, user_id=2c47d525ae5a470998d12a4c02774a59, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:47.977104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:47.990509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:48.021606 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2378/4753] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:48.023422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:48.025122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:48.043727 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2376/4754] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:47 2022] PUT /identity/v3/projects/56e17752e84f4059ada0923a0772c56e/users/2c47d525ae5a470998d12a4c02774a59/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:48.047750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:48.353891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544f9d-fca0-406d-a463-4142e32b22bf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:48.366301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1884d0d-8a23-4ee0-a9b4-9c2f1e066685 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:48.374875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:48.376204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:48.376664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:48.377169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:48.379842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:48.392082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:48.432825 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2377/4755] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:57:48.439544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:48.480173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4845-c783-4c42-b666-8851fc8b2287 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:48.501834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:48.516596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e4e1e-a605-483b-9786-4de0e3b31673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:48.519744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4e1e-a605-483b-9786-4de0e3b31673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:48.519744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4e1e-a605-483b-9786-4de0e3b31673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:48.520217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4e1e-a605-483b-9786-4de0e3b31673 admin admin] PATH_INFO: `/v3/projects/56e17752e84f4059ada0923a0772c56e/users/2c47d525ae5a470998d12a4c02774a59/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:48.529613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4e1e-a605-483b-9786-4de0e3b31673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e17752e84f4059ada0923a0772c56e, user_id=2c47d525ae5a470998d12a4c02774a59, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:48.544407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4e1e-a605-483b-9786-4de0e3b31673 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:48.607517 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2378/4756] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:48 2022] PUT /identity/v3/projects/56e17752e84f4059ada0923a0772c56e/users/2c47d525ae5a470998d12a4c02774a59/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:48.609336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba076-b3f9-4c96-ae3a-e38a807080d3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:48.609769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba076-b3f9-4c96-ae3a-e38a807080d3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:48.610173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba076-b3f9-4c96-ae3a-e38a807080d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:48.639757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:48.640859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:48.645099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:48.645417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:48.662529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7deba076-b3f9-4c96-ae3a-e38a807080d3 None None] MFA Rules not processed for user `2c47d525ae5a470998d12a4c02774a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:48.664106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7deba076-b3f9-4c96-ae3a-e38a807080d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:48.822656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:48.834252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:48.868896 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2379/4757] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:57:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:48.904153 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2379/4758] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:48.909322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:48.947574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670448d-ae19-418d-8510-dca22d0b2a68 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:49.193348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:49.200437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:49.200779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:49.201020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:49.201771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:49.216229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:49.360385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba076-b3f9-4c96-ae3a-e38a807080d3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:49.367846 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2380/4759] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:57:48 2022] POST /identity/v3/projects => generated 385 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:57:49.379670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba076-b3f9-4c96-ae3a-e38a807080d3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:49.595033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:49.595788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:49.600382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:49.600855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:49.602794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:49.614659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:49.651473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:49.696048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:49.704244 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2380/4760] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:57:49 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:57:49.717409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3a98a-2f4d-4b57-81e7-779ec6a0d939 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:49.793319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837b81d-7e06-4ba8-848a-bf00d9758762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:49.796052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837b81d-7e06-4ba8-848a-bf00d9758762 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:49.801094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837b81d-7e06-4ba8-848a-bf00d9758762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:49.802242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837b81d-7e06-4ba8-848a-bf00d9758762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:49.804080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837b81d-7e06-4ba8-848a-bf00d9758762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:49.819989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837b81d-7e06-4ba8-848a-bf00d9758762 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:49.881074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:49.887497 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2381/4761] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:57:49.903722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba34f-92b5-47d8-8000-d2024c0cec4d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:49.940338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:49.942016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:49.947820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:49.950172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:49.951647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:49.974164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:49.985175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:49.985926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:49.986442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:50.024337 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2381/4762] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:57:50.025621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:50.054379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a069b-fd38-473e-a573-e066915a4c37 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:50.055051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:50.057767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:50.060287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1d44-b61b-4c28-9235-01a5f6d66f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:50.061495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1d44-b61b-4c28-9235-01a5f6d66f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:50.061979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1d44-b61b-4c28-9235-01a5f6d66f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:50.062433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1d44-b61b-4c28-9235-01a5f6d66f71 admin admin] PATH_INFO: `/v3/projects/91095c36b40740f091d00fc0cbc41316/users/e64042dc15e444f7b0004629573a5f2a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:50.113247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1d44-b61b-4c28-9235-01a5f6d66f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91095c36b40740f091d00fc0cbc41316, user_id=e64042dc15e444f7b0004629573a5f2a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:50.117022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1d44-b61b-4c28-9235-01a5f6d66f71 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:50.166425 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2382/4763] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:57:50 2022] PUT /identity/v3/projects/91095c36b40740f091d00fc0cbc41316/users/e64042dc15e444f7b0004629573a5f2a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:50.177448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250edae8-75c7-48eb-be3f-0257dbe85e1a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:50.178106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250edae8-75c7-48eb-be3f-0257dbe85e1a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:50.178576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250edae8-75c7-48eb-be3f-0257dbe85e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:50.276044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-250edae8-75c7-48eb-be3f-0257dbe85e1a None None] MFA Rules not processed for user `e64042dc15e444f7b0004629573a5f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:50.280392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-250edae8-75c7-48eb-be3f-0257dbe85e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:50.405116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:50.447107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2383/4764] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:50.464524 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2382/4765] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 14 14:57:50.498303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250edae8-75c7-48eb-be3f-0257dbe85e1a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:50.986575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250edae8-75c7-48eb-be3f-0257dbe85e1a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:51.026319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b4d78-5361-4be6-a1a3-303e34504226 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:51.027778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b4d78-5361-4be6-a1a3-303e34504226 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:51.046136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b4d78-5361-4be6-a1a3-303e34504226 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:51.051594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b4d78-5361-4be6-a1a3-303e34504226 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:51.319154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:51.356302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b4d78-5361-4be6-a1a3-303e34504226 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:51.359997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b4d78-5361-4be6-a1a3-303e34504226 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:51.398176 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2384/4766] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:57:52.356545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:52.360349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:52.603904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea2cc-2700-496e-9b2b-8c04901ea02c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:52.721979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:52.723563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:52.726637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:52.731944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:53.096580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:53.124936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:53.209279 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2383/4767] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:57:53.546654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:53.550684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:53.554596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:53.628225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:53.636167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:53.669586 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2385/4768] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:53.674198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:53.781843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279973bf-d1ce-44f0-b4b1-66ff54773612 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:53.820450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b44fb6-edbe-459a-8bd6-880724dcc3be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:53.848796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b44fb6-edbe-459a-8bd6-880724dcc3be service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:53.851816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b44fb6-edbe-459a-8bd6-880724dcc3be service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:53.856180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b44fb6-edbe-459a-8bd6-880724dcc3be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:53.931172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b44fb6-edbe-459a-8bd6-880724dcc3be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:53.936753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b44fb6-edbe-459a-8bd6-880724dcc3be service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:53.975347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2384/4769] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:57:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:57.991795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:58.007170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:58.171856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08aa42-7343-4e25-b3b7-8017c82721a2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:58.180261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:58.182024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:58.182607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:58.183332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] PATH_INFO: `/v3/users/6e6fd9e020654519b5061df41ed34ccf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:58.185561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6fd9e020654519b5061df41ed34ccf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:58.190690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:58.394159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6fd9e020654519b5061df41ed34ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:58.438776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6fd9e020654519b5061df41ed34ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:58.440190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6fd9e020654519b5061df41ed34ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:58.490650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6fd9e020654519b5061df41ed34ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:58.492331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6fd9e020654519b5061df41ed34ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:57:58.572722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:58.573976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:58.573976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:58.575478 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2386/4770] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:57:57 2022] DELETE /identity/v3/users/6e6fd9e020654519b5061df41ed34ccf => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:57:58.636617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:57:58.638243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:58.839577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:58.914681 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2385/4771] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:57:58.951919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:57:58.954716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:57:59.299519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52a8b-5e4d-4eff-b5ab-eedcf100e4c9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:57:59.344303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af41754-8e3d-454c-aa19-fc3cd3810128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:57:59.346880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41754-8e3d-454c-aa19-fc3cd3810128 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:57:59.347470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41754-8e3d-454c-aa19-fc3cd3810128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:57:59.347988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41754-8e3d-454c-aa19-fc3cd3810128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:57:59.410021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af41754-8e3d-454c-aa19-fc3cd3810128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:57:59.425769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af41754-8e3d-454c-aa19-fc3cd3810128 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:57:59.507181 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2387/4772] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:58:00.303353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:00.310627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:00.379768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0b9a5-c9d5-43b8-905e-5767f31c2e92 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:00.396543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:00.398328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:00.402758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:00.403067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] PATH_INFO: `/v3/users/2c47d525ae5a470998d12a4c02774a59` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:00.406141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c47d525ae5a470998d12a4c02774a59)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:00.419991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:00.653646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c47d525ae5a470998d12a4c02774a59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:00.766051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c47d525ae5a470998d12a4c02774a59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:00.837896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c47d525ae5a470998d12a4c02774a59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:00.851043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c47d525ae5a470998d12a4c02774a59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:00.905766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c47d525ae5a470998d12a4c02774a59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:00.965649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:00.966677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:00.966677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:00.973168 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2386/4773] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:58:00 2022] DELETE /identity/v3/users/2c47d525ae5a470998d12a4c02774a59 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:00.996007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:01.073130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:01.088460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:01.513708 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2388/4774] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:01.524590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:01.526943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:01.820693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e576a-442c-45a9-9cfd-27bded7181da admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:01.837534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff12b2-04c8-407c-b164-ceb60e62e2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:01.838310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff12b2-04c8-407c-b164-ceb60e62e2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:01.838682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff12b2-04c8-407c-b164-ceb60e62e2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:01.839037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff12b2-04c8-407c-b164-ceb60e62e2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:01.888346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff12b2-04c8-407c-b164-ceb60e62e2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:01.889902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff12b2-04c8-407c-b164-ceb60e62e2b0 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:01.900499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:01.903938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:01.933865 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2387/4775] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:58:02.025903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a2b5-679a-47a3-bc09-0cecc3afc855 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:02.078301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:02.084545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:02.085231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:02.085739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] PATH_INFO: `/v3/projects/a55d05eb595540588ed7f78561a35b0c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:02.099561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55d05eb595540588ed7f78561a35b0c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:02.110834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:02.344087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55d05eb595540588ed7f78561a35b0c', 'request_id': 'req-559a5229-595a-444f-88c2-8e75a5f1dd6f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:02.378069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55d05eb595540588ed7f78561a35b0c', 'request_id': 'req-559a5229-595a-444f-88c2-8e75a5f1dd6f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:02.416110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55d05eb595540588ed7f78561a35b0c', 'request_id': 'req-559a5229-595a-444f-88c2-8e75a5f1dd6f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:02.441054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] The token cache is being invalidate because project a55d05eb595540588ed7f78561a35b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:58:02.441846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:02.444755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-559a5229-595a-444f-88c2-8e75a5f1dd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:02.449282 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2389/4776] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:58:01 2022] DELETE /identity/v3/projects/a55d05eb595540588ed7f78561a35b0c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:02.454290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951536-a66b-42cb-b3d0-bb7b11a87c6c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:02.456202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951536-a66b-42cb-b3d0-bb7b11a87c6c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:02.456700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951536-a66b-42cb-b3d0-bb7b11a87c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:02.509328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f4951536-a66b-42cb-b3d0-bb7b11a87c6c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:02.510943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f4951536-a66b-42cb-b3d0-bb7b11a87c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:02.710957 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2388/4777] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:02.717908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7255d2-f3cd-4191-83ad-fab294daaf89 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:02.718390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7255d2-f3cd-4191-83ad-fab294daaf89 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:02.718654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7255d2-f3cd-4191-83ad-fab294daaf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:02.762991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e7255d2-f3cd-4191-83ad-fab294daaf89 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:02.764227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e7255d2-f3cd-4191-83ad-fab294daaf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:02.810165 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2390/4778] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:02.815389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951536-a66b-42cb-b3d0-bb7b11a87c6c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:02.821021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:02.844311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951536-a66b-42cb-b3d0-bb7b11a87c6c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:02.872191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:02.883129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:02.884147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:02.888341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:02.890226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:58:02.898194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:02.902458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:02.978434 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2389/4779] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:58:02.984506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7255d2-f3cd-4191-83ad-fab294daaf89 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:03.010220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7255d2-f3cd-4191-83ad-fab294daaf89 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:03.050018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:03.053067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:03.054067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:03.055598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:03.062607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:03.067899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:03.230664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2391/4780] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:58:02 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:03.236408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:03.257571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5358d1-7bbf-411b-8a5f-c895144060c6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:03.460040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:03.462478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:03.702248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:03.704024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:03.704771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:03.705731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:03.706507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:03.726355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:03.749919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7e04b-a67c-47d8-9f16-3d269cdf72f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:03.765004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:03.766072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:03.766432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:03.766962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] PATH_INFO: `/v3/projects/56e17752e84f4059ada0923a0772c56e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:03.779942 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2390/4781] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:58:03 2022] POST /identity/v3/users => generated 285 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:03.784085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e17752e84f4059ada0923a0772c56e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:03.784833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:03.791294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:03.794454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:03.806314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdabe8b-b37e-497d-baad-c239c1ff9d87 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:03.820814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:03.823305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:03.823624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:03.824273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:03.828395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:03.832493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:03.860279 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2391/4782] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:58:03.865721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:03.896889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eedfb2-4dd2-4405-a879-64318d57a73b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:03.909067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:03.915730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:03.916058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:03.916370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:03.917832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:03.923215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:03.964282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e17752e84f4059ada0923a0772c56e', 'request_id': 'req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:03.968374 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2392/4783] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:58:03.978012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:03.987377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e17752e84f4059ada0923a0772c56e', 'request_id': 'req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:03.996892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e17752e84f4059ada0923a0772c56e', 'request_id': 'req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.007249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ed587-8b3c-4c53-853a-f06773a4a39a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:04.072041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] The token cache is being invalidate because project 56e17752e84f4059ada0923a0772c56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:58:04.073822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.078689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.086575 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2392/4784] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:58:03 2022] DELETE /identity/v3/projects/56e17752e84f4059ada0923a0772c56e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:04.093147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:04.096515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:04.224918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da6a5e-cfcc-4a3f-aadc-4569180f6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:04.226500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da6a5e-cfcc-4a3f-aadc-4569180f6fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:04.226999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da6a5e-cfcc-4a3f-aadc-4569180f6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:04.250073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da6a5e-cfcc-4a3f-aadc-4569180f6fdd admin admin] PATH_INFO: `/v3/projects/3f7d1b6aec0f40f19187dc4672e3bcac/users/338e339b033d4024946a2b11e1c08fcc/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:04.259207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93eeb2-796d-4a50-bf17-6008b40fbbd4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:04.267584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:04.268859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:04.269666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:04.270177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] PATH_INFO: `/v3/users/e64042dc15e444f7b0004629573a5f2a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:04.275086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64042dc15e444f7b0004629573a5f2a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:04.280941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:04.298163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da6a5e-cfcc-4a3f-aadc-4569180f6fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7d1b6aec0f40f19187dc4672e3bcac, user_id=338e339b033d4024946a2b11e1c08fcc, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:04.301849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da6a5e-cfcc-4a3f-aadc-4569180f6fdd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:04.355196 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2393/4785] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:58:03 2022] PUT /identity/v3/projects/3f7d1b6aec0f40f19187dc4672e3bcac/users/338e339b033d4024946a2b11e1c08fcc/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:04.376607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:04.376909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:04.377233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:04.417626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64042dc15e444f7b0004629573a5f2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.469221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64042dc15e444f7b0004629573a5f2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.469971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64042dc15e444f7b0004629573a5f2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.475745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] MFA Rules not processed for user `338e339b033d4024946a2b11e1c08fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:04.478273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:04.511572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64042dc15e444f7b0004629573a5f2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.515778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64042dc15e444f7b0004629573a5f2a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:04.563370 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2393/4786] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:58:04 2022] DELETE /identity/v3/users/e64042dc15e444f7b0004629573a5f2a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:58:04.636852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:04.784889 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2394/4787] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:58:04.802265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:04.804294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:04.849460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:05.002090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542551a-044c-48a1-afc4-55f94d94ecf2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:05.018553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9605-019e-4f50-a49d-b008b49d9950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:05.020078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9605-019e-4f50-a49d-b008b49d9950 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:05.022268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9605-019e-4f50-a49d-b008b49d9950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:05.022773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9605-019e-4f50-a49d-b008b49d9950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:05.331218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f9605-019e-4f50-a49d-b008b49d9950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:05.333302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f9605-019e-4f50-a49d-b008b49d9950 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:05.375791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2394/4788] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:58:06.974887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:06.978130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:07.563199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d606906-b34f-4881-a1bf-a00ba22dfd64 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:07.722763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:07.725743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:07.725935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:07.732240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] PATH_INFO: `/v3/projects/91095c36b40740f091d00fc0cbc41316` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:07.736107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91095c36b40740f091d00fc0cbc41316)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:07.738342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:07.920047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91095c36b40740f091d00fc0cbc41316', 'request_id': 'req-1df9897e-4d93-4087-8753-ccaa28fd91d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:07.949654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91095c36b40740f091d00fc0cbc41316', 'request_id': 'req-1df9897e-4d93-4087-8753-ccaa28fd91d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:07.980409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91095c36b40740f091d00fc0cbc41316', 'request_id': 'req-1df9897e-4d93-4087-8753-ccaa28fd91d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:08.018657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] The token cache is being invalidate because project 91095c36b40740f091d00fc0cbc41316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:58:08.018950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:08.021522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:08.027463 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2395/4789] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:58:06 2022] DELETE /identity/v3/projects/91095c36b40740f091d00fc0cbc41316 => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:08.043007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65debe0-215c-4e73-95c4-031264dea810 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:08.044034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65debe0-215c-4e73-95c4-031264dea810 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:08.044487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65debe0-215c-4e73-95c4-031264dea810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:08.082461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f65debe0-215c-4e73-95c4-031264dea810 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:08.084425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f65debe0-215c-4e73-95c4-031264dea810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:08.215579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:08.217110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:08.240353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:08.310242 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2395/4790] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:08.346828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041987-46d7-469c-b03d-4b2e445d1500 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:08.347504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041987-46d7-469c-b03d-4b2e445d1500 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:08.348058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041987-46d7-469c-b03d-4b2e445d1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:08.415127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-87041987-46d7-469c-b03d-4b2e445d1500 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:08.429320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-87041987-46d7-469c-b03d-4b2e445d1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:08.500816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9897e-4d93-4087-8753-ccaa28fd91d7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:08.521153 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2396/4791] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:58:08.522397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87041987-46d7-469c-b03d-4b2e445d1500 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:08.530602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:08.532246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:08.532744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:08.533196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:08.543553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:08.594967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:08.601896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:08.649596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87041987-46d7-469c-b03d-4b2e445d1500 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:08.659795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2396/4792] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:58:08.687489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:08.713958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:08.714321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:08.714735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:08.715426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:58:08.715820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:08.727025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:08.808490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:08.811420 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2397/4793] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:58:08.824808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c25beb-3bdb-4823-aa34-8b941dfef283 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:08.841183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:08.842486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:08.843650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:08.844162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:08.846860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:08.852565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:08.955725 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2397/4794] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:58:08 2022] POST /identity/v3/projects => generated 357 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:58:08.959915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:09.016592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a6088-a80e-427b-b401-ebcbc44cc7f1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:09.329333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:09.400832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:09.401544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:09.401884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:09.402146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:09.408809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:09.416045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:09.505251 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2398/4795] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:58:08 2022] POST /identity/v3/users => generated 279 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:09.506477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:09.567537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d642-bef0-4c9e-b7d3-fc01d54d5b89 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:09.605083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:09.606417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:09.607557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:09.608365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:09.610034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:09.621382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:09.706375 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2398/4796] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:58:09.713475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:09.787011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f2982-79b6-48fd-9146-1b3793e43670 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:09.813662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46f2b5-a42a-4192-b144-e22fbd166c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:09.814443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f2b5-a42a-4192-b144-e22fbd166c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:09.814957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f2b5-a42a-4192-b144-e22fbd166c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:09.815250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f2b5-a42a-4192-b144-e22fbd166c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:09.817286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46f2b5-a42a-4192-b144-e22fbd166c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:09.821946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46f2b5-a42a-4192-b144-e22fbd166c7f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:09.862099 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2399/4797] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:09.864512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:09.891334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c97e0-1330-49c0-ba12-56d8404e0a45 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:09.928851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4973d-527e-4285-8d68-839b540e5972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:09.929210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4973d-527e-4285-8d68-839b540e5972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:09.930382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4973d-527e-4285-8d68-839b540e5972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:09.930823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4973d-527e-4285-8d68-839b540e5972 admin admin] PATH_INFO: `/v3/projects/8005c308318e410492e9bb32221aeed1/users/3b77f78a6e954a8fa6899386283cce08/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:09.996594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4973d-527e-4285-8d68-839b540e5972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8005c308318e410492e9bb32221aeed1, user_id=3b77f78a6e954a8fa6899386283cce08, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:09.998076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4973d-527e-4285-8d68-839b540e5972 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:10.061815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2399/4798] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:58:09 2022] PUT /identity/v3/projects/8005c308318e410492e9bb32221aeed1/users/3b77f78a6e954a8fa6899386283cce08/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:10.100102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d64a-15e5-4904-bf1f-82ee39f5d15f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:10.101144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d64a-15e5-4904-bf1f-82ee39f5d15f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:10.103349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d64a-15e5-4904-bf1f-82ee39f5d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:10.280145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9019d64a-15e5-4904-bf1f-82ee39f5d15f None None] MFA Rules not processed for user `3b77f78a6e954a8fa6899386283cce08`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:10.296487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9019d64a-15e5-4904-bf1f-82ee39f5d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:10.643123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3b81-2301-4d3b-bb53-0b596589e6b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:10.643846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3b81-2301-4d3b-bb53-0b596589e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:10.643846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3b81-2301-4d3b-bb53-0b596589e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:10.668540 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2400/4799] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:10.681310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-02be3b81-2301-4d3b-bb53-0b596589e6b7 None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:10.682862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02be3b81-2301-4d3b-bb53-0b596589e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:10.694821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d64a-15e5-4904-bf1f-82ee39f5d15f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:10.908088 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2400/4800] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:10.951990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d64a-15e5-4904-bf1f-82ee39f5d15f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:10.993029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:10.994307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:10.994861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:10.995407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] PATH_INFO: `/v3/users/3b77f78a6e954a8fa6899386283cce08` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:10.998188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b77f78a6e954a8fa6899386283cce08)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:11.000816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:11.181465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b77f78a6e954a8fa6899386283cce08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:11.211213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:11.247555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b77f78a6e954a8fa6899386283cce08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:11.260614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b77f78a6e954a8fa6899386283cce08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:11.279040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b77f78a6e954a8fa6899386283cce08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:11.292913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b77f78a6e954a8fa6899386283cce08'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:11.353792 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2401/4801] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:58:10 2022] DELETE /identity/v3/users/3b77f78a6e954a8fa6899386283cce08 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:58:11.361912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded55b8-42f3-425a-9898-f80f7f6f050a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:11.362891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded55b8-42f3-425a-9898-f80f7f6f050a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:11.363564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded55b8-42f3-425a-9898-f80f7f6f050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:11.421613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9ded55b8-42f3-425a-9898-f80f7f6f050a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:11.423022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ded55b8-42f3-425a-9898-f80f7f6f050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:11.540889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:11.611643 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2401/4802] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:11.685312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:11.687020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:11.876900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1357-abfc-4105-9f51-04ca7f88808d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:11.896929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:11.898358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:11.899053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:11.899715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:11.949517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:11.960621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:12.039774 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2402/4803] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:58:13.045885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf084-09d9-4fb5-bfe3-7827c2c2cba5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:13.046474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf084-09d9-4fb5-bfe3-7827c2c2cba5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:13.046865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf084-09d9-4fb5-bfe3-7827c2c2cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:13.082918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6b7bf084-09d9-4fb5-bfe3-7827c2c2cba5 None None] MFA Rules not processed for user `4813aa5acf744a8dac42de00d7e5a519`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:13.086588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b7bf084-09d9-4fb5-bfe3-7827c2c2cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:13.432554 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2402/4804] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:58:14.520923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:14.523640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:14.553780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071a4e1-4ec9-4dc5-bc6d-f1b191ab76ad service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:14.583027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:14.584151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:14.584582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:14.584983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] PATH_INFO: `/v3/projects/8005c308318e410492e9bb32221aeed1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:14.586733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8005c308318e410492e9bb32221aeed1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:14.589776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:14.741393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8005c308318e410492e9bb32221aeed1', 'request_id': 'req-136af40c-34fe-4c4b-af77-f1fbbb093522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:14.753185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8005c308318e410492e9bb32221aeed1', 'request_id': 'req-136af40c-34fe-4c4b-af77-f1fbbb093522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:14.763583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8005c308318e410492e9bb32221aeed1', 'request_id': 'req-136af40c-34fe-4c4b-af77-f1fbbb093522'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:14.780213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] The token cache is being invalidate because project 8005c308318e410492e9bb32221aeed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:58:14.780876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:14.781927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-136af40c-34fe-4c4b-af77-f1fbbb093522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:14.783866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2403/4805] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:58:14 2022] DELETE /identity/v3/projects/8005c308318e410492e9bb32221aeed1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:14.792650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101408-9263-496f-82c0-30f13ffe61ef None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:14.793482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101408-9263-496f-82c0-30f13ffe61ef None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:14.793482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101408-9263-496f-82c0-30f13ffe61ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:14.872379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6b101408-9263-496f-82c0-30f13ffe61ef None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:14.875101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b101408-9263-496f-82c0-30f13ffe61ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:15.113122 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2403/4806] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:15.127477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495251c-86c8-4afe-af9c-cbe6417b9457 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:15.129837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495251c-86c8-4afe-af9c-cbe6417b9457 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:15.131872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495251c-86c8-4afe-af9c-cbe6417b9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:15.219586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5495251c-86c8-4afe-af9c-cbe6417b9457 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:15.220994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5495251c-86c8-4afe-af9c-cbe6417b9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:15.275926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101408-9263-496f-82c0-30f13ffe61ef None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:15.277266 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2404/4807] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:58:15.307479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101408-9263-496f-82c0-30f13ffe61ef None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:15.332255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:15.334006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:15.334868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:15.336016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:15.337831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:58:15.342947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:15.351565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:15.432577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495251c-86c8-4afe-af9c-cbe6417b9457 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:15.435520 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2404/4808] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:58:15.455720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495251c-86c8-4afe-af9c-cbe6417b9457 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:15.470273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:15.472004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:15.476064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:15.476453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:15.477387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:15.483583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:15.590899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2405/4809] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:58:15 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:15.595989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:15.644886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab540dd-fece-4d30-bcb4-394ac3244a50 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:15.876459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:15.878388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:15.878911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:15.879441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:15.882700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:15.887398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:15.959044 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2405/4810] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:58:15 2022] POST /identity/v3/users => generated 291 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:15.966601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:16.000720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3905-e9b1-4bb3-bfeb-d4bb50befd69 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:16.024484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:16.025678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:16.026366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:16.026714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:16.032631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:16.035215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:16.089958 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2406/4811] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:16.091627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:16.128743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac70936-d943-4381-9768-b61fbb2245d1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:16.141610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829b871-7438-4c25-b68a-a509c6c2c4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:16.147930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829b871-7438-4c25-b68a-a509c6c2c4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:16.148261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829b871-7438-4c25-b68a-a509c6c2c4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:16.148661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829b871-7438-4c25-b68a-a509c6c2c4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:16.149546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829b871-7438-4c25-b68a-a509c6c2c4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:16.152356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829b871-7438-4c25-b68a-a509c6c2c4f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:16.157854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:16.199233 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2406/4812] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:16.201335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:16.229185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7997a-82b1-4793-94aa-b6c42c82c6ef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:16.259261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:16.260866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:16.261366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:16.261886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] PATH_INFO: `/v3/projects/6fb5b8e72cc942d4aae43d545943f1d0/users/5b3457c7b3174bb1a10e53aded810c19/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:16.304585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb5b8e72cc942d4aae43d545943f1d0, user_id=5b3457c7b3174bb1a10e53aded810c19, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:16.310391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:16.323889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:16.407416 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2407/4813] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:58:16 2022] PUT /identity/v3/projects/6fb5b8e72cc942d4aae43d545943f1d0/users/5b3457c7b3174bb1a10e53aded810c19/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:16.424625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5e24-beec-41ea-9054-d751c5c9cb76 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:16.426686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5e24-beec-41ea-9054-d751c5c9cb76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:16.427760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5e24-beec-41ea-9054-d751c5c9cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:16.479452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:16.489687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:16.670145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-347c5e24-beec-41ea-9054-d751c5c9cb76 None None] MFA Rules not processed for user `5b3457c7b3174bb1a10e53aded810c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:16.674633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-347c5e24-beec-41ea-9054-d751c5c9cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:17.070798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5daddb-7115-4d3c-b203-b30315030782 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:17.100988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:17.104476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:17.104910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:17.105200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:17.124800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:17.188456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:17.192071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:17.211863 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2407/4814] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 789 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:17.217103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5e24-beec-41ea-9054-d751c5c9cb76 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:17.259101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2408/4815] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:58:17.645904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5e24-beec-41ea-9054-d751c5c9cb76 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:17.700254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:17.709718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:17.710462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:17.715750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:17.717484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:17.728283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:17.889931 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2408/4816] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:58:17 2022] POST /identity/v3/projects => generated 379 bytes in 676 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:17.896812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:17.934398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9a42d-8d8f-468a-8610-019c7b3aa556 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:18.271456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:18.274849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:18.278896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:18.280974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:18.283571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:18.287430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:18.369768 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2409/4817] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:58:17 2022] POST /identity/v3/users => generated 290 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:18.377111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:18.423698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22180ec0-2f8d-49cc-8117-4044abdaba9b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:18.481645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:18.483479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:18.484345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:18.486421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:18.492259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:18.498866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:18.562603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:18.562955 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2409/4818] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:18.581010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ed822-6a1f-4eb4-8e1f-b9137ef17435 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:18.606962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986ad65-0aff-46c2-b1ae-4c3b83fda025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:18.610974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986ad65-0aff-46c2-b1ae-4c3b83fda025 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:18.611611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986ad65-0aff-46c2-b1ae-4c3b83fda025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:18.611978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986ad65-0aff-46c2-b1ae-4c3b83fda025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:18.612462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986ad65-0aff-46c2-b1ae-4c3b83fda025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:18.619333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986ad65-0aff-46c2-b1ae-4c3b83fda025 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:18.681627 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2410/4819] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:18.691442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:18.734338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6571da-3a71-4d6e-9b92-9ea56a74e2bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:18.760834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:18.765657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:18.773888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:18.776421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] PATH_INFO: `/v3/projects/2f76100ada084829aa5daf81e1812863/users/d5e1a8e590814a72a5e3fdb843e2134c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:18.885378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f76100ada084829aa5daf81e1812863, user_id=d5e1a8e590814a72a5e3fdb843e2134c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:18.912984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:19.016653 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2410/4820] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:58:18 2022] PUT /identity/v3/projects/2f76100ada084829aa5daf81e1812863/users/d5e1a8e590814a72a5e3fdb843e2134c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:19.026460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722788-7929-443e-8016-906b100b4662 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:19.027093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722788-7929-443e-8016-906b100b4662 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:19.027945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722788-7929-443e-8016-906b100b4662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:19.131853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7c722788-7929-443e-8016-906b100b4662 None None] MFA Rules not processed for user `d5e1a8e590814a72a5e3fdb843e2134c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:19.140258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c722788-7929-443e-8016-906b100b4662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:19.388621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:19.504161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2411/4821] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:19.507400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:19.608316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:19.675788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3949490-2a07-4f0a-a954-6c4f6818059b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:19.690299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:19.692454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:19.692971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:19.693434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:19.694592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:19.697054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:19.776096 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2411/4822] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:58:19 2022] POST /identity/v3/projects => generated 381 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:19.776703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c722788-7929-443e-8016-906b100b4662 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:19.807593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c722788-7929-443e-8016-906b100b4662 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:20.049018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:20.049931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:20.050226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:20.050515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:20.052109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:20.054122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:20.111247 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2412/4823] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:58:19 2022] POST /identity/v3/users => generated 297 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:20.116773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:20.136548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318a723-30e5-415f-81ea-3eea3026779e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:20.153238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:20.154559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:20.155140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:20.155964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:20.157035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:20.162204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:20.222725 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2412/4824] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:20.227683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:20.280264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170faa9-295d-40b0-bb7a-2d28ef250667 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:20.344392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:20.352172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:20.352746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:20.354360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] PATH_INFO: `/v3/projects/bcf89477995f47a781c92ce8c0cb5b36/users/6e8f2d5a274845fe897f5a99fbf7e5f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:20.419808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf89477995f47a781c92ce8c0cb5b36, user_id=6e8f2d5a274845fe897f5a99fbf7e5f6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:20.430840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:20.465480 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2413/4825] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:58:20 2022] PUT /identity/v3/projects/bcf89477995f47a781c92ce8c0cb5b36/users/6e8f2d5a274845fe897f5a99fbf7e5f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:58:20.470303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:20.522672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4c24c-73b2-4028-b4f7-dabe81df45e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:20.810434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c1d11-b9a6-475c-ad2c-08c71f5ade4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:20.815308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1d11-b9a6-475c-ad2c-08c71f5ade4e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:20.815596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1d11-b9a6-475c-ad2c-08c71f5ade4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:20.817801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1d11-b9a6-475c-ad2c-08c71f5ade4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:20.822434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c1d11-b9a6-475c-ad2c-08c71f5ade4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:20.826233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c1d11-b9a6-475c-ad2c-08c71f5ade4e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:20.863851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:20.878785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2413/4826] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:20.881467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e44672-12df-4759-be21-bd59dfc5e378 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:20.914357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:20.915558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:20.915948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:20.916342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] PATH_INFO: `/v3/projects/bcf89477995f47a781c92ce8c0cb5b36/users/6e8f2d5a274845fe897f5a99fbf7e5f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:20.925850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf89477995f47a781c92ce8c0cb5b36, user_id=6e8f2d5a274845fe897f5a99fbf7e5f6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:20.929223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:20.974403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2414/4827] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:58:20 2022] PUT /identity/v3/projects/bcf89477995f47a781c92ce8c0cb5b36/users/6e8f2d5a274845fe897f5a99fbf7e5f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:58:20.986434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbfc54-aff5-41f6-8a75-d74429a85947 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:20.986850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbfc54-aff5-41f6-8a75-d74429a85947 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:20.987242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbfc54-aff5-41f6-8a75-d74429a85947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:21.071893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-02bbfc54-aff5-41f6-8a75-d74429a85947 None None] MFA Rules not processed for user `6e8f2d5a274845fe897f5a99fbf7e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:21.080777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02bbfc54-aff5-41f6-8a75-d74429a85947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:21.303138 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2414/4828] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:21.342930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:21.344890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:21.505890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f70393-b742-42ea-8ac7-c3bfc93f6478 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:21.522124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:21.523116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:21.523434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:21.523716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:21.687821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:21.689678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:21.706755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:21.737037 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2415/4829] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:58:28.591722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:28.592579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:28.592579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:28.709423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:28.709423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:28.806314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:28.929641 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2415/4830] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:28.956468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:28.961621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:29.305512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00813718-7870-430a-a481-6ed28fdc72d7 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:29.333136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:29.334969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:29.335523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:29.335977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:29.369618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:29.375393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:29.414869 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2416/4831] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 14:58:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 14:58:38.904949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:39.396618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=33 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:46.729607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:46.732984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:46.891194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adeb85-e48c-47dc-bae4-238f12e82530 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:46.901979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:46.903432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:46.904408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:46.904916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] PATH_INFO: `/v3/users/9fae0a09c9c74d6f95b07606f5ae828b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:46.908641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fae0a09c9c74d6f95b07606f5ae828b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:46.913026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:47.077115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fae0a09c9c74d6f95b07606f5ae828b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.132037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fae0a09c9c74d6f95b07606f5ae828b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.154936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fae0a09c9c74d6f95b07606f5ae828b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.156179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fae0a09c9c74d6f95b07606f5ae828b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.168983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-74cba0ba-1eba-4adf-bed5-baca58408a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fae0a09c9c74d6f95b07606f5ae828b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.179945 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2416/4832] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:58:46 2022] DELETE /identity/v3/users/9fae0a09c9c74d6f95b07606f5ae828b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:47.469592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:47.496931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34612da4-416a-4cb5-a05b-c2685faf20e4 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:47.644917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:47.645986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:47.646430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:47.646789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] PATH_INFO: `/v3/projects/5eb5073406d6445bbaaf9ce03f79dab3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:47.648422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb5073406d6445bbaaf9ce03f79dab3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:47.650782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:47.741850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb5073406d6445bbaaf9ce03f79dab3', 'request_id': 'req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.757769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb5073406d6445bbaaf9ce03f79dab3', 'request_id': 'req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.773732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb5073406d6445bbaaf9ce03f79dab3', 'request_id': 'req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.799929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] The token cache is being invalidate because project 5eb5073406d6445bbaaf9ce03f79dab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:58:47.800538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.802263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6ecba9ac-c524-41f8-97ec-07f2255d3fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:58:47.811541 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2417/4833] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:58:47 2022] DELETE /identity/v3/projects/5eb5073406d6445bbaaf9ce03f79dab3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:47.813287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da589d-fa7e-4831-a26b-e7d3161022f9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:47.814096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da589d-fa7e-4831-a26b-e7d3161022f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:47.814373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da589d-fa7e-4831-a26b-e7d3161022f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:47.859179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-24da589d-fa7e-4831-a26b-e7d3161022f9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:47.861485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24da589d-fa7e-4831-a26b-e7d3161022f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:48.037880 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2417/4834] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:58:48.054444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6e8a-3fd8-4a07-9d86-b68fb76e3afc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.055118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6e8a-3fd8-4a07-9d86-b68fb76e3afc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.055638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6e8a-3fd8-4a07-9d86-b68fb76e3afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.121041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6c7e6e8a-3fd8-4a07-9d86-b68fb76e3afc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:48.124993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6c7e6e8a-3fd8-4a07-9d86-b68fb76e3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:48.148864 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2418/4835] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:48.150088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da589d-fa7e-4831-a26b-e7d3161022f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:48.171661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da589d-fa7e-4831-a26b-e7d3161022f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:48.179846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:48.181056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.181574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.182081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.183564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:58:48.185088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:48.188450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:48.214817 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2418/4836] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:58:48.216171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e6e8a-3fd8-4a07-9d86-b68fb76e3afc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:48.235067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e6e8a-3fd8-4a07-9d86-b68fb76e3afc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:48.246748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:48.247625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.247925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.248205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.248936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:48.250996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:48.298046 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2419/4837] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:58:48 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:58:48.302432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:48.314897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94469ee-b9d4-49a6-a315-3ab6b61e5d1b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:48.320375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:48.398965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:48.399705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.400002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.400275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.401002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:48.403082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:48.430951 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2419/4838] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:58:48 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:58:48.435147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:48.448347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcce50-251d-4c7b-bb09-dc9d9a612346 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:48.456686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:48.457406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.457695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.458489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.459775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:48.460767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:48.479691 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2420/4839] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:58:48.481891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:48.494547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd47d44-ac29-466a-8983-b64c785d4cff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:48.501620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba036a9-a726-40da-8e72-481b58450530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:48.502333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba036a9-a726-40da-8e72-481b58450530 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.502827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba036a9-a726-40da-8e72-481b58450530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.503189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba036a9-a726-40da-8e72-481b58450530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.504335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba036a9-a726-40da-8e72-481b58450530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:48.506085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba036a9-a726-40da-8e72-481b58450530 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:48.529954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:48.531321 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2420/4840] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:58:48.542876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53734-a689-4887-8c65-8e362290f2cb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:48.550558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:48.553554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.554864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.555429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] PATH_INFO: `/v3/projects/c9a2c2bf376243c0ba8c572cc1bca54b/users/c1a4b4998ca6479f85adc2b9c65e1e06/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.592836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a2c2bf376243c0ba8c572cc1bca54b, user_id=c1a4b4998ca6479f85adc2b9c65e1e06, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:48.595854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:48.615337 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2421/4841] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:58:48 2022] PUT /identity/v3/projects/c9a2c2bf376243c0ba8c572cc1bca54b/users/c1a4b4998ca6479f85adc2b9c65e1e06/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:58:48.620833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.621152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.621437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.656413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:58:48.658720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:48.747320 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2421/4842] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:58:48.759094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:48.765018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:48.894947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:48.980032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f0343-f101-4241-a659-fdbfb6063ae5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:48.984937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:48.986625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:48.986958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:48.987334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:48.999233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:49.000910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:49.014981 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2422/4843] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:58:53.661219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:58:53.662968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:53.698517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4128-94f0-4664-a640-7acfe501a9c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:58:53.704466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2f91d-b6fb-4b8b-9b0a-f954795ca270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:58:53.705260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f91d-b6fb-4b8b-9b0a-f954795ca270 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:58:53.705642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f91d-b6fb-4b8b-9b0a-f954795ca270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:58:53.705990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f91d-b6fb-4b8b-9b0a-f954795ca270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:58:53.708270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9dc2f91d-b6fb-4b8b-9b0a-f954795ca270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:58:53.877898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2f91d-b6fb-4b8b-9b0a-f954795ca270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:58:53.879505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2f91d-b6fb-4b8b-9b0a-f954795ca270 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:58:53.903033 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2422/4844] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:58:59.008468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=14 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:03.889309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:13.134233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:13.136637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:13.513185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f682-572e-4235-acd0-1efdccd8458d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:13.530605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6765f-0fbd-4713-b5f3-5097a6f2a223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:13.531846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6765f-0fbd-4713-b5f3-5097a6f2a223 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:13.532363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6765f-0fbd-4713-b5f3-5097a6f2a223 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:13.532840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6765f-0fbd-4713-b5f3-5097a6f2a223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:13.537881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5ba6765f-0fbd-4713-b5f3-5097a6f2a223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:13.696399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6765f-0fbd-4713-b5f3-5097a6f2a223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:13.705651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6765f-0fbd-4713-b5f3-5097a6f2a223 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:13.758758 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2423/4845] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:16.555702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ac66-bc98-4cd1-be8d-ddb28b806830 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:16.556218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ac66-bc98-4cd1-be8d-ddb28b806830 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:16.556697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ac66-bc98-4cd1-be8d-ddb28b806830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:16.646198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cdb9ac66-bc98-4cd1-be8d-ddb28b806830 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:16.649954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cdb9ac66-bc98-4cd1-be8d-ddb28b806830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:16.862325 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2423/4846] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:16.869698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d76cd-34a5-4840-8dde-99e38a68d3cb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:16.870389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d76cd-34a5-4840-8dde-99e38a68d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:16.870389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d76cd-34a5-4840-8dde-99e38a68d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:16.921127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bb8d76cd-34a5-4840-8dde-99e38a68d3cb None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:16.923912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb8d76cd-34a5-4840-8dde-99e38a68d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:16.949553 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2424/4847] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:16.958365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ac66-bc98-4cd1-be8d-ddb28b806830 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:17.006570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ac66-bc98-4cd1-be8d-ddb28b806830 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:17.022025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:17.023471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:17.024023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:17.024948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:17.047119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:17.050537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:17.075239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2424/4848] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:18.158677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d76cd-34a5-4840-8dde-99e38a68d3cb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:18.189905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d76cd-34a5-4840-8dde-99e38a68d3cb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:18.209711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8f819-7ea8-499f-a6d4-38a56741815b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:18.210403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f819-7ea8-499f-a6d4-38a56741815b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:18.210690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f819-7ea8-499f-a6d4-38a56741815b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:18.210968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f819-7ea8-499f-a6d4-38a56741815b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:18.215485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-29c8f819-7ea8-499f-a6d4-38a56741815b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:18.252450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8f819-7ea8-499f-a6d4-38a56741815b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:18.254054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8f819-7ea8-499f-a6d4-38a56741815b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:18.295254 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2425/4849] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:19.015326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:19.051572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9abfe1-d0fd-49d7-ba04-c66b0a30ddf5 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:19.068749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8101cbf-69c5-4bbe-bd77-563466d4b2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:19.069594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101cbf-69c5-4bbe-bd77-563466d4b2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:19.071031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101cbf-69c5-4bbe-bd77-563466d4b2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:19.071792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101cbf-69c5-4bbe-bd77-563466d4b2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:19.077545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8101cbf-69c5-4bbe-bd77-563466d4b2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:19.348305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8101cbf-69c5-4bbe-bd77-563466d4b2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:19.350542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8101cbf-69c5-4bbe-bd77-563466d4b2f2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:19.376705 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2425/4850] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:19.687551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01438a-2c12-4b94-be5c-28d367280b90 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:19.687551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01438a-2c12-4b94-be5c-28d367280b90 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:19.688092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01438a-2c12-4b94-be5c-28d367280b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:19.786824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-da01438a-2c12-4b94-be5c-28d367280b90 None None] MFA Rules not processed for user `4813aa5acf744a8dac42de00d7e5a519`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:19.807045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da01438a-2c12-4b94-be5c-28d367280b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:19.840534 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2426/4851] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:20.055113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f88d0-be4e-47cc-9782-93ef65098428 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:20.055888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f88d0-be4e-47cc-9782-93ef65098428 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:20.056634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f88d0-be4e-47cc-9782-93ef65098428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:20.157894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-012f88d0-be4e-47cc-9782-93ef65098428 None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:20.163761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-012f88d0-be4e-47cc-9782-93ef65098428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:20.385708 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2426/4852] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:21.917051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01438a-2c12-4b94-be5c-28d367280b90 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:21.945364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01438a-2c12-4b94-be5c-28d367280b90 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:21.959370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894bd19-1553-45cc-a4d1-862175303079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:21.961585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bd19-1553-45cc-a4d1-862175303079 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:21.962109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bd19-1553-45cc-a4d1-862175303079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:21.964726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bd19-1553-45cc-a4d1-862175303079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:21.970226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1894bd19-1553-45cc-a4d1-862175303079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:22.020976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894bd19-1553-45cc-a4d1-862175303079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:22.023083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894bd19-1553-45cc-a4d1-862175303079 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:22.052310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2427/4853] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:26.095650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1595a-1090-4fb7-b9f1-65d472146e74 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:26.097282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1595a-1090-4fb7-b9f1-65d472146e74 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:26.097815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1595a-1090-4fb7-b9f1-65d472146e74 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:26.099867 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2427/4854] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 14:59:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:59:26.112393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e313-3433-4256-be2c-321f313cbb92 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:26.113645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e313-3433-4256-be2c-321f313cbb92 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:26.114214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e313-3433-4256-be2c-321f313cbb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:26.211442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-97b6e313-3433-4256-be2c-321f313cbb92 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:26.214612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-97b6e313-3433-4256-be2c-321f313cbb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:26.479867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:26.719975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2428/4855] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 14:59:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 609 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:26.827348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1595a-1090-4fb7-b9f1-65d472146e74 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:26.839713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fb1595a-1090-4fb7-b9f1-65d472146e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:26.892415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1595a-1090-4fb7-b9f1-65d472146e74 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:26.915631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:26.921975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:26.922367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:26.922635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:26.941701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:26.946113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:26.998801 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2428/4856] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:27.384234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf9e07-2742-431f-9fa6-42a34414dbb0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:27.385010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf9e07-2742-431f-9fa6-42a34414dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:27.385010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf9e07-2742-431f-9fa6-42a34414dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:27.428378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5edf9e07-2742-431f-9fa6-42a34414dbb0 None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:27.429731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5edf9e07-2742-431f-9fa6-42a34414dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:27.464000 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2429/4857] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:27.766388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:27.804434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8323e3-e559-4603-a849-898a27a6279e service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:27.835992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe02d9-3921-42b9-af50-6e4815786802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:27.850517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe02d9-3921-42b9-af50-6e4815786802 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:27.850988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe02d9-3921-42b9-af50-6e4815786802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:27.852663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe02d9-3921-42b9-af50-6e4815786802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:27.860366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cfe02d9-3921-42b9-af50-6e4815786802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:27.894223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:27.905571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe02d9-3921-42b9-af50-6e4815786802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:27.907597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe02d9-3921-42b9-af50-6e4815786802 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:27.958237 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2429/4858] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:35.404396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf9e07-2742-431f-9fa6-42a34414dbb0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:35.440469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf9e07-2742-431f-9fa6-42a34414dbb0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:35.451817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:35.453045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:35.453572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:35.454088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:35.474044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:35.521438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:35.524578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:35.575714 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2430/4859] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:37.926920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:41.291746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f954-e01a-4f3b-88a5-f1abdc43499b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:41.292302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f954-e01a-4f3b-88a5-f1abdc43499b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:41.292982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f954-e01a-4f3b-88a5-f1abdc43499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:41.356447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b174f954-e01a-4f3b-88a5-f1abdc43499b None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:41.359601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b174f954-e01a-4f3b-88a5-f1abdc43499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:41.384196 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2430/4860] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:45.552725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=29 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:46.433006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:46.436362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:46.558297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffadc8-d4ca-4c69-b474-b8003956b11f service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:46.570562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:46.572861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:46.573446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:46.574404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] PATH_INFO: `/v3/users/b06a5d6f31ea4d4a9a7e69f759a3c7ce` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:46.577573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06a5d6f31ea4d4a9a7e69f759a3c7ce)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:46.585110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:46.721284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:46.758928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:46.761269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:46.780408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:46.781802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3ce0e1a-570c-4154-b6be-d6556bbd699b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:46.838123 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2431/4861] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:59:46 2022] DELETE /identity/v3/users/b06a5d6f31ea4d4a9a7e69f759a3c7ce => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:59:47.444445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f954-e01a-4f3b-88a5-f1abdc43499b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:47.483811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f954-e01a-4f3b-88a5-f1abdc43499b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:47.777934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:47.781209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:47.781209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:47.781209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] PATH_INFO: `/v3/projects/27951e61632946f58c199f09723d6fdd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:47.785436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27951e61632946f58c199f09723d6fdd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:47.790314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:47.937499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27951e61632946f58c199f09723d6fdd', 'request_id': 'req-34772240-5857-4d3c-a133-85371a289a66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:47.953317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27951e61632946f58c199f09723d6fdd', 'request_id': 'req-34772240-5857-4d3c-a133-85371a289a66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:47.972310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27951e61632946f58c199f09723d6fdd', 'request_id': 'req-34772240-5857-4d3c-a133-85371a289a66'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:48.007875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] The token cache is being invalidate because project 27951e61632946f58c199f09723d6fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:59:48.008805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:48.010683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34772240-5857-4d3c-a133-85371a289a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:48.025227 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2431/4862] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:59:47 2022] DELETE /identity/v3/projects/27951e61632946f58c199f09723d6fdd => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:59:48.025878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f26ca-f35f-40f6-a912-a052c8f1fae4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.026757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f26ca-f35f-40f6-a912-a052c8f1fae4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.027388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f26ca-f35f-40f6-a912-a052c8f1fae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.078081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-156f26ca-f35f-40f6-a912-a052c8f1fae4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:48.082091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-156f26ca-f35f-40f6-a912-a052c8f1fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:48.308167 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2432/4863] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:48.317770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0b3a-9291-4d2c-a994-85b5b9cf56c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.318418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0b3a-9291-4d2c-a994-85b5b9cf56c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.318926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0b3a-9291-4d2c-a994-85b5b9cf56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.362712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-430a0b3a-9291-4d2c-a994-85b5b9cf56c1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:48.365276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-430a0b3a-9291-4d2c-a994-85b5b9cf56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:48.388196 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2432/4864] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:48.397041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f26ca-f35f-40f6-a912-a052c8f1fae4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:48.423387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f26ca-f35f-40f6-a912-a052c8f1fae4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:48.444622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:48.445664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.445969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.446700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.447853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:59:48.448194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:48.450088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:48.476350 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2433/4865] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:59:48.477828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a0b3a-9291-4d2c-a994-85b5b9cf56c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:48.498497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a0b3a-9291-4d2c-a994-85b5b9cf56c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:48.508791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:48.510199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.510694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.511308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.512236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:48.514741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:48.566704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:48.579126 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2433/4866] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:59:48 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:59:48.585794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56ca45-a773-4e61-aced-8e44e2dd044d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:48.666573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:48.711308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:48.712291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.712699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.713116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.714207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:48.718213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:48.761625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:48.773405 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2434/4867] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:59:48 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:59:48.776681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76087f-f9c7-46a2-93fb-c491aad015ad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:48.783913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:48.784902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.785197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.785484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.786263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:48.788107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:48.814768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:48.826021 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2434/4868] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:59:48.831072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b99f-e27b-438c-9ba8-15eb51ff8631 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:48.838924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664caa0e-4df4-4109-9027-5dcd1a236581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:48.839689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664caa0e-4df4-4109-9027-5dcd1a236581 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.839987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664caa0e-4df4-4109-9027-5dcd1a236581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.840289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664caa0e-4df4-4109-9027-5dcd1a236581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.841270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664caa0e-4df4-4109-9027-5dcd1a236581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:48.843724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664caa0e-4df4-4109-9027-5dcd1a236581 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:48.868095 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2435/4869] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:59:48.871531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:48.894073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9710ad7-b686-46e2-ad86-6a2d9d90ccc3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:48.902531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:48.903685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.903896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.904377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] PATH_INFO: `/v3/projects/eccfc3dd1edc424cb8f3916346f75da9/users/7690a000a2ea48329fe3e426b901c5d7/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:48.929784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccfc3dd1edc424cb8f3916346f75da9, user_id=7690a000a2ea48329fe3e426b901c5d7, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:48.933664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:48.972416 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2435/4870] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:59:48 2022] PUT /identity/v3/projects/eccfc3dd1edc424cb8f3916346f75da9/users/7690a000a2ea48329fe3e426b901c5d7/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:59:48.973763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:48.974368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:48.977448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:49.057044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] MFA Rules not processed for user `7690a000a2ea48329fe3e426b901c5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:49.060024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:49.259498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:49.262758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:49.279332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2436/4871] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:49.342468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:49.421390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca898-35e7-4f30-8cc8-021bb8467140 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:49.426175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f0f1-2237-41cd-9868-9a549d1e5c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:49.427191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f0f1-2237-41cd-9868-9a549d1e5c9a service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:49.427743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f0f1-2237-41cd-9868-9a549d1e5c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:49.430415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f0f1-2237-41cd-9868-9a549d1e5c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:49.447879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f0f1-2237-41cd-9868-9a549d1e5c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:49.449938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f0f1-2237-41cd-9868-9a549d1e5c9a service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:49.480239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2436/4872] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:59:54.193444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:54.197048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:54.543319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6b78e-29c1-4db4-b272-18032e4bd4d8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:54.568137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:54.593604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:54.594083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:54.594587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] PATH_INFO: `/v3/users/338e339b033d4024946a2b11e1c08fcc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:54.609824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338e339b033d4024946a2b11e1c08fcc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:54.620650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:54.859757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338e339b033d4024946a2b11e1c08fcc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:54.869868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:54.971746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338e339b033d4024946a2b11e1c08fcc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:54.974999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338e339b033d4024946a2b11e1c08fcc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:55.047456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338e339b033d4024946a2b11e1c08fcc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:55.049349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338e339b033d4024946a2b11e1c08fcc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:55.085579 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2437/4873] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:59:54 2022] DELETE /identity/v3/users/338e339b033d4024946a2b11e1c08fcc => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:59:55.092381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:55.093202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:55.093202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:55.143007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:55.154858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:55.412919 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2437/4874] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:55.466686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:55.468963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:55.610204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d2c76-98d2-4d86-83ac-222f82f98df7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:55.624209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f860c-ce61-4921-ba97-9a13da371dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:55.625092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f860c-ce61-4921-ba97-9a13da371dff service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:55.625493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f860c-ce61-4921-ba97-9a13da371dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:55.625884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f860c-ce61-4921-ba97-9a13da371dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:55.648616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f860c-ce61-4921-ba97-9a13da371dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:55.650263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f860c-ce61-4921-ba97-9a13da371dff service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:55.673391 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2438/4875] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:59:57.014672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:57.018586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:57.045421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a692-2a28-4f03-b433-1426e330ecae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:57.059206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:57.060464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:57.061161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:57.064113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] PATH_INFO: `/v3/projects/3f7d1b6aec0f40f19187dc4672e3bcac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:57.067803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7d1b6aec0f40f19187dc4672e3bcac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:57.069858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:57.200825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7d1b6aec0f40f19187dc4672e3bcac', 'request_id': 'req-60d40039-ee5b-4fc6-b362-5d81769a2f78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:57.217943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7d1b6aec0f40f19187dc4672e3bcac', 'request_id': 'req-60d40039-ee5b-4fc6-b362-5d81769a2f78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:57.231330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7d1b6aec0f40f19187dc4672e3bcac', 'request_id': 'req-60d40039-ee5b-4fc6-b362-5d81769a2f78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:57.271249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] The token cache is being invalidate because project 3f7d1b6aec0f40f19187dc4672e3bcac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:59:57.271580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:57.273393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-60d40039-ee5b-4fc6-b362-5d81769a2f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:59:57.276618 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2438/4876] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:59:57 2022] DELETE /identity/v3/projects/3f7d1b6aec0f40f19187dc4672e3bcac => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:59:57.281335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb1eed-d234-4619-b39d-f4ea95f8b7fe None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:57.282201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb1eed-d234-4619-b39d-f4ea95f8b7fe None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:57.282667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb1eed-d234-4619-b39d-f4ea95f8b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:57.326204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-facb1eed-d234-4619-b39d-f4ea95f8b7fe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:57.328542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-facb1eed-d234-4619-b39d-f4ea95f8b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:57.567100 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2439/4877] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:59:57.578515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9546e62-e145-4654-8047-3115b0b4ccc5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:57.583768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9546e62-e145-4654-8047-3115b0b4ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:57.584778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9546e62-e145-4654-8047-3115b0b4ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:57.674702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c9546e62-e145-4654-8047-3115b0b4ccc5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:57.678956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9546e62-e145-4654-8047-3115b0b4ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:57.727753 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2439/4878] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:59:57.730004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb1eed-d234-4619-b39d-f4ea95f8b7fe None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:57.771485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb1eed-d234-4619-b39d-f4ea95f8b7fe None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:57.797225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:57.798720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:57.805204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:57.805664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:57.806579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:59:57.808356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:57.810271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:57.862495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9546e62-e145-4654-8047-3115b0b4ccc5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:57.867136 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2440/4879] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 14:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:59:57.886608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9546e62-e145-4654-8047-3115b0b4ccc5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:57.909712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:57.911151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:57.911596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:57.911987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:57.913197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:57.917936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:57.986668 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2440/4880] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 14:59:57 2022] POST /identity/v3/projects => generated 357 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:59:57.991780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:58.005463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b477-d798-4846-a418-cfc3209ac77b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:58.158245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:58.172116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:58.172912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:58.173443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:58.174733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:58.175554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:58.178248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:58.232031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:58.233064 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2441/4881] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 14:59:57 2022] POST /identity/v3/users => generated 279 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:59:58.254220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8be4-f263-49a3-b5c2-955a5ed15d33 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:58.277434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:58.280925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:58.281364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:58.281886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:58.283073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:58.292266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:58.309849 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2441/4882] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:59:58.313729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:58.370064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59513a71-90e3-48b3-922a-d65cf10a168a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:58.393311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c566777-b267-4488-b653-57af2dd5a1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:58.405979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c566777-b267-4488-b653-57af2dd5a1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:58.406543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c566777-b267-4488-b653-57af2dd5a1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:58.407028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c566777-b267-4488-b653-57af2dd5a1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:58.409475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c566777-b267-4488-b653-57af2dd5a1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:58.413421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c566777-b267-4488-b653-57af2dd5a1d9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:58.463042 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2442/4883] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:59:58.467468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:58.485910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b68e-4f66-41c5-87eb-20d789b1e981 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:58.509554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:58.510520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:58.510883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:58.511176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] PATH_INFO: `/v3/projects/be982066584d4efd889eba2dd065fa0a/users/3917b3597a134b8aa6b02fdad1cb67aa/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:58.514530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:58.571652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be982066584d4efd889eba2dd065fa0a, user_id=3917b3597a134b8aa6b02fdad1cb67aa, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:58.575104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:58.618241 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2442/4884] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 14:59:58 2022] PUT /identity/v3/projects/be982066584d4efd889eba2dd065fa0a/users/3917b3597a134b8aa6b02fdad1cb67aa/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:59:58.618714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:58.619006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:58.619311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:58.680999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] MFA Rules not processed for user `3917b3597a134b8aa6b02fdad1cb67aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:59:58.684065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:58.875525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2443/4885] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:59:58.917742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:58.922668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:59.148461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd00dce-317e-4fbc-81a9-62d1a154694d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:59.156764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:59.158519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:59.158519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:59.158767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:59.173611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:59.175659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:59:59.209238 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2443/4886] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 14:59:58 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:59:59.557329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:59:59.560527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:59:59.855733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bbb54-5219-43d3-a93f-8e5e48efc694 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:59:59.868203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:59:59.869961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:59:59.870484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:59:59.871176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] PATH_INFO: `/v3/users/2625ce3aa5034d048494fca0dc403c51` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:59:59.873931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2625ce3aa5034d048494fca0dc403c51)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:59:59.878623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:00.057652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2625ce3aa5034d048494fca0dc403c51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.086910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2625ce3aa5034d048494fca0dc403c51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.088365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2625ce3aa5034d048494fca0dc403c51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.107466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:00.148103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2625ce3aa5034d048494fca0dc403c51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.149810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8072dc06-ba12-4258-85ce-3bc09c7607cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2625ce3aa5034d048494fca0dc403c51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.197707 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2444/4887] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:59:59 2022] DELETE /identity/v3/users/2625ce3aa5034d048494fca0dc403c51 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:00.545095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:00.555113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:00.615592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae5765-6241-4e25-b9e0-165f6ab10618 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:00.802457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:00.803420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:00.803714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:00.804000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] PATH_INFO: `/v3/users/5b3457c7b3174bb1a10e53aded810c19` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:00.805383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3457c7b3174bb1a10e53aded810c19)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:00.809017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:00.931021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3457c7b3174bb1a10e53aded810c19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.951330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3457c7b3174bb1a10e53aded810c19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.966717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3457c7b3174bb1a10e53aded810c19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.967861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3457c7b3174bb1a10e53aded810c19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:00.995324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3457c7b3174bb1a10e53aded810c19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:01.024354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2444/4888] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:00 2022] DELETE /identity/v3/users/5b3457c7b3174bb1a10e53aded810c19 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:01.030231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:01.030840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:01.031790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:01.151961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:01.154368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:01.443147 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2445/4889] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:01.541503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:01.545237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:01.576571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:01.705589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc3dee-979f-46cf-8a55-cf495a8568e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:01.715033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae717c-c1a0-4451-bf54-6ce2f09f346e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:01.716434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae717c-c1a0-4451-bf54-6ce2f09f346e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:01.722083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae717c-c1a0-4451-bf54-6ce2f09f346e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:01.722622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae717c-c1a0-4451-bf54-6ce2f09f346e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:01.744299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae717c-c1a0-4451-bf54-6ce2f09f346e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:01.751776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae717c-c1a0-4451-bf54-6ce2f09f346e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:01.752510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:01.754764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:01.768279 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2445/4890] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:01.804455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cdc3a-5850-440a-b16f-f01f77cce91e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:01.865940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:01.878045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:01.885322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:01.888152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] PATH_INFO: `/v3/projects/bcf2159a7a09439aa1be7f78d8b9d1eb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:01.898270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf2159a7a09439aa1be7f78d8b9d1eb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:01.913479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:02.083525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'request_id': 'req-2f2c44cf-d90f-48a8-b870-a03007922712'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.108092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'request_id': 'req-2f2c44cf-d90f-48a8-b870-a03007922712'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.119400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'request_id': 'req-2f2c44cf-d90f-48a8-b870-a03007922712'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.140603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] The token cache is being invalidate because project bcf2159a7a09439aa1be7f78d8b9d1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:02.140907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.142726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.147892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2446/4891] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:01 2022] DELETE /identity/v3/projects/bcf2159a7a09439aa1be7f78d8b9d1eb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:02.151578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a26c-ee13-4b56-837b-07556166a1b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:02.151900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a26c-ee13-4b56-837b-07556166a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:02.152557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148a26c-ee13-4b56-837b-07556166a1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:02.229298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f148a26c-ee13-4b56-837b-07556166a1b8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:02.231298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f148a26c-ee13-4b56-837b-07556166a1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:02.442995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:02.444753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:02.494679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2446/4892] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:02.503934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1cf7-cba2-4298-8bb5-e4a6056a4bb1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:02.504600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1cf7-cba2-4298-8bb5-e4a6056a4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:02.505198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1cf7-cba2-4298-8bb5-e4a6056a4bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:02.570522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4bcc1cf7-cba2-4298-8bb5-e4a6056a4bb1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:02.578475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4bcc1cf7-cba2-4298-8bb5-e4a6056a4bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:02.614504 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2447/4893] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:02.618972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1cf7-cba2-4298-8bb5-e4a6056a4bb1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:02.632150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c44cf-d90f-48a8-b870-a03007922712 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:02.641236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:02.642806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:02.643118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:02.643470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] PATH_INFO: `/v3/projects/6fb5b8e72cc942d4aae43d545943f1d0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:02.645041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb5b8e72cc942d4aae43d545943f1d0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:02.647617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:02.657422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1cf7-cba2-4298-8bb5-e4a6056a4bb1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:02.667049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:02.677858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:02.679640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:02.680562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:02.681446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:02.685756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:02.687150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:02.694968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:02.745885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb5b8e72cc942d4aae43d545943f1d0', 'request_id': 'req-f598af61-ae59-46b2-b666-b38a19fb8000'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.761152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb5b8e72cc942d4aae43d545943f1d0', 'request_id': 'req-f598af61-ae59-46b2-b666-b38a19fb8000'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.773837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb5b8e72cc942d4aae43d545943f1d0', 'request_id': 'req-f598af61-ae59-46b2-b666-b38a19fb8000'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.802474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2448/4894] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:00:02.804675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:02.851961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] The token cache is being invalidate because project 6fb5b8e72cc942d4aae43d545943f1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:02.852901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.854161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:02.868487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2447/4895] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:02 2022] DELETE /identity/v3/projects/6fb5b8e72cc942d4aae43d545943f1d0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:02.875392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:02.890017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae495b0-e7d7-45de-b1a4-d178e14b2350 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:02.900795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:03.171050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:03.176491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:03.176961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:03.177603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:03.178689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:03.186181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:03.207852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598af61-ae59-46b2-b666-b38a19fb8000 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:03.226092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:03.227154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:03.227495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:03.227734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] PATH_INFO: `/v3/users/d5e1a8e590814a72a5e3fdb843e2134c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:03.232922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e1a8e590814a72a5e3fdb843e2134c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:03.234961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:03.282961 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2449/4896] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:02 2022] POST /identity/v3/projects => generated 371 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:03.284874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:03.287518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:03.318810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:03.433615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e1a8e590814a72a5e3fdb843e2134c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:03.475595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e1a8e590814a72a5e3fdb843e2134c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:03.477024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e1a8e590814a72a5e3fdb843e2134c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:03.489277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b837f-d737-43a1-9d38-37f9a415b2be admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:03.495304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:03.496021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:03.496344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:03.497276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:03.498081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:03.500620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:03.520238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e1a8e590814a72a5e3fdb843e2134c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:03.522504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e1a8e590814a72a5e3fdb843e2134c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:03.541875 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2450/4897] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:03 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:03.543092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:03.545915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:03.568651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa7551-32ca-46d5-b695-258073ab2020 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:03.569644 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2448/4898] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:02 2022] DELETE /identity/v3/users/d5e1a8e590814a72a5e3fdb843e2134c => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:03.800755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:03.802486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:03.805226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:03.808815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:03.812800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:03.822548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:03.904091 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2451/4899] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:03.909630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:03.998327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcad89-9baf-404f-aa00-561cf0bb3aa7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:04.038586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65782de6-18a9-4fa8-a2e4-506460178906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:04.040538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65782de6-18a9-4fa8-a2e4-506460178906 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:04.041273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65782de6-18a9-4fa8-a2e4-506460178906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:04.041930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65782de6-18a9-4fa8-a2e4-506460178906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:04.043573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65782de6-18a9-4fa8-a2e4-506460178906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:04.049081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65782de6-18a9-4fa8-a2e4-506460178906 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:04.098928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2449/4900] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:00:04.101584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:04.136695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3192c-8d41-46ac-96c5-42aa95769229 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:04.148309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:04.150056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:04.150658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:04.158569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] PATH_INFO: `/v3/projects/f363dcbe8c20457e9cba3d8cdcfa6eb0/users/139fdab5e3524b4799be9fbc2b1e8c42/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:04.208722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f363dcbe8c20457e9cba3d8cdcfa6eb0, user_id=139fdab5e3524b4799be9fbc2b1e8c42, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:04.214239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:04.286489 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2452/4901] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:04 2022] PUT /identity/v3/projects/f363dcbe8c20457e9cba3d8cdcfa6eb0/users/139fdab5e3524b4799be9fbc2b1e8c42/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:04.290023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724820e-3172-438e-aa4d-d50310b7e0f8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:04.290621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724820e-3172-438e-aa4d-d50310b7e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:04.291180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724820e-3172-438e-aa4d-d50310b7e0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:04.335842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:04.410613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4724820e-3172-438e-aa4d-d50310b7e0f8 None None] MFA Rules not processed for user `139fdab5e3524b4799be9fbc2b1e8c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:04.412835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4724820e-3172-438e-aa4d-d50310b7e0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:04.701480 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2450/4902] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:04.917391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:04.920647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:05.143529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521094eb-2fb1-4422-8de2-ae8ead303de8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:05.151464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:05.163373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:05.163373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:05.163373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] PATH_INFO: `/v3/projects/2f76100ada084829aa5daf81e1812863` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:05.163373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f76100ada084829aa5daf81e1812863)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:05.163373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:05.191029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:05.261036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f76100ada084829aa5daf81e1812863', 'request_id': 'req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.280880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f76100ada084829aa5daf81e1812863', 'request_id': 'req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.293198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f76100ada084829aa5daf81e1812863', 'request_id': 'req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.325413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] The token cache is being invalidate because project 2f76100ada084829aa5daf81e1812863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:05.325768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.326512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.328572 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2453/4903] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:04 2022] DELETE /identity/v3/projects/2f76100ada084829aa5daf81e1812863 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:05.336089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724820e-3172-438e-aa4d-d50310b7e0f8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:05.394526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724820e-3172-438e-aa4d-d50310b7e0f8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:05.625492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:05.640315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:05.645230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:05.646395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:05.646684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:05.647167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] PATH_INFO: `/v3/users/6e8f2d5a274845fe897f5a99fbf7e5f6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:05.649077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8f2d5a274845fe897f5a99fbf7e5f6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:05.651783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:05.801276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8f2d5a274845fe897f5a99fbf7e5f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.837454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8f2d5a274845fe897f5a99fbf7e5f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.838287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8f2d5a274845fe897f5a99fbf7e5f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.850847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8f2d5a274845fe897f5a99fbf7e5f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.851681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b70c9440-ae1a-40ae-afd4-2ef5f635aff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8f2d5a274845fe897f5a99fbf7e5f6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:05.905742 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2451/4904] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:05 2022] DELETE /identity/v3/users/6e8f2d5a274845fe897f5a99fbf7e5f6 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:06.081331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12a9b-ff67-4671-b9f9-9a5a5734245a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:06.400883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:06.403556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:06.404357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:06.404632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:06.413575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:06.639658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:06.703528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:06.707953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:06.754895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2454/4905] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 1130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:07.269475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e987aba-a6b9-4639-8034-891c2a2332bd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:07.269960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e987aba-a6b9-4639-8034-891c2a2332bd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:07.270046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e987aba-a6b9-4639-8034-891c2a2332bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:07.341333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9e987aba-a6b9-4639-8034-891c2a2332bd None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:07.347876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9e987aba-a6b9-4639-8034-891c2a2332bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:07.373354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:07.375122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:07.400872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:07.613879 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2452/4906] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:07.701755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cae82-4363-4c31-84e4-d78542453a40 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:07.727017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:07.727825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:07.728118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:07.728399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] PATH_INFO: `/v3/projects/bcf89477995f47a781c92ce8c0cb5b36` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:07.731686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf89477995f47a781c92ce8c0cb5b36)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:07.734511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:07.874674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf89477995f47a781c92ce8c0cb5b36', 'request_id': 'req-4cc4c447-a03c-49e3-bfd8-516e9053f739'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:07.885119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf89477995f47a781c92ce8c0cb5b36', 'request_id': 'req-4cc4c447-a03c-49e3-bfd8-516e9053f739'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:07.902682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf89477995f47a781c92ce8c0cb5b36', 'request_id': 'req-4cc4c447-a03c-49e3-bfd8-516e9053f739'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:07.936587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] The token cache is being invalidate because project bcf89477995f47a781c92ce8c0cb5b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:07.936899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:07.945947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cc4c447-a03c-49e3-bfd8-516e9053f739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:07.951608 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2455/4907] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:07 2022] DELETE /identity/v3/projects/bcf89477995f47a781c92ce8c0cb5b36 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:07.953445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbf853-6857-4849-bda5-97d3085613b1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:07.953970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbf853-6857-4849-bda5-97d3085613b1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:07.954267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbf853-6857-4849-bda5-97d3085613b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:08.057418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f8cbf853-6857-4849-bda5-97d3085613b1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:08.061557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f8cbf853-6857-4849-bda5-97d3085613b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:08.285700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57d03-cc86-428f-a813-24a0ceaf8a44 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:08.286037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57d03-cc86-428f-a813-24a0ceaf8a44 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:08.286271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57d03-cc86-428f-a813-24a0ceaf8a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:08.289519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2453/4908] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:08.326013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-18f57d03-cc86-428f-a813-24a0ceaf8a44 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:08.327293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18f57d03-cc86-428f-a813-24a0ceaf8a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:08.353042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbf853-6857-4849-bda5-97d3085613b1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:08.358501 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2456/4909] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:08.368323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbf853-6857-4849-bda5-97d3085613b1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:08.384868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:08.385574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:08.386316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:08.386535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:08.387325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:08.392973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:08.394711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:08.440122 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2454/4910] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:00:08.452932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f57d03-cc86-428f-a813-24a0ceaf8a44 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:08.465306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f57d03-cc86-428f-a813-24a0ceaf8a44 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:08.487658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:08.488532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:08.488847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:08.489297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:08.492074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:08.496137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:08.587421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2457/4911] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:08 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:08.591650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:08.613390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249688a-57d0-4792-b8c7-8932cb74a954 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:08.994222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:08.996803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:08.998258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:08.998991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:09.007826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:09.016568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:09.104839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2455/4912] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:08 2022] POST /identity/v3/users => generated 283 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:09.108567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:09.140084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b833-045b-4a7c-b358-98a63d2a820e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:09.170895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:09.172939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:09.178093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:09.182635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:09.198511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:09.211760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:09.279412 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2458/4913] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:00:09.283590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:09.304103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be8360-3b25-47ee-9630-ea6b084d38dc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:09.318871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495c92b-ef7b-4ef9-8865-98b7cee0ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:09.319862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495c92b-ef7b-4ef9-8865-98b7cee0ced8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:09.320181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495c92b-ef7b-4ef9-8865-98b7cee0ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:09.321544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495c92b-ef7b-4ef9-8865-98b7cee0ced8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:09.323200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495c92b-ef7b-4ef9-8865-98b7cee0ced8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:09.325149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495c92b-ef7b-4ef9-8865-98b7cee0ced8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:09.358101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2456/4914] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:09.360260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:09.388396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b315078-8c96-4548-a51e-147c795c41c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:09.416555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:09.417629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:09.418043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:09.418451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] PATH_INFO: `/v3/projects/b6e046f739df4473b8bb027968016bf4/users/08a298c4b8da438a9eea25c393d235c1/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:09.478996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e046f739df4473b8bb027968016bf4, user_id=08a298c4b8da438a9eea25c393d235c1, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:09.482065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:09.531449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46351f3-b120-40cc-9cee-5f43bec20543 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:09.532152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46351f3-b120-40cc-9cee-5f43bec20543 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:09.532562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46351f3-b120-40cc-9cee-5f43bec20543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:09.534161 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2459/4915] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:09 2022] PUT /identity/v3/projects/b6e046f739df4473b8bb027968016bf4/users/08a298c4b8da438a9eea25c393d235c1/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:09.605599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e46351f3-b120-40cc-9cee-5f43bec20543 None None] MFA Rules not processed for user `08a298c4b8da438a9eea25c393d235c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:09.607022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e46351f3-b120-40cc-9cee-5f43bec20543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:09.675400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:09.797296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:09.800091 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2457/4916] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:09.811537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:10.094481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf23bb-cf84-4801-8d2c-af3b5706babe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:10.125709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:10.125709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:10.125709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:10.125709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:10.126211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:10.134899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:10.240443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46351f3-b120-40cc-9cee-5f43bec20543 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:10.246937 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2460/4917] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:09 2022] POST /identity/v3/projects => generated 365 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:10.264182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46351f3-b120-40cc-9cee-5f43bec20543 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:10.407323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:10.409392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:10.409966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:10.410681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:10.411804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:10.414455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:10.453317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:10.454075 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2458/4918] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:10 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:10.475531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49aec5-559b-499c-8e7b-8283f9033854 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:10.487731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:10.489910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:10.490661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:10.491165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:10.494174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:10.496420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:10.523240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:10.534090 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2461/4919] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:10.539487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20751-77b3-4630-baf1-46cbffce1718 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:10.545731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:10.547543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:10.548233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:10.548826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] PATH_INFO: `/v3/projects/fe9c4ad4093041609cc24f610db884fe/users/552fc89e4850460f9d422768c4d9f8b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:10.573413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c4ad4093041609cc24f610db884fe, user_id=552fc89e4850460f9d422768c4d9f8b1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:10.578753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:10.615321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:10.616154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2459/4920] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:10 2022] PUT /identity/v3/projects/fe9c4ad4093041609cc24f610db884fe/users/552fc89e4850460f9d422768c4d9f8b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:10.635060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b819-4f27-4998-999d-389423e7a24b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:10.783682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dba76-e28f-4887-92bc-a84005154349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:10.785374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dba76-e28f-4887-92bc-a84005154349 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:10.787721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dba76-e28f-4887-92bc-a84005154349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:10.788772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dba76-e28f-4887-92bc-a84005154349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:10.789772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dba76-e28f-4887-92bc-a84005154349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:10.791749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dba76-e28f-4887-92bc-a84005154349 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:10.811533 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2462/4921] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:10.817966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:10.838130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983b3d-2c81-4a06-84c0-57fe8eda8a68 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:10.889794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:10.893454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:10.894616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:10.894616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] PATH_INFO: `/v3/projects/fe9c4ad4093041609cc24f610db884fe/users/552fc89e4850460f9d422768c4d9f8b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:10.907375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c4ad4093041609cc24f610db884fe, user_id=552fc89e4850460f9d422768c4d9f8b1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:10.911561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:10.952054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2460/4922] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:10 2022] PUT /identity/v3/projects/fe9c4ad4093041609cc24f610db884fe/users/552fc89e4850460f9d422768c4d9f8b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:10.952289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:10.952510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:10.952817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:11.046516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] MFA Rules not processed for user `552fc89e4850460f9d422768c4d9f8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:11.047845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:11.338133 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2463/4923] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:11.362679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:11.365009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:11.607257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168521cf-661c-4f87-b22c-f4aef575751f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:11.620093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352cb55-dc95-4bff-b6be-08b3c63e5516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:11.625045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352cb55-dc95-4bff-b6be-08b3c63e5516 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:11.625501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352cb55-dc95-4bff-b6be-08b3c63e5516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:11.625950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352cb55-dc95-4bff-b6be-08b3c63e5516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:11.662830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352cb55-dc95-4bff-b6be-08b3c63e5516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:11.666136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352cb55-dc95-4bff-b6be-08b3c63e5516 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:11.697822 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2461/4924] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:19.075420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:19.075420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:19.075420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:19.385737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7f46b-2c13-457c-b8fd-544971c17454 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:19.395542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:19.397942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:19.398794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:19.399504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] PATH_INFO: `/v3/users/139fdab5e3524b4799be9fbc2b1e8c42` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:19.403652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139fdab5e3524b4799be9fbc2b1e8c42)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:19.412061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:19.568695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139fdab5e3524b4799be9fbc2b1e8c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:19.662263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139fdab5e3524b4799be9fbc2b1e8c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:19.684107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139fdab5e3524b4799be9fbc2b1e8c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:19.684896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139fdab5e3524b4799be9fbc2b1e8c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:19.705515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139fdab5e3524b4799be9fbc2b1e8c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:19.714008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2464/4925] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:19 2022] DELETE /identity/v3/users/139fdab5e3524b4799be9fbc2b1e8c42 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:19.721694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:19.722372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:19.722714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:19.760172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:19.764552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:19.784846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:19.959161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2462/4926] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:19.980057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:19.980925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:20.012324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:20.014006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:20.215858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57e91c-e115-41b3-bba0-ec5603854f92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:20.226501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d723a6-4477-40ef-99d6-9d5c824a75b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:20.228543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d723a6-4477-40ef-99d6-9d5c824a75b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:20.229109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d723a6-4477-40ef-99d6-9d5c824a75b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:20.229615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d723a6-4477-40ef-99d6-9d5c824a75b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:20.249994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a00de-be2b-420d-b441-a59523fdee18 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:20.252430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d723a6-4477-40ef-99d6-9d5c824a75b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:20.257421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d723a6-4477-40ef-99d6-9d5c824a75b7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:20.268328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:20.269036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:20.269327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:20.269611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:20.274771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:20.294014 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2465/4927] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:20.295799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:20.299683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:20.300176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:20.378797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:20.380537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:20.441217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:20.528226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2466/4928] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:20.529819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:20.531619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:20.549227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5822d-6f2a-4a81-97b4-f86bc45908c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:20.554404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bf9f9-8688-415f-b2bc-87ef307cc2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:20.555221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf9f9-8688-415f-b2bc-87ef307cc2da service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:20.556118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf9f9-8688-415f-b2bc-87ef307cc2da service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:20.556543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bf9f9-8688-415f-b2bc-87ef307cc2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:20.560362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-340bf9f9-8688-415f-b2bc-87ef307cc2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:20.619384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:20.622509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:20.671379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2463/4929] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:20.682936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf9f9-8688-415f-b2bc-87ef307cc2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:20.684712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bf9f9-8688-415f-b2bc-87ef307cc2da service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:20.709910 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2467/4930] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:22.037405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:22.040336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:22.130884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8708-78ed-4d99-a948-e960ae646b15 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:22.147263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:22.155157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:22.156232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:22.156954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] PATH_INFO: `/v3/projects/f363dcbe8c20457e9cba3d8cdcfa6eb0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:22.162100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f363dcbe8c20457e9cba3d8cdcfa6eb0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:22.166717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:22.316608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f363dcbe8c20457e9cba3d8cdcfa6eb0', 'request_id': 'req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:22.347005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f363dcbe8c20457e9cba3d8cdcfa6eb0', 'request_id': 'req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:22.370925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f363dcbe8c20457e9cba3d8cdcfa6eb0', 'request_id': 'req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:22.375753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:22.428786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] The token cache is being invalidate because project f363dcbe8c20457e9cba3d8cdcfa6eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:22.429828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:22.431791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73c9a42d-31fc-482e-896f-ca8b0bde0ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:22.437046 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2464/4931] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:22 2022] DELETE /identity/v3/projects/f363dcbe8c20457e9cba3d8cdcfa6eb0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:22.449730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd6e16-5451-4692-a47f-38a5e987ef3b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:22.451540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd6e16-5451-4692-a47f-38a5e987ef3b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:22.452693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd6e16-5451-4692-a47f-38a5e987ef3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:22.493039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d7cd6e16-5451-4692-a47f-38a5e987ef3b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:22.496030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7cd6e16-5451-4692-a47f-38a5e987ef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:22.684004 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2468/4932] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:22.686052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efae312-c27d-4ee3-97f3-c198b1d4a997 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:22.686986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efae312-c27d-4ee3-97f3-c198b1d4a997 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:22.687724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efae312-c27d-4ee3-97f3-c198b1d4a997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:22.749367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3efae312-c27d-4ee3-97f3-c198b1d4a997 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:22.760874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3efae312-c27d-4ee3-97f3-c198b1d4a997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:22.780043 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2465/4933] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:22.788531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd6e16-5451-4692-a47f-38a5e987ef3b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:22.833829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd6e16-5451-4692-a47f-38a5e987ef3b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:22.844613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:22.845630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:22.846138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:22.846654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:22.848361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:22.848831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:22.854091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:22.893962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efae312-c27d-4ee3-97f3-c198b1d4a997 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:22.896390 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2469/4934] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:22.928694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efae312-c27d-4ee3-97f3-c198b1d4a997 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:22.952735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:22.953870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:22.954582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:22.958434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:22.964908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:22.973914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:23.048978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:23.059733 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2466/4935] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:22 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:23.074592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac89fd-4b9a-4c7e-952a-ddb0547fec59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:23.308383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:23.316269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:23.402573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:23.458467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:23.461273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:23.462230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:23.462875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:23.467167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:23.473452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:23.534316 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2470/4936] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:23 2022] POST /identity/v3/users => generated 286 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:23.542630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:23.564599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5b779-3418-4b77-a1d6-7bfdcf41de1b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:23.569928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:23.570910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:23.571193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:23.571838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:23.573404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:23.574817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:23.588823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2471/4937] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:00:23.592953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:23.608280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aff75-1f31-4048-bc9c-bde0a7e40f56 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:23.614166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:23.615033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:23.615551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:23.615679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:23.616409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:23.618234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:23.637323 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2472/4938] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:00:23.638121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:23.650532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2ee3-831d-4e48-818b-811fb804d12b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:23.651202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80b0d-fbfb-48f4-98d0-95d993d272a5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:23.656001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76532cde-c190-4b94-95e2-e754e0717e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:23.658216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532cde-c190-4b94-95e2-e754e0717e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:23.658429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532cde-c190-4b94-95e2-e754e0717e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:23.658688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532cde-c190-4b94-95e2-e754e0717e58 admin admin] PATH_INFO: `/v3/projects/6a4b01e0a14a45adbf8a2bac2e68b3ac/users/15eb0b6fae154b1ea6605a84e32d1cbb/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:23.670320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:23.671908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:23.672456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:23.673062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] PATH_INFO: `/v3/users/08a298c4b8da438a9eea25c393d235c1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:23.675677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a298c4b8da438a9eea25c393d235c1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:23.682655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:23.686880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76532cde-c190-4b94-95e2-e754e0717e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4b01e0a14a45adbf8a2bac2e68b3ac, user_id=15eb0b6fae154b1ea6605a84e32d1cbb, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:23.691324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76532cde-c190-4b94-95e2-e754e0717e58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:23.724762 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2473/4939] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:23 2022] PUT /identity/v3/projects/6a4b01e0a14a45adbf8a2bac2e68b3ac/users/15eb0b6fae154b1ea6605a84e32d1cbb/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:23.741441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:23.743307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:23.745250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:23.836806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a298c4b8da438a9eea25c393d235c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:23.843703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] MFA Rules not processed for user `15eb0b6fae154b1ea6605a84e32d1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:23.846455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:23.881717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a298c4b8da438a9eea25c393d235c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:23.883041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a298c4b8da438a9eea25c393d235c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:23.918288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a298c4b8da438a9eea25c393d235c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:23.921447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-851e0c49-3cd3-4161-9d7e-b66abda6b1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a298c4b8da438a9eea25c393d235c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:23.976792 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2467/4940] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:23 2022] DELETE /identity/v3/users/08a298c4b8da438a9eea25c393d235c1 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:23.985280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:23.986338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:23.987005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:24.037231 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2474/4941] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:24.040098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:24.042948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:24.056156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:24.060565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:24.156904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:24.197026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6a60d-a18f-4324-9e53-e94b5e3a977b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:24.253953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:24.301582 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2468/4942] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:24.323071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:24.330786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:24.372279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:24.372995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:24.373285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:24.373581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:24.374315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:24.377022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:24.442091 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2475/4943] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:24 2022] POST /identity/v3/projects => generated 371 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:24.449342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:24.596925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d2961-86a6-47cd-8ee9-f062c83be3a9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:24.738812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8cb98-d030-4dbb-913a-2d2bc4a159a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:24.748376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:24.750238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:24.752207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:24.752923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:24.754587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:24.759048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:24.791978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:24.792739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:24.793060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:24.793388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:24.807506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:24.809626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:24.817305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2476/4944] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:24 2022] POST /identity/v3/users => generated 292 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:24.819642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:24.825575 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2469/4945] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:24.826755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:24.843723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676101-d75c-4e69-98bc-90d9225819aa service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:24.864980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc7589-72dd-4b00-bfad-7860e1199ff5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:24.867525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:24.869040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:24.869232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:24.869700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:24.871588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:24.874814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:24.887521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:24.889329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:24.889828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:24.890335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:24.901170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:24.921268 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2470/4946] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:24.932925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:25.018595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129220b-dde0-4d7f-9385-b09a836d7a05 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:25.050325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:25.054068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:25.054599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:25.057345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] PATH_INFO: `/v3/projects/50b833d3464a46afb51777418eb61a02/users/28be3aeacd5f451fa81966fe7f2f60b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:25.170636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b833d3464a46afb51777418eb61a02, user_id=28be3aeacd5f451fa81966fe7f2f60b5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:25.212550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:25.307991 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2471/4947] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:24 2022] PUT /identity/v3/projects/50b833d3464a46afb51777418eb61a02/users/28be3aeacd5f451fa81966fe7f2f60b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:25.310035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:25.320791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:25.338598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:25.416861 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2477/4948] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:25.656395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39352ec-e409-4636-b3b3-bac892aae03c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:25.670583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a2648-8ce9-4920-b4a5-aa9d139fae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:25.672216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2648-8ce9-4920-b4a5-aa9d139fae66 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:25.672806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2648-8ce9-4920-b4a5-aa9d139fae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:25.673420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2648-8ce9-4920-b4a5-aa9d139fae66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:25.675114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a2648-8ce9-4920-b4a5-aa9d139fae66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:25.680310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a2648-8ce9-4920-b4a5-aa9d139fae66 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:25.713025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:25.732349 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2472/4949] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:25.734433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:25.749710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f9a8-babb-43a1-aa70-1aa852741a76 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:25.764007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:25.764952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:25.765245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:25.765530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] PATH_INFO: `/v3/projects/50b833d3464a46afb51777418eb61a02/users/28be3aeacd5f451fa81966fe7f2f60b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:25.768987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b833d3464a46afb51777418eb61a02, user_id=28be3aeacd5f451fa81966fe7f2f60b5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:25.772900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:25.793367 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2478/4950] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:25 2022] PUT /identity/v3/projects/50b833d3464a46afb51777418eb61a02/users/28be3aeacd5f451fa81966fe7f2f60b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:25.820814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155df98-4a85-44ce-861f-a39a4f37851b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:25.821303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155df98-4a85-44ce-861f-a39a4f37851b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:25.822056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155df98-4a85-44ce-861f-a39a4f37851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:25.891703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7155df98-4a85-44ce-861f-a39a4f37851b None None] MFA Rules not processed for user `28be3aeacd5f451fa81966fe7f2f60b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:25.897430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7155df98-4a85-44ce-861f-a39a4f37851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:26.164892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:26.174497 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2473/4951] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:26.197896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc32d-a7ef-4f46-abf3-488f73ee29a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:26.208827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:26.210419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:26.211300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:26.211854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:26.213761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:26.220489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:26.228432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:26.268935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155df98-4a85-44ce-861f-a39a4f37851b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:26.279812 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2479/4952] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:26 2022] POST /identity/v3/services => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:26.289088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155df98-4a85-44ce-861f-a39a4f37851b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:26.323123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:26.324447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:26.324953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:26.325461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:26.326891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:26.329341 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:26.329341 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:00:26.329341 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:00:26.332716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:26.362186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:26.372634 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2474/4953] 10.222.0.98 () {60 vars in 1212 bytes} [Thu Jul 14 15:00:26 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:26.392588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d782-0f47-489c-aa9a-351e06f8e358 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:26.408387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:26.410195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:26.411255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:26.412209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:26.414012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:26.419243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:26.467491 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2480/4954] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:26 2022] POST /identity/v3/services => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:26.474270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:26.500244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06482-eb7f-4c0f-9691-fdf11b625184 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:26.572524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:26.574096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:26.574564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:26.575086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:26.577788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:26.583609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:26.610847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2475/4955] 10.222.0.98 () {60 vars in 1212 bytes} [Thu Jul 14 15:00:26 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:26.611108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:26.637600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd0164-34d5-495f-a40f-c81edf75638e tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:26.676536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:26.682364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:26.683587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:26.685895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:26.691979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:26.700690 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:26.700690 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:26.700690 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:26.712085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:26.749159 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2481/4956] 10.222.0.98 () {58 vars in 1190 bytes} [Thu Jul 14 15:00:26 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 762 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:00:26.756589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:26.757256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:26.760684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:26.780920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2aa43d-523c-47dd-98ab-902125fe9eef tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:26.793761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68aa60-d4b3-4eb2-9508-209cbf3449fd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:26.794908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68aa60-d4b3-4eb2-9508-209cbf3449fd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:26.796128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68aa60-d4b3-4eb2-9508-209cbf3449fd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:26.796926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68aa60-d4b3-4eb2-9508-209cbf3449fd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:26.799006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68aa60-d4b3-4eb2-9508-209cbf3449fd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=dea675d0b8c14b008de691ccfa519162)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:26.801363 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-7f68aa60-d4b3-4eb2-9508-209cbf3449fd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:26.801363 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:26.801363 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:26.803729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68aa60-d4b3-4eb2-9508-209cbf3449fd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:26.849495 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2482/4957] 10.222.0.98 () {58 vars in 1289 bytes} [Thu Jul 14 15:00:26 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162 => generated 332 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:26.853972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8b77-a5ad-4dee-8e38-febfc28f59a3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:26.854990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8b77-a5ad-4dee-8e38-febfc28f59a3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:26.855862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8b77-a5ad-4dee-8e38-febfc28f59a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:26.910434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9fdd8b77-a5ad-4dee-8e38-febfc28f59a3 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:26.913724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9fdd8b77-a5ad-4dee-8e38-febfc28f59a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:27.022807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff0d8-ec29-4e90-91be-92c3609eabc4 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:27.038043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:27.038971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:27.039261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:27.039703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] PATH_INFO: `/v3/users/7690a000a2ea48329fe3e426b901c5d7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:27.044305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7690a000a2ea48329fe3e426b901c5d7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:27.046400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:27.154075 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2483/4958] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:26 2022] POST /identity/v3/auth/tokens => generated 3510 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:27.166395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8b77-a5ad-4dee-8e38-febfc28f59a3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:27.180625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:27.190762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7690a000a2ea48329fe3e426b901c5d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:27.223389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8b77-a5ad-4dee-8e38-febfc28f59a3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:27.251680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:27.253472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:27.254007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:27.254506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:27.259765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=dea675d0b8c14b008de691ccfa519162)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:27.263205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:27.304384 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2484/4959] 10.222.0.98 () {58 vars in 1290 bytes} [Thu Jul 14 15:00:27 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162 => generated 0 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 14 15:00:27.306301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:27.331423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7690a000a2ea48329fe3e426b901c5d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:27.333046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7690a000a2ea48329fe3e426b901c5d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:27.348033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f28fe-43e7-4991-8b05-732f85adfd51 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:27.375092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7690a000a2ea48329fe3e426b901c5d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:27.376945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:27.378450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:27.378954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:27.379487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:27.380770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=dea675d0b8c14b008de691ccfa519162)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:27.382700 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:27.382700 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:27.382700 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:27.384033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2d1db33f-286a-4fb1-8888-a316fa1fc95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7690a000a2ea48329fe3e426b901c5d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:27.402036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:27.434880 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2476/4960] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:26 2022] DELETE /identity/v3/users/7690a000a2ea48329fe3e426b901c5d7 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:27.434880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:27.434880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:27.434880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:27.465364 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2485/4961] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:00:27 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:27.472924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:27.481830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:27.493192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:27.496136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:27.544646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75282327-0c39-41d9-a2f5-067627be0619 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:27.825268 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2477/4962] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3495 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:27.826114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:27.830791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:27.889145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0363aa-aa29-4ca6-81e6-490053ac8d2b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:27.898444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:27.900281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:27.900965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:27.901812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] PATH_INFO: `/v3/projects/b6e046f739df4473b8bb027968016bf4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:27.905813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e046f739df4473b8bb027968016bf4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:27.910904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:27.989716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:27.991745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:27.992069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:27.992334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:27.997544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:28.000351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:28.018585 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2486/4963] 10.222.0.98 () {58 vars in 1190 bytes} [Thu Jul 14 15:00:27 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:00:28.019602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:28.025161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:28.082902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e046f739df4473b8bb027968016bf4', 'request_id': 'req-47ec136b-5925-492c-9a84-1eed31c14d0b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.107403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e046f739df4473b8bb027968016bf4', 'request_id': 'req-47ec136b-5925-492c-9a84-1eed31c14d0b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.125016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e046f739df4473b8bb027968016bf4', 'request_id': 'req-47ec136b-5925-492c-9a84-1eed31c14d0b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.162173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:28.167783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] The token cache is being invalidate because project b6e046f739df4473b8bb027968016bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:28.168879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.172072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.184041 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2478/4964] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:27 2022] DELETE /identity/v3/projects/b6e046f739df4473b8bb027968016bf4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:28.186861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:28.189671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:28.246624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313731c-43ee-4a08-a108-5ffe475fbdcb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:28.445374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:28.491628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:28.492337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:28.492805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:28.493103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:28.495165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:28.550965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec136b-5925-492c-9a84-1eed31c14d0b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:28.587225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:28.588788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:28.589915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:28.589915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:28.591051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=dea675d0b8c14b008de691ccfa519162)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:28.594053 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:28.594053 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:00:28.594053 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:00:28.595953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:28.644327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:28.646124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Could not find Endpoint Group: dea675d0b8c14b008de691ccfa519162.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: dea675d0b8c14b008de691ccfa519162. Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 14 15:00:28.654265 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 14 15:00:28.655379 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 14 15:00:28.655379 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 14 15:00:28.655379 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 14 15:00:28.655379 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 14 15:00:28.655379 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: dea675d0b8c14b008de691ccfa519162. Jul 14 15:00:28.655379 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:28.663526 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2487/4965] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:28 2022] GET /identity/v3/auth/tokens => generated 3495 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:28.664688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:28.666363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:28.668027 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2479/4966] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:00:28 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/dea675d0b8c14b008de691ccfa519162 => generated 120 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:00:28.669637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:28.691028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fb490-7846-4f87-ad9b-511fae914fea service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:28.705094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:28.707234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:28.709961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:28.709961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] PATH_INFO: `/v3/users/552fc89e4850460f9d422768c4d9f8b1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:28.712181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=552fc89e4850460f9d422768c4d9f8b1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:28.713832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d6ac5-1c8c-469c-a169-7e584969de70 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:28.715151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:28.728119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:28.729668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:28.730187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:28.730703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services/bd25788fb10d4576a9fb316f15acf0c9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:28.732128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bd25788fb10d4576a9fb316f15acf0c9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:28.735847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:28.808070 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2480/4967] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:28 2022] DELETE /identity/v3/services/bd25788fb10d4576a9fb316f15acf0c9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:28.820416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:28.834192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552fc89e4850460f9d422768c4d9f8b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.856989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552fc89e4850460f9d422768c4d9f8b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.869635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552fc89e4850460f9d422768c4d9f8b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.870390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552fc89e4850460f9d422768c4d9f8b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.891082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552fc89e4850460f9d422768c4d9f8b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:28.908308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32274ff7-c7cf-4496-b3ee-1c16d38dc837 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:28.937518 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2488/4968] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:28 2022] DELETE /identity/v3/users/552fc89e4850460f9d422768c4d9f8b1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:28.945562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:28.947404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:28.948448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:28.948448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:28.949898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:28.954554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:29.022604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:29.022604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:29.023636 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2481/4969] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:28 2022] POST /identity/v3/services => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:29.050116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:29.242342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4649f3c-6c62-4280-80d8-77ba5c230abc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:29.303055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:29.307681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:29.308133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:29.308526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:29.309481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:29.310801 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:29.310801 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:29.310801 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:29.315208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:29.333207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2489/4970] 10.222.0.98 () {60 vars in 1212 bytes} [Thu Jul 14 15:00:29 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:29.338157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:29.361556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce038c7-373a-4ec1-ba95-12ec128be81f tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:29.377146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:29.378019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:29.378404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:29.378788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:29.379812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:29.385043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:29.417892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2482/4971] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:29 2022] POST /identity/v3/services => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:29.420744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:29.439686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8961f2a-21a9-4490-a78f-aae651f04688 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:29.472302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:29.475812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:29.476409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:29.477699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f0850857f5de493c8602b19abca8c812` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:29.479470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=f0850857f5de493c8602b19abca8c812)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:29.482806 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:29.482806 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:29.482806 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:29.485229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:29.516839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2490/4972] 10.222.0.98 () {60 vars in 1312 bytes} [Thu Jul 14 15:00:29 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/f0850857f5de493c8602b19abca8c812 => generated 335 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:29.520309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:29.545137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:29.547414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644d570-db67-45ec-bfea-5b318c5e6ee0 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:29.550032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:29.555825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:29.557012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:29.557463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:29.557910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services/f6b3c77742014c818fc0bb2d06ef24c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:29.558754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f6b3c77742014c818fc0bb2d06ef24c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:29.563099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:29.598430 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2483/4973] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:29 2022] DELETE /identity/v3/services/f6b3c77742014c818fc0bb2d06ef24c3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:29.605082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:29.663083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284245c3-a684-4c2b-9772-39594194c9ca tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:29.680833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:29.683291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:29.684100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:29.684886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f0850857f5de493c8602b19abca8c812` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:29.686708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f0850857f5de493c8602b19abca8c812)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:29.692898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:29.735110 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2484/4974] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:00:29 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f0850857f5de493c8602b19abca8c812 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:29.738912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:29.742781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:29.879648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51767c98-d1db-480c-b692-3d359cbabf86 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:29.928338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae164c5d-8fd0-46bd-b321-bbfca8f4fcfb tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:29.941397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:29.943188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:29.943503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:29.943993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:29.944517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] PATH_INFO: `/v3/users/d2cb918769c44026b2b4358f3fcd7cff` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:29.947226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:29.947941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cb918769c44026b2b4358f3fcd7cff)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:29.948126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:29.949141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:29.951635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:29.952906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:29.979653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:29.983019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:30.003242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:30.026845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cb918769c44026b2b4358f3fcd7cff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.040202 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2491/4975] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:29 2022] GET /identity/v3/auth/tokens => generated 3565 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:00:30.044355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cb918769c44026b2b4358f3fcd7cff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.044885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:30.045343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cb918769c44026b2b4358f3fcd7cff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.055700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cb918769c44026b2b4358f3fcd7cff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.056553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cb918769c44026b2b4358f3fcd7cff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.091506 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2485/4976] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:29 2022] DELETE /identity/v3/users/d2cb918769c44026b2b4358f3fcd7cff => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:30.126809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd4b16-a47a-4af7-adb4-642f911d8fb4 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:30.271521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:30.296617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:30.298462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:30.298644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:30.298833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services/bf38f9036cad42b2b6dd926dc6db5dfd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:30.299604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bf38f9036cad42b2b6dd926dc6db5dfd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:30.301310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:30.380911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2492/4977] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:30 2022] DELETE /identity/v3/services/bf38f9036cad42b2b6dd926dc6db5dfd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:30.382943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:30.384856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:30.426755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:30.429217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:30.435840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a584948-999a-4364-b29b-1e61970edbcb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:30.460257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:30.461261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:30.461644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:30.462006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2cf429647fea40f8bb6c8ed349f5ec83` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:30.462791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=2cf429647fea40f8bb6c8ed349f5ec83)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:30.465121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:30.481634 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2486/4978] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:00:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/2cf429647fea40f8bb6c8ed349f5ec83 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:30.483029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:30.503637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916fa7b-9600-4664-b781-6cd0208c1767 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:30.509776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28be3aeacd5f451fa81966fe7f2f60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b833d3464a46afb51777418eb61a02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:30.510820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:30.511602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:30.512199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] PATH_INFO: `/v3/services/cfb85100e2bc440e8f22123b7fe957b8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:30.512990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cfb85100e2bc440e8f22123b7fe957b8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:30.514973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:30.551190 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2487/4979] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:30 2022] DELETE /identity/v3/services/cfb85100e2bc440e8f22123b7fe957b8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:30.552942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:30.555069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:30.674983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e845a-0a6d-4e56-aa50-8feafa864409 tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:30.686110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c7251-09b7-48ba-aae6-24e52f7837bd tempest-EndPointGroupsTest-975605970 tempest-EndPointGroupsTest-975605970-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:30.691092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:30.692240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:30.692593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:30.692886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] PATH_INFO: `/v3/users/15eb0b6fae154b1ea6605a84e32d1cbb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:30.694878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15eb0b6fae154b1ea6605a84e32d1cbb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:30.697631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:30.701893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:30.703655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:30.704793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:30.705297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] PATH_INFO: `/v3/projects/eccfc3dd1edc424cb8f3916346f75da9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:30.710574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccfc3dd1edc424cb8f3916346f75da9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:30.717189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:30.769990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15eb0b6fae154b1ea6605a84e32d1cbb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.778121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:30.793842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15eb0b6fae154b1ea6605a84e32d1cbb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.795024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15eb0b6fae154b1ea6605a84e32d1cbb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.812322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15eb0b6fae154b1ea6605a84e32d1cbb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.814114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c69ce5c-efc8-40d7-b887-c13bee272347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15eb0b6fae154b1ea6605a84e32d1cbb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.871894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2488/4980] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:30 2022] DELETE /identity/v3/users/15eb0b6fae154b1ea6605a84e32d1cbb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:30.875160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737be728-4898-4278-8d64-3750871a3a6e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:30.877726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737be728-4898-4278-8d64-3750871a3a6e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:30.878292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737be728-4898-4278-8d64-3750871a3a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:30.933107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccfc3dd1edc424cb8f3916346f75da9', 'request_id': 'req-f0d5130c-0bdb-43f8-9abd-d5712bae812f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.957392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccfc3dd1edc424cb8f3916346f75da9', 'request_id': 'req-f0d5130c-0bdb-43f8-9abd-d5712bae812f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:30.966128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-737be728-4898-4278-8d64-3750871a3a6e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:30.975960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-737be728-4898-4278-8d64-3750871a3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:30.977377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccfc3dd1edc424cb8f3916346f75da9', 'request_id': 'req-f0d5130c-0bdb-43f8-9abd-d5712bae812f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.020782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] The token cache is being invalidate because project eccfc3dd1edc424cb8f3916346f75da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:31.021191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.022452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0d5130c-0bdb-43f8-9abd-d5712bae812f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.026374 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2493/4981] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:30 2022] DELETE /identity/v3/projects/eccfc3dd1edc424cb8f3916346f75da9 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:31.043474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9bd53-0c54-454e-8b01-4e531acdc85c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.044245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9bd53-0c54-454e-8b01-4e531acdc85c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.044539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9bd53-0c54-454e-8b01-4e531acdc85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.104191 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2489/4982] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:31.104191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737be728-4898-4278-8d64-3750871a3a6e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:31.104191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-737be728-4898-4278-8d64-3750871a3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.114202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-55c9bd53-0c54-454e-8b01-4e531acdc85c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:31.116485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55c9bd53-0c54-454e-8b01-4e531acdc85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.121294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737be728-4898-4278-8d64-3750871a3a6e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:31.128566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:31.129817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.130214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.130911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] PATH_INFO: `/v3/projects/fe9c4ad4093041609cc24f610db884fe` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.132579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9c4ad4093041609cc24f610db884fe)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:31.134995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:31.150442 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2494/4983] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:31.158389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.158881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.159415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.193190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:31.194441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.205890 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2495/4984] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:31.206999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:31.208726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.241976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9c4ad4093041609cc24f610db884fe', 'request_id': 'req-6c1b357d-65bf-47d0-a146-e6e28c9f9027'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.255674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9c4ad4093041609cc24f610db884fe', 'request_id': 'req-6c1b357d-65bf-47d0-a146-e6e28c9f9027'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.270108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9c4ad4093041609cc24f610db884fe', 'request_id': 'req-6c1b357d-65bf-47d0-a146-e6e28c9f9027'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.276240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:31.295320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] The token cache is being invalidate because project fe9c4ad4093041609cc24f610db884fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:31.296167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.298484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:31.302236 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2490/4985] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:31 2022] DELETE /identity/v3/projects/fe9c4ad4093041609cc24f610db884fe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:31.304910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:31.307587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.311520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791263-cfb0-4827-b905-f27c8918e71a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:31.380352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fbbc7-e313-4681-a44e-d599ff16b512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:31.381872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fbbc7-e313-4681-a44e-d599ff16b512 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.382330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fbbc7-e313-4681-a44e-d599ff16b512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.382783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fbbc7-e313-4681-a44e-d599ff16b512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.385377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd8fbbc7-e313-4681-a44e-d599ff16b512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.462702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:31.489993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b357d-65bf-47d0-a146-e6e28c9f9027 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:31.509819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240461b-bad7-482e-94c0-1b69b7349808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:31.518459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240461b-bad7-482e-94c0-1b69b7349808 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.518908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240461b-bad7-482e-94c0-1b69b7349808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.519436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240461b-bad7-482e-94c0-1b69b7349808 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.524460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240461b-bad7-482e-94c0-1b69b7349808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:31.524896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240461b-bad7-482e-94c0-1b69b7349808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:31.526822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240461b-bad7-482e-94c0-1b69b7349808 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:31.588297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2491/4986] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:31.589426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a4d2-ad09-457b-85fc-d029a24c4acd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.589722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a4d2-ad09-457b-85fc-d029a24c4acd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.590003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a4d2-ad09-457b-85fc-d029a24c4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.622221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fbbc7-e313-4681-a44e-d599ff16b512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:31.630042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fbbc7-e313-4681-a44e-d599ff16b512 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:31.635827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8940a4d2-ad09-457b-85fc-d029a24c4acd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:31.637102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8940a4d2-ad09-457b-85fc-d029a24c4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.663085 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2492/4987] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:31.666205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a4d2-ad09-457b-85fc-d029a24c4acd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:31.669975 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2496/4988] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:31.672318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774a1d8-100f-4f5c-b952-b705b132aaae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.673466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774a1d8-100f-4f5c-b952-b705b132aaae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.673825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774a1d8-100f-4f5c-b952-b705b132aaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.714493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a4d2-ad09-457b-85fc-d029a24c4acd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:31.728775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:31.732802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.733136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5774a1d8-100f-4f5c-b952-b705b132aaae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:31.733790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.734479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.735209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5774a1d8-100f-4f5c-b952-b705b132aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:31.737934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:31.743738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:31.768694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2497/4989] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:31.773932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774a1d8-100f-4f5c-b952-b705b132aaae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:31.809049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774a1d8-100f-4f5c-b952-b705b132aaae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:31.858301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:31.859749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:31.860746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:31.861235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:31.862668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:31.863232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:31.889445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:31.906817 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2493/4990] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:31 2022] POST /identity/v3/projects => generated 401 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:31.915378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:31.975129 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2498/4991] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:00:31.977183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:32.004879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8402e58-826c-4ac9-9497-cd693eb8f171 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.182598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12eeb5-2533-4d1a-b304-df5e5b2a9f92 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.186036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.187584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:32.189008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:32.191902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:32.198081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:32.207321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.208211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:32.208711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:32.209251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:32.209953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:32.210562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:32.214204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:32.253264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2494/4992] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:31 2022] POST /identity/v3/users => generated 301 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:32.258441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:32.271290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5fa65-051d-4680-87d3-981c7f36ad02 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.277629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.278500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:32.278900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:32.279317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:32.280233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:32.282769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:32.301143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2495/4993] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:32.303711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:32.316656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444e4a-13f8-483e-a3c5-6866ef7d28d8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.323288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.324293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:32.324757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:32.325264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:32.326152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:32.328085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:32.334575 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2499/4994] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:31 2022] POST /identity/v3/projects => generated 373 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:32.348543 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2496/4995] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:32.351893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:32.355858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:32.365798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:32.368652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:32.413633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214424-a52b-4188-9091-9df76c1e0fa3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.567893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.569313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:32.576206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:32.576649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] PATH_INFO: `/v3/projects/da0dc51858c64e3589abc68587ab1b40` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:32.580234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0dc51858c64e3589abc68587ab1b40)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:32.582440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:32.611951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54149796-4d6f-4478-9836-da986d55c7c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.633051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.634589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:32.637694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:32.637694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:32.637694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:32.644468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:32.699699 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2500/4996] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:32 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:32.705202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:32.740692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f21b-b633-44c1-bc13-c014f5b3230e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.748599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:32.827932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0dc51858c64e3589abc68587ab1b40', 'request_id': 'req-7426854e-4973-4d45-8916-f5c92ee9d8c2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:32.859022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0dc51858c64e3589abc68587ab1b40', 'request_id': 'req-7426854e-4973-4d45-8916-f5c92ee9d8c2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:32.884983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0dc51858c64e3589abc68587ab1b40', 'request_id': 'req-7426854e-4973-4d45-8916-f5c92ee9d8c2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:32.919796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d19e6-e135-4695-a28a-f9b2d3a6430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.921018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d19e6-e135-4695-a28a-f9b2d3a6430e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:32.921421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d19e6-e135-4695-a28a-f9b2d3a6430e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:32.921817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d19e6-e135-4695-a28a-f9b2d3a6430e admin admin] PATH_INFO: `/v3/projects/eb8111b8a7014a3593e350eb3a47e0bb/users/e2293419a3ac4a08995749f4b7c00f58/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:32.930046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] The token cache is being invalidate because project da0dc51858c64e3589abc68587ab1b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:32.931061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:32.932880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:32.939730 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2497/4997] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:32 2022] DELETE /identity/v3/projects/da0dc51858c64e3589abc68587ab1b40 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:32.941768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:32.950672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:32.962391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d19e6-e135-4695-a28a-f9b2d3a6430e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8111b8a7014a3593e350eb3a47e0bb, user_id=e2293419a3ac4a08995749f4b7c00f58, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:32.966255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d19e6-e135-4695-a28a-f9b2d3a6430e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:32.978225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426854e-4973-4d45-8916-f5c92ee9d8c2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:32.996640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6d394-9bbc-4695-8382-6f9fe3002f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:32.999526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6d394-9bbc-4695-8382-6f9fe3002f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.002445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6d394-9bbc-4695-8382-6f9fe3002f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.003335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6d394-9bbc-4695-8382-6f9fe3002f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.004252 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2501/4998] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:32 2022] PUT /identity/v3/projects/eb8111b8a7014a3593e350eb3a47e0bb/users/e2293419a3ac4a08995749f4b7c00f58/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:33.006588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bebb85-3f6a-4d39-95da-014bbe16927d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.006888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bebb85-3f6a-4d39-95da-014bbe16927d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.007175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bebb85-3f6a-4d39-95da-014bbe16927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.007386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6d394-9bbc-4695-8382-6f9fe3002f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:33.012915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6d394-9bbc-4695-8382-6f9fe3002f34 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:33.035868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-99bebb85-3f6a-4d39-95da-014bbe16927d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:33.037526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99bebb85-3f6a-4d39-95da-014bbe16927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:33.056315 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2498/4999] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:33.057047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad282f6-9cbe-44a0-9f3e-9d2023f9ecad None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.057863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad282f6-9cbe-44a0-9f3e-9d2023f9ecad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.058708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad282f6-9cbe-44a0-9f3e-9d2023f9ecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.123708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7ad282f6-9cbe-44a0-9f3e-9d2023f9ecad None None] MFA Rules not processed for user `e2293419a3ac4a08995749f4b7c00f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:33.126672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ad282f6-9cbe-44a0-9f3e-9d2023f9ecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:33.245066 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2502/5000] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:33.246379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bebb85-3f6a-4d39-95da-014bbe16927d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:33.294700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bebb85-3f6a-4d39-95da-014bbe16927d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:33.319122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ff313-975f-4244-b77f-373eca1bc9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:33.319879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ff313-975f-4244-b77f-373eca1bc9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.320179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ff313-975f-4244-b77f-373eca1bc9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.320463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ff313-975f-4244-b77f-373eca1bc9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.321227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ff313-975f-4244-b77f-373eca1bc9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:33.323195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ff313-975f-4244-b77f-373eca1bc9e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:33.352478 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2503/5001] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:33.352478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6976-efc5-4c72-9dde-148da3119d89 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.352478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6976-efc5-4c72-9dde-148da3119d89 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.352478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6976-efc5-4c72-9dde-148da3119d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.353307 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2499/5002] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:33.353307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7cefd-acb4-4366-93ec-8ac68566cd6e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.354889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7cefd-acb4-4366-93ec-8ac68566cd6e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.355547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7cefd-acb4-4366-93ec-8ac68566cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.380682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:33.403576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bb2a6976-efc5-4c72-9dde-148da3119d89 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:33.405082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb2a6976-efc5-4c72-9dde-148da3119d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:33.424879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c5f7cefd-acb4-4366-93ec-8ac68566cd6e None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:33.426832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5f7cefd-acb4-4366-93ec-8ac68566cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:33.429132 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2504/5003] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:33.429909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6976-efc5-4c72-9dde-148da3119d89 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:33.467564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6976-efc5-4c72-9dde-148da3119d89 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:33.478183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:33.480128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.480128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.480128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] PATH_INFO: `/v3/projects/5a4d6fed279048dfb0e97b1d3cb84deb/users/84a833be8bf245af87264bb1d0bb2240/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.521139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4d6fed279048dfb0e97b1d3cb84deb, user_id=84a833be8bf245af87264bb1d0bb2240, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:33.525764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:33.564416 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2505/5004] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:33 2022] PUT /identity/v3/projects/5a4d6fed279048dfb0e97b1d3cb84deb/users/84a833be8bf245af87264bb1d0bb2240/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:33.564416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:33.567682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:33.658714 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2500/5005] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:33.659883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7cefd-acb4-4366-93ec-8ac68566cd6e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:33.677510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7cefd-acb4-4366-93ec-8ac68566cd6e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:33.749742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:33.777757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c499e89-1a94-4764-8c02-7c34aded2046 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:33.798134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809283e-a849-4fae-bb6a-422a648f3ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:33.800767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809283e-a849-4fae-bb6a-422a648f3ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.801355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809283e-a849-4fae-bb6a-422a648f3ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.801856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809283e-a849-4fae-bb6a-422a648f3ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.803618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809283e-a849-4fae-bb6a-422a648f3ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:33.808537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809283e-a849-4fae-bb6a-422a648f3ef8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:33.838391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:33.838391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.838391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.838391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.839174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:33.839174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:33.840559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:33.869394 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2501/5006] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:33.870701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2506/5007] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:33 2022] POST /identity/v3/projects => generated 403 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:33.873937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a430a-ed9d-4df0-81d5-38734db87413 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:33.874214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:33.874422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a430a-ed9d-4df0-81d5-38734db87413 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:33.875038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a430a-ed9d-4df0-81d5-38734db87413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:33.876509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:33.904813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4e14-4089-4299-aa6f-71d2d9e0fe83 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:33.934841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-509a430a-ed9d-4df0-81d5-38734db87413 None None] MFA Rules not processed for user `84a833be8bf245af87264bb1d0bb2240`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:33.939856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-509a430a-ed9d-4df0-81d5-38734db87413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:34.051756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:34.053071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:34.053515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:34.053916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] PATH_INFO: `/v3/projects/6a4b01e0a14a45adbf8a2bac2e68b3ac` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:34.055683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4b01e0a14a45adbf8a2bac2e68b3ac)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:34.057918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:34.142521 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2507/5008] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:34.148218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a430a-ed9d-4df0-81d5-38734db87413 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:34.158248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4b01e0a14a45adbf8a2bac2e68b3ac', 'request_id': 'req-4db9589b-4a60-491e-9098-5c058e821794'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.172465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a430a-ed9d-4df0-81d5-38734db87413 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:34.183360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4b01e0a14a45adbf8a2bac2e68b3ac', 'request_id': 'req-4db9589b-4a60-491e-9098-5c058e821794'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.214447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4b01e0a14a45adbf8a2bac2e68b3ac', 'request_id': 'req-4db9589b-4a60-491e-9098-5c058e821794'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.286486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] The token cache is being invalidate because project 6a4b01e0a14a45adbf8a2bac2e68b3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:34.287024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.289180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.295442 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2502/5009] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:33 2022] DELETE /identity/v3/projects/6a4b01e0a14a45adbf8a2bac2e68b3ac => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:34.295442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:34.302296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:34.359968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:34.391318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:34.393278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:34.393278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:34.393709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:34.394987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:34.398974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:34.450287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:34.457115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9589b-4a60-491e-9098-5c058e821794 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:34.465865 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2508/5010] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:34 2022] POST /identity/v3/projects => generated 383 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:34.467039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:34.469651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:34.470289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:34.471392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:34.472188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:34.472923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:34.473809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:34.476000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:34.504410 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2503/5011] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:34 2022] POST /identity/v3/users => generated 308 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:34.505992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:34.507675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:34.523567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38278b-38b4-433f-b8e3-667e90d455dd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:34.604072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:34.606094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:34.606716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:34.607245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] PATH_INFO: `/v3/users/28be3aeacd5f451fa81966fe7f2f60b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:34.608789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28be3aeacd5f451fa81966fe7f2f60b5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:34.611843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:34.642110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9eaf-484b-4c2d-9954-1641d3ea0134 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:34.650403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:34.651668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:34.652226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:34.652931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:34.659216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:34.680512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28be3aeacd5f451fa81966fe7f2f60b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.719575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28be3aeacd5f451fa81966fe7f2f60b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.721482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28be3aeacd5f451fa81966fe7f2f60b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.733939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28be3aeacd5f451fa81966fe7f2f60b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.737499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28be3aeacd5f451fa81966fe7f2f60b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:34.772661 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2504/5012] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:34 2022] DELETE /identity/v3/users/28be3aeacd5f451fa81966fe7f2f60b5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:34.773982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:34.785864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:34.871852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:34.875592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:34.897688 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2509/5013] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:34.898637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:34.917060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97d1d-b0a7-4dce-b378-d441aef802f2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:34.950149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d36a7-5e05-42b0-a8e6-4230c32f4c43 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:34.960667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e973fe-f617-4a52-8781-4b0405e4462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:34.961950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e973fe-f617-4a52-8781-4b0405e4462d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:34.962571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e973fe-f617-4a52-8781-4b0405e4462d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:34.962982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e973fe-f617-4a52-8781-4b0405e4462d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:34.964121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e973fe-f617-4a52-8781-4b0405e4462d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:34.966537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e973fe-f617-4a52-8781-4b0405e4462d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.003307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:35.037992 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2505/5014] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:34 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:35.040498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.041577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.042148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.071088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:35.074096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:35.093062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.096276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.097554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.098276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.100071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.103778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.142249 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2510/5015] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:35.143379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.166639 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2506/5016] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:35.167863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.169965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:35.183055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c3aef-c85f-49e2-905f-ff94dd0890f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:35.192491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce7819-986f-4fc0-bd15-8573743e800d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:35.207493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.209066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.209457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.209760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.209956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] PATH_INFO: `/v3/projects/a0bef6385a9c49a4800af7ee108e5ec5/users/3739a1686ec64703866dd4559202d1f2/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.211824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.212512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.213423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.217853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.220165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.242255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2511/5017] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:35.242255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.271908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4e57-cf0d-44f9-8f3b-4237f29fe08d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:35.278130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.278964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.279124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.279447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.280215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.282327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.290953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bef6385a9c49a4800af7ee108e5ec5, user_id=3739a1686ec64703866dd4559202d1f2, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.298927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.306908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2512/5018] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:35.312953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.328898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:35.347225 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2507/5019] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:35 2022] PUT /identity/v3/projects/a0bef6385a9c49a4800af7ee108e5ec5/users/3739a1686ec64703866dd4559202d1f2/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:35.350693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42474ea-37bc-4c78-985f-20e9023be9d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:35.352490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.465626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d9ef-d383-4ac0-93bf-9622c720b259 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:35.479456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.480376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.480702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.481061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.482160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.484147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.499705 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2508/5020] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:35.505756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.529869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade85229-2d33-4ca9-8b59-b8f10588393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.531835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85229-2d33-4ca9-8b59-b8f10588393d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.532390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85229-2d33-4ca9-8b59-b8f10588393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.532905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85229-2d33-4ca9-8b59-b8f10588393d admin admin] PATH_INFO: `/v3/projects/b9ea059a2cd047c0b59f066f38b01d27/users/b128110e3c7f4e2bb93292b8a6f0ea8b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.538987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5d5a1-1720-46c5-a1ab-d726e9828c3b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:35.548760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3577f-5feb-4481-9dea-44400168b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.550734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3577f-5feb-4481-9dea-44400168b82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.551439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3577f-5feb-4481-9dea-44400168b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.552058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3577f-5feb-4481-9dea-44400168b82b admin admin] PATH_INFO: `/v3/projects/a0bef6385a9c49a4800af7ee108e5ec5/users/3739a1686ec64703866dd4559202d1f2/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.556881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3577f-5feb-4481-9dea-44400168b82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bef6385a9c49a4800af7ee108e5ec5, user_id=3739a1686ec64703866dd4559202d1f2, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.557899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade85229-2d33-4ca9-8b59-b8f10588393d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ea059a2cd047c0b59f066f38b01d27, user_id=b128110e3c7f4e2bb93292b8a6f0ea8b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.561108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade85229-2d33-4ca9-8b59-b8f10588393d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.566579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3577f-5feb-4481-9dea-44400168b82b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.583523 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2513/5021] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:35 2022] PUT /identity/v3/projects/b9ea059a2cd047c0b59f066f38b01d27/users/b128110e3c7f4e2bb93292b8a6f0ea8b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:35.590855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.591437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.592014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.599420 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2509/5022] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:35 2022] PUT /identity/v3/projects/a0bef6385a9c49a4800af7ee108e5ec5/users/3739a1686ec64703866dd4559202d1f2/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:35.611201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.617624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.619758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:35.621693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.621894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:35.693679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] MFA Rules not processed for user `3739a1686ec64703866dd4559202d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:35.699784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:35.828182 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2514/5023] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:35.849297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.853874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:35.854951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:35.890144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800089f-d99b-4ead-a839-a09f92f7de58 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:35.901305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:35.904046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:35.905117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:35.905265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] PATH_INFO: `/v3/projects/50b833d3464a46afb51777418eb61a02` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:35.908909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b833d3464a46afb51777418eb61a02)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:35.914444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:35.965805 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2510/5024] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:35.967345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:35.971234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:36.039513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b833d3464a46afb51777418eb61a02', 'request_id': 'req-f3f4205d-2f37-4732-98f7-8b6fff7da13f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:36.067729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b833d3464a46afb51777418eb61a02', 'request_id': 'req-f3f4205d-2f37-4732-98f7-8b6fff7da13f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:36.068040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b833d3464a46afb51777418eb61a02', 'request_id': 'req-f3f4205d-2f37-4732-98f7-8b6fff7da13f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:36.103000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] The token cache is being invalidate because project 50b833d3464a46afb51777418eb61a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:36.103442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:36.104506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:36.112007 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2515/5025] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:35 2022] DELETE /identity/v3/projects/50b833d3464a46afb51777418eb61a02 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:36.113001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:36.115975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:36.131750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:36.186845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0844-4f92-432f-8849-437d0b2d8270 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:36.239597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4205d-2f37-4732-98f7-8b6fff7da13f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:36.248887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d7011-8bec-4bb4-bac2-8bd1b347e715 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3739a1686ec64703866dd4559202d1f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0bef6385a9c49a4800af7ee108e5ec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:36.249545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7011-8bec-4bb4-bac2-8bd1b347e715 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.249848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7011-8bec-4bb4-bac2-8bd1b347e715 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.250105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7011-8bec-4bb4-bac2-8bd1b347e715 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.251072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d7011-8bec-4bb4-bac2-8bd1b347e715 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:36.254700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d7011-8bec-4bb4-bac2-8bd1b347e715 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:36.287794 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2516/5026] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:00:36 2022] POST /identity/v3/roles => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:36.287794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def578d2-1c3f-4862-8138-31813bbe6f27 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.288107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def578d2-1c3f-4862-8138-31813bbe6f27 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.288542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def578d2-1c3f-4862-8138-31813bbe6f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.290444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:36.291307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.291766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.292122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.294513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:36.332905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-def578d2-1c3f-4862-8138-31813bbe6f27 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:36.335839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-def578d2-1c3f-4862-8138-31813bbe6f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:36.480493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:36.482116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:36.520066 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2511/5027] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:36.520066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:36.540615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91339-ef7b-459d-8bb7-eadabb3af60a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:36.559748 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2517/5028] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:36.559748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.559748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.559748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.560920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bce43-6118-46f6-8543-7b36e0cdef3f tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3739a1686ec64703866dd4559202d1f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0bef6385a9c49a4800af7ee108e5ec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:36.560920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bce43-6118-46f6-8543-7b36e0cdef3f tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.560920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bce43-6118-46f6-8543-7b36e0cdef3f tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.561389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bce43-6118-46f6-8543-7b36e0cdef3f tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] PATH_INFO: `/v3/projects/eb8111b8a7014a3593e350eb3a47e0bb/users/e2293419a3ac4a08995749f4b7c00f58/roles/20e4ac8ade5f4262969e71f6d80bb0fa` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.561389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bce43-6118-46f6-8543-7b36e0cdef3f tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eb8111b8a7014a3593e350eb3a47e0bb, user_id=e2293419a3ac4a08995749f4b7c00f58, role_id=20e4ac8ade5f4262969e71f6d80bb0fa)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:36.571305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bce43-6118-46f6-8543-7b36e0cdef3f tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:36.590984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:36.593318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:36.603381 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2512/5029] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:36 2022] PUT /identity/v3/projects/eb8111b8a7014a3593e350eb3a47e0bb/users/e2293419a3ac4a08995749f4b7c00f58/roles/20e4ac8ade5f4262969e71f6d80bb0fa => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:36.605799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323483-8d0b-4a3d-940c-cd0e53f81989 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.606360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323483-8d0b-4a3d-940c-cd0e53f81989 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.606894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323483-8d0b-4a3d-940c-cd0e53f81989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.649742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4c323483-8d0b-4a3d-940c-cd0e53f81989 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:36.652952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4c323483-8d0b-4a3d-940c-cd0e53f81989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:36.748911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:36.769909 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2518/5030] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:36.780363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:36.790337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:36.849010 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2513/5031] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:36.853533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c323483-8d0b-4a3d-940c-cd0e53f81989 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:36.874347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c323483-8d0b-4a3d-940c-cd0e53f81989 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:36.884583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:36.885986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.886485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.886966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.888067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:36.888631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:36.894894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:36.957457 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2514/5032] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:36.959739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:36.979958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:36.980743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a9b4c-f5bb-4789-bf8c-765eaa1ccc43 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:36.992335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:36.993511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:36.994009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:36.994520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:36.995940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:37.000605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:37.017790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896adc8-9251-4be4-a6e1-13132f15a6f4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:37.026264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd52d-084a-4241-92e9-26776f86f43c tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2293419a3ac4a08995749f4b7c00f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb8111b8a7014a3593e350eb3a47e0bb', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1908380099', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:37.027949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd52d-084a-4241-92e9-26776f86f43c tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.028505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd52d-084a-4241-92e9-26776f86f43c tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.029029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd52d-084a-4241-92e9-26776f86f43c tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] PATH_INFO: `/v3/users/e2293419a3ac4a08995749f4b7c00f58/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.030298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd52d-084a-4241-92e9-26776f86f43c tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] RBAC: Authorizing `identity:create_application_credential(user_id=e2293419a3ac4a08995749f4b7c00f58)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:37.032755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd52d-084a-4241-92e9-26776f86f43c tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:37.102778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2515/5033] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:36 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:37.105267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:37.261008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2519/5034] 10.222.0.98 () {60 vars in 1314 bytes} [Thu Jul 14 15:00:36 2022] POST /identity/v3/users/e2293419a3ac4a08995749f4b7c00f58/application_credentials => generated 659 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:37.275234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4100b38-a8d8-498b-bb80-a4a0771edadc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.276257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4100b38-a8d8-498b-bb80-a4a0771edadc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.276257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4100b38-a8d8-498b-bb80-a4a0771edadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.309697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17907446-1e37-49b6-af81-b67c20f2a186 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:37.316511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:37.317999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.318508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.318979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.319790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:37.322663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:37.355866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2516/5035] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:37 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:37.362425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:37.365375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b4100b38-a8d8-498b-bb80-a4a0771edadc None None] MFA Rules not processed for user `e2293419a3ac4a08995749f4b7c00f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:37.367708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4100b38-a8d8-498b-bb80-a4a0771edadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:37.384919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66078f7d-dadf-44ce-8d36-35a959eeeb9f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:37.394883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:37.396143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.396507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.397155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.399087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:37.401300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:37.418923 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2517/5036] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:37 2022] GET /identity/v3/roles => generated 1651 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:37.424713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:37.439625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822260f-d02d-4c8a-8756-cce1ecf84bdd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:37.446067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:37.447331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.447698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.448010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.448863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:37.450681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:37.469112 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2518/5037] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:37 2022] GET /identity/v3/roles => generated 1651 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:37.474502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:37.496023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb5ae4-98e5-4adf-915e-0c1c5cf773ef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:37.509235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf499e-c001-4f5d-9e14-e783cc87096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:37.511021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf499e-c001-4f5d-9e14-e783cc87096a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.512499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf499e-c001-4f5d-9e14-e783cc87096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.513110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf499e-c001-4f5d-9e14-e783cc87096a admin admin] PATH_INFO: `/v3/projects/6f10f2126ed14e26bedb23244ea3f70d/users/53e51abfd30e41658fbeb2d4c4f29ea8/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.581350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf499e-c001-4f5d-9e14-e783cc87096a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f10f2126ed14e26bedb23244ea3f70d, user_id=53e51abfd30e41658fbeb2d4c4f29ea8, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:37.587440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf499e-c001-4f5d-9e14-e783cc87096a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:37.617471 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2520/5038] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 14 15:00:37.618554 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2519/5039] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:37 2022] PUT /identity/v3/projects/6f10f2126ed14e26bedb23244ea3f70d/users/53e51abfd30e41658fbeb2d4c4f29ea8/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:37.621373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4100b38-a8d8-498b-bb80-a4a0771edadc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:37.637927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150194-fcbe-4247-b628-45c61b425995 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.638222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150194-fcbe-4247-b628-45c61b425995 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.638521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150194-fcbe-4247-b628-45c61b425995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.689288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:37.726120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c3150194-fcbe-4247-b628-45c61b425995 None None] MFA Rules not processed for user `53e51abfd30e41658fbeb2d4c4f29ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:37.730080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c3150194-fcbe-4247-b628-45c61b425995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:37.840764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4100b38-a8d8-498b-bb80-a4a0771edadc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:37.857171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:37.870837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2293419a3ac4a08995749f4b7c00f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb8111b8a7014a3593e350eb3a47e0bb', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1908380099', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:37.879057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:37.879906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:37.880504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] PATH_INFO: `/v3/users/e2293419a3ac4a08995749f4b7c00f58/application_credentials/189d3278ed6a49d9a4b56513adabb328` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:37.891790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e2293419a3ac4a08995749f4b7c00f58, application_credential_id=189d3278ed6a49d9a4b56513adabb328)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:37.893836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:37.932627 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2520/5040] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:37.937520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150194-fcbe-4247-b628-45c61b425995 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:37.950388 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2521/5041] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:00:37 2022] DELETE /identity/v3/users/e2293419a3ac4a08995749f4b7c00f58/application_credentials/189d3278ed6a49d9a4b56513adabb328 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:37.956829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:38.155196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150194-fcbe-4247-b628-45c61b425995 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:38.166284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:38.167791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:38.168349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:38.168824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:38.171848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:38.178197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:38.272716 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2521/5042] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:37 2022] POST /identity/v3/projects => generated 369 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:38.276823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:38.374795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3eb60-37c0-42a8-b1f2-84baf8d4ae34 tempest-ApplicationCredentialsV3AdminTest-299552153 tempest-ApplicationCredentialsV3AdminTest-299552153-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:38.499231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7a93d-4dbf-4bde-9b44-3b746f0b26f6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:38.503257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3739a1686ec64703866dd4559202d1f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0bef6385a9c49a4800af7ee108e5ec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:38.504194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:38.504490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:38.504773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] PATH_INFO: `/v3/roles/20e4ac8ade5f4262969e71f6d80bb0fa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:38.509517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: Authorizing `identity:delete_role(role_id=20e4ac8ade5f4262969e71f6d80bb0fa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:38.512044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:38.515728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:38.516988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:38.517262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:38.517548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:38.519431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:38.523719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:38.579961 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2522/5043] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:38 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:38.583975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:38.593687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] Invalidating the token cache because role 20e4ac8ade5f4262969e71f6d80bb0fa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:38.594035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:38.597895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:38.603721 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2522/5044] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:37 2022] DELETE /identity/v3/roles/20e4ac8ade5f4262969e71f6d80bb0fa => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:38.604772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6817858-8447-423c-81ef-d8012bc6e12f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:38.614252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:38.615776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:38.689909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:38.705767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:38.736518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30333d-1194-49d2-b501-1eb949500785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:38.739913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30333d-1194-49d2-b501-1eb949500785 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:38.740400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30333d-1194-49d2-b501-1eb949500785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:38.742701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30333d-1194-49d2-b501-1eb949500785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:38.743864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30333d-1194-49d2-b501-1eb949500785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:38.749722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30333d-1194-49d2-b501-1eb949500785 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:38.794852 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2523/5045] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:38.796531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:38.796823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:38.797143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:38.811171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84afd3-f5eb-48cf-9db6-9f252b110b91 tempest-ApplicationCredentialsV3AdminTest-1613855029 tempest-ApplicationCredentialsV3AdminTest-1613855029-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:38.823217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:38.825334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:38.825914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:38.826429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] PATH_INFO: `/v3/users/e2293419a3ac4a08995749f4b7c00f58` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:38.832242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2293419a3ac4a08995749f4b7c00f58)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:38.837116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:38.867697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:38.868981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:38.966940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2293419a3ac4a08995749f4b7c00f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:39.049187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2293419a3ac4a08995749f4b7c00f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:39.079841 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2524/5046] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:39.082020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2293419a3ac4a08995749f4b7c00f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:39.083196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:39.084080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2293419a3ac4a08995749f4b7c00f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:39.091066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:39.127776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5faa35fa-d0fa-44a2-97e0-bf690e965c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2293419a3ac4a08995749f4b7c00f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:39.166372 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2523/5047] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:38 2022] DELETE /identity/v3/users/e2293419a3ac4a08995749f4b7c00f58 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:39.172650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:39.173417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:39.173712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:39.176201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727719b4-dbe2-45c3-b1bb-14e51e8c3732 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:39.212423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:39.213775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:39.379258 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2524/5048] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:39.505142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:39.506761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:39.512026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:39.519110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] PATH_INFO: `/v3/projects/d2a60d41486546d195a09f2d9ac20927/users/943756133e184708ad86846f11f94c04/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:39.563563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a60d41486546d195a09f2d9ac20927, user_id=943756133e184708ad86846f11f94c04, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:39.568681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:39.578127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:39.580459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:39.600664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2525/5049] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:39 2022] PUT /identity/v3/projects/d2a60d41486546d195a09f2d9ac20927/users/943756133e184708ad86846f11f94c04/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:39.607513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:39.612798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:39.684712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:39.715831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd662ea-abbe-4863-a5af-eee807d37e57 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:39.730298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baebee4-e32e-4085-bbe8-f95f2e0e17fd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:39.737474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:39.738867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:39.739403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:39.739884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:39.741397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:39.743892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:39.767796 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2526/5050] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:39.769529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:39.793340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e9de-7710-4302-8e88-be7186b6ba96 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:39.807181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d12984-f0f8-4dbf-bc85-7d49c66989a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:39.809034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d12984-f0f8-4dbf-bc85-7d49c66989a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:39.810445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d12984-f0f8-4dbf-bc85-7d49c66989a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:39.811038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d12984-f0f8-4dbf-bc85-7d49c66989a7 admin admin] PATH_INFO: `/v3/projects/d2a60d41486546d195a09f2d9ac20927/users/943756133e184708ad86846f11f94c04/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:39.815438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d12984-f0f8-4dbf-bc85-7d49c66989a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a60d41486546d195a09f2d9ac20927, user_id=943756133e184708ad86846f11f94c04, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:39.821752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d12984-f0f8-4dbf-bc85-7d49c66989a7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:39.837862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:39.838617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:39.838856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:39.839125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:39.847515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:39.856431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:39.857991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:39.865485 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2527/5051] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:39 2022] PUT /identity/v3/projects/d2a60d41486546d195a09f2d9ac20927/users/943756133e184708ad86846f11f94c04/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:39.883930 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2525/5052] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:39.896764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb5c5-b897-41da-bbb9-ed501764ade2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:39.897661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb5c5-b897-41da-bbb9-ed501764ade2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:39.897809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb5c5-b897-41da-bbb9-ed501764ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:39.992477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c17cb5c5-b897-41da-bbb9-ed501764ade2 None None] MFA Rules not processed for user `943756133e184708ad86846f11f94c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:39.994640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c17cb5c5-b897-41da-bbb9-ed501764ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:40.159260 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2528/5053] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:40.161315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:40.339710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b54db-c5b4-4cc2-8425-31948ddff459 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:40.348774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:40.349839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:40.350349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:40.350782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:40.352240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:40.355490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:40.413072 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2526/5054] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:00:40 2022] POST /identity/v3/domains => generated 277 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:40.414365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb5c5-b897-41da-bbb9-ed501764ade2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:40.440896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb5c5-b897-41da-bbb9-ed501764ade2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:40.619014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:40.620542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:40.621063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:40.621571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:40.623068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:40.631041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:40.736269 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2529/5055] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:40 2022] POST /identity/v3/groups => generated 280 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:40.738894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:40.795800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87370bb3-0c4d-4f2f-a16b-00ebe4bc9471 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:40.816978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:40.818673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:40.819578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:40.819964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/8e26ec9d7f59402190caa352565862dc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:40.848510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:update_group(group_id=8e26ec9d7f59402190caa352565862dc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:40.851612 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:40.851612 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:40.851612 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:40.859314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:40.922333 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2527/5056] 10.222.0.98 () {60 vars in 1246 bytes} [Thu Jul 14 15:00:40 2022] PATCH /identity/v3/groups/8e26ec9d7f59402190caa352565862dc => generated 291 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:00:40.927174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:40.962041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427adb11-2fd4-4c16-90c0-a7393718c686 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:40.970855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:40.972369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:40.973056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:40.973365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/8e26ec9d7f59402190caa352565862dc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:40.997277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:get_group(group_id=8e26ec9d7f59402190caa352565862dc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:41.003050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:41.007354 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2530/5057] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:40 2022] GET /identity/v3/groups/8e26ec9d7f59402190caa352565862dc => generated 291 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:41.013236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:41.043228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afe6d3-e537-4dc4-b9db-200919953e11 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:41.066921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:41.080030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:41.081050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:41.081771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/8e26ec9d7f59402190caa352565862dc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:41.088755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:update_group(group_id=8e26ec9d7f59402190caa352565862dc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:41.134691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:41.191613 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2528/5058] 10.222.0.98 () {60 vars in 1245 bytes} [Thu Jul 14 15:00:41 2022] PATCH /identity/v3/groups/8e26ec9d7f59402190caa352565862dc => generated 307 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:41.196686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:41.240737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb20b-0981-493a-8410-54f167888548 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:41.270448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:41.272132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:41.278630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:41.279141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/8e26ec9d7f59402190caa352565862dc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:41.299837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8e26ec9d7f59402190caa352565862dc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:41.314630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:41.515987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2531/5059] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:00:41 2022] DELETE /identity/v3/groups/8e26ec9d7f59402190caa352565862dc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:41.518300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:41.576032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9603484-06f6-4c85-b508-7218f0dc3ebc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:41.760615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:41.761333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:41.761627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:41.761931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:41.762659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:41.770033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:41.777731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:41.796972 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2529/5060] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:41 2022] POST /identity/v3/groups => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:41.801854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:41.816542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd992eed-dab9-41c0-bdee-449f045b1bb9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:41.826924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dbf13-58b9-45a7-bd6b-695a1b76f36c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:41.827717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbf13-58b9-45a7-bd6b-695a1b76f36c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:41.828556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbf13-58b9-45a7-bd6b-695a1b76f36c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:41.828556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbf13-58b9-45a7-bd6b-695a1b76f36c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:41.829224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dbf13-58b9-45a7-bd6b-695a1b76f36c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:41.832106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dbf13-58b9-45a7-bd6b-695a1b76f36c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:41.851535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:41.892745 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2532/5061] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:41 2022] POST /identity/v3/users => generated 321 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:41.902611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:41.942749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2119a-62db-4eef-88ca-1a3abdd4bc7f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:41.980457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:41.981523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:41.982341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:41.982634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/6621fbaafc2e446fa0744afe711e6d79` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:42.038855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=6621fbaafc2e446fa0744afe711e6d79)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:42.043021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:42.059036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:42.059859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:42.059859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:42.121715 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2530/5062] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 15:00:41 2022] PUT /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/6621fbaafc2e446fa0744afe711e6d79 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:42.124539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:42.143129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:42.146181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:42.326656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8d404-1641-480e-8c57-9fb15b3569b5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:42.354843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:42.356218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:42.356604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:42.357071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:42.358304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:42.361994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:42.373701 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2533/5063] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:42.374753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:42.377960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:42.451826 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2531/5064] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:42 2022] POST /identity/v3/users => generated 323 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:42.453527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:42.493326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac53815-f74f-4270-afe4-17ac35092da2 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:42.513807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:42.515496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:42.516011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:42.517083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/c80798b0666141419ebcd832b7b45f03` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:42.538458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469befe8-1fc4-4de5-8cec-7189e284a5d0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:42.558847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:42.560170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:42.560807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:42.561110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] PATH_INFO: `/v3/projects/eb8111b8a7014a3593e350eb3a47e0bb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:42.569043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8111b8a7014a3593e350eb3a47e0bb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:42.572603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=c80798b0666141419ebcd832b7b45f03)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:42.576317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:42.581874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:42.656189 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2532/5065] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 15:00:42 2022] PUT /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/c80798b0666141419ebcd832b7b45f03 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:42.658390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:42.738518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8111b8a7014a3593e350eb3a47e0bb', 'request_id': 'req-78dfdb19-a974-49e6-a866-094bb409e1ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:42.761563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8111b8a7014a3593e350eb3a47e0bb', 'request_id': 'req-78dfdb19-a974-49e6-a866-094bb409e1ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:42.773576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8111b8a7014a3593e350eb3a47e0bb', 'request_id': 'req-78dfdb19-a974-49e6-a866-094bb409e1ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:42.811369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] The token cache is being invalidate because project eb8111b8a7014a3593e350eb3a47e0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:42.812646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:42.816120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:42.826125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2534/5066] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:42 2022] DELETE /identity/v3/projects/eb8111b8a7014a3593e350eb3a47e0bb => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:42.827879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:42.833840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:42.850427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281820-bd9c-4144-9f0c-348f79551fa7 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:42.912462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:42.921206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:43.008607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfdb19-a974-49e6-a866-094bb409e1ce admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:43.020590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:43.021680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:43.022058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:43.022441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] PATH_INFO: `/v3/users/3739a1686ec64703866dd4559202d1f2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:43.027111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3739a1686ec64703866dd4559202d1f2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:43.029620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:43.033126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:43.033976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:43.034267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:43.034612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:43.036340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:43.039009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:43.120488 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2533/5067] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:42 2022] POST /identity/v3/users => generated 321 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:43.129644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:43.141131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:43.162207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3739a1686ec64703866dd4559202d1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:43.195607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61d782-9f7a-4038-a836-1a09a07aa20e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:43.206363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3739a1686ec64703866dd4559202d1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:43.207224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3739a1686ec64703866dd4559202d1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:43.228034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:43.229182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3739a1686ec64703866dd4559202d1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:43.231929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:43.234522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3739a1686ec64703866dd4559202d1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:43.237367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:43.240326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/080ec510875f49e084523845375ff098` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:43.261881 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2535/5068] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:42 2022] DELETE /identity/v3/users/3739a1686ec64703866dd4559202d1f2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:43.305574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=080ec510875f49e084523845375ff098)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:43.326589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:43.425289 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2534/5069] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 15:00:43 2022] PUT /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/080ec510875f49e084523845375ff098 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:43.430203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:43.432273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:43.669225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6de947-5766-4b44-a5a6-eb9a08b28957 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:43.825023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:43.839332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:43.840367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:43.840739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:43.841107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:43.843444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=0c5207296acd4d2ab29fc5712e8384a4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:43.845212 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:43.845212 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:00:43.845212 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:00:43.846883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:43.874768 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2536/5070] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:00:43 2022] GET /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users => generated 1081 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:43.876683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:43.890258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59397987-2c7c-4d28-8aad-443d36ba483c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:43.897185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:43.898384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:43.898774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:43.900476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/6621fbaafc2e446fa0744afe711e6d79` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:43.902649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=6621fbaafc2e446fa0744afe711e6d79)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:43.904551 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:43.904551 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:43.904551 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:43.906190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:43.929418 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2535/5071] 10.222.0.98 () {58 vars in 1341 bytes} [Thu Jul 14 15:00:43 2022] HEAD /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/6621fbaafc2e446fa0744afe711e6d79 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:43.931206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:43.944021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87eb2-2591-4107-85ca-e4c6477990f5 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:43.950172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:43.951566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:43.951991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:43.952290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/6621fbaafc2e446fa0744afe711e6d79` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:43.954311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=6621fbaafc2e446fa0744afe711e6d79)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:43.956375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:43.968165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6621fbaafc2e446fa0744afe711e6d79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.023093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2537/5072] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 15:00:43 2022] DELETE /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/6621fbaafc2e446fa0744afe711e6d79 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:44.028430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:44.042558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d28a0-c531-4c9a-8b76-00e5feb32baa tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:44.169721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:44.172366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:44.173621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:44.174087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/c80798b0666141419ebcd832b7b45f03` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:44.176589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=c80798b0666141419ebcd832b7b45f03)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:44.178944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:44.200563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2536/5073] 10.222.0.98 () {58 vars in 1341 bytes} [Thu Jul 14 15:00:44 2022] HEAD /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/c80798b0666141419ebcd832b7b45f03 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:44.204749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:44.216513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ed22-4d7f-42bb-ade5-eae7c7732047 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:44.222885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:44.223887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:44.224825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:44.225136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/c80798b0666141419ebcd832b7b45f03` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:44.227916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=c80798b0666141419ebcd832b7b45f03)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:44.230626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:44.242320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c80798b0666141419ebcd832b7b45f03'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.272784 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2538/5074] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 15:00:44 2022] DELETE /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/c80798b0666141419ebcd832b7b45f03 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:44.277111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:44.289687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45194-81c1-40a9-9b22-d8effc657360 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:44.339624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:44.341543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:44.394750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:44.416445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:44.418590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:44.419016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:44.419748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/080ec510875f49e084523845375ff098` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:44.424127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=080ec510875f49e084523845375ff098)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:44.426511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:44.456311 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2537/5075] 10.222.0.98 () {58 vars in 1341 bytes} [Thu Jul 14 15:00:44 2022] HEAD /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/080ec510875f49e084523845375ff098 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:44.460673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:44.486021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0bd9b-6120-4de0-8e63-f01ff1a685d6 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:44.500752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:44.502264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:44.502915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:44.503556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/080ec510875f49e084523845375ff098` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:44.512508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0c5207296acd4d2ab29fc5712e8384a4, user_id=080ec510875f49e084523845375ff098)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:44.515069 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:44.515069 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:44.515069 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:44.520239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:44.553497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448952d-0ea1-4541-95ff-8b8bdf8bbb8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:44.559588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:44.560633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:44.560802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:44.561094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] PATH_INFO: `/v3/projects/a0bef6385a9c49a4800af7ee108e5ec5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:44.562534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bef6385a9c49a4800af7ee108e5ec5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:44.565343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:44.615154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '080ec510875f49e084523845375ff098'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.673165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2538/5076] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 15:00:44 2022] DELETE /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users/080ec510875f49e084523845375ff098 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:44.681558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:44.771166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bef6385a9c49a4800af7ee108e5ec5', 'request_id': 'req-cb9a981a-b489-4ecb-a49f-06b585a27ea0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.802861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bef6385a9c49a4800af7ee108e5ec5', 'request_id': 'req-cb9a981a-b489-4ecb-a49f-06b585a27ea0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.837633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bef6385a9c49a4800af7ee108e5ec5', 'request_id': 'req-cb9a981a-b489-4ecb-a49f-06b585a27ea0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.897336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] The token cache is being invalidate because project a0bef6385a9c49a4800af7ee108e5ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:44.897615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.900077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb9a981a-b489-4ecb-a49f-06b585a27ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:44.905135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2539/5077] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:44 2022] DELETE /identity/v3/projects/a0bef6385a9c49a4800af7ee108e5ec5 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:44.908767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067a4f0-b278-47ae-84c8-9249befdea51 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:44.909309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067a4f0-b278-47ae-84c8-9249befdea51 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:44.910075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067a4f0-b278-47ae-84c8-9249befdea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:44.944030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04026c4-2df4-4bd8-bade-c5819946c86e tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:44.950926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f067a4f0-b278-47ae-84c8-9249befdea51 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:44.952297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f067a4f0-b278-47ae-84c8-9249befdea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:45.023789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:45.107058 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2540/5078] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:45.110528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7fc2-0986-492f-bf5e-ef5028cf60b1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.110870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7fc2-0986-492f-bf5e-ef5028cf60b1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.111122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7fc2-0986-492f-bf5e-ef5028cf60b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:45.132042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:45.133046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.133342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.133625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:45.146699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=0c5207296acd4d2ab29fc5712e8384a4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:45.146699 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:45.146699 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:00:45.146699 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:00:45.151197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:45.175146 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2539/5079] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:00:44 2022] GET /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4/users => generated 145 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:45.180218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:45.183179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:45.184833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fb8e7fc2-0986-492f-bf5e-ef5028cf60b1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:45.187552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb8e7fc2-0986-492f-bf5e-ef5028cf60b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:45.226277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1833b0-4d0d-4285-a123-ef61fba9d17c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:45.248210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:45.249154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.249456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.249807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users/080ec510875f49e084523845375ff098` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:45.260296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=080ec510875f49e084523845375ff098)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:45.263237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:45.312144 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2541/5080] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:45.321192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72796f68-2e67-4618-8097-23224b5a0e54 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.321910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72796f68-2e67-4618-8097-23224b5a0e54 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.322155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72796f68-2e67-4618-8097-23224b5a0e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:45.345997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-72796f68-2e67-4618-8097-23224b5a0e54 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:45.347328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-72796f68-2e67-4618-8097-23224b5a0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:45.359441 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2542/5081] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:45.367490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72796f68-2e67-4618-8097-23224b5a0e54 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:45.372934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080ec510875f49e084523845375ff098'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:45.388378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72796f68-2e67-4618-8097-23224b5a0e54 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:45.410416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:45.411666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.417022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.418301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:45.419767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:45.420310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:45.424746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:45.436338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:45.456705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080ec510875f49e084523845375ff098'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:45.480269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080ec510875f49e084523845375ff098'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:45.482136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080ec510875f49e084523845375ff098'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:45.502975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2543/5082] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:45.504830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:45.517317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080ec510875f49e084523845375ff098'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:45.543945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559368fb-012a-411d-8d73-1bd943376e3f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:45.548061 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2540/5083] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:45 2022] DELETE /identity/v3/users/080ec510875f49e084523845375ff098 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:45.554332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:45.562028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:45.639114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:45.640011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.640530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.641923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:45.642773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:45.646251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:45.691104 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2544/5084] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:45 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:45.692187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:45.695103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:45.846511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:45.871211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b298c-4cc1-421c-8e18-d6dac088143c tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:45.897675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81813fb-56f4-4a05-8d98-2ade43ed99d2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:45.905324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4572412-134e-46ec-9658-8fe70ed4b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:45.907844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572412-134e-46ec-9658-8fe70ed4b74a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.908115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572412-134e-46ec-9658-8fe70ed4b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.908416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572412-134e-46ec-9658-8fe70ed4b74a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:45.909399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4572412-134e-46ec-9658-8fe70ed4b74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:45.911758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4572412-134e-46ec-9658-8fe70ed4b74a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:45.975947 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2545/5085] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:45 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:45.979676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a5980-206a-4105-9167-9c40c2e04a5e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:45.982501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a5980-206a-4105-9167-9c40c2e04a5e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:45.983461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a5980-206a-4105-9167-9c40c2e04a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.030292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f90a5980-206a-4105-9167-9c40c2e04a5e None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:46.031996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f90a5980-206a-4105-9167-9c40c2e04a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:46.043021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:46.045881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:46.047991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:46.048522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users/c80798b0666141419ebcd832b7b45f03` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.052659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c80798b0666141419ebcd832b7b45f03)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:46.055709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:46.171407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80798b0666141419ebcd832b7b45f03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.209340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80798b0666141419ebcd832b7b45f03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.235174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80798b0666141419ebcd832b7b45f03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.236108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80798b0666141419ebcd832b7b45f03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.237935 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2546/5086] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:46.246373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a5980-206a-4105-9167-9c40c2e04a5e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:46.260353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80798b0666141419ebcd832b7b45f03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.287162 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2541/5087] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:45 2022] DELETE /identity/v3/users/c80798b0666141419ebcd832b7b45f03 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:46.288641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a5980-206a-4105-9167-9c40c2e04a5e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:46.289402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:46.294408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:46.312033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:46.432264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:46.433533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:46.433533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:46.433533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.434597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:46.437420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:46.456755 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2547/5088] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:46.465355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:46.468537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:46.535155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba60ce-11cc-4304-b911-8608f2d9e7a3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:46.553571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:46.554787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:46.555452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:46.555767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.557945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:46.578182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:46.581300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:46.607550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0d6af-ed6a-49f7-9f9a-7f8e7cf04b8c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:46.619777 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2542/5089] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:46.624064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:46.628027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:46.638072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:46.639609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:46.640116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:46.640629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users/6621fbaafc2e446fa0744afe711e6d79` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.649115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6621fbaafc2e446fa0744afe711e6d79)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:46.649674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be75cc9-9850-4ec8-abfa-96497368f108 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:46.654244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:46.655430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:46.656469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:46.656773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:46.657064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.657993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:46.660172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:46.673523 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2543/5090] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:46.679386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:46.680332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:46.702587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd63bd-3101-46db-b4f8-0657703ee036 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:46.734697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6621fbaafc2e446fa0744afe711e6d79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.751745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35cc9e-d49d-405c-9da7-7504197f850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:46.752551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6621fbaafc2e446fa0744afe711e6d79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.753354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6621fbaafc2e446fa0744afe711e6d79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.762542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35cc9e-d49d-405c-9da7-7504197f850f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:46.762790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6621fbaafc2e446fa0744afe711e6d79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.763478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6621fbaafc2e446fa0744afe711e6d79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:46.767849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35cc9e-d49d-405c-9da7-7504197f850f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:46.768321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35cc9e-d49d-405c-9da7-7504197f850f admin admin] PATH_INFO: `/v3/projects/26e9439c5e6745f9a737c660270e12e6/users/9ec7a6cb28cc4743a15b1be2c32d6ef4/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.801828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2548/5091] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:46 2022] DELETE /identity/v3/users/6621fbaafc2e446fa0744afe711e6d79 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:46.803096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:46.806918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:46.846669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35cc9e-d49d-405c-9da7-7504197f850f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e9439c5e6745f9a737c660270e12e6, user_id=9ec7a6cb28cc4743a15b1be2c32d6ef4, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:46.850227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35cc9e-d49d-405c-9da7-7504197f850f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:46.870309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2544/5092] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:46 2022] PUT /identity/v3/projects/26e9439c5e6745f9a737c660270e12e6/users/9ec7a6cb28cc4743a15b1be2c32d6ef4/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:46.894588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:46.895128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:46.895621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:46.916530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86398-e564-45e2-aa56-77feffea968b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:46.950234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] MFA Rules not processed for user `9ec7a6cb28cc4743a15b1be2c32d6ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:46.953325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:47.061493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.062395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.062701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.063063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/0c5207296acd4d2ab29fc5712e8384a4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.065206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0c5207296acd4d2ab29fc5712e8384a4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.067961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.131051 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2545/5093] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:47.134957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.139719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:47.159581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:47.177978 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2549/5094] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:00:46 2022] DELETE /identity/v3/groups/0c5207296acd4d2ab29fc5712e8384a4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:47.180971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.226438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:47.274591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31842d86-4568-46b4-912e-b5bb338d3146 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.283417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.284360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.284826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.285224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.286946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.290159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.300146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46cb7-04de-439f-b55b-7f13cd91d806 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.317592 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2550/5095] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:47 2022] POST /identity/v3/groups => generated 327 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:47.318875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.331185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6986-efbd-4bf4-b2a8-11c562bf1937 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.339244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.340169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.340841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.341236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.342306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.345535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.369650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2551/5096] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:47 2022] POST /identity/v3/groups => generated 326 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:47.370859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.385246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4554af1-a784-4d3e-998c-9ba06181d7af tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.391496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.392581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.393215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.393611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.394551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.397562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.424680 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2552/5097] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:47 2022] POST /identity/v3/groups => generated 326 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:47.426312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.441852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.442630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ab0d-dbd6-4e79-8195-d367273c9380 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.443401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.443885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.444553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.445610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.449189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.452397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.453854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.454312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.454898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.456496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.457838 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:00:47.457838 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:00:47.457838 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:00:47.459348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.473135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2553/5098] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 15:00:47 2022] GET /identity/v3/groups => generated 1489 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:47.474408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.491978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0affb-982b-4521-b00a-a36e034dfd1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.498222 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2546/5099] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:47 2022] POST /identity/v3/projects => generated 383 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:47.501331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.502341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.502729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.503092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/2bb4561b9e3c4c07af296f6fa48f76ef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.504996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.511561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2bb4561b9e3c4c07af296f6fa48f76ef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.514113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.588674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2554/5100] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:00:47 2022] DELETE /identity/v3/groups/2bb4561b9e3c4c07af296f6fa48f76ef => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:47.593789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.689638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079468b0-96ce-40ab-bd9e-c97e030a2a13 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.696970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.698803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.700131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.700131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/6a044c5c907d4f46bd3453bd5097070d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.702548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ded7-845d-48a4-9fa7-2febe2f9be76 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.708611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6a044c5c907d4f46bd3453bd5097070d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.711187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.713503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:47.824466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.825714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.829991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.829991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.829991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.830865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:47.847581 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2555/5101] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:00:47 2022] DELETE /identity/v3/groups/6a044c5c907d4f46bd3453bd5097070d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:47.849662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.864290 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2547/5102] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:47 2022] POST /identity/v3/users => generated 298 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:47.869417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:47.882565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06867fc5-4cd9-415d-8218-bf05b119841d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:47.903734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:47.994460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:47.995477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:47.995822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:47.996160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:47.996952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:47.998651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.011014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e6a8c-f542-43b0-81ed-e24f98513a2b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.021353 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2548/5103] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:00:48.023023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.026970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.028127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.031768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.033119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/94803a0af4d146ddbeb120e96a1480f3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.041217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f392a6-f1bb-47e7-b4da-c64dc21d7a47 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.047574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_group(group_id=94803a0af4d146ddbeb120e96a1480f3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.050639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.055790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.057593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.058735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.059611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] PATH_INFO: `/v3/projects/fb1e8eff1dc54ef69e2339e5c89e0022/users/8fe1b6ae1823493597865404417dab5b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.120390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1e8eff1dc54ef69e2339e5c89e0022, user_id=8fe1b6ae1823493597865404417dab5b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.125212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.135482 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2556/5104] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:00:47 2022] DELETE /identity/v3/groups/94803a0af4d146ddbeb120e96a1480f3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:48.150706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.195877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2549/5105] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:48 2022] PUT /identity/v3/projects/fb1e8eff1dc54ef69e2339e5c89e0022/users/8fe1b6ae1823493597865404417dab5b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:48.202713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.320227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee721642-319a-425c-8a13-c1007f22d45c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.326075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.326857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.327172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.327564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.329092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.331111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.345689 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2550/5106] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:48.351757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.365950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9c88a-9821-412a-bdd3-8bc82d346c22 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.372264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f888d-f4c5-4a5e-8300-1135ac23cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.373208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f888d-f4c5-4a5e-8300-1135ac23cb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.373500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f888d-f4c5-4a5e-8300-1135ac23cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.373798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f888d-f4c5-4a5e-8300-1135ac23cb9e admin admin] PATH_INFO: `/v3/projects/fb1e8eff1dc54ef69e2339e5c89e0022/users/8fe1b6ae1823493597865404417dab5b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.376720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f888d-f4c5-4a5e-8300-1135ac23cb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1e8eff1dc54ef69e2339e5c89e0022, user_id=8fe1b6ae1823493597865404417dab5b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.380512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f888d-f4c5-4a5e-8300-1135ac23cb9e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.395940 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2551/5107] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:00:48 2022] PUT /identity/v3/projects/fb1e8eff1dc54ef69e2339e5c89e0022/users/8fe1b6ae1823493597865404417dab5b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:48.414153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4175f-e81b-4071-af1d-95a81f65d5e5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.414534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4175f-e81b-4071-af1d-95a81f65d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.414791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4175f-e81b-4071-af1d-95a81f65d5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.444181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200dfa-46e9-45e6-87fc-41f7e6103e8a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.466422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65a4175f-e81b-4071-af1d-95a81f65d5e5 None None] MFA Rules not processed for user `8fe1b6ae1823493597865404417dab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:48.467741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65a4175f-e81b-4071-af1d-95a81f65d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:48.510682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:48.671907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.676227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.677878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.678169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:48.681402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.683007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.695540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.749142 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2552/5108] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:48.749142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537deebc-f7b8-4696-8f1c-c946ae8bd457 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.749752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537deebc-f7b8-4696-8f1c-c946ae8bd457 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.750659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537deebc-f7b8-4696-8f1c-c946ae8bd457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.789017 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2557/5109] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:48 2022] POST /identity/v3/users => generated 323 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:48.791985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.800833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-537deebc-f7b8-4696-8f1c-c946ae8bd457 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:48.803621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-537deebc-f7b8-4696-8f1c-c946ae8bd457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:48.821956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a0032-978f-480f-b5d1-21bf735b7be3 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.830926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.832454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.833081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.833727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.835374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.839174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invalid input for field 'name': '' is too short Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: On instance['name']: Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: On instance['name']: Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: '' Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise error Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application '' Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.860042 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:00:48.863317 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application '' Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.867244 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2558/5110] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:00:48 2022] POST /identity/v3/domains => generated 283 bytes in 76 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:00:48.869390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.885078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4682bd2-dd0a-47a0-a849-29d0e82022bc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.900091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.900853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.901157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.901477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.903369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.906295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.942209 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2559/5111] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:48 2022] POST /identity/v3/groups => generated 325 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:48.942209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.962680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdec081-5e09-441a-9f5f-6322f1a24fbc tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:48.968990 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2553/5112] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:48.970930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537deebc-f7b8-4696-8f1c-c946ae8bd457 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:48.974809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:48.975708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:48.976009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:48.976878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:48.977423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:48.979324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: On instance['name']: Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: On instance['name']: Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise error Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.992737 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 14 15:00:48.994009 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:48.999640 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2560/5113] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:00:48 2022] POST /identity/v3/domains => generated 412 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:00:49.006899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:49.036332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537deebc-f7b8-4696-8f1c-c946ae8bd457 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:49.038270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29e114-d5a5-46b0-881a-135a8078bbf8 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:49.048413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:49.049805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:49.050295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:49.051363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/4de8525fe7084075b77191bb773f25ea/users/2fc38bb592694b0988b891052c8026bf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:49.065565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:49.068797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:49.069472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:49.070592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:49.071929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:49.081287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:49.132575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4de8525fe7084075b77191bb773f25ea, user_id=2fc38bb592694b0988b891052c8026bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:49.136068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:49.140710 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2561/5114] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:00:48 2022] POST /identity/v3/domains => generated 274 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:49.147645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:49.197091 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2554/5115] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 15:00:48 2022] PUT /identity/v3/groups/4de8525fe7084075b77191bb773f25ea/users/2fc38bb592694b0988b891052c8026bf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:49.201899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:49.391013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60146e-a20a-4cfa-9731-aa7dd9641eaf tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:49.400564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2725234-6868-477d-a535-a8db427699e8 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:49.418005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:49.420328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:49.421002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:49.421643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:49.429640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:49.434208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:49.502421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2555/5116] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:49 2022] POST /identity/v3/groups => generated 327 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:49.507411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:49.553576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6456e0-147a-4843-b269-346d44ca538b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:49.572210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:49.575114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:49.580771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:49.581660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/003d6f9a35684f2da643d48b89b02a06/users/2fc38bb592694b0988b891052c8026bf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:49.609401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=003d6f9a35684f2da643d48b89b02a06, user_id=2fc38bb592694b0988b891052c8026bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:49.614462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:49.694102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2556/5117] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 15:00:49 2022] PUT /identity/v3/groups/003d6f9a35684f2da643d48b89b02a06/users/2fc38bb592694b0988b891052c8026bf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:49.699075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:49.824531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:49.908652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:49.910628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:49.911144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:49.912812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains/ee96d4db5c71436c8b05494beae34fda` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:49.936708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ee96d4db5c71436c8b05494beae34fda)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:49.942085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:49.987229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6916c5-fb75-49d5-9835-6b2d6c4581b9 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 14 15:00:50.004596 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 14 15:00:50.005674 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:50.008655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:50.014204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:50.019141 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2562/5118] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:00:49 2022] DELETE /identity/v3/domains/ee96d4db5c71436c8b05494beae34fda => generated 120 bytes in 869 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:00:50.021849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:50.039374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:50.041422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users/2fc38bb592694b0988b891052c8026bf/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:50.048328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=2fc38bb592694b0988b891052c8026bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:50.056272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:50.070888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7151f6-214f-4de1-857a-ba9329c0b3dc tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:50.082639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:50.104577 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2557/5119] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:00:49 2022] GET /identity/v3/users/2fc38bb592694b0988b891052c8026bf/groups => generated 838 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:50.106092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:50.134969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984faeb5-354a-4da6-8d6e-891d7ab8cc1f tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:50.148863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:50.153549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:50.154112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:50.158156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/003d6f9a35684f2da643d48b89b02a06` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:50.160298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_group(group_id=003d6f9a35684f2da643d48b89b02a06)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:50.167253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:50.231079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:50.232716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:50.233997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:50.233997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains/ee96d4db5c71436c8b05494beae34fda` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:50.236718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ee96d4db5c71436c8b05494beae34fda)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:50.241277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:50.304233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.305947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.349692 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2558/5120] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:00:50 2022] DELETE /identity/v3/groups/003d6f9a35684f2da643d48b89b02a06 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:50.353312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.353312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.354820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:50.360081 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2563/5121] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:00:50 2022] PATCH /identity/v3/domains/ee96d4db5c71436c8b05494beae34fda => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:50.361375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:50.366955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:50.372675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:50.540725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd65c-12d0-4a3c-87f4-bb490f6a087b tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:50.577258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca145-4196-47b2-a39f-7f2d19406f50 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:50.589736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:50.592641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:50.595152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:50.595757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/groups/4de8525fe7084075b77191bb773f25ea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:50.597797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4de8525fe7084075b77191bb773f25ea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:50.603785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:50.670185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:50.671106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:50.671969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:50.672886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains/ee96d4db5c71436c8b05494beae34fda` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:50.693071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ee96d4db5c71436c8b05494beae34fda)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:50.699789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:50.745067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:50.782236 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2559/5122] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:00:50 2022] DELETE /identity/v3/groups/4de8525fe7084075b77191bb773f25ea => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:50.788051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:50.791901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.804811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.885932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:50.933256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda', 'request_id': 'req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.962390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda', 'request_id': 'req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:50.977840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda', 'request_id': 'req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.003622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] The token cache is being invalidate because project ee96d4db5c71436c8b05494beae34fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:51.003906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.004541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.008984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93494dcc-4e37-455a-842e-b9658511dcee tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:51.025908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda', 'request_id': 'req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.036032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda', 'request_id': 'req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.037420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ee96d4db5c71436c8b05494beae34fda', 'request_id': 'req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.048477 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2564/5123] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:00:50 2022] DELETE /identity/v3/domains/ee96d4db5c71436c8b05494beae34fda => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:51.053503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:51.057147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:51.113452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:51.116420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:51.116590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:51.116890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/users/2fc38bb592694b0988b891052c8026bf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:51.119181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2fc38bb592694b0988b891052c8026bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:51.122905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:51.226816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6c72-c059-4cad-bf1b-4d51c7b181e9 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:51.229141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc38bb592694b0988b891052c8026bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.246850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:51.247978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:51.248281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:51.248573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains/cb14f29e564d407eb848beae53a7b636` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:51.254873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc38bb592694b0988b891052c8026bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.269575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc38bb592694b0988b891052c8026bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.271148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc38bb592694b0988b891052c8026bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.274868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Could not find domain: cb14f29e564d407eb848beae53a7b636.: keystone.exception.DomainNotFound: Could not find domain: cb14f29e564d407eb848beae53a7b636. Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cb14f29e564d407eb848beae53a7b636. Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:00:51.286052 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:00:51.288156 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:00:51.292462 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cb14f29e564d407eb848beae53a7b636. Jul 14 15:00:51.295612 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.295612 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2565/5124] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:00:51 2022] DELETE /identity/v3/domains/cb14f29e564d407eb848beae53a7b636 => generated 112 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:00:51.296075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc38bb592694b0988b891052c8026bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.296698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:51.304872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:51.311873 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2560/5125] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:50 2022] DELETE /identity/v3/users/2fc38bb592694b0988b891052c8026bf => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:51.328254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:51.333969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:51.343790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8bc4-e009-4c50-8c57-14738772ae48 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:51.472459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:51.501668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:51.521452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:51.523669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:51.523954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:51.524244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:51.535290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:51.537296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:51.557834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44562-e290-4627-bd87-fb91527d1b27 tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:51.570301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2566/5126] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:00:51 2022] POST /identity/v3/domains => generated 252 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:51.575408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:51.580511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:51.581443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:51.581729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:51.582012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/domains/6017b5829ff2448ba4a07ff93bfa1a5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:51.584290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6017b5829ff2448ba4a07ff93bfa1a5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:51.587343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:51.626481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.628756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.680023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.681157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.693494 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2561/5127] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:00:51 2022] PATCH /identity/v3/domains/6017b5829ff2448ba4a07ff93bfa1a5f => generated 278 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:51.693494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:51.698457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:51.745290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35b486-a3a0-454c-88fa-7a97f4e15f2a tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:51.861537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f34dd9-9afc-4639-a196-0d3af288400b tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:51.861748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:51.862387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:51.862605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:51.871707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:51.872658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:51.874976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:51.889342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943756133e184708ad86846f11f94c04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a60d41486546d195a09f2d9ac20927', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:51.890925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:51.892022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:51.892549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] PATH_INFO: `/v3/domains/6017b5829ff2448ba4a07ff93bfa1a5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:51.909997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.sql.core [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-164193170' for key 'project.ixu_project_name_domain_id'") Jul 14 15:00:51.909997 n-d-768852-23 devstack@keystone.service[80582]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:00:51.909997 n-d-768852-23 devstack@keystone.service[80582]: [parameters: {'id': 'b93bef60c0b34ea39fa65172486cf0b1', 'name': 'tempest-domain-dup-164193170', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 14 15:00:51.909997 n-d-768852-23 devstack@keystone.service[80582]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80582) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:00:51.911678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6017b5829ff2448ba4a07ff93bfa1a5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:51.914565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-164193170.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-164193170. Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:00:51.926057 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-164193170' for key 'project.ixu_project_name_domain_id'") Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 15:00:51.926993 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application yield resource Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise self.value Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application session.commit() Jul 14 15:00:51.928135 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:00:51.929047 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:00:51.929995 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:00:51.930928 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-164193170' for key 'project.ixu_project_name_domain_id'") Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [parameters: {'id': 'b93bef60c0b34ea39fa65172486cf0b1', 'name': 'tempest-domain-dup-164193170', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.931921 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-164193170. Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:00:51.932707 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-164193170. Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:51.939829 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2567/5128] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:00:51 2022] POST /identity/v3/domains => generated 211 bytes in 359 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:00:51.943980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:51.946118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:51.965682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.970644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:51.973925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4c3fd-75ea-472c-811e-8c89dae989e2 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:51.994960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:51.995954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:51.996176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:51.996455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains/126dbdac017c4c0fa57711aa0a63475c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:52.023111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=126dbdac017c4c0fa57711aa0a63475c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:52.024801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:52.041073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f', 'request_id': 'req-d0cef04e-fee2-426a-9494-9780920fb98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.050411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f', 'request_id': 'req-d0cef04e-fee2-426a-9494-9780920fb98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.060576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f', 'request_id': 'req-d0cef04e-fee2-426a-9494-9780920fb98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.095880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.098917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] The token cache is being invalidate because project 6017b5829ff2448ba4a07ff93bfa1a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:52.099300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.101308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.102912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.136209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:52.140721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f', 'request_id': 'req-d0cef04e-fee2-426a-9494-9780920fb98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.147097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f', 'request_id': 'req-d0cef04e-fee2-426a-9494-9780920fb98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.149893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6017b5829ff2448ba4a07ff93bfa1a5f', 'request_id': 'req-d0cef04e-fee2-426a-9494-9780920fb98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.165618 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2562/5129] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:00:51 2022] DELETE /identity/v3/domains/6017b5829ff2448ba4a07ff93bfa1a5f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:52.169905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:52.171569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:52.179366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.180463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.189350 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2568/5130] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:00:51 2022] PATCH /identity/v3/domains/126dbdac017c4c0fa57711aa0a63475c => generated 253 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:00:52.190907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:52.203017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:52.358559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:52.387228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cef04e-fee2-426a-9494-9780920fb98a tempest-GroupsV3TestJSON-1194009575 tempest-GroupsV3TestJSON-1194009575-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:52.436015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeab722-8d12-443b-9fd9-233d42e17548 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:52.441613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:52.442830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:52.443240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:52.444091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains/126dbdac017c4c0fa57711aa0a63475c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:52.461776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=126dbdac017c4c0fa57711aa0a63475c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:52.465119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:52.512722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.537473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.584609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:52.586328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:52.587898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:52.588552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] PATH_INFO: `/v3/users/53e51abfd30e41658fbeb2d4c4f29ea8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:52.598101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e51abfd30e41658fbeb2d4c4f29ea8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:52.605521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:52.658431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c', 'request_id': 'req-c7d2e367-221f-4ea7-b721-914518253343'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.676630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c', 'request_id': 'req-c7d2e367-221f-4ea7-b721-914518253343'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.694648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c', 'request_id': 'req-c7d2e367-221f-4ea7-b721-914518253343'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.714960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] The token cache is being invalidate because project 126dbdac017c4c0fa57711aa0a63475c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:52.715954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.717335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.717493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e51abfd30e41658fbeb2d4c4f29ea8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.730542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c', 'request_id': 'req-c7d2e367-221f-4ea7-b721-914518253343'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.737027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c', 'request_id': 'req-c7d2e367-221f-4ea7-b721-914518253343'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.737979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '126dbdac017c4c0fa57711aa0a63475c', 'request_id': 'req-c7d2e367-221f-4ea7-b721-914518253343'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.740784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e51abfd30e41658fbeb2d4c4f29ea8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.747390 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2569/5131] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:00:52 2022] DELETE /identity/v3/domains/126dbdac017c4c0fa57711aa0a63475c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:52.752282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:52.755037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:52.758005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e51abfd30e41658fbeb2d4c4f29ea8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.758902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e51abfd30e41658fbeb2d4c4f29ea8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.773209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d41019ca-77bb-4fe2-9f02-b19f1c574a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e51abfd30e41658fbeb2d4c4f29ea8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:52.786842 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2563/5132] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:52 2022] DELETE /identity/v3/users/53e51abfd30e41658fbeb2d4c4f29ea8 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:52.792139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:52.792608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:52.793062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:52.837930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:52.839759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:52.865173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:52.889954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e367-221f-4ea7-b721-914518253343 tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:52.933924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:53.026476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe1b6ae1823493597865404417dab5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:53.028235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:53.029736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:53.030791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] PATH_INFO: `/v3/domains/ee96d4db5c71436c8b05494beae34fda` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:53.039763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2564/5133] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:53.055425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Could not find domain: ee96d4db5c71436c8b05494beae34fda.: keystone.exception.DomainNotFound: Could not find domain: ee96d4db5c71436c8b05494beae34fda. Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ee96d4db5c71436c8b05494beae34fda. Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:00:53.076645 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:00:53.077774 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:00:53.079385 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ee96d4db5c71436c8b05494beae34fda. Jul 14 15:00:53.083723 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:00:53.083821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:53.083901 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2570/5134] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:00:52 2022] PATCH /identity/v3/domains/ee96d4db5c71436c8b05494beae34fda => generated 112 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 14 15:00:53.083901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:53.084484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:53.085711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:53.122484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25645f-50dd-4795-8aa6-5dc8f881eadb tempest-DomainsNegativeTestJSON-1411481164 tempest-DomainsNegativeTestJSON-1411481164-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:53.132992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:53.135792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:53.135792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:53.135792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] PATH_INFO: `/v3/users/9ec7a6cb28cc4743a15b1be2c32d6ef4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:53.137970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec7a6cb28cc4743a15b1be2c32d6ef4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:53.142092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:53.228232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec7a6cb28cc4743a15b1be2c32d6ef4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:53.284595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3aa4d-6f7b-44bb-8cf1-93833651206f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:53.289470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec7a6cb28cc4743a15b1be2c32d6ef4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:53.291241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec7a6cb28cc4743a15b1be2c32d6ef4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:53.301078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d9281-a992-4dd4-b4a0-e272ae597a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:53.302467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9281-a992-4dd4-b4a0-e272ae597a7f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:53.302958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9281-a992-4dd4-b4a0-e272ae597a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:53.303465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9281-a992-4dd4-b4a0-e272ae597a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:53.320976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec7a6cb28cc4743a15b1be2c32d6ef4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:53.325010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec7a6cb28cc4743a15b1be2c32d6ef4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:53.343520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d9281-a992-4dd4-b4a0-e272ae597a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:53.346896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d9281-a992-4dd4-b4a0-e272ae597a7f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:53.384635 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2565/5135] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:53.410779 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2571/5136] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:53 2022] DELETE /identity/v3/users/9ec7a6cb28cc4743a15b1be2c32d6ef4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:53.420147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:53.420908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:53.421560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:53.473972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:53.475762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:53.649475 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2566/5137] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:53.676381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:53.678825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:53.831139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b6106-f6c3-43cc-ac06-1d780267ae88 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:53.838585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:53.840001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:53.840542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:53.841149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:53.866933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:53.871180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:53.917195 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2572/5138] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:54.696839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:54.700109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:54.725549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe1a8f-6de4-4abd-99f5-e7f7e5288975 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:54.745710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:54.747484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:54.747748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:54.748803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] PATH_INFO: `/v3/projects/6f10f2126ed14e26bedb23244ea3f70d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:54.752347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f10f2126ed14e26bedb23244ea3f70d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:54.754083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:55.008164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f10f2126ed14e26bedb23244ea3f70d', 'request_id': 'req-fa44ec69-74e5-41ed-a513-92f06aaba92e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.040050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:55.048323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f10f2126ed14e26bedb23244ea3f70d', 'request_id': 'req-fa44ec69-74e5-41ed-a513-92f06aaba92e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.121047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f10f2126ed14e26bedb23244ea3f70d', 'request_id': 'req-fa44ec69-74e5-41ed-a513-92f06aaba92e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.213053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] The token cache is being invalidate because project 6f10f2126ed14e26bedb23244ea3f70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:55.213672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.220314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fa44ec69-74e5-41ed-a513-92f06aaba92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.235435 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2567/5139] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:54 2022] DELETE /identity/v3/projects/6f10f2126ed14e26bedb23244ea3f70d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:55.240051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:55.288242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d28be-f0dc-4e7d-9847-87a32c880af4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:55.569587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:55.623153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:55.624699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:55.625165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:55.625639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] PATH_INFO: `/v3/users/943756133e184708ad86846f11f94c04` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:55.628488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943756133e184708ad86846f11f94c04)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:55.645630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:55.646228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:55.646610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:55.646842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:55.755947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943756133e184708ad86846f11f94c04'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.773569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] MFA Rules not processed for user `b128110e3c7f4e2bb93292b8a6f0ea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:55.775294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:55.777628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943756133e184708ad86846f11f94c04'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.788460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943756133e184708ad86846f11f94c04'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.824478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943756133e184708ad86846f11f94c04'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.826423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943756133e184708ad86846f11f94c04'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:55.872321 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2573/5140] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:55 2022] DELETE /identity/v3/users/943756133e184708ad86846f11f94c04 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:55.955209 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2568/5141] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:00:55.971181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:55.973608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:56.143684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:56.146187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:56.186129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a42bd-3322-4731-bb9c-2b115dc3d335 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:56.243028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1f3b-621d-4e94-a5fc-8ee379d81c77 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:56.264855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:56.265623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:56.265937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:56.266761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:56.417134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:56.419344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:56.419602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:56.420122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] PATH_INFO: `/v3/projects/26e9439c5e6745f9a737c660270e12e6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:56.420612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:56.439928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:56.444161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e9439c5e6745f9a737c660270e12e6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:56.457316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:56.459770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:56.479847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2574/5142] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:00:56.737056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e9439c5e6745f9a737c660270e12e6', 'request_id': 'req-f1169fd8-7d7d-4021-baf3-cca8b452328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:56.762211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e9439c5e6745f9a737c660270e12e6', 'request_id': 'req-f1169fd8-7d7d-4021-baf3-cca8b452328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:56.789962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e9439c5e6745f9a737c660270e12e6', 'request_id': 'req-f1169fd8-7d7d-4021-baf3-cca8b452328a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:56.824687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] The token cache is being invalidate because project 26e9439c5e6745f9a737c660270e12e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:56.824867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:56.826875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:56.833261 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2569/5143] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:56 2022] DELETE /identity/v3/projects/26e9439c5e6745f9a737c660270e12e6 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:56.834561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:56.853337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a155b0-4eeb-4e3e-9acb-455b8efe2257 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:57.051827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:57.054276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:57.056991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:57.059878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] PATH_INFO: `/v3/users/8fe1b6ae1823493597865404417dab5b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:57.066891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe1b6ae1823493597865404417dab5b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:57.074979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:57.226733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe1b6ae1823493597865404417dab5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:57.326905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe1b6ae1823493597865404417dab5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:57.328661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe1b6ae1823493597865404417dab5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:57.366769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe1b6ae1823493597865404417dab5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:57.374531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db2cc555-e1cb-4313-b23c-304c79cfefe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe1b6ae1823493597865404417dab5b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:57.522264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2575/5144] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:00:56 2022] DELETE /identity/v3/users/8fe1b6ae1823493597865404417dab5b => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:57.996908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:57.999781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:58.034335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:58.056961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169fd8-7d7d-4021-baf3-cca8b452328a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:58.282884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:58.286076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:58.286735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:58.288438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] PATH_INFO: `/v3/projects/d2a60d41486546d195a09f2d9ac20927` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:58.293354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a60d41486546d195a09f2d9ac20927)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:58.298876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:58.450263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a60d41486546d195a09f2d9ac20927', 'request_id': 'req-50c25151-d57d-4b1e-8666-0ea3c172c488'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:58.467018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a60d41486546d195a09f2d9ac20927', 'request_id': 'req-50c25151-d57d-4b1e-8666-0ea3c172c488'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:58.481563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a60d41486546d195a09f2d9ac20927', 'request_id': 'req-50c25151-d57d-4b1e-8666-0ea3c172c488'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:58.518803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] The token cache is being invalidate because project d2a60d41486546d195a09f2d9ac20927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:58.519330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:58.520434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c25151-d57d-4b1e-8666-0ea3c172c488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:58.526689 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2570/5145] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:57 2022] DELETE /identity/v3/projects/d2a60d41486546d195a09f2d9ac20927 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:00:58.530496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e976-fc68-47f8-a0ff-8f841bc83706 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:58.532005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e976-fc68-47f8-a0ff-8f841bc83706 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:58.536868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e976-fc68-47f8-a0ff-8f841bc83706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:58.583701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5af8e976-fc68-47f8-a0ff-8f841bc83706 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:58.585605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5af8e976-fc68-47f8-a0ff-8f841bc83706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:58.922899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2576/5146] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:58.932558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299424e-3e6e-405d-978f-78d8b2c35749 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:58.933598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299424e-3e6e-405d-978f-78d8b2c35749 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:58.934149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299424e-3e6e-405d-978f-78d8b2c35749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:59.081656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1299424e-3e6e-405d-978f-78d8b2c35749 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:00:59.083907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1299424e-3e6e-405d-978f-78d8b2c35749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:59.107984 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2571/5147] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:00:59.116911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8e976-fc68-47f8-a0ff-8f841bc83706 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:59.197334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8e976-fc68-47f8-a0ff-8f841bc83706 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:59.240432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:59.241653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:59.242474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:59.242654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:59.252199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:00:59.252873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:59.261751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:59.274889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:59.326086 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2577/5148] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:00:59.327437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299424e-3e6e-405d-978f-78d8b2c35749 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:59.349863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299424e-3e6e-405d-978f-78d8b2c35749 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:59.365017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:59.365736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:59.366035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:59.366327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:59.367079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:59.369159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:59.475743 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2572/5149] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:00:59 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:00:59.481231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:59.511770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834daac-7a72-4d7e-bb63-5b323face0a6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:59.723494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:59.725116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:59.725785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:59.726379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:59.728098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:59.733126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:59.762590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:59.764944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:00:59.792358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cfbb-d005-480f-afbd-f838f06f3560 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:59.793882 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2578/5150] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:00:59 2022] POST /identity/v3/users => generated 288 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:00:59.795804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:59.812150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:59.817164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:59.817460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:59.817752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] PATH_INFO: `/v3/projects/fb1e8eff1dc54ef69e2339e5c89e0022` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:59.820328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c8ac-2c03-49b7-9946-61bde4f46c6a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:59.825156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1e8eff1dc54ef69e2339e5c89e0022)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:59.828732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:59.833193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:00:59.835958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:59.836523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:59.840124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:00:59.841522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:00:59.852126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:00:59.904305 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2579/5151] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:00:59.909738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:00:59.915039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'request_id': 'req-53117b4b-8a9f-43be-b25a-3df524d1609b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:59.923843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'request_id': 'req-53117b4b-8a9f-43be-b25a-3df524d1609b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:59.927776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:59.938420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1e8eff1dc54ef69e2339e5c89e0022', 'request_id': 'req-53117b4b-8a9f-43be-b25a-3df524d1609b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:59.949410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b47b-f50d-4eeb-be3f-7f6a266c56b3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:00:59.972136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] The token cache is being invalidate because project fb1e8eff1dc54ef69e2339e5c89e0022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:00:59.972740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:59.973609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53117b4b-8a9f-43be-b25a-3df524d1609b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:00:59.978784 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2573/5152] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:00:59 2022] DELETE /identity/v3/projects/fb1e8eff1dc54ef69e2339e5c89e0022 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:00:59.980673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176bf0a-6c67-4bb4-995f-ec2596a4aee6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:00:59.981025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176bf0a-6c67-4bb4-995f-ec2596a4aee6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:00:59.981319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176bf0a-6c67-4bb4-995f-ec2596a4aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.025853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6176bf0a-6c67-4bb4-995f-ec2596a4aee6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:00.027598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6176bf0a-6c67-4bb4-995f-ec2596a4aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:00.126070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.126940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.127235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.128392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.128392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.136452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.163176 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2580/5153] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:00.167720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:00.174200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:00.192830 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2574/5154] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:00.205830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bd7b7-6d1e-484c-89f4-bed9290184eb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.206119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bd7b7-6d1e-484c-89f4-bed9290184eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.206651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bd7b7-6d1e-484c-89f4-bed9290184eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.222729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f177b2-a417-429c-9100-03271d7a9c10 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:00.259257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9143ab-c242-4303-8d91-edaf4d791856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.260920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9143ab-c242-4303-8d91-edaf4d791856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.261434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9143ab-c242-4303-8d91-edaf4d791856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.268588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-375bd7b7-6d1e-484c-89f4-bed9290184eb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:00.270179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-375bd7b7-6d1e-484c-89f4-bed9290184eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:00.271672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9143ab-c242-4303-8d91-edaf4d791856 admin admin] PATH_INFO: `/v3/projects/d068a5c751c5414e8a6ea74f799b5b55/users/3485b0b128e047a99eabd7aaa98690fe/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.302705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9143ab-c242-4303-8d91-edaf4d791856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d068a5c751c5414e8a6ea74f799b5b55, user_id=3485b0b128e047a99eabd7aaa98690fe, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.309014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9143ab-c242-4303-8d91-edaf4d791856 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.313948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2575/5155] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:00.318698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bd7b7-6d1e-484c-89f4-bed9290184eb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:00.342410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bd7b7-6d1e-484c-89f4-bed9290184eb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:00.346506 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2581/5156] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:00 2022] PUT /identity/v3/projects/d068a5c751c5414e8a6ea74f799b5b55/users/3485b0b128e047a99eabd7aaa98690fe/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:00.367790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c329b-cfec-4b30-b1a8-86b9c310cb2c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.368418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c329b-cfec-4b30-b1a8-86b9c310cb2c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.369014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c329b-cfec-4b30-b1a8-86b9c310cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.425024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-326c329b-cfec-4b30-b1a8-86b9c310cb2c None None] MFA Rules not processed for user `3485b0b128e047a99eabd7aaa98690fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:00.428776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-326c329b-cfec-4b30-b1a8-86b9c310cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:00.492025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.494222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.494639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.494998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.496027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:00.496621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.501459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.517415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:00.551026 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2576/5157] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:01:00.552301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:00.565705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2db6-2dca-4160-b0a6-f943d0ca040f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:00.585513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.586585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.587101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.587581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.588487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.592837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.604694 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2582/5158] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:00.607787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c329b-cfec-4b30-b1a8-86b9c310cb2c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:00.624269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c329b-cfec-4b30-b1a8-86b9c310cb2c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:00.630249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.632053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.632530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.633024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.633914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.636599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.671555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2577/5159] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:00 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:00.673262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:00.692577 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2583/5160] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:00 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:00.698686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:00.757262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:00.763171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9a98-bbb6-4f00-8ea5-b79989f38db6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:00.851433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.851927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.852167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.852453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.853208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.855421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.886413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2578/5161] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:00 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:00.888174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:00.903975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eb7c9-b415-461b-be52-9a3acb58423b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:00.914752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fce2c4-fc7d-42bd-a643-5f899c28ed48 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:00.920421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.922183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.922183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.923046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.924382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.929830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.936734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:00.938125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:00.938627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:00.939108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:00.940484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:00.944266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:00.981907 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2579/5162] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:00.989035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.025200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e25ca-d9c9-4857-9e8d-ee26df911ce1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:01.037213 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2584/5163] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:00 2022] POST /identity/v3/users => generated 295 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:01.039050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.053423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:01.054482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.054482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.054681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.055478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:01.057266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:01.062214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832461f-dc95-4c96-a5d3-6f0445ceefaf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:01.073706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:01.074889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.075515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.076704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.078790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:01.082523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:01.087303 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2580/5164] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:01.093197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.116066 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2585/5165] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:01.124498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.134856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0c96-f997-49a7-8bf5-9bedee44d717 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:01.147201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b9d98-2e91-4ae5-943f-5b98107144c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:01.148172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9d98-2e91-4ae5-943f-5b98107144c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.148288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbda4c8-54dd-488e-8ecb-3fd7e2cc552f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:01.148482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9d98-2e91-4ae5-943f-5b98107144c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.148903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9d98-2e91-4ae5-943f-5b98107144c0 admin admin] PATH_INFO: `/v3/projects/e18dcb61f2824166bb0197dde7f9fbdb/users/4562afc1820c40f9a4fa04ec7d3e1a2d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.161266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:01.164233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.164906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.165464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] PATH_INFO: `/v3/projects/78f1597fcaf8431bbf0f6518b688e795/users/48046ae2963b482b8bf3ecd6778105af/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.217393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b9d98-2e91-4ae5-943f-5b98107144c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18dcb61f2824166bb0197dde7f9fbdb, user_id=4562afc1820c40f9a4fa04ec7d3e1a2d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:01.229284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b9d98-2e91-4ae5-943f-5b98107144c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:01.229649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f1597fcaf8431bbf0f6518b688e795, user_id=48046ae2963b482b8bf3ecd6778105af, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:01.258297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:01.262951 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2581/5166] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:01 2022] PUT /identity/v3/projects/e18dcb61f2824166bb0197dde7f9fbdb/users/4562afc1820c40f9a4fa04ec7d3e1a2d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:01.284466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69318523-3b99-4eee-8c3d-31702b641873 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.285053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69318523-3b99-4eee-8c3d-31702b641873 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.285490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69318523-3b99-4eee-8c3d-31702b641873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.334751 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2586/5167] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:01 2022] PUT /identity/v3/projects/78f1597fcaf8431bbf0f6518b688e795/users/48046ae2963b482b8bf3ecd6778105af/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:01.336206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.366977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-69318523-3b99-4eee-8c3d-31702b641873 None None] MFA Rules not processed for user `4562afc1820c40f9a4fa04ec7d3e1a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:01.370139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69318523-3b99-4eee-8c3d-31702b641873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:01.477992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3335b-4615-4066-864e-af7a6f659f8f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:01.505458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:01.508637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.509506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.511771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.513415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:01.518137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:01.569629 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2587/5168] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:01.575788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.589527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:01.603665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c405a-349b-42e7-b2c7-e009a219ba9d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:01.615849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26ec9-6067-41e0-a75f-22501a2843f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:01.618852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26ec9-6067-41e0-a75f-22501a2843f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.619401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26ec9-6067-41e0-a75f-22501a2843f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.620022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26ec9-6067-41e0-a75f-22501a2843f9 admin admin] PATH_INFO: `/v3/projects/78f1597fcaf8431bbf0f6518b688e795/users/48046ae2963b482b8bf3ecd6778105af/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.624772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26ec9-6067-41e0-a75f-22501a2843f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f1597fcaf8431bbf0f6518b688e795, user_id=48046ae2963b482b8bf3ecd6778105af, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:01.631163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26ec9-6067-41e0-a75f-22501a2843f9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:01.639755 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2582/5169] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:01.646832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69318523-3b99-4eee-8c3d-31702b641873 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.677919 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2588/5170] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:01 2022] PUT /identity/v3/projects/78f1597fcaf8431bbf0f6518b688e795/users/48046ae2963b482b8bf3ecd6778105af/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:01.679746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69318523-3b99-4eee-8c3d-31702b641873 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:01.698575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d5c86-a2b8-4a9b-8b18-4450b883d9fd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.698845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d5c86-a2b8-4a9b-8b18-4450b883d9fd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.699151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d5c86-a2b8-4a9b-8b18-4450b883d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.770830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6a0d5c86-a2b8-4a9b-8b18-4450b883d9fd None None] MFA Rules not processed for user `48046ae2963b482b8bf3ecd6778105af`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:01.772147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a0d5c86-a2b8-4a9b-8b18-4450b883d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:01.777081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:01.843196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:01.846054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:01.846910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:01.847678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:01.850821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:01.855140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:01.916928 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2583/5171] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:01 2022] POST /identity/v3/projects => generated 367 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:01.922336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:01.984276 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2589/5172] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:01.986350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d5c86-a2b8-4a9b-8b18-4450b883d9fd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:02.039621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d5c86-a2b8-4a9b-8b18-4450b883d9fd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:02.292657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4effaa-edb5-48ae-9eb7-e017da3cbe6c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:02.293862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4effaa-edb5-48ae-9eb7-e017da3cbe6c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:02.294395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4effaa-edb5-48ae-9eb7-e017da3cbe6c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:02.294907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4effaa-edb5-48ae-9eb7-e017da3cbe6c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:02.296330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4effaa-edb5-48ae-9eb7-e017da3cbe6c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:02.311242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4effaa-edb5-48ae-9eb7-e017da3cbe6c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:02.370357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebb78-e9a2-44b5-b3d1-8a24df74b02b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:02.393787 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2590/5173] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:01 2022] POST /identity/v3/projects => generated 332 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:02.397736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401999-a348-41c7-ae16-76aeab0e0187 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:02.398436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:02.398571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401999-a348-41c7-ae16-76aeab0e0187 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:02.399040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401999-a348-41c7-ae16-76aeab0e0187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:02.399718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:02.400431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:02.400937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:02.402779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:02.420180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:02.439982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7a401999-a348-41c7-ae16-76aeab0e0187 None None] MFA Rules not processed for user `b128110e3c7f4e2bb93292b8a6f0ea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:02.446639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7a401999-a348-41c7-ae16-76aeab0e0187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:02.509145 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2584/5174] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:01 2022] POST /identity/v3/users => generated 290 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:02.512368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:02.564462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499bb0-f131-458e-ac73-7f856aa7b323 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:02.635973 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2591/5175] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:02.648823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a401999-a348-41c7-ae16-76aeab0e0187 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:02.677988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:02.769662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ff0ee-4484-4100-9460-aa1c46ffe33c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:02.769662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff0ee-4484-4100-9460-aa1c46ffe33c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:02.769662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff0ee-4484-4100-9460-aa1c46ffe33c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:02.770341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff0ee-4484-4100-9460-aa1c46ffe33c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:02.770341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ff0ee-4484-4100-9460-aa1c46ffe33c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:02.770341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ff0ee-4484-4100-9460-aa1c46ffe33c tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:02.814486 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2585/5176] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:01:02 2022] POST /identity/v3/projects => generated 333 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:02.817402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c064-cbc7-4c1f-9934-433c345e8034 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:02.817822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c064-cbc7-4c1f-9934-433c345e8034 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:02.818183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c064-cbc7-4c1f-9934-433c345e8034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:02.850509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ac13c064-cbc7-4c1f-9934-433c345e8034 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:02.855326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ac13c064-cbc7-4c1f-9934-433c345e8034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:02.934068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:02.987116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a401999-a348-41c7-ae16-76aeab0e0187 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:03.015089 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2586/5177] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:03.019460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c064-cbc7-4c1f-9934-433c345e8034 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:03.101908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:03.102700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:03.102986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:03.103255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:03.107874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:03.114859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:03.151359 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2592/5178] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:03.151359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:03.155085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:03.271741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c064-cbc7-4c1f-9934-433c345e8034 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:03.284521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:03.286710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:03.287004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:03.287313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:03.288469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:03.290932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:03.299104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1a20-c051-487b-8e09-0898c2e22cb3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:03.306660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:03.308043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:03.308043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:03.308043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:03.314447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:03.348547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:03.350070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:03.394023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2593/5179] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:03.399175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:03.420654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2587/5180] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:03 2022] POST /identity/v3/projects => generated 357 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:03.425110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:03.433886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a1230-bdbe-4eb5-8f90-b50b32ac3ae0 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:03.628106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397d4ec-3a5c-4a7b-b15f-6c6c976681c1 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:03.639897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:03.640447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:03.640921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:03.641683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:03.642653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:03.645898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:03.681875 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2588/5181] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:01:03 2022] GET /identity/v3/projects => generated 7153 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:01:03.687076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:03.693758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:03.724594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10554aa-5849-4e12-83ea-f245c9c98786 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:03.725376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:03.727752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:03.728415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:03.728939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] PATH_INFO: `/v3/projects/ff1007a54bb545758a1054934a6d7243/users/d2c17dbb98d6479da5a1f081deeb7855/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:03.730423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:03.731142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:03.731474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:03.731764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:03.732582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:03.732898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:03.736217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:03.752349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1007a54bb545758a1054934a6d7243, user_id=d2c17dbb98d6479da5a1f081deeb7855, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:03.759934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:03.766490 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2589/5182] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 15:01:03 2022] GET /identity/v3/projects?enabled=False => generated 443 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:03.769279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:03.796398 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2594/5183] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:03 2022] PUT /identity/v3/projects/ff1007a54bb545758a1054934a6d7243/users/d2c17dbb98d6479da5a1f081deeb7855/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:03.799830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac18b6-4cc0-4993-9b0f-2b8dca068b94 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:03.802742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:03.962874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:04.034402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:04.035357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:04.035839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:04.037175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13142d1-ae50-4f24-bd3c-269450eef05d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:04.039846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:04.040275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Adding query filter params (parent_id=5d935ab62ac9413cbf137c3c6feb9976) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:04.040707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:04.043468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:04.056968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:04.058014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:04.058462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:04.058902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:04.059854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:04.068991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:04.085517 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2590/5184] 10.222.0.98 () {58 vars in 1215 bytes} [Thu Jul 14 15:01:03 2022] GET /identity/v3/projects?parent_id=5d935ab62ac9413cbf137c3c6feb9976 => generated 497 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:04.086379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:04.105837 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2595/5185] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:04.110127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36792d-6b7c-4669-9e14-01bfdadcac31 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:04.112815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:04.128253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:04.135976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15170fc-b4f8-4a2a-8077-51fdb42d22db admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:04.138900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:04.139581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:04.141370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects/351e3c5237d54e00b77bf4b2b687b5a5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:04.143966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:delete_project(project_id=351e3c5237d54e00b77bf4b2b687b5a5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:04.147141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:04.148771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d67f22-5caf-481e-8742-614ffd7b80c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:04.150825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67f22-5caf-481e-8742-614ffd7b80c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:04.151370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67f22-5caf-481e-8742-614ffd7b80c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:04.152357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67f22-5caf-481e-8742-614ffd7b80c1 admin admin] PATH_INFO: `/v3/projects/ff1007a54bb545758a1054934a6d7243/users/d2c17dbb98d6479da5a1f081deeb7855/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:04.158213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d67f22-5caf-481e-8742-614ffd7b80c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1007a54bb545758a1054934a6d7243, user_id=d2c17dbb98d6479da5a1f081deeb7855, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:04.165595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d67f22-5caf-481e-8742-614ffd7b80c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:04.196818 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2596/5186] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:04 2022] PUT /identity/v3/projects/ff1007a54bb545758a1054934a6d7243/users/d2c17dbb98d6479da5a1f081deeb7855/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:04.221974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76748def-0047-4789-9cd0-277ba4210c13 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:04.222355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76748def-0047-4789-9cd0-277ba4210c13 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:04.225639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76748def-0047-4789-9cd0-277ba4210c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:04.297097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-76748def-0047-4789-9cd0-277ba4210c13 None None] MFA Rules not processed for user `d2c17dbb98d6479da5a1f081deeb7855`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:04.299576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351e3c5237d54e00b77bf4b2b687b5a5', 'request_id': 'req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.302478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-76748def-0047-4789-9cd0-277ba4210c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:04.312052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351e3c5237d54e00b77bf4b2b687b5a5', 'request_id': 'req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.346848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351e3c5237d54e00b77bf4b2b687b5a5', 'request_id': 'req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.388003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] The token cache is being invalidate because project 351e3c5237d54e00b77bf4b2b687b5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:04.388454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.389673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.395117 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2591/5187] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:04 2022] DELETE /identity/v3/projects/351e3c5237d54e00b77bf4b2b687b5a5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:04.401213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:04.406091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:04.533174 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2597/5188] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:04.540884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76748def-0047-4789-9cd0-277ba4210c13 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:04.556150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76748def-0047-4789-9cd0-277ba4210c13 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:04.563254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:04.564137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:04.564546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:04.564959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:04.565827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:04.568003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:04.601014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7fab-1372-4bf7-b8c5-bf3b53e2cf7b tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:04.616542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:04.631615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:04.631984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:04.632310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects/5d935ab62ac9413cbf137c3c6feb9976` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:04.644990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d935ab62ac9413cbf137c3c6feb9976)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:04.647675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:04.648130 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2598/5189] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:04 2022] POST /identity/v3/projects => generated 360 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:01:04.652759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:04.727415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:04.781415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d935ab62ac9413cbf137c3c6feb9976', 'request_id': 'req-8e5bf349-c22c-4588-ace9-8231930e61ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.792573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d935ab62ac9413cbf137c3c6feb9976', 'request_id': 'req-8e5bf349-c22c-4588-ace9-8231930e61ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.795545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:04.814448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d935ab62ac9413cbf137c3c6feb9976', 'request_id': 'req-8e5bf349-c22c-4588-ace9-8231930e61ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.858584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] The token cache is being invalidate because project 5d935ab62ac9413cbf137c3c6feb9976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:04.859666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.860629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:04.863686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f1127-f8ae-471b-8c87-6adadfa9803d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:04.864260 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2592/5190] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:04 2022] DELETE /identity/v3/projects/5d935ab62ac9413cbf137c3c6feb9976 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:04.869473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:04.874194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:05.085407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bf349-c22c-4588-ace9-8231930e61ea tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:05.101944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48046ae2963b482b8bf3ecd6778105af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78f1597fcaf8431bbf0f6518b688e795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:05.104308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:05.105189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:05.106277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] PATH_INFO: `/v3/projects/b331fe1e76604ed3a9ede2b09d0ffa6e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:05.109514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:05.111461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:05.111801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:05.112157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b331fe1e76604ed3a9ede2b09d0ffa6e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:05.112352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:05.113723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:05.117351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:05.118865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:05.169279 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2599/5191] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:04 2022] POST /identity/v3/users => generated 416 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:05.170810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:05.178612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:05.223744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0952a-3031-4586-868d-db165f34738a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:05.256341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b331fe1e76604ed3a9ede2b09d0ffa6e', 'request_id': 'req-c6d5e454-b918-4164-9df2-08d3b7805017'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.275420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b331fe1e76604ed3a9ede2b09d0ffa6e', 'request_id': 'req-c6d5e454-b918-4164-9df2-08d3b7805017'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.291423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b331fe1e76604ed3a9ede2b09d0ffa6e', 'request_id': 'req-c6d5e454-b918-4164-9df2-08d3b7805017'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.321099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] The token cache is being invalidate because project b331fe1e76604ed3a9ede2b09d0ffa6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:05.321708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.324273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.328637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2593/5192] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:04 2022] DELETE /identity/v3/projects/b331fe1e76604ed3a9ede2b09d0ffa6e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:05.333090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:05.338315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:05.467802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:05.471113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:05.475783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:05.476729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/users/065461c955444b449a13012b0a075dc1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:05.508406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e454-b918-4164-9df2-08d3b7805017 tempest-ListProjectsTestJSON-1103356505 tempest-ListProjectsTestJSON-1103356505-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:05.524180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:05.525294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:05.525596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:05.525887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] PATH_INFO: `/v3/users/3485b0b128e047a99eabd7aaa98690fe` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:05.528206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3485b0b128e047a99eabd7aaa98690fe)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:05.528556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_user(user_id=065461c955444b449a13012b0a075dc1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:05.535658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:05.541160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:05.564784 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2600/5193] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:01:05 2022] GET /identity/v3/users/065461c955444b449a13012b0a075dc1 => generated 416 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:05.569392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:05.579544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:05.583765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:05.631450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb49d9-90be-43d6-ba04-1be460efc984 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:05.641325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3485b0b128e047a99eabd7aaa98690fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.644585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:05.647701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:05.648325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:05.649059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/users/065461c955444b449a13012b0a075dc1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:05.651884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_user(user_id=065461c955444b449a13012b0a075dc1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:05.662323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:05.672595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3485b0b128e047a99eabd7aaa98690fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.688570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3485b0b128e047a99eabd7aaa98690fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.689250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3485b0b128e047a99eabd7aaa98690fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.702085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e4906bf-cf26-4572-a054-1c832cc55832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3485b0b128e047a99eabd7aaa98690fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.729056 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2594/5194] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:05 2022] DELETE /identity/v3/users/3485b0b128e047a99eabd7aaa98690fe => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:05.737967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:05.738539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:05.739772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:05.784568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:05.787061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065461c955444b449a13012b0a075dc1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.815487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065461c955444b449a13012b0a075dc1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.816112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065461c955444b449a13012b0a075dc1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.825394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:05.829784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:05.834957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065461c955444b449a13012b0a075dc1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.835946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065461c955444b449a13012b0a075dc1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:05.864389 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2601/5195] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:05 2022] DELETE /identity/v3/users/065461c955444b449a13012b0a075dc1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:05.870411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:05.872043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:06.026676 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2595/5196] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:06.029270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:06.037468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:06.053279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e4ef9-4191-4f9f-b1dc-455c5bdb6907 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:06.071761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:06.076675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:06.078413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:06.080027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/f06128a7d8a6449b807745fce5c2e1c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:06.085088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f06128a7d8a6449b807745fce5c2e1c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:06.092661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:06.286447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06128a7d8a6449b807745fce5c2e1c3', 'request_id': 'req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:06.310781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06128a7d8a6449b807745fce5c2e1c3', 'request_id': 'req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:06.326578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537542c1-d293-4057-9ec5-292cc5ff0135 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:06.352013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06128a7d8a6449b807745fce5c2e1c3', 'request_id': 'req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:06.393025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project f06128a7d8a6449b807745fce5c2e1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:06.393329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:06.399144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d2b786b-cdfa-4adf-a51a-1be86795f2b6 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:06.404684 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2602/5197] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:05 2022] DELETE /identity/v3/projects/f06128a7d8a6449b807745fce5c2e1c3 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:06.414548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:06.419596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:06.420032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:06.505694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:06.512901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:06.577578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:06.706227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:06.707721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:06.709017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:06.709523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:06.723570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:06.738097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:06.776217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:06.778442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:06.789421 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2603/5198] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:06.789421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:06.800803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:06.826636 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2596/5199] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:06.831841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:06.839386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:07.252074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79a17-892d-4431-b718-bf405a4e0dd6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:07.258968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:07.259695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:07.259985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:07.260268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:07.274866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:07.405341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e889-20a1-466d-b6f7-8857ac1b1174 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:07.449072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:07.459428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:07.461380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:07.464411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:07.465076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:07.466266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:07.472897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:07.480899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:07.517364 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2604/5200] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:07.521383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:07.530941 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2597/5201] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:06 2022] POST /identity/v3/projects => generated 348 bytes in 704 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:07.540472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:07.576784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791c1e-51d9-48c5-b556-e7437d33e026 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:07.826928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298974e-2089-4604-b422-2813baf4e8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:07.829256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298974e-2089-4604-b422-2813baf4e8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:07.829514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298974e-2089-4604-b422-2813baf4e8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:07.830842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298974e-2089-4604-b422-2813baf4e8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:07.833623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e298974e-2089-4604-b422-2813baf4e8b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:07.880167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298974e-2089-4604-b422-2813baf4e8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:07.890169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298974e-2089-4604-b422-2813baf4e8b8 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:07.944593 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2605/5202] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:07.950140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:07.951102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:07.957285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:07.983180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465669c3-1288-45fe-bc44-b65f4abf4f66 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:08.039681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:08.041897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:08.052208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:08.054832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:08.057673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:08.061516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:08.065966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:08.119822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:08.133003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:08.145469 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2598/5203] 10.222.0.98 () {58 vars in 1159 bytes} [Thu Jul 14 15:01:07 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:08.147323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:08.207823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a6c4f-47f8-4971-af63-a033a3f1df1a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:08.228213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:08.229440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:08.229799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:08.230168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:08.231129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:08.240062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:08.277060 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2599/5204] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 15:01:08 2022] GET /identity/v3/domains => generated 829 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:08.278510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:08.302667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980340a9-b7b1-4967-a058-f0c860aef67a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:08.328040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:08.329717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:08.330200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:08.330665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/6f39dbe5d3ee4b978adfef3cbabbe0e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:08.333321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:update_project(project_id=6f39dbe5d3ee4b978adfef3cbabbe0e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:08.334439 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:01:08.334439 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:01:08.334439 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:01:08.337097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:08.364810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:08.370946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:08.441837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:08.445716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:08.449739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:08.458184 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2600/5205] 10.222.0.98 () {60 vars in 1251 bytes} [Thu Jul 14 15:01:08 2022] PATCH /identity/v3/projects/6f39dbe5d3ee4b978adfef3cbabbe0e9 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:08.461446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:08.467485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:08.499132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2606/5206] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:08.519070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:08.604510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:08.607239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:08.661400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31ac1d-0956-4504-a927-027a9c45bcd4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:08.692324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:08.697747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:08.698128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:08.698425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/6f39dbe5d3ee4b978adfef3cbabbe0e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:08.805496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f39dbe5d3ee4b978adfef3cbabbe0e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:08.810256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:08.918685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5f71-caa0-45b4-9948-25efe38a9c27 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:08.946029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:08.959901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.153371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9', 'request_id': 'req-3ff186b5-db49-4521-b5fc-39cedb441f96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.179451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9', 'request_id': 'req-3ff186b5-db49-4521-b5fc-39cedb441f96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.198353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9', 'request_id': 'req-3ff186b5-db49-4521-b5fc-39cedb441f96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.203558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:09.204419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:09.204714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:09.205005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:09.279879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 6f39dbe5d3ee4b978adfef3cbabbe0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:09.280608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.284427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.337864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9', 'request_id': 'req-3ff186b5-db49-4521-b5fc-39cedb441f96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.348798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9', 'request_id': 'req-3ff186b5-db49-4521-b5fc-39cedb441f96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.349256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6f39dbe5d3ee4b978adfef3cbabbe0e9', 'request_id': 'req-3ff186b5-db49-4521-b5fc-39cedb441f96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:09.368063 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2601/5207] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:08 2022] DELETE /identity/v3/projects/6f39dbe5d3ee4b978adfef3cbabbe0e9 => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:09.373728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:09.379717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:09.507533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:09.511654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:09.556466 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2607/5208] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:01:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 953 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:09.566749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:09.609245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff186b5-db49-4521-b5fc-39cedb441f96 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:09.641385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:09.642179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:09.642484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:09.642767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:09.643557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:09.645581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:09.761764 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2602/5209] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:09 2022] POST /identity/v3/projects => generated 358 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:09.764163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:09.844416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ac111-6869-478a-a4e8-8e6dce45dde0 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:09.935764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:10.159113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:10.167572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:10.167874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:10.168168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/b7170b592676420da341f4b912196e88` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:10.170006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=b7170b592676420da341f4b912196e88)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:10.172815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:10.176210 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2608/5210] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:09 2022] GET /identity/v3/projects/b7170b592676420da341f4b912196e88 => generated 358 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:10.180311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:10.199015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3ecda-734c-4ddf-a78e-d1ecf66c126a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:10.224499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:10.226518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:10.226887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:10.227316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/b7170b592676420da341f4b912196e88` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:10.237079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7170b592676420da341f4b912196e88)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:10.240059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:10.467449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7170b592676420da341f4b912196e88', 'request_id': 'req-8917bda5-f120-49e7-9707-29acec5a7882'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:10.499460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7170b592676420da341f4b912196e88', 'request_id': 'req-8917bda5-f120-49e7-9707-29acec5a7882'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:10.533080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7170b592676420da341f4b912196e88', 'request_id': 'req-8917bda5-f120-49e7-9707-29acec5a7882'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:10.619218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project b7170b592676420da341f4b912196e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:10.619761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:10.632983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:10.642934 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2603/5211] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:10 2022] DELETE /identity/v3/projects/b7170b592676420da341f4b912196e88 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:10.648057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:10.650645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:10.670461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551c10-6828-4090-af85-0688b0d82d9c tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:10.870878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:10.872055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:10.872588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:10.873076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:10.874059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:10.876936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:10.958605 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2609/5212] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:10 2022] POST /identity/v3/projects => generated 360 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:10.963016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:11.037762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917bda5-f120-49e7-9707-29acec5a7882 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:11.315417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:11.315417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:11.315417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:11.347661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/7e2adeba7acc446888054593472a79ca` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:11.361355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=7e2adeba7acc446888054593472a79ca)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:11.401921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:11.407573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2604/5213] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:10 2022] GET /identity/v3/projects/7e2adeba7acc446888054593472a79ca => generated 360 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:11.409649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:11.452572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500ac4a-b46c-4273-95ed-a0c1cb3e09c7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:11.515099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:11.517515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:11.520760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:11.525580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:11.530331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:11.534268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/7e2adeba7acc446888054593472a79ca` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:11.541544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e2adeba7acc446888054593472a79ca)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:11.558767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:11.707583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e165a-df33-4fc6-a64b-d333b7d2c7e8 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:11.723778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:11.725083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:11.725580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:11.726055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] PATH_INFO: `/v3/projects/d068a5c751c5414e8a6ea74f799b5b55` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:11.729442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d068a5c751c5414e8a6ea74f799b5b55)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:11.740067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:11.744251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:11.908219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2adeba7acc446888054593472a79ca', 'request_id': 'req-67edd1c2-7653-4b96-9aef-aab3b5b284ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:11.915520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd068a5c751c5414e8a6ea74f799b5b55', 'request_id': 'req-376eb68b-111e-455d-aa5c-a75b9763044c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:11.938883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd068a5c751c5414e8a6ea74f799b5b55', 'request_id': 'req-376eb68b-111e-455d-aa5c-a75b9763044c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:11.956132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2adeba7acc446888054593472a79ca', 'request_id': 'req-67edd1c2-7653-4b96-9aef-aab3b5b284ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:11.968995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd068a5c751c5414e8a6ea74f799b5b55', 'request_id': 'req-376eb68b-111e-455d-aa5c-a75b9763044c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.005482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2adeba7acc446888054593472a79ca', 'request_id': 'req-67edd1c2-7653-4b96-9aef-aab3b5b284ea'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.025234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] The token cache is being invalidate because project d068a5c751c5414e8a6ea74f799b5b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:12.026106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.028529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.037354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2605/5214] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:11 2022] DELETE /identity/v3/projects/d068a5c751c5414e8a6ea74f799b5b55 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:12.042173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:12.049748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:12.105085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 7e2adeba7acc446888054593472a79ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:12.113624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.120687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.151093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2610/5215] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:11 2022] DELETE /identity/v3/projects/7e2adeba7acc446888054593472a79ca => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:12.156951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:12.160835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:12.270544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb68b-111e-455d-aa5c-a75b9763044c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:12.287112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:12.288469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:12.288962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:12.289428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] PATH_INFO: `/v3/users/48046ae2963b482b8bf3ecd6778105af` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:12.293593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48046ae2963b482b8bf3ecd6778105af)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:12.300505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:12.351007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:12.431344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48046ae2963b482b8bf3ecd6778105af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.466348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48046ae2963b482b8bf3ecd6778105af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.479033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edd1c2-7653-4b96-9aef-aab3b5b284ea tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:12.481576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48046ae2963b482b8bf3ecd6778105af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.482722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48046ae2963b482b8bf3ecd6778105af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.497087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48046ae2963b482b8bf3ecd6778105af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:12.518660 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2606/5216] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:12 2022] DELETE /identity/v3/users/48046ae2963b482b8bf3ecd6778105af => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:12.647491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:12.648564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:12.649202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:12.649655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:12.650553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:12.658026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:12.750975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2611/5217] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:01:12 2022] POST /identity/v3/projects => generated 347 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:12.753849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:12.755490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:12.777998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:12.898806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e243185-be8c-4d60-90af-c128a46dfce0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:13.157332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:13.172391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:13.173012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:13.173602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/3f6b9ab8bdf54166aea4191f60be4535` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:13.177212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f6b9ab8bdf54166aea4191f60be4535)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:13.199505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:13.209319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2607/5218] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:12 2022] GET /identity/v3/projects/3f6b9ab8bdf54166aea4191f60be4535 => generated 347 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:01:13.210506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:13.260403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076c1fe-6d2f-4d82-9051-74210b63a78a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:13.292053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:13.293543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:13.294056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:13.294554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/3f6b9ab8bdf54166aea4191f60be4535` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:13.297376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f6b9ab8bdf54166aea4191f60be4535)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:13.315728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:13.488062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6b9ab8bdf54166aea4191f60be4535', 'request_id': 'req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:13.519915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6b9ab8bdf54166aea4191f60be4535', 'request_id': 'req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:13.528384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6b9ab8bdf54166aea4191f60be4535', 'request_id': 'req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:13.567450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 3f6b9ab8bdf54166aea4191f60be4535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:13.568022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:13.571676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:13.580528 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2612/5219] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:13 2022] DELETE /identity/v3/projects/3f6b9ab8bdf54166aea4191f60be4535 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:13.587977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:13.590408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:13.626097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e4905-88e1-49c6-ade7-1450ae4c71f4 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:14.022066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:14.025262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:14.028096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:14.028533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:14.034932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:14.044182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:14.123057 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2608/5220] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:01:13 2022] POST /identity/v3/domains => generated 276 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:14.123492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:14.146401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4a846-7797-49ad-96ff-0b9cf1ac60ab tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:14.292902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:14.320798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:14.322197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:14.322928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:14.323254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:14.324028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:14.335289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:14.420914 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2613/5221] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:14 2022] POST /identity/v3/projects => generated 405 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:14.431225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:14.450355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef7484-3901-4855-9851-c2169b14418a tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:14.569252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:14.596310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:14.597335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:14.597477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:14.597721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/11a6f67b4ff34fb0bb1ac59bdf8e4cfe` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:14.600343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=11a6f67b4ff34fb0bb1ac59bdf8e4cfe)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:14.603765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:14.607371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2609/5222] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:14 2022] GET /identity/v3/projects/11a6f67b4ff34fb0bb1ac59bdf8e4cfe => generated 405 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:14.613687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:14.640331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f70d6-d1a9-4b3c-a0d9-9eb417cbf068 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:14.647495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:14.648514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:14.648853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:14.649090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/11a6f67b4ff34fb0bb1ac59bdf8e4cfe` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:14.651172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11a6f67b4ff34fb0bb1ac59bdf8e4cfe)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:14.654228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:14.783569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a6f67b4ff34fb0bb1ac59bdf8e4cfe', 'request_id': 'req-e41ca15d-ffa8-461c-99b0-c39a23610a3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:14.807980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a6f67b4ff34fb0bb1ac59bdf8e4cfe', 'request_id': 'req-e41ca15d-ffa8-461c-99b0-c39a23610a3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:14.829896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a6f67b4ff34fb0bb1ac59bdf8e4cfe', 'request_id': 'req-e41ca15d-ffa8-461c-99b0-c39a23610a3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:14.883684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 11a6f67b4ff34fb0bb1ac59bdf8e4cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:14.884097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:14.890995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:14.896730 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2614/5223] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:14 2022] DELETE /identity/v3/projects/11a6f67b4ff34fb0bb1ac59bdf8e4cfe => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:14.904043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:14.907779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:14.930011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed650-9346-4cfd-b2dc-a31d2cfc0958 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:15.155996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:15.157627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:15.157922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:15.158199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains/9512793cfb814ae2bed7989b695ca28a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:15.166723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9512793cfb814ae2bed7989b695ca28a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:15.168488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:15.236594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9512793cfb814ae2bed7989b695ca28a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:15.238178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9512793cfb814ae2bed7989b695ca28a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:15.333019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9512793cfb814ae2bed7989b695ca28a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:15.338421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9512793cfb814ae2bed7989b695ca28a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:15.342274 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2610/5224] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:01:14 2022] PATCH /identity/v3/domains/9512793cfb814ae2bed7989b695ca28a => generated 277 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:15.349372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:15.380248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ca15d-ffa8-461c-99b0-c39a23610a3b tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:15.658369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:15.663295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:15.665631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:15.666421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains/9512793cfb814ae2bed7989b695ca28a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:15.719097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9512793cfb814ae2bed7989b695ca28a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:15.725246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:15.835042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9512793cfb814ae2bed7989b695ca28a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:15.844625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9512793cfb814ae2bed7989b695ca28a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:15.926451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:15.983992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:15.986571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:16.060616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9512793cfb814ae2bed7989b695ca28a', 'request_id': 'req-e1b866fa-f677-427c-a358-a9050327bd58'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.091503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9512793cfb814ae2bed7989b695ca28a', 'request_id': 'req-e1b866fa-f677-427c-a358-a9050327bd58'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.117759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9512793cfb814ae2bed7989b695ca28a', 'request_id': 'req-e1b866fa-f677-427c-a358-a9050327bd58'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.169383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 9512793cfb814ae2bed7989b695ca28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:16.169900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.172552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.193713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c433870-45da-4c81-9d10-78122bd7a0cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:16.268576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9512793cfb814ae2bed7989b695ca28a', 'request_id': 'req-e1b866fa-f677-427c-a358-a9050327bd58'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.289748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9512793cfb814ae2bed7989b695ca28a', 'request_id': 'req-e1b866fa-f677-427c-a358-a9050327bd58'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.294088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9512793cfb814ae2bed7989b695ca28a', 'request_id': 'req-e1b866fa-f677-427c-a358-a9050327bd58'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.304555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:16.306200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:16.306573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:16.306764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] PATH_INFO: `/v3/projects/78f1597fcaf8431bbf0f6518b688e795` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:16.312157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f1597fcaf8431bbf0f6518b688e795)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:16.320149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:16.335706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:16.336403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2615/5225] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:15 2022] DELETE /identity/v3/domains/9512793cfb814ae2bed7989b695ca28a => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:16.345690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:16.350962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:16.420035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f1597fcaf8431bbf0f6518b688e795', 'request_id': 'req-7b5ab205-f716-4a45-951e-62564acc6afe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.428897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f1597fcaf8431bbf0f6518b688e795', 'request_id': 'req-7b5ab205-f716-4a45-951e-62564acc6afe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.436944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f1597fcaf8431bbf0f6518b688e795', 'request_id': 'req-7b5ab205-f716-4a45-951e-62564acc6afe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.470131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] The token cache is being invalidate because project 78f1597fcaf8431bbf0f6518b688e795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:16.470584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.471182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b5ab205-f716-4a45-951e-62564acc6afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:16.473504 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2611/5226] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:15 2022] DELETE /identity/v3/projects/78f1597fcaf8431bbf0f6518b688e795 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:16.479602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84672a65-2cb8-4d44-8205-2267951e7c2c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:16.480043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84672a65-2cb8-4d44-8205-2267951e7c2c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:16.480456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84672a65-2cb8-4d44-8205-2267951e7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:16.540050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-84672a65-2cb8-4d44-8205-2267951e7c2c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:16.543606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84672a65-2cb8-4d44-8205-2267951e7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:16.672355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b866fa-f677-427c-a358-a9050327bd58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:16.788333 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2612/5227] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:16.797483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307433-1946-4161-b49b-fad2943171b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:16.797788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307433-1946-4161-b49b-fad2943171b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:16.798054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307433-1946-4161-b49b-fad2943171b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:16.858862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f6307433-1946-4161-b49b-fad2943171b1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:16.868767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6307433-1946-4161-b49b-fad2943171b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:16.893879 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2613/5228] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:16.900933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307433-1946-4161-b49b-fad2943171b1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:16.921574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307433-1946-4161-b49b-fad2943171b1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:16.928628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:16.929874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:16.931256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:16.931947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:16.933071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:16.933852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:16.936079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:16.979650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2614/5229] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:16.980989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:17.008463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd09af-f58e-416b-9070-1c9361a3a8c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:17.018991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:17.020264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:17.021162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:17.021860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:17.022826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:17.027413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:17.027413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:17.027971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:17.028185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:17.029359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:17.035920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:17.044825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:17.100911 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2616/5230] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:01:16 2022] POST /identity/v3/domains => generated 273 bytes in 757 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:01:17.106075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:17.112936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:17.153244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2615/5231] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:16 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:17.158006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:17.283673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:17.570304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7e132-e060-410c-8554-50ec67fd2dad tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:17.594594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:17.621875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144d03b-1caf-440a-ae9d-65a9c0f447b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:17.650123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:17.652193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:17.661075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:17.662830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:17.668429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:17.687298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:17.783511 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2616/5232] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:17 2022] POST /identity/v3/users => generated 284 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:17.785326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:17.827574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6fe1-71a0-40ea-8e0e-cb72863e25b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:17.850956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:17.857928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:17.858853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:17.859394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:17.860943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:17.870121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:17.919517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:17.920295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:17.920609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:17.925513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:17.925513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:17.925925 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2617/5233] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:01:17.926104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:17.927065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:17.977581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d96aea-bda7-4b3e-8fdb-2d567874ade3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:18.021089 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2617/5234] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:17 2022] POST /identity/v3/projects => generated 408 bytes in 919 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:18.026888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:18.027760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:18.029109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:18.030654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:18.033779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:18.034769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:18.037560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:18.088405 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2618/5235] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:01:18.089498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:18.118908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d87d-892f-483d-9997-d26e5d0883ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:18.229954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f13ee1-a741-4fd0-99de-51f3b8b2d7cd tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:18.247339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:18.248183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:18.248539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:18.255393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:18.256431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:18.258944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:18.295947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fcfdb-44e5-4458-913d-9ef6f07406fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:18.297825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcfdb-44e5-4458-913d-9ef6f07406fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:18.298347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcfdb-44e5-4458-913d-9ef6f07406fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:18.298877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fcfdb-44e5-4458-913d-9ef6f07406fa admin admin] PATH_INFO: `/v3/projects/507d6ed9b1364635bb20f70253a2200a/users/38db1f53f31b4090b02a676ca26951ab/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:18.345167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fcfdb-44e5-4458-913d-9ef6f07406fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=507d6ed9b1364635bb20f70253a2200a, user_id=38db1f53f31b4090b02a676ca26951ab, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:18.370676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fcfdb-44e5-4458-913d-9ef6f07406fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:18.372602 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2618/5236] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:18 2022] POST /identity/v3/projects => generated 404 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:18.379264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:18.423601 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2619/5237] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:18 2022] PUT /identity/v3/projects/507d6ed9b1364635bb20f70253a2200a/users/38db1f53f31b4090b02a676ca26951ab/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:18.453123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee015-12d5-46ff-8ac3-8d525795e425 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:18.453123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee015-12d5-46ff-8ac3-8d525795e425 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:18.453123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee015-12d5-46ff-8ac3-8d525795e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:18.494625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:18.533168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dc9ee015-12d5-46ff-8ac3-8d525795e425 None None] MFA Rules not processed for user `38db1f53f31b4090b02a676ca26951ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:18.538754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc9ee015-12d5-46ff-8ac3-8d525795e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:18.590926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee92f0a-2402-4023-baca-56257790cf19 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:18.860974 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2620/5238] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:18.868019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee015-12d5-46ff-8ac3-8d525795e425 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:18.978476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:18.980368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:18.981060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:18.988027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/ef25a07fd4be474183dc87e4e3ca973a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:19.007994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef25a07fd4be474183dc87e4e3ca973a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:19.011981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:19.025428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:19.078370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee015-12d5-46ff-8ac3-8d525795e425 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:19.106449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:19.108547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:19.109931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:19.110699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:19.112430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:19.117707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:19.227036 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2621/5239] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:18 2022] POST /identity/v3/projects => generated 365 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:19.232657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:19.305952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef25a07fd4be474183dc87e4e3ca973a', 'request_id': 'req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:19.336623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef25a07fd4be474183dc87e4e3ca973a', 'request_id': 'req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:19.372487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef25a07fd4be474183dc87e4e3ca973a', 'request_id': 'req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:19.437839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project ef25a07fd4be474183dc87e4e3ca973a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:19.438568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:19.445167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:19.455921 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2619/5240] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:18 2022] DELETE /identity/v3/projects/ef25a07fd4be474183dc87e4e3ca973a => generated 0 bytes in 1072 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:19.457887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:19.470895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:19.639761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197f76-afa5-414b-af90-8a153a5ebf56 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:19.788684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db718a2-4d1d-4c5e-a0ee-1f192d4b4355 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:19.822729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:19.824274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:19.824795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:19.825308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/9259d4902e5d4090a0484bf46a7d854b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:19.832675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9259d4902e5d4090a0484bf46a7d854b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:19.839425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:19.879930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:20.000972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:20.001585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:20.001875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:20.002156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:20.002873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:20.011312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:20.057439 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2622/5241] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:19 2022] POST /identity/v3/users => generated 289 bytes in 826 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:20.064010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:20.065662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9259d4902e5d4090a0484bf46a7d854b', 'request_id': 'req-a4c7c205-a048-44c2-a561-e113f17f0f81'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:20.066594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:20.107897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9259d4902e5d4090a0484bf46a7d854b', 'request_id': 'req-a4c7c205-a048-44c2-a561-e113f17f0f81'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:20.110685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f1e1-e053-4389-80c4-a5efde68a24e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:20.163421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9259d4902e5d4090a0484bf46a7d854b', 'request_id': 'req-a4c7c205-a048-44c2-a561-e113f17f0f81'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:20.194881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 9259d4902e5d4090a0484bf46a7d854b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:20.195537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:20.197322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:20.209549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2620/5242] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:19 2022] DELETE /identity/v3/projects/9259d4902e5d4090a0484bf46a7d854b => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:20.210879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:20.214902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:20.374606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:20.384308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:20.384615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:20.384928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:20.385661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:20.406030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:20.408299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:20.445009 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2623/5243] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:20.451255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:20.453729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:20.506230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e29e1e-a656-40c0-9c4a-7313300f7ba1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:20.523708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:20.524837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:20.525128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:20.525410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] PATH_INFO: `/v3/projects/1916401bfe33480c9a0344a64a6729eb/users/38d7f1fecd4740f99863bc7d525cc774/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:20.567904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1916401bfe33480c9a0344a64a6729eb, user_id=38d7f1fecd4740f99863bc7d525cc774, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:20.570703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:20.612782 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2624/5244] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:20 2022] PUT /identity/v3/projects/1916401bfe33480c9a0344a64a6729eb/users/38d7f1fecd4740f99863bc7d525cc774/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:20.614186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:20.616028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7c205-a048-44c2-a561-e113f17f0f81 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:20.792686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:20.796207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:20.797300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:20.797894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains/809033990057448381e647ce2b100b29` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:20.804213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=809033990057448381e647ce2b100b29)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:20.852367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:20.857828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce3639-0b9f-4478-a2da-82151f11ce35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:20.863123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:20.863912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:20.864205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:20.864482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:20.865304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:20.879762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:20.899731 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2625/5245] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:20.902535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:20.908154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '809033990057448381e647ce2b100b29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:20.909342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '809033990057448381e647ce2b100b29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:20.950285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6844f-7953-4748-8646-0969d7dbd719 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:21.012630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '809033990057448381e647ce2b100b29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:21.014222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '809033990057448381e647ce2b100b29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:21.022802 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2621/5246] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:01:20 2022] PATCH /identity/v3/domains/809033990057448381e647ce2b100b29 => generated 274 bytes in 814 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:21.028404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:21.030073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:21.062679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:21.131957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95e85-80d9-4146-a8e1-9d31e315150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:21.132970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95e85-80d9-4146-a8e1-9d31e315150e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:21.133160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95e85-80d9-4146-a8e1-9d31e315150e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:21.133452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95e85-80d9-4146-a8e1-9d31e315150e admin admin] PATH_INFO: `/v3/projects/1916401bfe33480c9a0344a64a6729eb/users/38d7f1fecd4740f99863bc7d525cc774/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:21.144426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95e85-80d9-4146-a8e1-9d31e315150e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1916401bfe33480c9a0344a64a6729eb, user_id=38d7f1fecd4740f99863bc7d525cc774, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:21.154458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95e85-80d9-4146-a8e1-9d31e315150e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:21.210988 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2626/5247] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:20 2022] PUT /identity/v3/projects/1916401bfe33480c9a0344a64a6729eb/users/38d7f1fecd4740f99863bc7d525cc774/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:21.237176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1964-2998-4221-b26b-3e81e285c090 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:21.237661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1964-2998-4221-b26b-3e81e285c090 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:21.238144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1964-2998-4221-b26b-3e81e285c090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:21.380129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-988e1964-2998-4221-b26b-3e81e285c090 None None] MFA Rules not processed for user `38d7f1fecd4740f99863bc7d525cc774`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:21.383155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-988e1964-2998-4221-b26b-3e81e285c090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:21.400774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31feb9-09d7-4449-b4d5-2bc56c1d31b5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:21.593339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:21.727694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:21.729255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:21.729737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:21.732768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains/809033990057448381e647ce2b100b29` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:21.767324 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2627/5248] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:21.773209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e1964-2998-4221-b26b-3e81e285c090 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:21.779942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=809033990057448381e647ce2b100b29)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:21.792396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:21.813529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e1964-2998-4221-b26b-3e81e285c090 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:21.832533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:21.833710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:21.834222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:21.834802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:21.835900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:21.837325 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:01:21.837325 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:01:21.837325 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:01:21.841508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:21.877711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '809033990057448381e647ce2b100b29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:21.887844 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2628/5249] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:01:21 2022] POST /identity/v3/regions => generated 223 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:21.892990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:21.897321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '809033990057448381e647ce2b100b29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:21.951882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d70fdd-7067-462a-a241-7d337407d8f8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:21.965896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:21.967320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:21.968024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:21.969204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:21.972329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:21.977429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:22.063253 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2629/5250] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:01:21 2022] POST /identity/v3/regions => generated 224 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:01:22.069705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:22.072660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809033990057448381e647ce2b100b29', 'request_id': 'req-4cd764c1-ba07-4bb0-af99-0abe916df19f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.092980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809033990057448381e647ce2b100b29', 'request_id': 'req-4cd764c1-ba07-4bb0-af99-0abe916df19f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.124440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809033990057448381e647ce2b100b29', 'request_id': 'req-4cd764c1-ba07-4bb0-af99-0abe916df19f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.176000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3352-c380-40f5-b6c8-dd94ac8ea04e tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:22.179033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 809033990057448381e647ce2b100b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:22.179393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.180747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.208916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '809033990057448381e647ce2b100b29', 'request_id': 'req-4cd764c1-ba07-4bb0-af99-0abe916df19f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.211226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:22.220848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '809033990057448381e647ce2b100b29', 'request_id': 'req-4cd764c1-ba07-4bb0-af99-0abe916df19f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.224039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '809033990057448381e647ce2b100b29', 'request_id': 'req-4cd764c1-ba07-4bb0-af99-0abe916df19f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:22.242039 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2622/5251] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:21 2022] DELETE /identity/v3/domains/809033990057448381e647ce2b100b29 => generated 0 bytes in 1214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:22.249418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:22.252291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:22.432979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:22.434760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:22.435305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:22.435762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/86c7a3e6-d43d-4f88-b5c1-0cf121bb019a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:22.438950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:create_region(region_id=86c7a3e6-d43d-4f88-b5c1-0cf121bb019a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:22.444038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:22.486872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd764c1-ba07-4bb0-af99-0abe916df19f tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:22.514464 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2630/5252] 10.222.0.98 () {60 vars in 1258 bytes} [Thu Jul 14 15:01:22 2022] PUT /identity/v3/regions/86c7a3e6-d43d-4f88-b5c1-0cf121bb019a => generated 232 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:22.517403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:22.520449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:22.546274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:22.547732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:22.548034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:22.548321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:22.549047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:22.551017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:22.603949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875839-cb67-4fb2-8154-4978c356554f tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:22.631721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:22.634409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:22.635069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:22.635750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/86c7a3e6-d43d-4f88-b5c1-0cf121bb019a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:22.637341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:delete_region(region_id=86c7a3e6-d43d-4f88-b5c1-0cf121bb019a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:22.642861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:22.686145 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2623/5253] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:22 2022] POST /identity/v3/projects => generated 378 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:22.692222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:22.730352 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2631/5254] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:01:22 2022] DELETE /identity/v3/regions/86c7a3e6-d43d-4f88-b5c1-0cf121bb019a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:22.736454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:22.832598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39af755-cf9d-495c-a8c1-4d5fba815790 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:22.980174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780839f5-6e33-44a0-8bfb-befa02d3de58 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.012114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:23.069511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.071458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.072454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.072893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/c650752316234cc9bb6dd4e34c1b772e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.076181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=c650752316234cc9bb6dd4e34c1b772e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.090445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:23.091911 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2624/5255] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:22 2022] GET /identity/v3/projects/c650752316234cc9bb6dd4e34c1b772e => generated 378 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:23.095569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:23.128271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a808-da88-4840-b10c-993074def68d tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.139921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.141997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.142277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.142754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.148873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.155467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:23.164967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.169198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.173608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.178318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.185079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.198416 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:01:23.198416 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:01:23.198416 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:01:23.210280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:23.287345 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2632/5256] 10.222.0.98 () {60 vars in 1149 bytes} [Thu Jul 14 15:01:22 2022] POST /identity/v3/regions => generated 254 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:23.290902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:23.392035 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2625/5257] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:01:23 2022] GET /identity/v3/projects => generated 6513 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:23.400950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:23.403324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552894b6-200d-4371-902d-7308d91282a8 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.421210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.423696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.424252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.426259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/359afbf2b00347d8a200a6340a998ef0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.427910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:update_region(region_id=359afbf2b00347d8a200a6340a998ef0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.430660 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:01:23.430660 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:01:23.430660 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:01:23.432778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:23.445849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823ed31-62d5-40cd-8759-4fb9b3cd7e56 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.496739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.497825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.498206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.498725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/c650752316234cc9bb6dd4e34c1b772e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.506253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c650752316234cc9bb6dd4e34c1b772e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.506253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:23.506869 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2633/5258] 10.222.0.98 () {60 vars in 1249 bytes} [Thu Jul 14 15:01:23 2022] PATCH /identity/v3/regions/359afbf2b00347d8a200a6340a998ef0 => generated 253 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:23.508557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:23.543234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0be87-64b6-420f-b671-709741960d12 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.549584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.550601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.550972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.551379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/359afbf2b00347d8a200a6340a998ef0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.552156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:get_region(region_id=359afbf2b00347d8a200a6340a998ef0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.553369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:23.566410 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2634/5259] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:01:23 2022] GET /identity/v3/regions/359afbf2b00347d8a200a6340a998ef0 => generated 253 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:23.568458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:23.597901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:23.598247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebc91-a23e-4845-977e-83846a7c9509 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.636190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c650752316234cc9bb6dd4e34c1b772e', 'request_id': 'req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:23.658819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c650752316234cc9bb6dd4e34c1b772e', 'request_id': 'req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:23.684890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c650752316234cc9bb6dd4e34c1b772e', 'request_id': 'req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:23.723081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project c650752316234cc9bb6dd4e34c1b772e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:23.723451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:23.724997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:23.732312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2626/5260] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:23 2022] DELETE /identity/v3/projects/c650752316234cc9bb6dd4e34c1b772e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:23.740482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:23.742621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:23.818873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.828356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.828811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.829207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/359afbf2b00347d8a200a6340a998ef0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.830448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:delete_region(region_id=359afbf2b00347d8a200a6340a998ef0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.836850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:23.899091 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2635/5261] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:23 2022] DELETE /identity/v3/regions/359afbf2b00347d8a200a6340a998ef0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:23.900612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:23.904125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:23.969484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d710f-ad71-4edf-aaf0-5d7932f3f308 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.973554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3c585-a91b-4eb7-a0ad-f78b0ed4bd22 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:23.980709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:23.981609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:23.982034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:23.982408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:23.985095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:23.986567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.010682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2636/5262] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 15:01:23 2022] GET /identity/v3/regions => generated 669 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:01:24.011985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:24.031800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb69143-a13e-441b-88e7-84b79805d5aa tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:24.037660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:24.038642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:24.041357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:24.041876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:24.051851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:24.052945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:24.053347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:24.053737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/359afbf2b00347d8a200a6340a998ef0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:24.054655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:delete_region(region_id=359afbf2b00347d8a200a6340a998ef0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:24.054899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:24.057197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.058413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Could not find region: 359afbf2b00347d8a200a6340a998ef0.: keystone.exception.RegionNotFound: Could not find region: 359afbf2b00347d8a200a6340a998ef0. Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 359afbf2b00347d8a200a6340a998ef0. Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:01:24.102080 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 359afbf2b00347d8a200a6340a998ef0. Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:24.104507 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2637/5263] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:24 2022] DELETE /identity/v3/regions/359afbf2b00347d8a200a6340a998ef0 => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 14 15:01:24.111099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:24.150826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031ebe8-8cc3-40ed-90cf-a38ebb1c3b46 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:24.167784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:24.170499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:24.170499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:24.172594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:24.176240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:24.180167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.197570 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2638/5264] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 15:01:24 2022] GET /identity/v3/regions => generated 669 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:24.204718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:24.221245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3b71-bff5-4aeb-b9d2-a99e2d906dd5 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:24.223918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2627/5265] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:01:23 2022] POST /identity/v3/projects => generated 347 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:24.226972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:24.340293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:24.494984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:24.496125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:24.496632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:24.497023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:24.497939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:24.501605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.550560 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2639/5266] 10.222.0.98 () {60 vars in 1149 bytes} [Thu Jul 14 15:01:24 2022] POST /identity/v3/regions => generated 253 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:24.566160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:24.596318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf7c5-89fc-4dca-bbca-0e00d3fe2e74 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:24.680073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:24.681861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:24.682374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:24.685403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e9119-c803-4d64-800d-fdf1b016fcb0 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:24.687622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/f5170f41d7ab477badd869891bc28654` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:24.693266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:update_project(project_id=f5170f41d7ab477badd869891bc28654)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:24.698812 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:01:24.698812 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:01:24.698812 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:01:24.706897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.741347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:24.743851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:24.752083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:24.752888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:24.757848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Adding query filter params (parent_region_id=bc28c67c502644619399ba45549c78c2) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:24.758734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:24.764401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.799528 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2640/5267] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:01:24 2022] GET /identity/v3/regions?parent_region_id=bc28c67c502644619399ba45549c78c2 => generated 399 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:24.801574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:24.842445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712524c5-a2de-4b83-8fb9-d7577ec0628c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:24.861390 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2628/5268] 10.222.0.98 () {60 vars in 1251 bytes} [Thu Jul 14 15:01:24 2022] PATCH /identity/v3/projects/f5170f41d7ab477badd869891bc28654 => generated 361 bytes in 637 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:24.870180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:24.872052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:24.873548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:24.874109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:24.874816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/5e89710c70664c8bbce9e348a88891a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:24.876329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:delete_region(region_id=5e89710c70664c8bbce9e348a88891a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:24.879538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:24.936611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa391f-55e8-42bb-a993-5fa9b3dd0790 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:24.955589 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2641/5269] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:24 2022] DELETE /identity/v3/regions/5e89710c70664c8bbce9e348a88891a6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:24.956242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:24.957105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:25.010429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3cb4-56f3-4bb6-b2ec-f295fbd1b4c3 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:25.011592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:25.013247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:25.014548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:25.015465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/f5170f41d7ab477badd869891bc28654` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:25.019011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:25.020222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:25.020706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:25.021221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/ffd082fc15b540e489f30aa903f0b402` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:25.022332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ffd082fc15b540e489f30aa903f0b402)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:25.035704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:25.043666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=f5170f41d7ab477badd869891bc28654)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:25.050807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:25.056395 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2629/5270] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:24 2022] GET /identity/v3/projects/f5170f41d7ab477badd869891bc28654 => generated 348 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:25.063933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:25.090473 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2642/5271] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:24 2022] DELETE /identity/v3/regions/ffd082fc15b540e489f30aa903f0b402 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:25.096963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:25.097317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebc1d1-91e2-4494-996b-122c8aa32da3 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:25.167185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:25.173974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:25.174554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:25.175060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/f5170f41d7ab477badd869891bc28654` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:25.182005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5170f41d7ab477badd869891bc28654)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:25.186167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:25.202474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3f95-ae0b-476f-8d21-ccc29e873c31 tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:25.217133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d7f1fecd4740f99863bc7d525cc774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1916401bfe33480c9a0344a64a6729eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:25.221790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:25.222733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:25.223249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] PATH_INFO: `/v3/regions/bc28c67c502644619399ba45549c78c2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:25.224248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorizing `identity:delete_region(region_id=bc28c67c502644619399ba45549c78c2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:25.227583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:25.303158 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2643/5272] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:25 2022] DELETE /identity/v3/regions/bc28c67c502644619399ba45549c78c2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:25.310146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:25.313476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:25.424450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5170f41d7ab477badd869891bc28654', 'request_id': 'req-30270471-407e-4d9c-8ac0-abc9f639a796'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:25.453936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5170f41d7ab477badd869891bc28654', 'request_id': 'req-30270471-407e-4d9c-8ac0-abc9f639a796'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:25.496666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5170f41d7ab477badd869891bc28654', 'request_id': 'req-30270471-407e-4d9c-8ac0-abc9f639a796'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:25.571684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project f5170f41d7ab477badd869891bc28654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:25.574770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:25.576987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:25.590916 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2630/5273] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:25 2022] DELETE /identity/v3/projects/f5170f41d7ab477badd869891bc28654 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:25.593547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:25.596577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:25.769585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4b370-8505-40b4-a181-741361e5308c tempest-RegionsTestJSON-870811665 tempest-RegionsTestJSON-870811665-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:25.869706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:25.884297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30270471-407e-4d9c-8ac0-abc9f639a796 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:25.944796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:25.944796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:25.945325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:25.945590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:25.946617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:25.948655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:26.041252 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2631/5274] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:25 2022] POST /identity/v3/projects => generated 359 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:01:26.043795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:26.048079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:26.049000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:26.057447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:26.057447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] PATH_INFO: `/v3/users/38db1f53f31b4090b02a676ca26951ab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:26.067298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38db1f53f31b4090b02a676ca26951ab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:26.081280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:26.312439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:26.329459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38db1f53f31b4090b02a676ca26951ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:26.349330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38db1f53f31b4090b02a676ca26951ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:26.360492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38db1f53f31b4090b02a676ca26951ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:26.361332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38db1f53f31b4090b02a676ca26951ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:26.377601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccede6b2-ef44-4fc0-886c-1610ee993545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38db1f53f31b4090b02a676ca26951ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:26.393726 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2644/5275] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:25 2022] DELETE /identity/v3/users/38db1f53f31b4090b02a676ca26951ab => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:26.395874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:26.398681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:26.399088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:26.458898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:26.459974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fcbd0-db53-4d4a-a22f-ff3fe37d5507 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:26.462774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:26.713132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:26.716742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:26.718193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:26.726884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/0eb2b45cbbdc4a1eab8aae3880f7b133` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:26.731153 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2645/5276] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:26.736685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:update_project(project_id=0eb2b45cbbdc4a1eab8aae3880f7b133)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:26.756457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:26.758772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:26.759862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:27.042480 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2632/5277] 10.222.0.98 () {60 vars in 1251 bytes} [Thu Jul 14 15:01:26 2022] PATCH /identity/v3/projects/0eb2b45cbbdc4a1eab8aae3880f7b133 => generated 371 bytes in 1001 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:27.049902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:27.052985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:27.066258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:27.133709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056018e-2aa9-46ee-8f2a-ea570e383fd7 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:27.157931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee0961-90d2-45c3-9846-c8c91d43a24c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:27.161012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:27.162764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:27.163601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:27.164225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/0eb2b45cbbdc4a1eab8aae3880f7b133` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:27.164728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:27.165596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:27.166054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:27.166680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:27.180826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:27.189803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:27.220641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eb2b45cbbdc4a1eab8aae3880f7b133)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:27.224893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:27.231020 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2646/5278] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:01:27.233660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2633/5279] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:27 2022] GET /identity/v3/projects/0eb2b45cbbdc4a1eab8aae3880f7b133 => generated 358 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:27.235949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:27.310013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191895a-09d6-410b-9207-67541cf6b9cf tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:27.333936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:27.336102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:27.336971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:27.337879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/0eb2b45cbbdc4a1eab8aae3880f7b133` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:27.344186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0eb2b45cbbdc4a1eab8aae3880f7b133)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:27.357005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:27.585683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb2b45cbbdc4a1eab8aae3880f7b133', 'request_id': 'req-3f37b839-252f-46f1-a755-5a3fabd078d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:27.614554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb2b45cbbdc4a1eab8aae3880f7b133', 'request_id': 'req-3f37b839-252f-46f1-a755-5a3fabd078d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:27.643973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb2b45cbbdc4a1eab8aae3880f7b133', 'request_id': 'req-3f37b839-252f-46f1-a755-5a3fabd078d9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:27.685961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project 0eb2b45cbbdc4a1eab8aae3880f7b133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:27.687147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:27.697602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:27.716841 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2634/5280] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:27 2022] DELETE /identity/v3/projects/0eb2b45cbbdc4a1eab8aae3880f7b133 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:27.718761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:27.741657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131dfcd-dcf5-4423-b496-ce521cc1808d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:27.888757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:27.890399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:27.890860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:27.891357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:27.892218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:27.895424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:27.976589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:27.977593 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2647/5281] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:27 2022] POST /identity/v3/projects => generated 353 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:27.978391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:28.009443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37b839-252f-46f1-a755-5a3fabd078d9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:28.065967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:28.174404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:28.178150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:28.179454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:28.180057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/fe0a2b25f4024ac7bd84692a132b5aad` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:28.182230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:update_project(project_id=fe0a2b25f4024ac7bd84692a132b5aad)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:28.184815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:28.264749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:28.271424 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2635/5282] 10.222.0.98 () {60 vars in 1251 bytes} [Thu Jul 14 15:01:27 2022] PATCH /identity/v3/projects/fe0a2b25f4024ac7bd84692a132b5aad => generated 365 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:28.315187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231903-e519-4b39-9ed7-9640ae2f6ee5 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:28.338444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:28.341812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:28.343116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:28.344796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/fe0a2b25f4024ac7bd84692a132b5aad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:28.402144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe0a2b25f4024ac7bd84692a132b5aad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:28.406787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:28.426635 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2648/5283] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:01:28 2022] GET /identity/v3/projects/fe0a2b25f4024ac7bd84692a132b5aad => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:28.431458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:28.450451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab570260-fe70-458a-bc1d-7c3d16e776ee tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:28.474728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:28.476349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:28.476653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:28.476945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/projects/fe0a2b25f4024ac7bd84692a132b5aad` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:28.479251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe0a2b25f4024ac7bd84692a132b5aad)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:28.499233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:28.662955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0a2b25f4024ac7bd84692a132b5aad', 'request_id': 'req-10cfb496-73c8-40b6-a71e-4594290faec2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:28.707851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0a2b25f4024ac7bd84692a132b5aad', 'request_id': 'req-10cfb496-73c8-40b6-a71e-4594290faec2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:28.723421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0a2b25f4024ac7bd84692a132b5aad', 'request_id': 'req-10cfb496-73c8-40b6-a71e-4594290faec2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:28.747772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] The token cache is being invalidate because project fe0a2b25f4024ac7bd84692a132b5aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:28.748165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:28.759764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:28.763883 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2636/5284] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:28 2022] DELETE /identity/v3/projects/fe0a2b25f4024ac7bd84692a132b5aad => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:28.770909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:28.775167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:28.834995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce2f60-6427-43f3-a6d3-d0706a238fa9 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:29.014795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:29.020797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:29.021317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:29.021849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains/809033990057448381e647ce2b100b29` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:29.055183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Could not find domain: 809033990057448381e647ce2b100b29.: keystone.exception.DomainNotFound: Could not find domain: 809033990057448381e647ce2b100b29. Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 809033990057448381e647ce2b100b29. Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:01:29.077767 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:29.078945 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 809033990057448381e647ce2b100b29. Jul 14 15:01:29.080197 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:29.090685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:29.091981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2649/5285] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:01:28 2022] PATCH /identity/v3/domains/809033990057448381e647ce2b100b29 => generated 112 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:01:29.109824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb496-73c8-40b6-a71e-4594290faec2 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:29.119908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609d242-7eff-4e71-a864-be5af9192621 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2c17dbb98d6479da5a1f081deeb7855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1007a54bb545758a1054934a6d7243', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:29.121804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609d242-7eff-4e71-a864-be5af9192621 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:29.122120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609d242-7eff-4e71-a864-be5af9192621 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:29.122664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609d242-7eff-4e71-a864-be5af9192621 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] PATH_INFO: `/v3/domains/9512793cfb814ae2bed7989b695ca28a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:29.159788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609d242-7eff-4e71-a864-be5af9192621 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e609d242-7eff-4e71-a864-be5af9192621 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Could not find domain: 9512793cfb814ae2bed7989b695ca28a.: keystone.exception.DomainNotFound: Could not find domain: 9512793cfb814ae2bed7989b695ca28a. Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9512793cfb814ae2bed7989b695ca28a. Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:01:29.175679 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:29.177550 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9512793cfb814ae2bed7989b695ca28a. Jul 14 15:01:29.179549 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:01:29.184002 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2637/5286] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:01:29 2022] PATCH /identity/v3/domains/9512793cfb814ae2bed7989b695ca28a => generated 112 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:01:29.186862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:29.190368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:29.381978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:29.499308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e645031-cb9e-4458-94d5-8b73d3d74667 tempest-ProjectsTestJSON-835625167 tempest-ProjectsTestJSON-835625167-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:29.504943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:29.505871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:29.506160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:29.506444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] PATH_INFO: `/v3/users/4562afc1820c40f9a4fa04ec7d3e1a2d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:29.508804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4562afc1820c40f9a4fa04ec7d3e1a2d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:29.510964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:29.629533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4562afc1820c40f9a4fa04ec7d3e1a2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:29.661816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4562afc1820c40f9a4fa04ec7d3e1a2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:29.680924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4562afc1820c40f9a4fa04ec7d3e1a2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:29.681695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4562afc1820c40f9a4fa04ec7d3e1a2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:29.697248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4562afc1820c40f9a4fa04ec7d3e1a2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:29.730766 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2650/5287] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:29 2022] DELETE /identity/v3/users/4562afc1820c40f9a4fa04ec7d3e1a2d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:29.738242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:29.739697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:29.740527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:29.824789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:29.839885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:30.022011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:30.025018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:30.035224 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2638/5288] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:30.063343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:30.064805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:30.083581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:30.110724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620bdc-6325-4d12-879a-e945671ee86f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:30.122464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:30.124281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:30.125473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:30.126125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] PATH_INFO: `/v3/projects/507d6ed9b1364635bb20f70253a2200a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:30.130732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507d6ed9b1364635bb20f70253a2200a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:30.136698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:30.204471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ebef8-cdf4-4f60-a22b-abc1e1dc41ac None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:30.218099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:30.219831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:30.220478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:30.220927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:30.251458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:30.254849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:30.282006 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2639/5289] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:30.365075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507d6ed9b1364635bb20f70253a2200a', 'request_id': 'req-9c60a73d-2f4f-45c9-8462-2643d9e04a07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.376952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507d6ed9b1364635bb20f70253a2200a', 'request_id': 'req-9c60a73d-2f4f-45c9-8462-2643d9e04a07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.391734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507d6ed9b1364635bb20f70253a2200a', 'request_id': 'req-9c60a73d-2f4f-45c9-8462-2643d9e04a07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.423008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] The token cache is being invalidate because project 507d6ed9b1364635bb20f70253a2200a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:30.425249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.427499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.430432 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2651/5290] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:30 2022] DELETE /identity/v3/projects/507d6ed9b1364635bb20f70253a2200a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:30.435838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:30.451728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb93999-8101-4f0f-a160-748a313bab2d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:30.634490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:30.635508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:30.635918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:30.636304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] PATH_INFO: `/v3/users/38d7f1fecd4740f99863bc7d525cc774` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:30.644238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d7f1fecd4740f99863bc7d525cc774)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:30.646760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:30.838080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d7f1fecd4740f99863bc7d525cc774'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.876093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d7f1fecd4740f99863bc7d525cc774'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.881217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d7f1fecd4740f99863bc7d525cc774'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.901218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d7f1fecd4740f99863bc7d525cc774'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:30.905418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d7f1fecd4740f99863bc7d525cc774'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:31.031469 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2640/5291] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:30 2022] DELETE /identity/v3/users/38d7f1fecd4740f99863bc7d525cc774 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:31.911333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:31.915393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:31.931910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:31.936256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:31.972462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60a73d-2f4f-45c9-8462-2643d9e04a07 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:32.081703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:32.182129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:32.213497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:32.215014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:32.215389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:32.215587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] PATH_INFO: `/v3/projects/e18dcb61f2824166bb0197dde7f9fbdb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:32.217751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18dcb61f2824166bb0197dde7f9fbdb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:32.223472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d824c3-c6e3-4685-b74f-4a92cecf4f19 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:32.223783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:32.245141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:32.247129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:32.247396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:32.248468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] PATH_INFO: `/v3/projects/1916401bfe33480c9a0344a64a6729eb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:32.252987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1916401bfe33480c9a0344a64a6729eb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:32.260870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:32.473513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1916401bfe33480c9a0344a64a6729eb', 'request_id': 'req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.476747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18dcb61f2824166bb0197dde7f9fbdb', 'request_id': 'req-c4fc0d01-d438-4768-9a22-7bda7e852601'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.496911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1916401bfe33480c9a0344a64a6729eb', 'request_id': 'req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.510130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18dcb61f2824166bb0197dde7f9fbdb', 'request_id': 'req-c4fc0d01-d438-4768-9a22-7bda7e852601'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.517223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1916401bfe33480c9a0344a64a6729eb', 'request_id': 'req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.552684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18dcb61f2824166bb0197dde7f9fbdb', 'request_id': 'req-c4fc0d01-d438-4768-9a22-7bda7e852601'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.579147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] The token cache is being invalidate because project 1916401bfe33480c9a0344a64a6729eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:32.585883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.591353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a5c3ba35-a4ef-47ab-9251-e6cc99ac0069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.599672 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2641/5292] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:31 2022] DELETE /identity/v3/projects/1916401bfe33480c9a0344a64a6729eb => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:32.609620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea23f7-0808-426d-8c44-fe4b880f0322 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:32.612244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] The token cache is being invalidate because project e18dcb61f2824166bb0197dde7f9fbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:32.619527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea23f7-0808-426d-8c44-fe4b880f0322 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:32.620271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea23f7-0808-426d-8c44-fe4b880f0322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:32.620680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.624824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:32.628890 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2652/5293] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:31 2022] DELETE /identity/v3/projects/e18dcb61f2824166bb0197dde7f9fbdb => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:32.634044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:32.647109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:32.712731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9bea23f7-0808-426d-8c44-fe4b880f0322 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:32.715017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9bea23f7-0808-426d-8c44-fe4b880f0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:32.910803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0d01-d438-4768-9a22-7bda7e852601 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:32.986243 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2642/5294] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:32.997459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526455-e1a1-448b-8b9b-7c3e343b7fca None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:32.998020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526455-e1a1-448b-8b9b-7c3e343b7fca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:32.998478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526455-e1a1-448b-8b9b-7c3e343b7fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:33.059396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bd526455-e1a1-448b-8b9b-7c3e343b7fca None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:33.063028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bd526455-e1a1-448b-8b9b-7c3e343b7fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:33.100368 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2643/5295] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:33.105598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd526455-e1a1-448b-8b9b-7c3e343b7fca None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:33.120052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:33.121894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:33.123244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:33.125153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] PATH_INFO: `/v3/users/d2c17dbb98d6479da5a1f081deeb7855` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:33.128087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c17dbb98d6479da5a1f081deeb7855)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:33.134748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:33.138433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd526455-e1a1-448b-8b9b-7c3e343b7fca None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:33.161007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:33.163512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:33.163879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:33.166869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:33.169407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:33.172409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:33.178474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:33.230251 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2644/5296] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:33.237246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:33.238783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:33.277849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6452a04-9e1c-44ba-948a-859807b45356 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:33.291401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:33.292034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:33.292314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:33.292607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:33.293523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:33.295877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:33.312025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c17dbb98d6479da5a1f081deeb7855'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:33.376952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c17dbb98d6479da5a1f081deeb7855'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:33.436098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c17dbb98d6479da5a1f081deeb7855'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:33.438736 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2645/5297] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:33 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:01:33.444379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c17dbb98d6479da5a1f081deeb7855'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:33.445146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:33.486989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c17dbb98d6479da5a1f081deeb7855'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:33.507443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:33.565772 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2653/5298] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:32 2022] DELETE /identity/v3/users/d2c17dbb98d6479da5a1f081deeb7855 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:33.642536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879e5c-b7b3-4e19-88b2-9e47c390b430 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:34.029065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:34.032345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:34.038181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:34.039297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:34.043129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:34.048611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:34.106779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:34.116011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:34.148418 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2646/5299] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:33 2022] POST /identity/v3/users => generated 286 bytes in 700 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:34.155951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:34.169110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:34.239769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2acda-2371-4db1-970d-033187416d36 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:34.279567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:34.282412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:34.287134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:34.291304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:34.298028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:34.307889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:34.344555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2647/5300] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:01:34.346839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:34.369738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7bdc2-3f15-40a4-8684-2273e567a84d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:34.386887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:34.395881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:34.396818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:34.399039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:34.399973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:34.401779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:34.437148 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2648/5301] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:34.444519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:34.445841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2b5b3-6870-48e1-a4c9-86728b16bc0c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:34.469117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac590c4-e2f0-4e08-8fd8-be831409f73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:34.469829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac590c4-e2f0-4e08-8fd8-be831409f73a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:34.470123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac590c4-e2f0-4e08-8fd8-be831409f73a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:34.470417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac590c4-e2f0-4e08-8fd8-be831409f73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:34.487935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2201b1-9ef3-4b36-8ced-2e1e693fa4e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:34.488781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ac590c4-e2f0-4e08-8fd8-be831409f73a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:34.506079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:34.507252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:34.507572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:34.507853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] PATH_INFO: `/v3/projects/111ae12dd1774be29c1b8d4b330e7fa5/users/9c9caf638f094dec8e516d4cb5a28333/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:34.529521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac590c4-e2f0-4e08-8fd8-be831409f73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:34.531947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac590c4-e2f0-4e08-8fd8-be831409f73a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:34.554234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111ae12dd1774be29c1b8d4b330e7fa5, user_id=9c9caf638f094dec8e516d4cb5a28333, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:34.567386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:34.599747 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2654/5302] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:34.636033 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2649/5303] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:34 2022] PUT /identity/v3/projects/111ae12dd1774be29c1b8d4b330e7fa5/users/9c9caf638f094dec8e516d4cb5a28333/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:34.668411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff796f-54ee-4cfc-91b3-9cdfd2893106 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:34.668411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff796f-54ee-4cfc-91b3-9cdfd2893106 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:34.668411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff796f-54ee-4cfc-91b3-9cdfd2893106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:34.756263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2cff796f-54ee-4cfc-91b3-9cdfd2893106 None None] MFA Rules not processed for user `9c9caf638f094dec8e516d4cb5a28333`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:34.757553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cff796f-54ee-4cfc-91b3-9cdfd2893106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:35.015647 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2655/5304] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:35.023715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:35.042891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a2b05-d0ff-4eab-898e-17a8d7a37045 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:35.065430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:35.069841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:35.075170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:35.075703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:35.076475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9c9caf638f094dec8e516d4cb5a28333)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:35.079080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:35.122429 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2650/5305] 10.222.0.98 () {60 vars in 1298 bytes} [Thu Jul 14 15:01:35 2022] POST /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2 => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:35.131608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff796f-54ee-4cfc-91b3-9cdfd2893106 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:35.172993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff796f-54ee-4cfc-91b3-9cdfd2893106 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:35.190775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:35.192954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:35.193873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:35.199989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/8243d14e0b8648899bf5d41aad8656c4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:35.220219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9c9caf638f094dec8e516d4cb5a28333, credential_id=8243d14e0b8648899bf5d41aad8656c4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:35.223922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:35.258887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:35.304534 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2656/5306] 10.222.0.98 () {58 vars in 1379 bytes} [Thu Jul 14 15:01:35 2022] DELETE /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/8243d14e0b8648899bf5d41aad8656c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:35.316560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:35.364214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a237db-12ac-493c-8253-5f1b7af671bf tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:35.373086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:35.375091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:35.375677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:35.376273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:35.377483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9c9caf638f094dec8e516d4cb5a28333)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:35.380488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:35.454988 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2651/5307] 10.222.0.98 () {60 vars in 1298 bytes} [Thu Jul 14 15:01:35 2022] POST /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2 => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:35.461346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:35.482868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531574-d613-4ff8-ad65-71c3214442e4 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:35.490673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:35.492149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:35.492608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:35.499112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/766690cc4f5b4896a6ccf8a7fd03e002` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:35.502622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9c9caf638f094dec8e516d4cb5a28333, credential_id=766690cc4f5b4896a6ccf8a7fd03e002)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:35.505536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:35.614058 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2657/5308] 10.222.0.98 () {58 vars in 1379 bytes} [Thu Jul 14 15:01:35 2022] DELETE /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/766690cc4f5b4896a6ccf8a7fd03e002 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:35.620185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:35.661375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec0cb6-2d49-4e55-a851-3f6e15f8603e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:35.681848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1d76-e10d-4390-be31-f898ea863431 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:35.683469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1d76-e10d-4390-be31-f898ea863431 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:35.683975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1d76-e10d-4390-be31-f898ea863431 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:35.684486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1d76-e10d-4390-be31-f898ea863431 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/766690cc4f5b4896a6ccf8a7fd03e002` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9dae1d76-e10d-4390-be31-f898ea863431 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Could not find credential: 8fb5eacf2556e9300ec9684d9f60ebb8ec6199e5f170c69165991d3e80607481.: keystone.exception.CredentialNotFound: Could not find credential: 8fb5eacf2556e9300ec9684d9f60ebb8ec6199e5f170c69165991d3e80607481. Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 14 15:01:35.738059 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:01:35.739909 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 8fb5eacf2556e9300ec9684d9f60ebb8ec6199e5f170c69165991d3e80607481. Jul 14 15:01:35.741906 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:01:35.749105 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2652/5309] 10.222.0.98 () {58 vars in 1376 bytes} [Thu Jul 14 15:01:35 2022] GET /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/766690cc4f5b4896a6ccf8a7fd03e002 => generated 148 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:01:35.762662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:35.803433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4504824-8501-40dc-95c1-5d556793edf6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:35.852452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:35.854351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:35.860299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:35.863065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:35.874613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9c9caf638f094dec8e516d4cb5a28333)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:35.882193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:35.967305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2658/5310] 10.222.0.98 () {60 vars in 1298 bytes} [Thu Jul 14 15:01:35 2022] POST /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2 => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:01:35.971264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1d76-e10d-4390-be31-f898ea863431 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:36.021471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:36.028800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:36.037103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1d76-e10d-4390-be31-f898ea863431 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:36.088502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:36.090921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:36.098136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:36.099051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:36.100851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9c9caf638f094dec8e516d4cb5a28333)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:36.107132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:36.210062 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2653/5311] 10.222.0.98 () {60 vars in 1298 bytes} [Thu Jul 14 15:01:35 2022] POST /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2 => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:36.217256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:36.289571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd41b76-28aa-4e20-9a9c-fce0ffad2e99 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:36.338828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:36.340265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:36.341058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:36.341504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:36.341867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208eeb5-50d7-4ffd-a0ac-90f0d86cb8a0 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:36.342617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=9c9caf638f094dec8e516d4cb5a28333)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:36.346125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:36.364887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:36.372867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:36.373780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:36.376437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] PATH_INFO: `/v3/projects/ff1007a54bb545758a1054934a6d7243` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:36.379489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1007a54bb545758a1054934a6d7243)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:36.385754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:36.413265 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2654/5312] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 15:01:36 2022] GET /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2 => generated 865 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:36.415538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:36.485306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6398fe-1955-458b-b3fc-ae0523c12f62 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:36.516458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:36.518286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:36.518777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:36.519306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/4408bedcf7f64ec39df7f7ecdff2c272` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:36.522053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1007a54bb545758a1054934a6d7243', 'request_id': 'req-153c2c48-a456-490d-8568-54e502cf0a19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:36.527032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9c9caf638f094dec8e516d4cb5a28333, credential_id=4408bedcf7f64ec39df7f7ecdff2c272)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:36.531604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1007a54bb545758a1054934a6d7243', 'request_id': 'req-153c2c48-a456-490d-8568-54e502cf0a19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:36.537026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:36.542084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1007a54bb545758a1054934a6d7243', 'request_id': 'req-153c2c48-a456-490d-8568-54e502cf0a19'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:36.577004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] The token cache is being invalidate because project ff1007a54bb545758a1054934a6d7243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:36.578844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:36.581094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-153c2c48-a456-490d-8568-54e502cf0a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:36.584161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:36.590525 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2659/5313] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:36 2022] DELETE /identity/v3/projects/ff1007a54bb545758a1054934a6d7243 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:36.596470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4817e-e12c-45d5-b034-422fa28c437e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:36.596774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4817e-e12c-45d5-b034-422fa28c437e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:36.597284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4817e-e12c-45d5-b034-422fa28c437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:36.608659 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2655/5314] 10.222.0.98 () {58 vars in 1379 bytes} [Thu Jul 14 15:01:36 2022] DELETE /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/4408bedcf7f64ec39df7f7ecdff2c272 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:36.614172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:36.621112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:36.680604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cf848-4833-42ca-a94f-a25016edbd38 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:36.713992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9be4817e-e12c-45d5-b034-422fa28c437e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:36.723435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9be4817e-e12c-45d5-b034-422fa28c437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:37.032858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:37.048171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b229f-6e1a-4577-b787-4ad552c80e4e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.056953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b229f-6e1a-4577-b787-4ad552c80e4e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.064285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b229f-6e1a-4577-b787-4ad552c80e4e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.064993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b229f-6e1a-4577-b787-4ad552c80e4e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/9277651e34984ba2aa965eb2dcb56329` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.068844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b229f-6e1a-4577-b787-4ad552c80e4e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9c9caf638f094dec8e516d4cb5a28333, credential_id=9277651e34984ba2aa965eb2dcb56329)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.075523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b229f-6e1a-4577-b787-4ad552c80e4e tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.092553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2660/5315] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:37.137400 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2656/5316] 10.222.0.98 () {58 vars in 1379 bytes} [Thu Jul 14 15:01:36 2022] DELETE /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/9277651e34984ba2aa965eb2dcb56329 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:37.151453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4817e-e12c-45d5-b034-422fa28c437e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.198636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4817e-e12c-45d5-b034-422fa28c437e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.210864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4fa6c-f0d6-40ba-af22-c9b6ac0dd3f3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.211162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4fa6c-f0d6-40ba-af22-c9b6ac0dd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.211498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4fa6c-f0d6-40ba-af22-c9b6ac0dd3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.238458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.254202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.254685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.255186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.259239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0ec4fa6c-f0d6-40ba-af22-c9b6ac0dd3f3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:37.260581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ec4fa6c-f0d6-40ba-af22-c9b6ac0dd3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:37.265176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9c9caf638f094dec8e516d4cb5a28333)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.281176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.305894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2657/5317] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:37.306901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4fa6c-f0d6-40ba-af22-c9b6ac0dd3f3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.333880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4fa6c-f0d6-40ba-af22-c9b6ac0dd3f3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.349062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.350820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.350820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.350820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.351628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:37.351809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.353504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.385192 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2658/5318] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:37.385192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.399813 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2661/5319] 10.222.0.98 () {60 vars in 1298 bytes} [Thu Jul 14 15:01:37 2022] POST /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2 => generated 367 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:37.401789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.422908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a413-90f0-4dd6-af49-7315b475ee36 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.442884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.443638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.443919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.444208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.444960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.447331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.485554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859e3b5-216f-490c-a006-3bbf089c98b6 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.501235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.505383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.506325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.507095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/5b5fe77bdb2f49a6b0ffd457dc346a5a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.520550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=9c9caf638f094dec8e516d4cb5a28333, credential_id=5b5fe77bdb2f49a6b0ffd457dc346a5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.530150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.538837 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2659/5320] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:37 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:37.547183 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2662/5321] 10.222.0.98 () {58 vars in 1376 bytes} [Thu Jul 14 15:01:37 2022] GET /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/5b5fe77bdb2f49a6b0ffd457dc346a5a => generated 367 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:37.547480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.548553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.582662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c55626-cac1-4807-bd7c-9a096a980bd8 tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.754520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b113a65-27e4-4a51-99fb-b580832acdcb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.761158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9caf638f094dec8e516d4cb5a28333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111ae12dd1774be29c1b8d4b330e7fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.762131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.762404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.762700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/5b5fe77bdb2f49a6b0ffd457dc346a5a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.766542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9c9caf638f094dec8e516d4cb5a28333, credential_id=5b5fe77bdb2f49a6b0ffd457dc346a5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.770132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.771300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.772048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.772339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.772623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.773411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.778307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.817912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2663/5322] 10.222.0.98 () {58 vars in 1379 bytes} [Thu Jul 14 15:01:37 2022] DELETE /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333/credentials/OS-EC2/5b5fe77bdb2f49a6b0ffd457dc346a5a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:37.825195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.827459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:37.838612 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2660/5323] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:37 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:01:37.840669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.865066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274dd8b-b453-4700-adfb-477428ee95eb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.877570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.880357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.881045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.882843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.883460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.887878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.888516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da4f2-5fa0-4c8e-97c6-ad09ace61aeb tempest-EC2CredentialsTest-762782804 tempest-EC2CredentialsTest-762782804-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:37.903938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:37.905011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:37.906464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:37.906934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] PATH_INFO: `/v3/users/9c9caf638f094dec8e516d4cb5a28333` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:37.908707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9caf638f094dec8e516d4cb5a28333)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:37.911119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:37.935771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2661/5324] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:37.938330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:37.990063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f93f5-4030-4943-ad8c-52826d302f42 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:38.007469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8e6e4-6354-405a-adc9-6fefd8f77329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:38.008632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e6e4-6354-405a-adc9-6fefd8f77329 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:38.009225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e6e4-6354-405a-adc9-6fefd8f77329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:38.012373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e6e4-6354-405a-adc9-6fefd8f77329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:38.014017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8e6e4-6354-405a-adc9-6fefd8f77329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:38.015231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9caf638f094dec8e516d4cb5a28333'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:38.029584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8e6e4-6354-405a-adc9-6fefd8f77329 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:38.035021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9caf638f094dec8e516d4cb5a28333'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:38.060366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9caf638f094dec8e516d4cb5a28333'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:38.061351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9caf638f094dec8e516d4cb5a28333'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:38.073441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9caf638f094dec8e516d4cb5a28333'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:38.082955 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2664/5325] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:37 2022] DELETE /identity/v3/users/9c9caf638f094dec8e516d4cb5a28333 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:38.092478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:38.092741 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2662/5326] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:38.094640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:38.095633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d249-436a-4046-b89c-503e50574784 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:38.096105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d249-436a-4046-b89c-503e50574784 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:38.096606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d249-436a-4046-b89c-503e50574784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:38.134827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9996d249-436a-4046-b89c-503e50574784 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:38.137090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9996d249-436a-4046-b89c-503e50574784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:38.163659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:38.197362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:38.256864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36a549-0b1c-4619-9d50-db11c825d7c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:38.276358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44c501-122c-4a1d-8b23-ed1013113068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:38.277993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44c501-122c-4a1d-8b23-ed1013113068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:38.278696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44c501-122c-4a1d-8b23-ed1013113068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:38.279233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44c501-122c-4a1d-8b23-ed1013113068 admin admin] PATH_INFO: `/v3/projects/f1643c98647b41c7b0f5b5e3e1bb9c2b/users/8775f8da4e8e42dba64c580dda2fe5b9/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:38.302620 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2663/5327] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:38.309302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44c501-122c-4a1d-8b23-ed1013113068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1643c98647b41c7b0f5b5e3e1bb9c2b, user_id=8775f8da4e8e42dba64c580dda2fe5b9, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:38.313605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44c501-122c-4a1d-8b23-ed1013113068 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:38.333014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996d249-436a-4046-b89c-503e50574784 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:38.339141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9996d249-436a-4046-b89c-503e50574784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:38.360288 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2665/5328] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:38 2022] PUT /identity/v3/projects/f1643c98647b41c7b0f5b5e3e1bb9c2b/users/8775f8da4e8e42dba64c580dda2fe5b9/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:38.365646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af2cc-8126-4e0c-a40e-10ca5ef37378 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:38.366696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af2cc-8126-4e0c-a40e-10ca5ef37378 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:38.367577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af2cc-8126-4e0c-a40e-10ca5ef37378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:38.431229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd1af2cc-8126-4e0c-a40e-10ca5ef37378 None None] MFA Rules not processed for user `8775f8da4e8e42dba64c580dda2fe5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:38.436891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd1af2cc-8126-4e0c-a40e-10ca5ef37378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:38.637602 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2666/5329] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:38.640364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af2cc-8126-4e0c-a40e-10ca5ef37378 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:38.659963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af2cc-8126-4e0c-a40e-10ca5ef37378 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:38.669263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8775f8da4e8e42dba64c580dda2fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1643c98647b41c7b0f5b5e3e1bb9c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:38.670621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:38.671402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:38.672038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] PATH_INFO: `/v3/auth/catalog` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:38.676527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:38.678727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:38.699956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996d249-436a-4046-b89c-503e50574784 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:38.709255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2667/5330] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 15:01:38 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:38.712149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:38.956182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cbd22-02af-4465-91b9-d835ac21187d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:38.958166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cbd22-02af-4465-91b9-d835ac21187d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:38.962079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cbd22-02af-4465-91b9-d835ac21187d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:38.962815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cbd22-02af-4465-91b9-d835ac21187d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:39.041579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694241-34d5-48ff-b209-5bbe3fe587a5 tempest-IdentityCatalogTest-976901478 tempest-IdentityCatalogTest-976901478-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:39.059774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:39.064109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:39.064684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:39.065176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] PATH_INFO: `/v3/users/8775f8da4e8e42dba64c580dda2fe5b9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:39.075178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8775f8da4e8e42dba64c580dda2fe5b9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:39.086581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:39.252463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8775f8da4e8e42dba64c580dda2fe5b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:39.257653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cbd22-02af-4465-91b9-d835ac21187d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:39.272525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cbd22-02af-4465-91b9-d835ac21187d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:39.289376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:39.303558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8775f8da4e8e42dba64c580dda2fe5b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:39.325949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8775f8da4e8e42dba64c580dda2fe5b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:39.326625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8775f8da4e8e42dba64c580dda2fe5b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:39.328999 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2664/5331] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 997 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:39.342583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8775f8da4e8e42dba64c580dda2fe5b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:39.357495 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2668/5332] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:38 2022] DELETE /identity/v3/users/8775f8da4e8e42dba64c580dda2fe5b9 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:39.362354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:39.362799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:39.362962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:39.400118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:39.402252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:39.464866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:39.572766 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2665/5333] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:39.645888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:39.650940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:39.978423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3dbdb-5063-48f5-9d8b-bf5fef717668 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:39.986586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534e00-28cb-4923-8da5-ebd09ea7ddd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:39.987835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534e00-28cb-4923-8da5-ebd09ea7ddd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:39.988355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534e00-28cb-4923-8da5-ebd09ea7ddd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:39.988883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534e00-28cb-4923-8da5-ebd09ea7ddd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:40.015401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534e00-28cb-4923-8da5-ebd09ea7ddd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:40.019610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534e00-28cb-4923-8da5-ebd09ea7ddd7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:40.039639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2669/5334] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:42.124761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:42.129113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:42.165634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e516-800e-4896-88f3-a6c70e465b90 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:42.176034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:42.177264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:42.177713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:42.178168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] PATH_INFO: `/v3/projects/111ae12dd1774be29c1b8d4b330e7fa5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:42.180067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=111ae12dd1774be29c1b8d4b330e7fa5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:42.182357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:42.374707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111ae12dd1774be29c1b8d4b330e7fa5', 'request_id': 'req-09e471e1-d19c-491c-b2bb-50bef91cd21a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:42.398165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111ae12dd1774be29c1b8d4b330e7fa5', 'request_id': 'req-09e471e1-d19c-491c-b2bb-50bef91cd21a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:42.412537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111ae12dd1774be29c1b8d4b330e7fa5', 'request_id': 'req-09e471e1-d19c-491c-b2bb-50bef91cd21a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:42.445011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] The token cache is being invalidate because project 111ae12dd1774be29c1b8d4b330e7fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:42.445325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:42.447411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09e471e1-d19c-491c-b2bb-50bef91cd21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:42.455377 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2666/5335] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:42 2022] DELETE /identity/v3/projects/111ae12dd1774be29c1b8d4b330e7fa5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:42.462913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:42.463684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:42.463684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:42.552054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:42.553884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:42.677496 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2670/5336] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:42.699249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b629e6-d16e-44e7-a1f5-cbd830e6cf4a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:42.699969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b629e6-d16e-44e7-a1f5-cbd830e6cf4a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:42.700456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b629e6-d16e-44e7-a1f5-cbd830e6cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:42.785786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:42.787716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:42.798612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d1b629e6-d16e-44e7-a1f5-cbd830e6cf4a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:42.804808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d1b629e6-d16e-44e7-a1f5-cbd830e6cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:42.810831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2cc45-151c-4053-b234-58a7d1138a50 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:42.842221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:42.849504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:42.849744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:42.850201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] PATH_INFO: `/v3/projects/f1643c98647b41c7b0f5b5e3e1bb9c2b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:42.855145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1643c98647b41c7b0f5b5e3e1bb9c2b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:42.864343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:42.895153 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2667/5337] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:42.897284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b629e6-d16e-44e7-a1f5-cbd830e6cf4a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:42.976081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b629e6-d16e-44e7-a1f5-cbd830e6cf4a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:42.998224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:42.999601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.005303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.005959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.007477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:43.008133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.019449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.046760 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2668/5338] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:43.049550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1643c98647b41c7b0f5b5e3e1bb9c2b', 'request_id': 'req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:43.052970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.062651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1643c98647b41c7b0f5b5e3e1bb9c2b', 'request_id': 'req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:43.078463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1643c98647b41c7b0f5b5e3e1bb9c2b', 'request_id': 'req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:43.085571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975c11-c5e0-489d-b296-2193eb4c01e2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:43.094910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:43.101429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] The token cache is being invalidate because project f1643c98647b41c7b0f5b5e3e1bb9c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:43.102249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:43.104390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f2bf204-1eab-4f8e-b768-c5925eff8d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:43.106670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2671/5339] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:42 2022] DELETE /identity/v3/projects/f1643c98647b41c7b0f5b5e3e1bb9c2b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:43.113567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837dff-6571-4fa0-b976-432972692cb1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.114472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837dff-6571-4fa0-b976-432972692cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.115813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837dff-6571-4fa0-b976-432972692cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.215884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3c837dff-6571-4fa0-b976-432972692cb1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:43.219069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c837dff-6571-4fa0-b976-432972692cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:43.272322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:43.273109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.273489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.273851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.274658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.277073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.314454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2669/5340] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:43 2022] POST /identity/v3/projects => generated 359 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:43.321315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.331578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:43.336732 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2672/5341] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:43.345097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e0ffd-f3d4-41aa-804e-8af0bad41c8a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.345413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e0ffd-f3d4-41aa-804e-8af0bad41c8a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.345797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e0ffd-f3d4-41aa-804e-8af0bad41c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.368938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:43.409116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-711e0ffd-f3d4-41aa-804e-8af0bad41c8a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:43.411824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-711e0ffd-f3d4-41aa-804e-8af0bad41c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:43.485567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baac85-25b1-48a7-88bc-1795df4601af admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:43.500486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:43.501300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.502317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.502317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.503875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.505768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.540921 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2670/5342] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:43 2022] POST /identity/v3/users => generated 280 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:43.545132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.552684 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2673/5343] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:43.553718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e0ffd-f3d4-41aa-804e-8af0bad41c8a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.567576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e0ffd-f3d4-41aa-804e-8af0bad41c8a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:43.568878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bef17-a946-4645-b565-ffcad49dd157 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:43.574059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:43.575094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.575611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.575975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.577154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:43.578132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.580043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.584346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:43.585351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.586133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.586585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.587583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.591078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.609794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2671/5344] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:01:43.613472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.626541 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2674/5345] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:43.632065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.641550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d28bb-a838-4250-b675-d66fbf15aa8a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:43.658873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abeff4-dd43-45e6-8204-d1a3a0c2b3fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:43.660599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:43.661326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.661775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.662073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.664491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.683066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.692413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:43.699915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.701474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.703519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.705940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.717705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.727575 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2672/5346] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:43.733037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.762633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05fd4-0b16-4928-8f96-5d1f129fea89 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:43.776880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e02eb8-d7f6-47fc-9b42-ebeca0dbc39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:43.778658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02eb8-d7f6-47fc-9b42-ebeca0dbc39e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.778954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02eb8-d7f6-47fc-9b42-ebeca0dbc39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.779246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02eb8-d7f6-47fc-9b42-ebeca0dbc39e admin admin] PATH_INFO: `/v3/projects/d8aa8b97b95a4616ae22765654ac7eb9/users/b2034bf83263441982f679475992360b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.825594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e02eb8-d7f6-47fc-9b42-ebeca0dbc39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8aa8b97b95a4616ae22765654ac7eb9, user_id=b2034bf83263441982f679475992360b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:43.837434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e02eb8-d7f6-47fc-9b42-ebeca0dbc39e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:43.839522 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2675/5347] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:43 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:43.844559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:43.860315 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2673/5348] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:43 2022] PUT /identity/v3/projects/d8aa8b97b95a4616ae22765654ac7eb9/users/b2034bf83263441982f679475992360b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:43.870753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb095a-dc7b-45d9-87d7-1d4baabc5542 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:43.871465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb095a-dc7b-45d9-87d7-1d4baabc5542 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:43.871981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb095a-dc7b-45d9-87d7-1d4baabc5542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:43.941434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f2eb095a-dc7b-45d9-87d7-1d4baabc5542 None None] MFA Rules not processed for user `b2034bf83263441982f679475992360b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:43.941434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f2eb095a-dc7b-45d9-87d7-1d4baabc5542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:44.034687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4300d-9f47-4b1e-bcba-597e9f48a65a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.074423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:44.194212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.195083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.195480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.195830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.196882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.199125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:44.217363 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2674/5349] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:44.224171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9a679-322f-4252-878a-29367d037acc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.225577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9a679-322f-4252-878a-29367d037acc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.225577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9a679-322f-4252-878a-29367d037acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.237472 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2676/5350] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:43 2022] POST /identity/v3/users => generated 289 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:44.241459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:44.273170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-17e9a679-322f-4252-878a-29367d037acc None None] MFA Rules not processed for user `b2034bf83263441982f679475992360b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:44.277131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-17e9a679-322f-4252-878a-29367d037acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:44.280170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e900-81ea-4614-a4d5-9d1c6b630f26 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.286430 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2675/5351] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:44 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:01:44.293486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8522ec-01c4-4b39-82da-2e2296f6b81e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.294931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8522ec-01c4-4b39-82da-2e2296f6b81e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.294931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8522ec-01c4-4b39-82da-2e2296f6b81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.301379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.311204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.312431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.312737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.315968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.320099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:44.335825 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2677/5352] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:44.339656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:44.355306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046804-8440-4243-b966-68af315e7104 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.356294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3c8522ec-01c4-4b39-82da-2e2296f6b81e None None] MFA Rules not processed for user `b2034bf83263441982f679475992360b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:44.357706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c8522ec-01c4-4b39-82da-2e2296f6b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:44.363210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.364098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.364521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.364909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.365777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.368955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:44.371389 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2676/5353] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:44 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:01:44.372563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8522ec-01c4-4b39-82da-2e2296f6b81e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:44.387114 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2678/5354] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:01:44.393554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:44.402140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8522ec-01c4-4b39-82da-2e2296f6b81e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.407811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e717a-0eb7-4bd4-9584-9581eb1e8a56 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.413060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2034bf83263441982f679475992360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8aa8b97b95a4616ae22765654ac7eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.413585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c593-65dd-45a6-9258-92a1e4fd7fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.413822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.414989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c593-65dd-45a6-9258-92a1e4fd7fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.415187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.415509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c593-65dd-45a6-9258-92a1e4fd7fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.415713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.416065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c593-65dd-45a6-9258-92a1e4fd7fe9 admin admin] PATH_INFO: `/v3/projects/f70e051e06664418944336dc28a1065d/users/077754891606438798ac95b954237742/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.437585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorizing `identity:check_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.437904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c593-65dd-45a6-9258-92a1e4fd7fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70e051e06664418944336dc28a1065d, user_id=077754891606438798ac95b954237742, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.441276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c593-65dd-45a6-9258-92a1e4fd7fe9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:44.448135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:44.464370 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2679/5356] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:44 2022] PUT /identity/v3/projects/f70e051e06664418944336dc28a1065d/users/077754891606438798ac95b954237742/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:44.476357 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2677/5356] 10.222.0.98 () {56 vars in 1263 bytes} [Thu Jul 14 15:01:44 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 14 15:01:44.478203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ed34c-fbe0-4448-9057-c28ae1324b02 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.479327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ed34c-fbe0-4448-9057-c28ae1324b02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.479805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ed34c-fbe0-4448-9057-c28ae1324b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.482501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:44.516745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364efd52-ed72-44de-925c-36899c8d5a8e tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.578970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d50ed34c-fbe0-4448-9057-c28ae1324b02 None None] MFA Rules not processed for user `077754891606438798ac95b954237742`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:44.581268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d50ed34c-fbe0-4448-9057-c28ae1324b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:44.591942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:44.748162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2034bf83263441982f679475992360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8aa8b97b95a4616ae22765654ac7eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.752455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.753163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.756303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.777420 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2680/5357] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:44.779928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9852-f4be-4404-b1f2-98edf469a8e2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.780436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9852-f4be-4404-b1f2-98edf469a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.781580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9852-f4be-4404-b1f2-98edf469a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.784911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.795259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:44.830159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2678/5358] 10.222.0.98 () {56 vars in 1262 bytes} [Thu Jul 14 15:01:44 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:44.832317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:44.848505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-87dc9852-f4be-4404-b1f2-98edf469a8e2 None None] MFA Rules not processed for user `c1a4b4998ca6479f85adc2b9c65e1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:44.850990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87dc9852-f4be-4404-b1f2-98edf469a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:44.877906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fcab6-aba9-4c6f-9dc9-b871a160dcc5 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.885337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077754891606438798ac95b954237742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f70e051e06664418944336dc28a1065d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.886447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.888067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.888574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.890601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.893151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:44.896116 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2679/5359] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 15:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:44.898101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:44.918835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48708-0e2d-46e9-a3f3-b76d61cc5b3e tempest-DefaultDomainTestJSON-960986241 tempest-DefaultDomainTestJSON-960986241-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:44.929392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2034bf83263441982f679475992360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8aa8b97b95a4616ae22765654ac7eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:44.930380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:44.946331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:44.946681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:44.961035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:44.963980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:45.007506 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2680/5360] 10.222.0.98 () {56 vars in 1265 bytes} [Thu Jul 14 15:01:44 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:45.008911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:45.077523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:45.169808 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2681/5361] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:45.171972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc9852-f4be-4404-b1f2-98edf469a8e2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:45.213178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc9852-f4be-4404-b1f2-98edf469a8e2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:45.238970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905171e-8916-45b1-ac43-48ca27d5921b tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2034bf83263441982f679475992360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8aa8b97b95a4616ae22765654ac7eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:45.240285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905171e-8916-45b1-ac43-48ca27d5921b tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:45.240791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905171e-8916-45b1-ac43-48ca27d5921b tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:45.241291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905171e-8916-45b1-ac43-48ca27d5921b tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:45.257845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a905171e-8916-45b1-ac43-48ca27d5921b tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:45.260935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2db817-f194-4cf7-ba79-cc2353d49486 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:45.288939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:45.294585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:45.295777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:45.299872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] PATH_INFO: `/v3/users/077754891606438798ac95b954237742` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:45.309011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=077754891606438798ac95b954237742)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:45.316145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a905171e-8916-45b1-ac43-48ca27d5921b tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 14 15:01:45.343028 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 14 15:01:45.347768 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 14 15:01:45.351145 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:45.351145 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:45.351145 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 14 15:01:45.351145 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 14 15:01:45.351145 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 14 15:01:45.351145 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:45.351145 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2682/5362] 10.222.0.98 () {56 vars in 1263 bytes} [Thu Jul 14 15:01:45 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 14 15:01:45.358215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77c4d-f78b-452c-9957-5ade5735087f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:45.360740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77c4d-f78b-452c-9957-5ade5735087f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:45.361598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77c4d-f78b-452c-9957-5ade5735087f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:45.399571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-51f77c4d-f78b-452c-9957-5ade5735087f None None] MFA Rules not processed for user `b2034bf83263441982f679475992360b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:45.403008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51f77c4d-f78b-452c-9957-5ade5735087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:45.415461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2683/5363] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:45 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:01:45.430309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77c4d-f78b-452c-9957-5ade5735087f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:45.457239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77c4d-f78b-452c-9957-5ade5735087f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:45.466606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2034bf83263441982f679475992360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8aa8b97b95a4616ae22765654ac7eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:45.468013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:45.468786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:45.469368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:45.493144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:45.512674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:45.535106 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2684/5364] 10.222.0.98 () {56 vars in 1262 bytes} [Thu Jul 14 15:01:45 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:45.541111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:45.560551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077754891606438798ac95b954237742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:45.566644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c0ba-9ae6-4a4c-80cc-38d0c28da696 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:45.576599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2034bf83263441982f679475992360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8aa8b97b95a4616ae22765654ac7eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:45.582044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:45.582716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:45.583762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:45.599649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:45.602745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:45.607585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077754891606438798ac95b954237742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:45.609483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077754891606438798ac95b954237742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:45.640676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077754891606438798ac95b954237742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:45.643042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2bd8414d-e9e2-4d49-b65c-f42c81ba3a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077754891606438798ac95b954237742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:45.660495 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2685/5365] 10.222.0.98 () {56 vars in 1265 bytes} [Thu Jul 14 15:01:45 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:45.668878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:45.692863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2681/5366] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:45 2022] DELETE /identity/v3/users/077754891606438798ac95b954237742 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:45.699112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:45.699660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:45.700158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:45.725676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2ca1d-5a1b-412a-b4e7-af54732f3b79 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:45.763101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:45.766343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:45.801831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:45.960135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2034bf83263441982f679475992360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8aa8b97b95a4616ae22765654ac7eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:45.961389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:45.962306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:45.964473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:45.971949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 14 15:01:46.007597 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 14 15:01:46.009757 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 14 15:01:46.011803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:01:46.011803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:01:46.011803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 14 15:01:46.011803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 14 15:01:46.011803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 14 15:01:46.011803 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:01:46.011803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2686/5367] 10.222.0.98 () {56 vars in 1262 bytes} [Thu Jul 14 15:01:45 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:01:46.022026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:46.031851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:46.092000 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2682/5368] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:46.099730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d087-650e-49c1-8302-171af3de17e1 tempest-TokensV3Test-823184869 tempest-TokensV3Test-823184869-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:46.112603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:46.115993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:46.116659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:46.117352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] PATH_INFO: `/v3/users/b2034bf83263441982f679475992360b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:46.142011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2034bf83263441982f679475992360b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:46.146174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:46.150413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:46.152171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:46.289511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2034bf83263441982f679475992360b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:46.320250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2034bf83263441982f679475992360b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:46.338540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2034bf83263441982f679475992360b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:46.339353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2034bf83263441982f679475992360b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:46.350292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c2731b8-fdd1-4c49-8b52-a392fc7d85ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2034bf83263441982f679475992360b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:46.372115 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2687/5369] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:46 2022] DELETE /identity/v3/users/b2034bf83263441982f679475992360b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:46.377852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:46.378129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:46.378457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:46.391098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9cb8-a475-4279-859d-23c06270b12b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:46.418634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:46.419755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:46.435599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:46.519448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:46.520133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:46.520415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:46.520689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:46.525029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:46.596634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2688/5370] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:46.634694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:46.637140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:46.663762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34bfda-a7ac-46d8-b7b9-e56bcebc8e71 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:46.675603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:46.676654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:46.677142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:46.677618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:46.724430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:46.727323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:46.746862 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2689/5371] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:46.798543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:46.800598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:46.822120 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2683/5372] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:47.002736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:47.004742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:47.237644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c86ec3-0839-42d3-bd57-354f86440fdd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:47.259097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7063ea-ad67-4e76-b2f1-f32bd85e2424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:47.264016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7063ea-ad67-4e76-b2f1-f32bd85e2424 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:47.264504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7063ea-ad67-4e76-b2f1-f32bd85e2424 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:47.265353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7063ea-ad67-4e76-b2f1-f32bd85e2424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:47.276960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf7063ea-ad67-4e76-b2f1-f32bd85e2424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:47.306210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7063ea-ad67-4e76-b2f1-f32bd85e2424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:47.308646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7063ea-ad67-4e76-b2f1-f32bd85e2424 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:47.346963 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2690/5373] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:01:48.040986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:48.043302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:48.068502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce589-c875-41bb-906c-193eff3c2856 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:48.076108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:48.077729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:48.078334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:48.078830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] PATH_INFO: `/v3/projects/d8aa8b97b95a4616ae22765654ac7eb9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:48.080507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8aa8b97b95a4616ae22765654ac7eb9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:48.083172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:48.111585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:48.237600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8aa8b97b95a4616ae22765654ac7eb9', 'request_id': 'req-81434c9a-628d-4a5e-bacb-7b155eec62e6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.261387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8aa8b97b95a4616ae22765654ac7eb9', 'request_id': 'req-81434c9a-628d-4a5e-bacb-7b155eec62e6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.285602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8aa8b97b95a4616ae22765654ac7eb9', 'request_id': 'req-81434c9a-628d-4a5e-bacb-7b155eec62e6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.332433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] The token cache is being invalidate because project d8aa8b97b95a4616ae22765654ac7eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:48.334436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.335978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.342100 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2684/5374] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:48 2022] DELETE /identity/v3/projects/d8aa8b97b95a4616ae22765654ac7eb9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:48.348124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90a7a-1d20-4a39-979f-3aef7a2fc6a1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:48.349205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90a7a-1d20-4a39-979f-3aef7a2fc6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:48.349681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90a7a-1d20-4a39-979f-3aef7a2fc6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:48.409429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-02b90a7a-1d20-4a39-979f-3aef7a2fc6a1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:48.410686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02b90a7a-1d20-4a39-979f-3aef7a2fc6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:48.411479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:48.413952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:48.552982 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2691/5375] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:48.558989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03fa47-4a97-4d71-a535-395d0b50c06d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:48.563977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03fa47-4a97-4d71-a535-395d0b50c06d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:48.564860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03fa47-4a97-4d71-a535-395d0b50c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:48.615463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e03fa47-4a97-4d71-a535-395d0b50c06d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:48.616817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e03fa47-4a97-4d71-a535-395d0b50c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:48.629775 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2692/5376] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:48.631187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03fa47-4a97-4d71-a535-395d0b50c06d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:48.640951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81434c9a-628d-4a5e-bacb-7b155eec62e6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:48.642786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03fa47-4a97-4d71-a535-395d0b50c06d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:48.649444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:48.650369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:48.650729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:48.651475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:48.652450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:48.653040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:48.656097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:48.660432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:48.661957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:48.662387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:48.662808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] PATH_INFO: `/v3/projects/f70e051e06664418944336dc28a1065d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:48.668774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70e051e06664418944336dc28a1065d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:48.676016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:48.676222 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2693/5377] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:48.677182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:48.691631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:48.708381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcafe35-198f-47e8-b815-dc21b53d1f90 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:48.750356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:48.751054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:48.751372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:48.751662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:48.753249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:48.755392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:48.810162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70e051e06664418944336dc28a1065d', 'request_id': 'req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.832894 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2694/5378] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:48 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:48.834215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:48.859988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70e051e06664418944336dc28a1065d', 'request_id': 'req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.880174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70e051e06664418944336dc28a1065d', 'request_id': 'req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.933631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] The token cache is being invalidate because project f70e051e06664418944336dc28a1065d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:48.934152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.940246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9225a1ad-ad6d-4359-a27e-19c8b39cd9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:48.949570 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2685/5379] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:48 2022] DELETE /identity/v3/projects/f70e051e06664418944336dc28a1065d => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:48.953077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:48.953741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:48.954241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.066657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] MFA Rules not processed for user `4813aa5acf744a8dac42de00d7e5a519`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:49.069292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:49.094666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a024ad-bf0d-49be-b3a3-f0129418cd70 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:49.106360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab34116-bec7-4e4d-b24c-3b72259b6dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:49.107850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34116-bec7-4e4d-b24c-3b72259b6dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.108977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34116-bec7-4e4d-b24c-3b72259b6dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.109483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34116-bec7-4e4d-b24c-3b72259b6dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.117794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab34116-bec7-4e4d-b24c-3b72259b6dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:49.125451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab34116-bec7-4e4d-b24c-3b72259b6dc4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:49.196224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:49.221957 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2695/5380] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:48 2022] POST /identity/v3/users => generated 286 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:49.227210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e18b-397c-4a7c-815e-efcf3f824037 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.227827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e18b-397c-4a7c-815e-efcf3f824037 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.228586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e18b-397c-4a7c-815e-efcf3f824037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.313121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1cb5e18b-397c-4a7c-815e-efcf3f824037 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:49.328550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1cb5e18b-397c-4a7c-815e-efcf3f824037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:49.346084 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2686/5381] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:49.347250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:49.352711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:49.361273 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2696/5382] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:49.371093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabc15b-eca3-479f-b7c3-be4ba1da04bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.371558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabc15b-eca3-479f-b7c3-be4ba1da04bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.371981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabc15b-eca3-479f-b7c3-be4ba1da04bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.400682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc92b15-c5a9-44cd-a46a-8fa373e8eb1e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:49.413666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:49.414548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.414941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.415526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.416434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:49.418775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:49.442640 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2687/5383] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:49.447689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:49.451190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bcabc15b-eca3-479f-b7c3-be4ba1da04bc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:49.458387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bcabc15b-eca3-479f-b7c3-be4ba1da04bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:49.476751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1054cb-8cc3-4fb4-81db-5b98fdef7e34 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:49.496389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:49.497165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.497559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.497950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.498955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:49.501282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:49.527989 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2688/5384] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:49.535709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:49.558341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82203157-6ed8-4863-ad39-908314953e3a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:49.559025 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2697/5385] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:49.574810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c427f9f-e4e5-44d6-86ae-a4a955624283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:49.575426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabc15b-eca3-479f-b7c3-be4ba1da04bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:49.575776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427f9f-e4e5-44d6-86ae-a4a955624283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.576070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427f9f-e4e5-44d6-86ae-a4a955624283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.576354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427f9f-e4e5-44d6-86ae-a4a955624283 admin admin] PATH_INFO: `/v3/projects/d640163bff184941bc492af508c0d564/users/52e4892c6c834e15b13124f78906b639/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.618398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c427f9f-e4e5-44d6-86ae-a4a955624283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d640163bff184941bc492af508c0d564, user_id=52e4892c6c834e15b13124f78906b639, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:49.621230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c427f9f-e4e5-44d6-86ae-a4a955624283 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:49.644889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabc15b-eca3-479f-b7c3-be4ba1da04bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:49.663022 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2689/5386] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:49 2022] PUT /identity/v3/projects/d640163bff184941bc492af508c0d564/users/52e4892c6c834e15b13124f78906b639/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:49.676288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.676636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.676899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.752778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] MFA Rules not processed for user `52e4892c6c834e15b13124f78906b639`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:49.754056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:49.894318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:49.895531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:49.895531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:49.898766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:49.905045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:49.905495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:49.926692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:49.983171 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2698/5387] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:49.989754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:50.036144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130113d-f2be-4828-92cf-33ef38623241 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:50.049348 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2690/5388] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:50.081220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:50.082543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:50.086370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:50.089632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:50.089632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:50.091092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:50.096918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:50.104417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:50.219512 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2699/5389] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:49 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:50.226293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:50.407453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:50.463977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef62be-c143-4903-a796-b8bb62299e85 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:50.494395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60453c-8f2f-4210-a4f6-f1ed7e438e8c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:50.511191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:50.512975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:50.513263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:50.513544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:50.514276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:50.517227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:50.520003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:50.589102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2700/5390] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:50 2022] POST /identity/v3/users => generated 289 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:50.590880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:50.605624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6f33-6c15-4666-97a3-3e3bb55a048b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:50.612880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:50.613591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:50.613959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:50.614249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:50.615014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:50.616774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:50.636750 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2701/5391] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:50.637688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:50.638392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:50.644098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:50.645924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:50.647172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:50.653773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16ab1-9639-4157-aabb-d7926a88841f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:50.660968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:50.662015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:50.662524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:50.663098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:50.664488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:50.666696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:50.687773 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2702/5392] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:50.689777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:50.705535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82281a-19a7-4c9b-943d-27af198ba807 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:50.714179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec12ef-b654-4bde-bd89-19e11a482865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:50.715679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec12ef-b654-4bde-bd89-19e11a482865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:50.716046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec12ef-b654-4bde-bd89-19e11a482865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:50.716410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec12ef-b654-4bde-bd89-19e11a482865 admin admin] PATH_INFO: `/v3/projects/3502f5a2df55442582d7786a06d230ac/users/7660014554b94c198614f33806f47e85/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:50.750885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec12ef-b654-4bde-bd89-19e11a482865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3502f5a2df55442582d7786a06d230ac, user_id=7660014554b94c198614f33806f47e85, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:50.761571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec12ef-b654-4bde-bd89-19e11a482865 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:50.783932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:50.797514 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2703/5393] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:50 2022] PUT /identity/v3/projects/3502f5a2df55442582d7786a06d230ac/users/7660014554b94c198614f33806f47e85/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:50.801056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:50.809299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91882de-5cf7-479f-a068-454f74ce4132 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:50.809746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91882de-5cf7-479f-a068-454f74ce4132 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:50.809918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91882de-5cf7-479f-a068-454f74ce4132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:50.835752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2691/5394] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:50.874635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e91882de-5cf7-479f-a068-454f74ce4132 None None] MFA Rules not processed for user `7660014554b94c198614f33806f47e85`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:50.877039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e91882de-5cf7-479f-a068-454f74ce4132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:51.072134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:51.095081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2658e-25c4-41b0-933a-61489808d2b4 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:51.186098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2704/5395] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:51.190313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63e17-7a4a-437b-ac28-76ca35feab45 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:51.194371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63e17-7a4a-437b-ac28-76ca35feab45 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:51.195052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63e17-7a4a-437b-ac28-76ca35feab45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:51.241416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:51.242350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:51.244336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:51.245277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] PATH_INFO: `/v3/users/52e4892c6c834e15b13124f78906b639` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:51.246378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2be63e17-7a4a-437b-ac28-76ca35feab45 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:51.247408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e4892c6c834e15b13124f78906b639)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:51.248549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2be63e17-7a4a-437b-ac28-76ca35feab45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:51.252341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:51.396455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e4892c6c834e15b13124f78906b639'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:51.453237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e4892c6c834e15b13124f78906b639'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:51.455077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e4892c6c834e15b13124f78906b639'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:51.455988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:51.475169 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2705/5396] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:01:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:51.476807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63e17-7a4a-437b-ac28-76ca35feab45 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:51.479802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e4892c6c834e15b13124f78906b639'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:51.480622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e4892c6c834e15b13124f78906b639'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:51.489446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:51.511367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63e17-7a4a-437b-ac28-76ca35feab45 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:51.514795 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2692/5397] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:51 2022] DELETE /identity/v3/users/52e4892c6c834e15b13124f78906b639 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:51.516546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:51.520582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:51.614267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a73bf-a2dd-48a5-a12d-de8c6f10f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:51.615779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a73bf-a2dd-48a5-a12d-de8c6f10f82d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:51.615779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a73bf-a2dd-48a5-a12d-de8c6f10f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:51.616121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a73bf-a2dd-48a5-a12d-de8c6f10f82d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:51.617085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a73bf-a2dd-48a5-a12d-de8c6f10f82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:51.619842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a73bf-a2dd-48a5-a12d-de8c6f10f82d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:51.716778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2706/5398] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:51 2022] POST /identity/v3/projects => generated 377 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:51.718511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac6b3-25a9-407b-9ea7-dfea802207cd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:51.719076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:51.719406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:51.719838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:51.765351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:51.767472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:51.871971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:51.872988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:51.873298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:51.873700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:51.876982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:51.925038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2707/5399] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:51.925536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:51.930598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:51.962686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa8a4-eabd-4d5a-a4de-d83d15f024ba None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:51.975644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:51.976382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:51.976689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:51.976959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:51.977647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:51.988041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:52.040670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2708/5400] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:51 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:52.041930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:52.044160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:52.047980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:52.053072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:52.079767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2693/5401] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:01:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:52.084908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:52.111862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778985ff-035b-41d7-9ccc-b2aa619cc1cb service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:52.127009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:52.127300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eb117-b2e3-4a65-a876-8b40f1cfc9a5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:52.128779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:52.129232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:52.130064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:52.132798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:52.133557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:52.133739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:52.134741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:52.135188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:52.139376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:52.150817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:52.151857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:52.165660 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2709/5402] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:52.171353 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2694/5403] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:52.173426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:52.186012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c401e-0468-47cc-894d-2018fa39d183 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:52.192255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34e305-f3f6-45c8-b8b4-aea523baee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:52.193295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e305-f3f6-45c8-b8b4-aea523baee07 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:52.193591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e305-f3f6-45c8-b8b4-aea523baee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:52.193880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e305-f3f6-45c8-b8b4-aea523baee07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:52.194649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e305-f3f6-45c8-b8b4-aea523baee07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:52.196669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e305-f3f6-45c8-b8b4-aea523baee07 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:52.200767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:52.216130 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2710/5404] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:52.221323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:52.239495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7acc-95d6-42f2-86ad-b7daf3500193 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:52.256667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:52.258370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:52.259165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:52.260411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] PATH_INFO: `/v3/projects/59cab910491d40819a7c0185e5623083/users/bbead0be0ded4a389795dcf39d699b72/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:52.305155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cab910491d40819a7c0185e5623083, user_id=bbead0be0ded4a389795dcf39d699b72, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:52.309186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:52.318884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:52.363678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856b2d-2bc0-47c8-a00e-04b0ea9c92ef None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:52.364010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856b2d-2bc0-47c8-a00e-04b0ea9c92ef None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:52.364269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856b2d-2bc0-47c8-a00e-04b0ea9c92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:52.364651 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2695/5405] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:52 2022] PUT /identity/v3/projects/59cab910491d40819a7c0185e5623083/users/bbead0be0ded4a389795dcf39d699b72/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:52.416192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b6856b2d-2bc0-47c8-a00e-04b0ea9c92ef None None] MFA Rules not processed for user `bbead0be0ded4a389795dcf39d699b72`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:52.418265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6856b2d-2bc0-47c8-a00e-04b0ea9c92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:52.652068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2711/5406] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:52.700780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:52.704631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:53.062779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93744263-c1f0-4aa7-8da5-c263f7c0b79f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:53.087241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:53.088758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:53.089514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:53.090452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:53.097671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:53.368725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:53.373225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:53.429926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2696/5407] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:53.759374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:53.760234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:53.761225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:53.876967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:53.886496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:54.120880 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2712/5408] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:01:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:54.144546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:54.324273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21474369-0226-4d49-90da-53eef446adb9 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:54.331249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:54.332270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:54.332736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:54.333172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:54.344283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:54.346464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:54.363820 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2697/5409] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:01:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:54.471983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:54.474799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:54.830601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9034f9-cd89-4a6d-ba91-cfbc8078b280 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:54.840080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:54.842160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:54.842459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:54.842978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] PATH_INFO: `/v3/projects/d640163bff184941bc492af508c0d564` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:54.844990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d640163bff184941bc492af508c0d564)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:54.857750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:54.858115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:54.861053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:54.915481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018115-0b02-485c-9b8e-8d75badaa00d service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:54.927423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:54.932329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551338dc-9f6d-4200-a0ea-c41be66fe360 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:54.933509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551338dc-9f6d-4200-a0ea-c41be66fe360 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:54.934040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551338dc-9f6d-4200-a0ea-c41be66fe360 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:54.934523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551338dc-9f6d-4200-a0ea-c41be66fe360 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:54.944422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd640163bff184941bc492af508c0d564', 'request_id': 'req-e4e0b02f-0433-4759-ab9d-90a45e052340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:54.958292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd640163bff184941bc492af508c0d564', 'request_id': 'req-e4e0b02f-0433-4759-ab9d-90a45e052340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:54.966304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd640163bff184941bc492af508c0d564', 'request_id': 'req-e4e0b02f-0433-4759-ab9d-90a45e052340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:54.982637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551338dc-9f6d-4200-a0ea-c41be66fe360 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:54.986246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551338dc-9f6d-4200-a0ea-c41be66fe360 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:54.999054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] The token cache is being invalidate because project d640163bff184941bc492af508c0d564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:01:55.000096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:55.002875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4e0b02f-0433-4759-ab9d-90a45e052340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:55.010695 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2713/5410] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:01:54 2022] DELETE /identity/v3/projects/d640163bff184941bc492af508c0d564 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:55.017011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09088460-db18-438a-b620-9f98b42ead5d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:55.017470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09088460-db18-438a-b620-9f98b42ead5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:55.017761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09088460-db18-438a-b620-9f98b42ead5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:55.042191 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2698/5411] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:01:55.100993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09088460-db18-438a-b620-9f98b42ead5d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:55.104759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09088460-db18-438a-b620-9f98b42ead5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:55.238743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aead9c-eebb-44b8-95a3-c622aa97b234 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:55.238743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aead9c-eebb-44b8-95a3-c622aa97b234 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:55.239190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aead9c-eebb-44b8-95a3-c622aa97b234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:55.308057 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2714/5412] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:55.312150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-61aead9c-eebb-44b8-95a3-c622aa97b234 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:55.314215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61aead9c-eebb-44b8-95a3-c622aa97b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:55.316482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:55.317079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:55.317512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:55.363556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:55.388856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:55.391324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:55.418714 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2699/5413] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:55.427261 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2715/5414] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:55.438761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aead9c-eebb-44b8-95a3-c622aa97b234 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:55.439310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:55.441614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:55.482596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aead9c-eebb-44b8-95a3-c622aa97b234 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:55.514109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c5a80-e849-466e-9df1-1379f8cc7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:55.518509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5a80-e849-466e-9df1-1379f8cc7fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:55.519389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5a80-e849-466e-9df1-1379f8cc7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:55.519819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5a80-e849-466e-9df1-1379f8cc7fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:55.528714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c5a80-e849-466e-9df1-1379f8cc7fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:01:55.530308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c5a80-e849-466e-9df1-1379f8cc7fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:55.532214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c5a80-e849-466e-9df1-1379f8cc7fdf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:55.573603 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2700/5415] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:01:55.578475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39704ba-6b4c-4a26-ba14-29c26bd9318b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:55.579035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39704ba-6b4c-4a26-ba14-29c26bd9318b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:55.580947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39704ba-6b4c-4a26-ba14-29c26bd9318b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:55.583510 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2701/5416] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:01:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:01:55.585368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39704ba-6b4c-4a26-ba14-29c26bd9318b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:55.640634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39704ba-6b4c-4a26-ba14-29c26bd9318b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:55.656386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3e00-b280-49ca-bfc4-15647b435b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:55.657270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3e00-b280-49ca-bfc4-15647b435b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:55.659395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3e00-b280-49ca-bfc4-15647b435b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:55.659832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3e00-b280-49ca-bfc4-15647b435b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:55.661188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa3e00-b280-49ca-bfc4-15647b435b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:55.672710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa3e00-b280-49ca-bfc4-15647b435b2d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:55.782011 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2702/5417] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:55.791604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b556-a112-4f89-bfa8-ec82c88d9b32 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:55.792080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b556-a112-4f89-bfa8-ec82c88d9b32 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:55.795390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b556-a112-4f89-bfa8-ec82c88d9b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:55.805362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f580a-4cbc-473e-ac04-c2e23587d842 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:55.860942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-18c7b556-a112-4f89-bfa8-ec82c88d9b32 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:55.862378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18c7b556-a112-4f89-bfa8-ec82c88d9b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:56.129888 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2703/5418] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:56.131092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b556-a112-4f89-bfa8-ec82c88d9b32 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:56.133516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:56.182722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:56.188290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.189159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.190140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.352564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b556-a112-4f89-bfa8-ec82c88d9b32 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:56.380289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:56.381754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.382477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.382949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.384066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:56.386323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:56.447588 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2704/5419] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:56 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:56.448783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:56.453804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:56.478925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:56.490849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:56.498637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1c72b-f148-46c7-8cb4-4cb31c2bda68 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:56.515310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:56.516308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.516814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.517274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.527818 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2716/5420] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1089 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:56.531986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:56.557663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:56.560922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:56.579006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:56.592544 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2705/5421] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:56.594781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4258d3-30bd-4dd1-b9a7-9b05cf31389f service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:56.643011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:56.644107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.646796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.647327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.648296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:56.654584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:56.715029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2717/5422] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:56.716360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:56.735720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b07fda-585d-4889-a6e6-8a630bbfe449 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:56.745206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:56.746530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.746530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.747134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.747925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:56.755799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:56.797780 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2706/5423] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:56.799179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:56.820626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac887-397b-499e-8b67-f4742fadeb9e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:56.854865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ed219-cfee-41bc-9cf6-45ef13da5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:56.855219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed219-cfee-41bc-9cf6-45ef13da5d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.855219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed219-cfee-41bc-9cf6-45ef13da5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.855752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ed219-cfee-41bc-9cf6-45ef13da5d2d admin admin] PATH_INFO: `/v3/projects/50338e2edfbb4b3cb741f1f63aa112e6/users/006d1750d84f4e1b872190e207a60e9c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.870064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:56.873566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:56.902141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ed219-cfee-41bc-9cf6-45ef13da5d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50338e2edfbb4b3cb741f1f63aa112e6, user_id=006d1750d84f4e1b872190e207a60e9c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:56.906163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ed219-cfee-41bc-9cf6-45ef13da5d2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:56.920549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5852a1-1aed-455c-998b-00af08925b69 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:56.934240 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2718/5424] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:56 2022] PUT /identity/v3/projects/50338e2edfbb4b3cb741f1f63aa112e6/users/006d1750d84f4e1b872190e207a60e9c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:56.953543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.953838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.954212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.956524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:56.957930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:56.958973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:56.960326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] PATH_INFO: `/v3/users/7660014554b94c198614f33806f47e85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:56.966962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7660014554b94c198614f33806f47e85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:56.969965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:57.027012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] MFA Rules not processed for user `006d1750d84f4e1b872190e207a60e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:57.028565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:57.128648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7660014554b94c198614f33806f47e85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:57.165376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7660014554b94c198614f33806f47e85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:57.166697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7660014554b94c198614f33806f47e85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:57.185638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7660014554b94c198614f33806f47e85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:57.188928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4063c63b-2dac-4e88-816f-b799c97d30c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7660014554b94c198614f33806f47e85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:01:57.251680 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2707/5425] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:01:56 2022] DELETE /identity/v3/users/7660014554b94c198614f33806f47e85 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:57.271088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4738-266a-4c83-a090-2e441acf70ae None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:57.273356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4738-266a-4c83-a090-2e441acf70ae None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:57.275304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4738-266a-4c83-a090-2e441acf70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:57.290319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2719/5426] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:57.298465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:57.306273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:57.331447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-20eb4738-266a-4c83-a090-2e441acf70ae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:57.334359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20eb4738-266a-4c83-a090-2e441acf70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:57.448414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:57.464647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a323b94-e6ff-4bb4-8ab6-1590d9ab5359 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:57.504353 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2708/5427] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:57.504353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:57.504353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:57.505347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:57.541569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:57.544157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:57.605023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:57.607820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:57.609066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:57.609579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:57.611049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:57.622985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:57.715881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:57.743333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2709/5428] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:01:57.745487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:57.748655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:57.761309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2720/5429] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:01:57 2022] POST /identity/v3/projects => generated 381 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:57.768195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:58.030179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17ac2-0ae0-49f6-af8e-a564b36afaaa None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:58.083396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe09c-ae4a-4e3e-9bb3-538a035fb4aa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:58.093792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:58.095454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.096255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.096944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:58.099072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:58.103700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:58.154332 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2721/5430] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:01:57 2022] POST /identity/v3/users => generated 297 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:01:58.156231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:58.185295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60069b0-3d77-4ddf-8bcf-97e8ad1d5676 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:58.204333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:58.205406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.205707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.206119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:58.207024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:58.208944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:58.243610 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2722/5431] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:01:58.249964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:58.252688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:58.253822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.254323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.254831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:58.275678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4167-76a2-4941-963d-60b7e51e2543 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:58.288694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:58.290213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.290751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.291799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] PATH_INFO: `/v3/projects/e41b4e0f36794217ac13f0604ee3c7b7/users/b3c3b4266cb54b62a6c7433d04f10410/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:58.307890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:58.310090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:58.318822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41b4e0f36794217ac13f0604ee3c7b7, user_id=b3c3b4266cb54b62a6c7433d04f10410, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:58.322657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:58.361923 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2723/5432] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:58 2022] PUT /identity/v3/projects/e41b4e0f36794217ac13f0604ee3c7b7/users/b3c3b4266cb54b62a6c7433d04f10410/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:01:58.363329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:58.397161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2710/5433] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:01:58.441759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:58.471906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff03b0-a76d-4619-9673-ac568bf83d33 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:58.478478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418df79-6b6f-4a19-a9c6-2cf669a6e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:58.479496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418df79-6b6f-4a19-a9c6-2cf669a6e6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.479904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418df79-6b6f-4a19-a9c6-2cf669a6e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.480329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418df79-6b6f-4a19-a9c6-2cf669a6e6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:58.482166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418df79-6b6f-4a19-a9c6-2cf669a6e6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:58.484223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418df79-6b6f-4a19-a9c6-2cf669a6e6b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:58.499400 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2724/5434] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:01:58.505657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:58.521013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfc1c7-75bd-4fa0-81fd-0f59b5e626ec service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:58.528550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:58.530626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.531095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.531623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] PATH_INFO: `/v3/projects/e41b4e0f36794217ac13f0604ee3c7b7/users/b3c3b4266cb54b62a6c7433d04f10410/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:58.535592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41b4e0f36794217ac13f0604ee3c7b7, user_id=b3c3b4266cb54b62a6c7433d04f10410, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:58.542142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:58.567351 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2711/5435] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:01:58 2022] PUT /identity/v3/projects/e41b4e0f36794217ac13f0604ee3c7b7/users/b3c3b4266cb54b62a6c7433d04f10410/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:01:58.581749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.582216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.582608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:58.630335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] MFA Rules not processed for user `b3c3b4266cb54b62a6c7433d04f10410`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:01:58.631919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:58.768507 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2725/5436] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:01:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:01:58.798410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:01:58.807957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:01:58.909043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcfde6-8290-4f86-8f41-856ac85d84c0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:01:58.914399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:01:58.917262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:01:58.918164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:01:58.918732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:01:59.070299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:01:59.075064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:01:59.086658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:59.099260 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2712/5437] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:01:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:00.676807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:00.679712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:00.897377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cce61-721f-42f0-a160-e743382a7b02 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:00.915582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:00.917241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:00.917241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:00.917241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] PATH_INFO: `/v3/projects/3502f5a2df55442582d7786a06d230ac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:00.919697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3502f5a2df55442582d7786a06d230ac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:00.929925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:01.118565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:01.176427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520c03-21cc-4c12-a229-8e07173bbf90 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:01.246083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3502f5a2df55442582d7786a06d230ac', 'request_id': 'req-0645abda-4e10-4a1d-a5a5-c0bd5272880a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.266997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3502f5a2df55442582d7786a06d230ac', 'request_id': 'req-0645abda-4e10-4a1d-a5a5-c0bd5272880a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.291690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3502f5a2df55442582d7786a06d230ac', 'request_id': 'req-0645abda-4e10-4a1d-a5a5-c0bd5272880a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.302684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:01.339639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] The token cache is being invalidate because project 3502f5a2df55442582d7786a06d230ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:01.344367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.345677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.352648 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2726/5438] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:00 2022] DELETE /identity/v3/projects/3502f5a2df55442582d7786a06d230ac => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:01.354975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:01.359427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:01.478478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:01.481381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:01.494185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:01.495138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:01.506331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:01.586916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645abda-4e10-4a1d-a5a5-c0bd5272880a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:01.611246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:01.620432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:01.622842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:01.624444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] PATH_INFO: `/v3/users/bbead0be0ded4a389795dcf39d699b72` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:01.633494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbead0be0ded4a389795dcf39d699b72)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:01.650529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:01.854495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:01.858658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:01.868919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbead0be0ded4a389795dcf39d699b72'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.894945 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2713/5439] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:01.926804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbead0be0ded4a389795dcf39d699b72'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.959337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbead0be0ded4a389795dcf39d699b72'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.968912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbead0be0ded4a389795dcf39d699b72'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:01.988081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9c81ffc0-629d-4ca0-b59a-7ee1e5d51bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbead0be0ded4a389795dcf39d699b72'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:02.011169 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2727/5440] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:02:01 2022] DELETE /identity/v3/users/bbead0be0ded4a389795dcf39d699b72 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:02.894695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:02.917045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79314314-281d-40f6-85cc-951eb65eebb5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:03.041541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:03.043261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:03.043909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:03.044496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] PATH_INFO: `/v3/projects/59cab910491d40819a7c0185e5623083` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:03.048416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cab910491d40819a7c0185e5623083)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:03.052461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:03.155918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cab910491d40819a7c0185e5623083', 'request_id': 'req-20aca77e-f88d-4b26-bc6c-456dc3959596'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:03.159564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:03.170942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cab910491d40819a7c0185e5623083', 'request_id': 'req-20aca77e-f88d-4b26-bc6c-456dc3959596'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:03.183938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cab910491d40819a7c0185e5623083', 'request_id': 'req-20aca77e-f88d-4b26-bc6c-456dc3959596'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:03.206290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] The token cache is being invalidate because project 59cab910491d40819a7c0185e5623083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:03.208962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:03.208962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20aca77e-f88d-4b26-bc6c-456dc3959596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:03.232398 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2714/5441] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:02 2022] DELETE /identity/v3/projects/59cab910491d40819a7c0185e5623083 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:03.249709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89a86-bd85-4fef-b316-9e24f94cc3b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:03.250291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89a86-bd85-4fef-b316-9e24f94cc3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:03.250534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89a86-bd85-4fef-b316-9e24f94cc3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:03.318924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7dd89a86-bd85-4fef-b316-9e24f94cc3b7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:03.325301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dd89a86-bd85-4fef-b316-9e24f94cc3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:03.500946 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2728/5442] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:03.503161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082392c-6654-4435-b3bb-196982115612 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:03.503540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082392c-6654-4435-b3bb-196982115612 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:03.503892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082392c-6654-4435-b3bb-196982115612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:03.544068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d082392c-6654-4435-b3bb-196982115612 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:03.545430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d082392c-6654-4435-b3bb-196982115612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:03.557361 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2715/5443] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:03.561500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd89a86-bd85-4fef-b316-9e24f94cc3b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:03.575259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd89a86-bd85-4fef-b316-9e24f94cc3b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:03.581943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:03.582842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:03.583142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:03.583600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:03.584326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:03.584652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:03.586646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:03.604412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:03.610842 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2729/5444] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:02:03.616300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082392c-6654-4435-b3bb-196982115612 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:03.636148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082392c-6654-4435-b3bb-196982115612 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:03.649425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:03.650177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:03.650640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:03.650928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:03.651831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:03.657145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:03.699178 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2716/5445] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:03 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:03.704709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:03.719813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad209b6-7300-4831-8594-a4716130fd6c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:03.835062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:03.836212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:03.837310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:03.837895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:03.838929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:03.842059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:03.890908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2730/5446] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:03 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:03.895431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:03.938811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77df8-6476-4840-aba7-d5cbf50a6ecc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:03.964935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:03.980110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:03.980110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:03.980569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:03.981236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:03.987362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:04.048658 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2717/5447] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:04.052591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:04.065961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85327ca-789b-4984-91e0-ddfaf54ab5d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:04.098996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6c98e-54a8-4945-a2c7-91fe8c4c1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:04.100312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c98e-54a8-4945-a2c7-91fe8c4c1885 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:04.100312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c98e-54a8-4945-a2c7-91fe8c4c1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:04.100701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c98e-54a8-4945-a2c7-91fe8c4c1885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:04.101554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6c98e-54a8-4945-a2c7-91fe8c4c1885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:04.110438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6c98e-54a8-4945-a2c7-91fe8c4c1885 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:04.132634 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2731/5448] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:04.139890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:04.183960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a17306-0069-4480-b207-196cfa54de6d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:04.208984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:04.211472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:04.212354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:04.213251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] PATH_INFO: `/v3/projects/c2d6f74f4f0b4a9a8f43a83e25c35901/users/53280268c5314fe1b108a0963adb6b99/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:04.263950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6f74f4f0b4a9a8f43a83e25c35901, user_id=53280268c5314fe1b108a0963adb6b99, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:04.288049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:04.325066 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2718/5449] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:04 2022] PUT /identity/v3/projects/c2d6f74f4f0b4a9a8f43a83e25c35901/users/53280268c5314fe1b108a0963adb6b99/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:04.338643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fbbd6-9e15-4eec-9454-e2d7da6651fd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:04.339198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fbbd6-9e15-4eec-9454-e2d7da6651fd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:04.339531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fbbd6-9e15-4eec-9454-e2d7da6651fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:04.402732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-411fbbd6-9e15-4eec-9454-e2d7da6651fd None None] MFA Rules not processed for user `53280268c5314fe1b108a0963adb6b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:04.407703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-411fbbd6-9e15-4eec-9454-e2d7da6651fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:04.657422 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2732/5450] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:04.681385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:04.686679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:04.690834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f937c9-83c6-4f27-9d27-87eeda898ede None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:04.691258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f937c9-83c6-4f27-9d27-87eeda898ede None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:04.691826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f937c9-83c6-4f27-9d27-87eeda898ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:04.731719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-69f937c9-83c6-4f27-9d27-87eeda898ede None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:04.734065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69f937c9-83c6-4f27-9d27-87eeda898ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:04.812446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286c56-0875-4c27-9d48-ade92fd89362 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:04.815994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:04.817112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:04.817517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:04.818286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:04.849558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:04.851674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:04.866219 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2719/5451] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:04.874714 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2733/5452] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:02:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:04.897047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:04.899900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:05.168886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862e60c-25fc-487c-8820-076330f7c30b service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:05.194450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:05.196593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:05.196593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:05.196969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:05.220387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:05.222871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:05.235199 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2720/5453] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:05.299639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608cc40-3158-409c-aa75-44b6c559a7d1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:05.299639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608cc40-3158-409c-aa75-44b6c559a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:05.299639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608cc40-3158-409c-aa75-44b6c559a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:05.343439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7608cc40-3158-409c-aa75-44b6c559a7d1 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:05.351155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7608cc40-3158-409c-aa75-44b6c559a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:05.377334 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2734/5454] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:05.403041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:05.434029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988da8c-f9eb-4264-9ab2-1637c00f1d58 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:05.454561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:05.455574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:05.456995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:05.457494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:05.473188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:05.489438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:05.493325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:05.523908 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2721/5455] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:02:06.222235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c673-4cea-4cdf-9db9-191087bf5b5f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:06.222684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c673-4cea-4cdf-9db9-191087bf5b5f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:06.223214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c673-4cea-4cdf-9db9-191087bf5b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:06.254117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:06.279092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7808c673-4cea-4cdf-9db9-191087bf5b5f None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:06.288774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7808c673-4cea-4cdf-9db9-191087bf5b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:06.325313 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2735/5456] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:06.361205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:06.386471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018b94-ad69-4e7a-82d2-036b88fe4276 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:06.397062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:06.398230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:06.398799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:06.399357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:06.426532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:06.430593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:06.468208 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2722/5457] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:02:07.328938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c258803-f10d-40c5-9802-da7fd72f4677 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:07.329491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c258803-f10d-40c5-9802-da7fd72f4677 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:07.329804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c258803-f10d-40c5-9802-da7fd72f4677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:07.393634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c258803-f10d-40c5-9802-da7fd72f4677 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:07.396030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c258803-f10d-40c5-9802-da7fd72f4677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:07.476440 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2736/5458] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:07.489202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:07.535903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e38d5-4880-4e8d-aee7-c9d61b4c3241 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:07.563342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:07.564804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:07.565860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:07.566471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:07.596470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:07.607687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:07.660937 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2723/5459] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:08.417392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9df01a-aa11-498e-8b01-520a55fac258 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:08.417943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9df01a-aa11-498e-8b01-520a55fac258 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:08.418457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9df01a-aa11-498e-8b01-520a55fac258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:08.563702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ba9df01a-aa11-498e-8b01-520a55fac258 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:08.566103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba9df01a-aa11-498e-8b01-520a55fac258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:08.651610 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2737/5460] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:08.699060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:08.742916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf706-85d7-45ad-88f9-e94b299ecc37 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:08.754235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:08.755920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:08.757718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:08.758383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:08.787991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:08.791837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:08.827230 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2724/5461] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:09.815776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b715-ca53-4cfe-afb1-53a355cf28c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:09.816409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b715-ca53-4cfe-afb1-53a355cf28c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:09.817008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b715-ca53-4cfe-afb1-53a355cf28c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:09.889251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c941b715-ca53-4cfe-afb1-53a355cf28c2 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:09.890610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c941b715-ca53-4cfe-afb1-53a355cf28c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:09.903485 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2738/5462] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:09.932148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:09.972802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedd48b-1c52-417f-8d89-80fb808f08f4 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:10.002611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:10.003970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:10.004647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:10.005327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:10.051018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:10.059123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:10.095838 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2725/5463] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:10.733301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfca56-fbd8-4f20-a763-b8109274e07e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:10.733767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfca56-fbd8-4f20-a763-b8109274e07e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:10.734239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfca56-fbd8-4f20-a763-b8109274e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:10.789982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-86bfca56-fbd8-4f20-a763-b8109274e07e None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:10.798630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86bfca56-fbd8-4f20-a763-b8109274e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:10.822976 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2739/5464] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 14 15:02:10.842597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:10.888286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7db-c4ed-4fcc-ab70-9c4b848aba52 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:10.912932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:10.918621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:10.922542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:10.923639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:10.986608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:10.999556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:11.071315 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2726/5465] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:13.546835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69eeb8-6bb4-4ba9-8d88-c67d458924f0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:13.548300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69eeb8-6bb4-4ba9-8d88-c67d458924f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:13.549041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69eeb8-6bb4-4ba9-8d88-c67d458924f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:13.618428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2d69eeb8-6bb4-4ba9-8d88-c67d458924f0 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:13.628202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2d69eeb8-6bb4-4ba9-8d88-c67d458924f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:13.668005 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2740/5466] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:02:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:13.694164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:13.732456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f7ff-e904-4c45-bf5e-41b0c90d5e32 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:13.743836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:13.745413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:13.746586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:13.747610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:13.802411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:13.807699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:13.838896 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2727/5467] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:15.391025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cbe4-5de5-47cb-82f5-70b776ee7ae7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:15.391632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cbe4-5de5-47cb-82f5-70b776ee7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:15.392404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cbe4-5de5-47cb-82f5-70b776ee7ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:15.432361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f365cbe4-5de5-47cb-82f5-70b776ee7ae7 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:15.436727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f365cbe4-5de5-47cb-82f5-70b776ee7ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:15.465223 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2741/5468] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:02:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:15.487088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:15.526168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430a75-ebe7-4bfb-99cd-1fae86cbb0b3 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:15.550975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:15.551764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:15.632432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:15.632432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:15.636610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:15.638306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:15.676087 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2728/5469] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:16.383739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb9be-9baf-43b0-a72f-5e3a2c8b8f58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:16.384243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb9be-9baf-43b0-a72f-5e3a2c8b8f58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:16.384753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb9be-9baf-43b0-a72f-5e3a2c8b8f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:16.496987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-998eb9be-9baf-43b0-a72f-5e3a2c8b8f58 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:16.499300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-998eb9be-9baf-43b0-a72f-5e3a2c8b8f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:16.561618 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2742/5470] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:16.601548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:16.622763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49617e-534e-43d6-98ad-5f3ba616d98d service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:16.639114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:16.640386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:16.647391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:16.647897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:16.671587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:16.673521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:16.697327 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2729/5471] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:02:17.100018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa395-7b6d-418d-9d94-92d6d3f45a54 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:17.100858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa395-7b6d-418d-9d94-92d6d3f45a54 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:17.101556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa395-7b6d-418d-9d94-92d6d3f45a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:17.177509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3b8aa395-7b6d-418d-9d94-92d6d3f45a54 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:17.178869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b8aa395-7b6d-418d-9d94-92d6d3f45a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:17.200426 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2743/5472] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:17.217502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:17.236392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174e794-b46a-42af-966b-38a3f858f17a service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:17.270754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:17.272894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:17.273619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:17.276843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:17.305547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:17.313366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:17.345145 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2730/5473] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:17.802033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24959e-f626-43a8-982b-f83fe5a03cf4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:17.802883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24959e-f626-43a8-982b-f83fe5a03cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:17.802883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24959e-f626-43a8-982b-f83fe5a03cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:17.843998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6e24959e-f626-43a8-982b-f83fe5a03cf4 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:17.845351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e24959e-f626-43a8-982b-f83fe5a03cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:17.890925 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2744/5474] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:17.968643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:18.066229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fc128-af9a-4f44-98f3-a70a10d7476b service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:18.109171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:18.110374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:18.110882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:18.111626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:18.195455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:18.204692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:18.244976 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2731/5475] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:02:18.766640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba18338-4a78-4720-84db-e05c3a1ade32 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:18.766934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba18338-4a78-4720-84db-e05c3a1ade32 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:18.767834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba18338-4a78-4720-84db-e05c3a1ade32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:18.812882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dba18338-4a78-4720-84db-e05c3a1ade32 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:18.814307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dba18338-4a78-4720-84db-e05c3a1ade32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:18.849036 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2745/5476] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:02:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:18.867158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:18.930015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af144de3-6bdc-4f58-89e7-e9f332277e64 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:18.967848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc61fc5-944e-4f47-890b-a75b38fba0b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:18.969083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc61fc5-944e-4f47-890b-a75b38fba0b1 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:18.979682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc61fc5-944e-4f47-890b-a75b38fba0b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:18.980042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc61fc5-944e-4f47-890b-a75b38fba0b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:19.067769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc61fc5-944e-4f47-890b-a75b38fba0b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:19.076827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc61fc5-944e-4f47-890b-a75b38fba0b1 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:19.125447 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2732/5477] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:02:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:19.480007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba18338-4a78-4720-84db-e05c3a1ade32 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:19.930280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba18338-4a78-4720-84db-e05c3a1ade32 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:19.947822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:19.948774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:19.949063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:19.949532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] PATH_INFO: `/v3/users/53280268c5314fe1b108a0963adb6b99` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:19.953395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] RBAC: Authorizing `identity:delete_user(user_id=53280268c5314fe1b108a0963adb6b99)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:19.958897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:20.131075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53280268c5314fe1b108a0963adb6b99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:20.191756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53280268c5314fe1b108a0963adb6b99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:20.227605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53280268c5314fe1b108a0963adb6b99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:20.229207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53280268c5314fe1b108a0963adb6b99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:20.280645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53280268c5314fe1b108a0963adb6b99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:20.347444 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2746/5478] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:02:19 2022] DELETE /identity/v3/users/53280268c5314fe1b108a0963adb6b99 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:20.353416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:20.354215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:20.354215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:20.403381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:20.404791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:20.640275 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2733/5479] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:20.688147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:20.691219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:20.754308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:20.884138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254a492-4a21-4ca9-8889-22b0db14cfde admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:20.904376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:20.906085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:20.906858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:20.907622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:20.946962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:20.956651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:21.000070 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2747/5480] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:02:24.424637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:24.428420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:24.469416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:24.757464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d4d78-d3e5-43bc-8e85-fbd207b446dc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:24.796206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a09c-a14d-4a74-a2d4-ba41ef33806e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:24.796713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a09c-a14d-4a74-a2d4-ba41ef33806e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:24.797041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a09c-a14d-4a74-a2d4-ba41ef33806e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:24.797332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a09c-a14d-4a74-a2d4-ba41ef33806e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:24.807025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d4b6a09c-a14d-4a74-a2d4-ba41ef33806e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:24.993977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a09c-a14d-4a74-a2d4-ba41ef33806e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:24.995723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a09c-a14d-4a74-a2d4-ba41ef33806e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:25.022755 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2734/5481] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:27.567914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:27.572998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:27.636609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cbc0-ee40-48cd-9da9-d5616422033b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:27.642841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:27.644341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:27.644912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:27.645473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] PATH_INFO: `/v3/projects/c2d6f74f4f0b4a9a8f43a83e25c35901` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:27.647183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d6f74f4f0b4a9a8f43a83e25c35901)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:27.649596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:27.772896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d6f74f4f0b4a9a8f43a83e25c35901', 'request_id': 'req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:27.786835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d6f74f4f0b4a9a8f43a83e25c35901', 'request_id': 'req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:27.810858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d6f74f4f0b4a9a8f43a83e25c35901', 'request_id': 'req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:27.860231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] The token cache is being invalidate because project c2d6f74f4f0b4a9a8f43a83e25c35901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:27.860231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:27.860231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4aa82d0a-51d8-4489-96b0-a63bd5d99ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:27.860231 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2748/5482] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:27 2022] DELETE /identity/v3/projects/c2d6f74f4f0b4a9a8f43a83e25c35901 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:27.866009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9ef04-2dd9-4ebc-8834-2f3a5a1e18f7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:27.866514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9ef04-2dd9-4ebc-8834-2f3a5a1e18f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:27.866604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9ef04-2dd9-4ebc-8834-2f3a5a1e18f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:27.901682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e7f9ef04-2dd9-4ebc-8834-2f3a5a1e18f7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:27.902967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e7f9ef04-2dd9-4ebc-8834-2f3a5a1e18f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:28.062766 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2735/5483] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:28.074189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532c4ba-bc80-4a7d-9655-9a4d4a014718 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:28.074500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532c4ba-bc80-4a7d-9655-9a4d4a014718 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:28.074993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532c4ba-bc80-4a7d-9655-9a4d4a014718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:28.103593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2532c4ba-bc80-4a7d-9655-9a4d4a014718 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:28.104932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2532c4ba-bc80-4a7d-9655-9a4d4a014718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:28.116055 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2749/5484] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:28.122148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9ef04-2dd9-4ebc-8834-2f3a5a1e18f7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:28.137768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9ef04-2dd9-4ebc-8834-2f3a5a1e18f7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:28.162073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:28.163203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:28.164630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:28.165238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:28.166205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:28.166700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:28.169310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:28.185651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3738-3715-4214-8d53-c6b5d867131a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:28.189723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3738-3715-4214-8d53-c6b5d867131a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:28.190466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3738-3715-4214-8d53-c6b5d867131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:28.218466 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2736/5485] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:02:28.221627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-200d3738-3715-4214-8d53-c6b5d867131a None None] MFA Rules not processed for user `4813aa5acf744a8dac42de00d7e5a519`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:28.225239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:28.225550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-200d3738-3715-4214-8d53-c6b5d867131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:28.250469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be804070-14b3-4cba-b893-5f23826a7652 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:28.272760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:28.273174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:28.273472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:28.273761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:28.274601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:28.276659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:28.336949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2750/5486] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:28.357350 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2737/5487] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:28 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:02:28.358546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d3738-3715-4214-8d53-c6b5d867131a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:28.392241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d3738-3715-4214-8d53-c6b5d867131a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:28.503545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:28.619937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:28.622425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:28.627052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:28.628166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:28.652318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:28.664793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:28.730895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2751/5488] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:28 2022] POST /identity/v3/users => generated 282 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:02:28.738015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:28.792305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d6c8-f84b-4f32-bf18-ad5b812fb8b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:28.806170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:28.810835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:28.817885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:28.818147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:28.819989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:28.824097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:28.839956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:28.868285 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2738/5489] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:28.871787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:28.891232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8592-4496-4cf6-b177-490bfde2eab0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:28.903811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa471e-a28a-4413-b5a7-abca88500b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:28.905769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa471e-a28a-4413-b5a7-abca88500b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:28.906232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa471e-a28a-4413-b5a7-abca88500b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:28.906688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa471e-a28a-4413-b5a7-abca88500b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:28.907642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa471e-a28a-4413-b5a7-abca88500b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:28.917527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa471e-a28a-4413-b5a7-abca88500b3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:28.937462 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2752/5490] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:02:28.945413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:29.017199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd9c3-8e83-4091-9d53-3da0662d9bb5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:29.042122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:29.046009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:29.046546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:29.047130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] PATH_INFO: `/v3/projects/829c87e1771348c4bd6d18e0f5b0d774/users/7eff3f440a62410e80fa455651abe8a5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:29.111385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829c87e1771348c4bd6d18e0f5b0d774, user_id=7eff3f440a62410e80fa455651abe8a5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:29.121704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:29.255194 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2739/5491] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:28 2022] PUT /identity/v3/projects/829c87e1771348c4bd6d18e0f5b0d774/users/7eff3f440a62410e80fa455651abe8a5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:29.258066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b0b2-1cec-4f7c-8633-ccd04d10bc89 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:29.258568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b0b2-1cec-4f7c-8633-ccd04d10bc89 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:29.259054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b0b2-1cec-4f7c-8633-ccd04d10bc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:29.397957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3602b0b2-1cec-4f7c-8633-ccd04d10bc89 None None] MFA Rules not processed for user `7eff3f440a62410e80fa455651abe8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:29.399396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3602b0b2-1cec-4f7c-8633-ccd04d10bc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:29.620317 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2753/5492] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:29.628298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:29.631004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:29.794916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c868a6-5497-4de7-9f55-a880b133eba1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:29.808941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b753a-edea-4fad-9588-75caaa480d1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:29.810598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b753a-edea-4fad-9588-75caaa480d1e service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:29.810598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b753a-edea-4fad-9588-75caaa480d1e service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:29.810598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b753a-edea-4fad-9588-75caaa480d1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:29.837165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b753a-edea-4fad-9588-75caaa480d1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:29.840090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b753a-edea-4fad-9588-75caaa480d1e service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:29.881222 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2740/5493] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:30.651213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602b0b2-1cec-4f7c-8633-ccd04d10bc89 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:30.947969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602b0b2-1cec-4f7c-8633-ccd04d10bc89 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:30.969847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:30.972250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:30.976933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:30.977771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] PATH_INFO: `/v3/users/7eff3f440a62410e80fa455651abe8a5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:30.980510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eff3f440a62410e80fa455651abe8a5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:30.987392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:31.172233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eff3f440a62410e80fa455651abe8a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:31.173828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:31.217361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eff3f440a62410e80fa455651abe8a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:31.234903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eff3f440a62410e80fa455651abe8a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:31.235735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eff3f440a62410e80fa455651abe8a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:31.254846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eff3f440a62410e80fa455651abe8a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:31.277419 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2754/5494] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:02:30 2022] DELETE /identity/v3/users/7eff3f440a62410e80fa455651abe8a5 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:31.283938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:31.284721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:31.284721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:31.349013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:31.352240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:31.566770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2741/5495] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:31.609483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:31.612088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:31.954673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f1f9-bfb3-4341-9e6a-a1d6afba59c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:31.960017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4c690-fd68-445b-8652-ed965a20bdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:31.961133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4c690-fd68-445b-8652-ed965a20bdbf service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:31.961621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4c690-fd68-445b-8652-ed965a20bdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:31.962065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4c690-fd68-445b-8652-ed965a20bdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:31.981986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4c690-fd68-445b-8652-ed965a20bdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:31.988380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4c690-fd68-445b-8652-ed965a20bdbf service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:32.011244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2755/5496] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:34.530327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:34.534378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:34.583231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4fc13-2f51-4cbc-831b-01db3821f843 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:34.594706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:34.596844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:34.599391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:34.600253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] PATH_INFO: `/v3/projects/829c87e1771348c4bd6d18e0f5b0d774` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:34.602948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829c87e1771348c4bd6d18e0f5b0d774)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:34.610066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:34.806510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829c87e1771348c4bd6d18e0f5b0d774', 'request_id': 'req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:34.837828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829c87e1771348c4bd6d18e0f5b0d774', 'request_id': 'req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:34.881045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829c87e1771348c4bd6d18e0f5b0d774', 'request_id': 'req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:34.942245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] The token cache is being invalidate because project 829c87e1771348c4bd6d18e0f5b0d774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:34.942616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:34.943396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb2c4f6f-e63e-4c3b-a7b7-e77b28ba0f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:34.945835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2742/5497] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:34 2022] DELETE /identity/v3/projects/829c87e1771348c4bd6d18e0f5b0d774 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:34.954390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb2fca-6f73-457a-9791-a3d4f07b30cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:34.955869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb2fca-6f73-457a-9791-a3d4f07b30cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:34.956588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb2fca-6f73-457a-9791-a3d4f07b30cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:34.991833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-debb2fca-6f73-457a-9791-a3d4f07b30cc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:34.994207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-debb2fca-6f73-457a-9791-a3d4f07b30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:35.160031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2756/5498] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:35.163631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baad74-44a7-4634-b9a3-9092833d27ad None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.164158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baad74-44a7-4634-b9a3-9092833d27ad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.164678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baad74-44a7-4634-b9a3-9092833d27ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.189336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:35.235990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-53baad74-44a7-4634-b9a3-9092833d27ad None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:35.239752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53baad74-44a7-4634-b9a3-9092833d27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:35.264188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb2fca-6f73-457a-9791-a3d4f07b30cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:35.275827 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2743/5499] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:35.296895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb2fca-6f73-457a-9791-a3d4f07b30cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:35.309949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:35.311526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.312709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.313124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.316290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:35.316713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:35.318484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:35.351034 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2757/5500] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:02:35.353724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baad74-44a7-4634-b9a3-9092833d27ad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:35.365259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baad74-44a7-4634-b9a3-9092833d27ad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:35.371766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:35.372611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.373499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.373935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.375600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:35.377003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:35.425298 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2744/5501] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:35 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:35.425621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:35.439354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92529fa9-b6c1-4aba-8347-a6c9fc1b7cf4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:35.518078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:35.528224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:35.535331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.535331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.535331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.535331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:35.538645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:35.584581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:35.596904 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2758/5502] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:35 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:35.597704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aab19-bd25-4ce2-91be-cf0e9e393b96 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:35.603126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:35.604005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.604482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.604927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.606371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:35.608919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:35.627428 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2745/5503] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:35.628940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:35.658162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f863-9fd2-4666-b863-1f2085db8910 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:35.666515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b5465-d8a7-4078-88f6-babadc5d0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:35.667900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5465-d8a7-4078-88f6-babadc5d0bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.668203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5465-d8a7-4078-88f6-babadc5d0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.669055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5465-d8a7-4078-88f6-babadc5d0bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.671396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b5465-d8a7-4078-88f6-babadc5d0bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:35.673247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b5465-d8a7-4078-88f6-babadc5d0bbf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:35.696526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:35.707599 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2759/5504] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:35.710472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc83c-5350-4c41-be30-21fdfbf92764 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:35.716888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:35.717834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.718163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.718621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] PATH_INFO: `/v3/projects/7167344fa4cc4f708b313b15b16f97dd/users/630121eb73e741869ec3c70ee5b82571/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.773163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7167344fa4cc4f708b313b15b16f97dd, user_id=630121eb73e741869ec3c70ee5b82571, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:35.779298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:35.822482 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2746/5505] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:35 2022] PUT /identity/v3/projects/7167344fa4cc4f708b313b15b16f97dd/users/630121eb73e741869ec3c70ee5b82571/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:35.825049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d92f8-85db-49cc-aa0b-c8d06b8a95fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:35.825532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d92f8-85db-49cc-aa0b-c8d06b8a95fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:35.825964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d92f8-85db-49cc-aa0b-c8d06b8a95fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:35.881873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-597d92f8-85db-49cc-aa0b-c8d06b8a95fe None None] MFA Rules not processed for user `630121eb73e741869ec3c70ee5b82571`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:35.885091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-597d92f8-85db-49cc-aa0b-c8d06b8a95fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:36.051585 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2760/5506] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:36.073838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:36.077685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:36.231523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070649-4a82-43b4-8bb4-dc74d29b89ac admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:36.244148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225347c0-bfaf-4e17-894a-561fce5c5d41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:36.244867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225347c0-bfaf-4e17-894a-561fce5c5d41 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:36.245160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225347c0-bfaf-4e17-894a-561fce5c5d41 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:36.245439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225347c0-bfaf-4e17-894a-561fce5c5d41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:36.263962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225347c0-bfaf-4e17-894a-561fce5c5d41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:36.265469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225347c0-bfaf-4e17-894a-561fce5c5d41 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:36.285813 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2747/5507] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:36.768237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d92f8-85db-49cc-aa0b-c8d06b8a95fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:37.024939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d92f8-85db-49cc-aa0b-c8d06b8a95fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:37.062733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:37.065218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:37.065543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:37.065941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] PATH_INFO: `/v3/users/630121eb73e741869ec3c70ee5b82571` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:37.067560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630121eb73e741869ec3c70ee5b82571)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:37.069906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:37.200315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630121eb73e741869ec3c70ee5b82571'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:37.253839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630121eb73e741869ec3c70ee5b82571'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:37.260923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:37.302818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630121eb73e741869ec3c70ee5b82571'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:37.304287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630121eb73e741869ec3c70ee5b82571'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:37.336897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630121eb73e741869ec3c70ee5b82571'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:37.348455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2761/5508] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:02:36 2022] DELETE /identity/v3/users/630121eb73e741869ec3c70ee5b82571 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:37.365638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:37.366137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:37.366237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:37.415073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:37.417779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:37.652896 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2748/5509] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:37.697704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:37.703258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:37.985252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132aa66-1f68-43a9-989a-f161021eb8c6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:38.010895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdb3c4-92e5-4fb0-8326-036fec7b80e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:38.015330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdb3c4-92e5-4fb0-8326-036fec7b80e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:38.020953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdb3c4-92e5-4fb0-8326-036fec7b80e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:38.021960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdb3c4-92e5-4fb0-8326-036fec7b80e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:38.085771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdb3c4-92e5-4fb0-8326-036fec7b80e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:38.118298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdb3c4-92e5-4fb0-8326-036fec7b80e4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:38.167796 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2762/5510] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:02:41.390377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:41.393675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:41.433411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adaccb-e71f-41c7-9095-763ffbf47845 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:41.467831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:41.470528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:41.474937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:41.475589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] PATH_INFO: `/v3/projects/7167344fa4cc4f708b313b15b16f97dd` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:41.483952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7167344fa4cc4f708b313b15b16f97dd)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:41.493493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:41.604807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:41.629159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7167344fa4cc4f708b313b15b16f97dd', 'request_id': 'req-b789b7c1-37d6-4bd5-9722-5294c39d7057'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:41.643936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7167344fa4cc4f708b313b15b16f97dd', 'request_id': 'req-b789b7c1-37d6-4bd5-9722-5294c39d7057'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:41.657852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7167344fa4cc4f708b313b15b16f97dd', 'request_id': 'req-b789b7c1-37d6-4bd5-9722-5294c39d7057'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:41.697084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] The token cache is being invalidate because project 7167344fa4cc4f708b313b15b16f97dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:41.697388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:41.702147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b789b7c1-37d6-4bd5-9722-5294c39d7057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:41.706152 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2749/5511] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:41 2022] DELETE /identity/v3/projects/7167344fa4cc4f708b313b15b16f97dd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:41.712857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a185-f8ad-451f-b4e5-7ef79967855f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:41.713977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a185-f8ad-451f-b4e5-7ef79967855f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:41.714463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a185-f8ad-451f-b4e5-7ef79967855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:41.764414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eda5a185-f8ad-451f-b4e5-7ef79967855f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:41.767402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eda5a185-f8ad-451f-b4e5-7ef79967855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:42.005195 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2763/5512] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:42.006228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf066c-a91f-4c4e-b61c-40561e7915bc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.006696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf066c-a91f-4c4e-b61c-40561e7915bc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.007040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf066c-a91f-4c4e-b61c-40561e7915bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.054685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-28bf066c-a91f-4c4e-b61c-40561e7915bc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:42.056115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28bf066c-a91f-4c4e-b61c-40561e7915bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:42.089697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a185-f8ad-451f-b4e5-7ef79967855f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:42.090018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2750/5513] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:42.106873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a185-f8ad-451f-b4e5-7ef79967855f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:42.114858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:42.115670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.115952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.116237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.117275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:42.117594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:42.119559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:42.161778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2764/5514] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:02:42.162929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf066c-a91f-4c4e-b61c-40561e7915bc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:42.180151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf066c-a91f-4c4e-b61c-40561e7915bc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:42.193615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:42.195770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.197943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.198235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.199138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:42.207646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:42.297347 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2751/5515] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:42 2022] POST /identity/v3/projects => generated 397 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:42.299627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:42.320221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5a5b3-21fa-46ff-aeed-da39bbb59701 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:42.428711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:42.429911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.434324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.434985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.436566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:42.442212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:42.505452 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2765/5516] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:42 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:42.510143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:42.531116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d442-7606-4509-a230-6996d9f86806 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:42.549850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:42.550565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.550855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.551138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.551935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:42.553671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:42.575232 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2752/5517] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:42.580838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:42.588998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:42.603414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c593fe-6b53-4e61-ba6f-24f8967197eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:42.631773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094874-a62e-40e5-8f64-55570ef69b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:42.633215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094874-a62e-40e5-8f64-55570ef69b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.634736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094874-a62e-40e5-8f64-55570ef69b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.636343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094874-a62e-40e5-8f64-55570ef69b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.638163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f094874-a62e-40e5-8f64-55570ef69b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:42.645563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f094874-a62e-40e5-8f64-55570ef69b36 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:42.679391 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2766/5518] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:42.686021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:42.720642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468a28-5908-44a1-8d89-f8c25c33e926 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:42.739704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:42.742428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.742854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.743155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] PATH_INFO: `/v3/projects/2a7b6676d96646db83dce13331e32c64/users/3447d58457ea4481932fe7284de47a2d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.809367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7b6676d96646db83dce13331e32c64, user_id=3447d58457ea4481932fe7284de47a2d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:42.818599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:42.873938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9311e-5ecf-4e76-8bd3-5823a1734956 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:42.874488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9311e-5ecf-4e76-8bd3-5823a1734956 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:42.874488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9311e-5ecf-4e76-8bd3-5823a1734956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:42.882120 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2753/5519] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:42 2022] PUT /identity/v3/projects/2a7b6676d96646db83dce13331e32c64/users/3447d58457ea4481932fe7284de47a2d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:42.950111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6ef9311e-5ecf-4e76-8bd3-5823a1734956 None None] MFA Rules not processed for user `3447d58457ea4481932fe7284de47a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:42.952053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ef9311e-5ecf-4e76-8bd3-5823a1734956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:43.150734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:43.172969 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2767/5520] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:43.352135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1122d9a-1d3e-4703-93eb-94d2aea00aac admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:43.365050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:43.366683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:43.366683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:43.366683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:43.367195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:43.369883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:43.456194 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2754/5521] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:43 2022] POST /identity/v3/projects => generated 399 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:43.461358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9311e-5ecf-4e76-8bd3-5823a1734956 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:43.501575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9311e-5ecf-4e76-8bd3-5823a1734956 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:43.668420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:43.670125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:43.670422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:43.670710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:43.671505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:43.675486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:43.720562 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2768/5522] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:43 2022] POST /identity/v3/users => generated 306 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:43.721239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:43.738181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d25622-d7f6-4cfe-b889-e1bf36b632cc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:43.751130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:43.752879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:43.753251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:43.753611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:43.754666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:43.758128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:43.779591 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2755/5523] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:02:43.780718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:43.796396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e338948-2eda-499a-acf5-b196ed69e61a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:43.803057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:43.804246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:43.804847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:43.806209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] PATH_INFO: `/v3/projects/21462d1cc49b44a59f4115198e57717d/users/97a8457e503141799ff10bc7e9263417/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:43.845312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21462d1cc49b44a59f4115198e57717d, user_id=97a8457e503141799ff10bc7e9263417, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:43.851647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:43.869700 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2769/5524] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:43 2022] PUT /identity/v3/projects/21462d1cc49b44a59f4115198e57717d/users/97a8457e503141799ff10bc7e9263417/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:43.876043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:43.893750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa66e-f76e-4ec3-85ba-88c6487c6851 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:43.960555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:44.018630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d1d9-cf55-417f-9dae-cafe61aea9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:44.021127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d1d9-cf55-417f-9dae-cafe61aea9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:44.022740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d1d9-cf55-417f-9dae-cafe61aea9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:44.023169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d1d9-cf55-417f-9dae-cafe61aea9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:44.025034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d1d9-cf55-417f-9dae-cafe61aea9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:44.027173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d1d9-cf55-417f-9dae-cafe61aea9cc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:44.047324 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2756/5525] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:44.049568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:44.070974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec8d1-73ec-44e8-939b-8e5db0b78b2d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:44.080206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:44.082222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:44.083068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:44.083801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] PATH_INFO: `/v3/projects/21462d1cc49b44a59f4115198e57717d/users/97a8457e503141799ff10bc7e9263417/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:44.087896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21462d1cc49b44a59f4115198e57717d, user_id=97a8457e503141799ff10bc7e9263417, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:44.094942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:44.121115 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2770/5526] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:44 2022] PUT /identity/v3/projects/21462d1cc49b44a59f4115198e57717d/users/97a8457e503141799ff10bc7e9263417/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:44.132038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:44.132314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:44.132940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:44.199864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] MFA Rules not processed for user `97a8457e503141799ff10bc7e9263417`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:44.202782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:44.365962 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2757/5527] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:44.385697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:44.387665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:44.434107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:44.477397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdd3bf-1be5-4144-9d17-557be3c616d0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:44.481317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:44.482703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:44.482995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:44.483308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:44.643201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:44.651650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:44.679304 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2771/5528] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:02:44.735598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:44.737239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:44.910135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f362a1-f991-48f1-86eb-6a80c752e83e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:44.926234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:44.928828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:44.928828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:44.929309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] PATH_INFO: `/v3/users/b128110e3c7f4e2bb93292b8a6f0ea8b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:44.932332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b128110e3c7f4e2bb93292b8a6f0ea8b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:44.937046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:45.062573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b128110e3c7f4e2bb93292b8a6f0ea8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:45.083356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:45.092965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b128110e3c7f4e2bb93292b8a6f0ea8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:45.094630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b128110e3c7f4e2bb93292b8a6f0ea8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:45.113010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b128110e3c7f4e2bb93292b8a6f0ea8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:45.114295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b128110e3c7f4e2bb93292b8a6f0ea8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:45.149905 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2758/5529] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:02:44 2022] DELETE /identity/v3/users/b128110e3c7f4e2bb93292b8a6f0ea8b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:46.651073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:46.654669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:46.736952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:46.739706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:46.828393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03a912-130e-451f-a807-05d0972adcb9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:46.931948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:46.932647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:46.932939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:46.933222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:46.936114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:46.970977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:47.054533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db3f1-04f4-4976-b24b-513ec8e6ad56 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:47.059815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:47.062043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:47.072784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:47.074397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:47.075138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:47.076418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:47.077991 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2772/5530] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:02:47.087647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:47.131876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:47.134801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:47.163174 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2759/5531] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:02:47.436286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:47.437848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:47.549513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5568e-aaee-4055-986d-9097a26eadc9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:47.554558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:47.556163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:47.556926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:47.557444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:47.559909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:47.587299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:47.590146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:47.606239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2773/5532] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:47.729434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:47.731111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:47.921244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:47.937549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452c621-e65f-4709-ac05-019bfca931fb service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:47.942903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec1abc-99bd-4012-8cb6-f2f18d005615 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:47.971226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bb6db-1425-4b32-ad57-5d1523941029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:47.972462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bb6db-1425-4b32-ad57-5d1523941029 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:47.973695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bb6db-1425-4b32-ad57-5d1523941029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:47.974827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bb6db-1425-4b32-ad57-5d1523941029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:47.979773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:47.981048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a0bb6db-1425-4b32-ad57-5d1523941029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:47.982814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:47.985456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:47.986676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] PATH_INFO: `/v3/projects/b9ea059a2cd047c0b59f066f38b01d27` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:47.989973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ea059a2cd047c0b59f066f38b01d27)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:47.992965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:48.033539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bb6db-1425-4b32-ad57-5d1523941029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:48.038040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bb6db-1425-4b32-ad57-5d1523941029 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:48.086910 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2774/5533] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:48.153654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ea059a2cd047c0b59f066f38b01d27', 'request_id': 'req-b40fb388-85aa-4afc-93a6-964dc7816416'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:48.174710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ea059a2cd047c0b59f066f38b01d27', 'request_id': 'req-b40fb388-85aa-4afc-93a6-964dc7816416'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:48.184595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ea059a2cd047c0b59f066f38b01d27', 'request_id': 'req-b40fb388-85aa-4afc-93a6-964dc7816416'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:48.217402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] The token cache is being invalidate because project b9ea059a2cd047c0b59f066f38b01d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:48.219706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:48.222869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b40fb388-85aa-4afc-93a6-964dc7816416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:48.225955 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2760/5534] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:47 2022] DELETE /identity/v3/projects/b9ea059a2cd047c0b59f066f38b01d27 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:02:48.231707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78983-ae85-4fcc-8ea6-ad3de7a84099 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:48.232463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78983-ae85-4fcc-8ea6-ad3de7a84099 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:48.232755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78983-ae85-4fcc-8ea6-ad3de7a84099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:48.284662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-faa78983-ae85-4fcc-8ea6-ad3de7a84099 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:48.295901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-faa78983-ae85-4fcc-8ea6-ad3de7a84099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:48.536498 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2775/5535] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:48.538336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646289f-e267-4dd2-8937-423cdbaa2d78 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:48.538672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646289f-e267-4dd2-8937-423cdbaa2d78 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:48.538968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646289f-e267-4dd2-8937-423cdbaa2d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:48.599802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3646289f-e267-4dd2-8937-423cdbaa2d78 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:48.601721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3646289f-e267-4dd2-8937-423cdbaa2d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:48.633560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2761/5536] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:48.640008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa78983-ae85-4fcc-8ea6-ad3de7a84099 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:48.657832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa78983-ae85-4fcc-8ea6-ad3de7a84099 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:48.679450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:48.680324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:48.680723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:48.681112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:48.682003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:48.693392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:48.701593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:48.733291 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2776/5537] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:02:48.735117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646289f-e267-4dd2-8937-423cdbaa2d78 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:48.740298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:48.746045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646289f-e267-4dd2-8937-423cdbaa2d78 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:48.761393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:48.762440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:48.762937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:48.763476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:48.764365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:48.768469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:48.836737 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2762/5538] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:48 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:48.843502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:48.861120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba5030-bc48-4f03-99f8-e542d03c6b92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:48.962986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:49.056061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:49.056833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:49.057171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:49.057511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:49.058268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:49.071070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:49.142493 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2777/5539] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:48 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:49.146502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:49.170906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257eeb8-e2d7-4830-ad19-2eaac2a1a4b4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:49.188316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:49.189394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:49.189848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:49.190292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:49.191248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:49.194987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:49.225193 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2763/5540] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:49.229392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:49.250619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54222-6716-4f5c-b586-4e3c32b1a716 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:49.264212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:49.265209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:49.265669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:49.266142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:49.267448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:49.269496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:49.284408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:49.286743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:49.309447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cd3db-da81-4a32-a73c-910fea84e779 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:49.310729 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2778/5541] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:02:49.314901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:49.323102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:49.324420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:49.325125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:49.325652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] PATH_INFO: `/v3/users/006d1750d84f4e1b872190e207a60e9c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:49.331929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006d1750d84f4e1b872190e207a60e9c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:49.334664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:49.345748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa5d8-e898-45b9-81fd-bc2ddd2960ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:49.372249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34368f-c01d-4a7b-ad20-c8ca17be38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:49.373992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34368f-c01d-4a7b-ad20-c8ca17be38e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:49.373992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34368f-c01d-4a7b-ad20-c8ca17be38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:49.374302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34368f-c01d-4a7b-ad20-c8ca17be38e5 admin admin] PATH_INFO: `/v3/projects/e83a2d7967344e64aac0c62b4e1f3d94/users/515dbc74a0544243bba03ae2974c218c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:49.422130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34368f-c01d-4a7b-ad20-c8ca17be38e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83a2d7967344e64aac0c62b4e1f3d94, user_id=515dbc74a0544243bba03ae2974c218c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:49.425535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34368f-c01d-4a7b-ad20-c8ca17be38e5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:49.446875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006d1750d84f4e1b872190e207a60e9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:49.455706 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2779/5542] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:49 2022] PUT /identity/v3/projects/e83a2d7967344e64aac0c62b4e1f3d94/users/515dbc74a0544243bba03ae2974c218c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:02:49.461227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354819-05c6-465d-b702-995963d565b4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:49.461518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354819-05c6-465d-b702-995963d565b4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:49.461832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354819-05c6-465d-b702-995963d565b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:49.496281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006d1750d84f4e1b872190e207a60e9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:49.499503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006d1750d84f4e1b872190e207a60e9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:49.520274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3354819-05c6-465d-b702-995963d565b4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:49.521576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3354819-05c6-465d-b702-995963d565b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:49.522380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006d1750d84f4e1b872190e207a60e9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:49.524660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f7c1a70-30b1-4f34-ab39-4ea03d877751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006d1750d84f4e1b872190e207a60e9c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:49.576949 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2764/5543] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:02:49 2022] DELETE /identity/v3/users/006d1750d84f4e1b872190e207a60e9c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:49.584032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:49.584634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:49.585253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:49.637023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:49.641440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:49.708906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2780/5544] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:49.838762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3354819-05c6-465d-b702-995963d565b4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:49.841057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3354819-05c6-465d-b702-995963d565b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:49.864669 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2765/5545] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:49.896723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:49.898247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:50.021196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:50.051037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96819f43-d6af-4965-92ec-944e8cb14182 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:50.055856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:50.056618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:50.056918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:50.057206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:50.082983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:50.084565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:50.092472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3354819-05c6-465d-b702-995963d565b4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:50.111876 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2766/5546] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:02:50.112618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:50.113324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:50.113617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:50.113902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:50.165184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:50.166950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:50.208474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2781/5547] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:02:51.932870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:51.936788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:51.994083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e543a66-056e-4474-90d4-400c260d0916 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:52.022135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:52.023466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:52.023935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:52.024406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] PATH_INFO: `/v3/projects/50338e2edfbb4b3cb741f1f63aa112e6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:52.045206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50338e2edfbb4b3cb741f1f63aa112e6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:52.060822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:52.259578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50338e2edfbb4b3cb741f1f63aa112e6', 'request_id': 'req-09363af8-447a-4c23-9d37-f9b6ead87f1b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.301887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50338e2edfbb4b3cb741f1f63aa112e6', 'request_id': 'req-09363af8-447a-4c23-9d37-f9b6ead87f1b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.320341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50338e2edfbb4b3cb741f1f63aa112e6', 'request_id': 'req-09363af8-447a-4c23-9d37-f9b6ead87f1b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.365659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] The token cache is being invalidate because project 50338e2edfbb4b3cb741f1f63aa112e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:52.366124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.367031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.369559 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2767/5548] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:51 2022] DELETE /identity/v3/projects/50338e2edfbb4b3cb741f1f63aa112e6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:52.374804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:52.405422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae6a21-41f5-41a7-8763-1902810edf10 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:52.574115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:52.712368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:52.716318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:52.717236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:52.718722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] PATH_INFO: `/v3/users/b3c3b4266cb54b62a6c7433d04f10410` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:52.722939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c3b4266cb54b62a6c7433d04f10410)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:52.724918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:52.864214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c3b4266cb54b62a6c7433d04f10410'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.904534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c3b4266cb54b62a6c7433d04f10410'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.948201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c3b4266cb54b62a6c7433d04f10410'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:52.951410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c3b4266cb54b62a6c7433d04f10410'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:53.033319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d7dccea-05a6-49ee-9d39-aadbef926ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c3b4266cb54b62a6c7433d04f10410'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:53.062185 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2782/5549] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:02:52 2022] DELETE /identity/v3/users/b3c3b4266cb54b62a6c7433d04f10410 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:54.931009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:54.934293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:54.959814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363af8-447a-4c23-9d37-f9b6ead87f1b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:55.051119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:55.052549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:55.053109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:55.053787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] PATH_INFO: `/v3/projects/e41b4e0f36794217ac13f0604ee3c7b7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:55.055560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41b4e0f36794217ac13f0604ee3c7b7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:55.058054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:55.174481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41b4e0f36794217ac13f0604ee3c7b7', 'request_id': 'req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:55.187142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41b4e0f36794217ac13f0604ee3c7b7', 'request_id': 'req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:55.197863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41b4e0f36794217ac13f0604ee3c7b7', 'request_id': 'req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:55.209085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:55.215813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] The token cache is being invalidate because project e41b4e0f36794217ac13f0604ee3c7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:02:55.217599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:55.219870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e941ce09-2daa-4de0-b5e5-a2a119fc3f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:02:55.226505 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2768/5550] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:02:54 2022] DELETE /identity/v3/projects/e41b4e0f36794217ac13f0604ee3c7b7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:55.233525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6536e9-bbfa-4bd1-aab5-e47625e24bac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:55.234404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6536e9-bbfa-4bd1-aab5-e47625e24bac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:55.234890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6536e9-bbfa-4bd1-aab5-e47625e24bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:55.332879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b6536e9-bbfa-4bd1-aab5-e47625e24bac None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:55.335354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b6536e9-bbfa-4bd1-aab5-e47625e24bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:55.533326 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2783/5551] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:55.541686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69754e-bffb-4c80-8f5e-3d51b7642e7e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:55.541993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69754e-bffb-4c80-8f5e-3d51b7642e7e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:55.542307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69754e-bffb-4c80-8f5e-3d51b7642e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:55.563498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5c69754e-bffb-4c80-8f5e-3d51b7642e7e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:55.564134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c69754e-bffb-4c80-8f5e-3d51b7642e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:55.578233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6536e9-bbfa-4bd1-aab5-e47625e24bac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:55.583313 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2769/5552] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:55.589874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6536e9-bbfa-4bd1-aab5-e47625e24bac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:55.597465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:55.598219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:55.598513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:55.598985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:55.600644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:55.601040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:55.603320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:55.634580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69754e-bffb-4c80-8f5e-3d51b7642e7e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:55.647882 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2784/5553] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:02:55.648211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69754e-bffb-4c80-8f5e-3d51b7642e7e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:55.657647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:55.658693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:55.659316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:55.659768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:55.660987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:55.663371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:55.708465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:55.719851 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2770/5554] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:55 2022] POST /identity/v3/projects => generated 357 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:02:55.725165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe65f-81d6-4665-b4d9-e29cd522effc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:55.810560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:55.897206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:55.898884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:55.899701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:55.900670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:55.902226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:55.914937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:55.986682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2785/5555] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:55 2022] POST /identity/v3/users => generated 279 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:55.991321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.007691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f276bb-b9ee-4664-9cf1-887fa8eb6545 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:56.017338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:56.018980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.020148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.020671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.021708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:56.023699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:56.041721 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2771/5556] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:56.043060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.059497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace42ad5-b007-48d9-b307-87eeaa2569da admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:56.066070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783054b-74d0-4398-86e8-9b8cda5ade16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:56.067416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783054b-74d0-4398-86e8-9b8cda5ade16 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.067897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783054b-74d0-4398-86e8-9b8cda5ade16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.068350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783054b-74d0-4398-86e8-9b8cda5ade16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.069556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783054b-74d0-4398-86e8-9b8cda5ade16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:56.071888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783054b-74d0-4398-86e8-9b8cda5ade16 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:56.096983 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2786/5557] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:56.098327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.112486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2189-2c98-42f1-8abd-8d17f58c0fd1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:56.118865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:56.120382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.120889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.121390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] PATH_INFO: `/v3/projects/be5bd4f3088341d9985b4d4710fd289a/users/1ff808e4d52d47c484f252e5f7b1d8c9/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.143191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5bd4f3088341d9985b4d4710fd289a, user_id=1ff808e4d52d47c484f252e5f7b1d8c9, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:56.146326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:56.174275 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2772/5558] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:56 2022] PUT /identity/v3/projects/be5bd4f3088341d9985b4d4710fd289a/users/1ff808e4d52d47c484f252e5f7b1d8c9/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:02:56.196296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9442-68df-4629-b039-6ca35b3b9a5b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.196645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9442-68df-4629-b039-6ca35b3b9a5b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.197131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9442-68df-4629-b039-6ca35b3b9a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.255609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-502e9442-68df-4629-b039-6ca35b3b9a5b None None] MFA Rules not processed for user `1ff808e4d52d47c484f252e5f7b1d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:56.257862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-502e9442-68df-4629-b039-6ca35b3b9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:56.365737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.373233 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2787/5559] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:56 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:02:56.487028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e398c-8baf-4fcd-b6d9-84a4600d56a3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:56.492915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:56.493629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.493926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.494209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.495118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:56.497318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:56.538982 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2773/5560] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:56 2022] POST /identity/v3/projects => generated 357 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:56.543572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e9442-68df-4629-b039-6ca35b3b9a5b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.557002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e9442-68df-4629-b039-6ca35b3b9a5b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:56.634370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:56.635431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.635873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.636841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.637036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:56.639638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:56.677805 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2788/5561] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:02:56 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:02:56.681824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.697095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4be2-7572-4534-9b73-6122cfbde026 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:56.703787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:56.704654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.704950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.705281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.706217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:56.708439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:56.749494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.761558 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2774/5562] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:02:56.764922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89353cb9-f8bf-43cf-9ca5-b0d4f7973e7c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:56.770847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:56.774871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:56.775094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:56.775586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] PATH_INFO: `/v3/projects/ea22a12ff4a848139ab442a78d1920e4/users/f7bcb11cee724815af34bc850b317c90/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:56.825171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea22a12ff4a848139ab442a78d1920e4, user_id=f7bcb11cee724815af34bc850b317c90, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:56.829055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:56.858515 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2789/5563] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:56 2022] PUT /identity/v3/projects/ea22a12ff4a848139ab442a78d1920e4/users/f7bcb11cee724815af34bc850b317c90/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:56.860010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:56.883645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6f3c9-9a36-4096-a180-33218b51e39b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:57.123141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d227e-fbdb-4f30-ae1a-023e4125f764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:57.124227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d227e-fbdb-4f30-ae1a-023e4125f764 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:57.124227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d227e-fbdb-4f30-ae1a-023e4125f764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:57.124579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d227e-fbdb-4f30-ae1a-023e4125f764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:57.125332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d227e-fbdb-4f30-ae1a-023e4125f764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:57.127060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d227e-fbdb-4f30-ae1a-023e4125f764 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:57.178078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2775/5564] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:02:57.188094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:57.214546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:57.230254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282f0f-996f-4d75-a27a-66dcdc0741e1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:57.252620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:57.253566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:57.253851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:57.254190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] PATH_INFO: `/v3/projects/ea22a12ff4a848139ab442a78d1920e4/users/f7bcb11cee724815af34bc850b317c90/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:57.261462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea22a12ff4a848139ab442a78d1920e4, user_id=f7bcb11cee724815af34bc850b317c90, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:57.272272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:57.300953 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2790/5565] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:02:57 2022] PUT /identity/v3/projects/ea22a12ff4a848139ab442a78d1920e4/users/f7bcb11cee724815af34bc850b317c90/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:02:57.320223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982d11-3d29-42b9-b082-0e02b7a59741 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:57.320802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982d11-3d29-42b9-b082-0e02b7a59741 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:57.321151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982d11-3d29-42b9-b082-0e02b7a59741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:57.329430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:57.360943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6d982d11-3d29-42b9-b082-0e02b7a59741 None None] MFA Rules not processed for user `f7bcb11cee724815af34bc850b317c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:02:57.362373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d982d11-3d29-42b9-b082-0e02b7a59741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:57.543666 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2776/5566] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:02:57.556172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:57.617499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164fd0-50c0-4e45-b728-968bc1f5949d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:57.643967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7bcb11cee724815af34bc850b317c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea22a12ff4a848139ab442a78d1920e4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:57.645472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:57.647738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:57.650286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:57.655230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:57.655697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:57.660617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:57.746912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2791/5567] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:02:57.748844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d982d11-3d29-42b9-b082-0e02b7a59741 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:57.799391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d982d11-3d29-42b9-b082-0e02b7a59741 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:57.835582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7bcb11cee724815af34bc850b317c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea22a12ff4a848139ab442a78d1920e4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:57.841007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:57.841801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:57.860838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:57.864836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:57.872134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:58.033867 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2777/5568] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:02:57 2022] POST /identity/v3/projects => generated 350 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:02:58.036557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:58.068700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2788-8a25-4f6f-837f-2b36308e5b0d tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:58.314433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7bcb11cee724815af34bc850b317c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea22a12ff4a848139ab442a78d1920e4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:58.316269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:58.317231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:58.317789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:58.319299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:02:58.319865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:58.322446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:58.353140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2792/5569] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:02:58.462254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:02:58.466699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:02:58.735244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12098920-7c00-45c9-8d2d-6a57f3f1ea1a tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:02:58.752442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ef10e-5996-4098-b9b3-8a9bd226734f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:02:58.754135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ef10e-5996-4098-b9b3-8a9bd226734f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:02:58.754893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ef10e-5996-4098-b9b3-8a9bd226734f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:02:58.755645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ef10e-5996-4098-b9b3-8a9bd226734f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:02:58.830046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ef10e-5996-4098-b9b3-8a9bd226734f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:02:58.843783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ef10e-5996-4098-b9b3-8a9bd226734f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:02:58.930828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2778/5570] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:02:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:03:01.297959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:01.321310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831435-0215-43c2-949c-7046da591fdb tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:01.348609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7bcb11cee724815af34bc850b317c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea22a12ff4a848139ab442a78d1920e4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:01.349729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:01.350179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:01.351963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] PATH_INFO: `/v3/projects/19f96bfac5614cadb1a5fb47d007c9c9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:01.355074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19f96bfac5614cadb1a5fb47d007c9c9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:01.359189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:01.663251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f96bfac5614cadb1a5fb47d007c9c9', 'request_id': 'req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:01.679342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f96bfac5614cadb1a5fb47d007c9c9', 'request_id': 'req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:01.718829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f96bfac5614cadb1a5fb47d007c9c9', 'request_id': 'req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:01.796733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] The token cache is being invalidate because project 19f96bfac5614cadb1a5fb47d007c9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:03:01.797343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:01.800696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:01.803809 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2793/5571] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:03:01 2022] DELETE /identity/v3/projects/19f96bfac5614cadb1a5fb47d007c9c9 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:03:02.140655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9fbc9-6e72-4d2c-8275-25e8db015be7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:02.141627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9fbc9-6e72-4d2c-8275-25e8db015be7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:02.142110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9fbc9-6e72-4d2c-8275-25e8db015be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:02.176224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c5f9fbc9-6e72-4d2c-8275-25e8db015be7 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:02.184493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5f9fbc9-6e72-4d2c-8275-25e8db015be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:02.355212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:02.406798 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2779/5572] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:03:02.435468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:02.437801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:02.553294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:02.620939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fbb9c-1a6b-4b5d-8132-910c32ca1cc4 tempest-QuotasTest-1897749511 tempest-QuotasTest-1897749511-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:02.636468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:02.641312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:02.642500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:02.643562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:02.683478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:02.690636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:02.728758 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2794/5573] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:03:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:03.047623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbd40-65f2-45f0-9e94-0d985e9ac994 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:03.047946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbd40-65f2-45f0-9e94-0d985e9ac994 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:03.048189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbd40-65f2-45f0-9e94-0d985e9ac994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:03.147965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0cadbd40-65f2-45f0-9e94-0d985e9ac994 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:03.153234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0cadbd40-65f2-45f0-9e94-0d985e9ac994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:03.218775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2780/5574] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:03:03.236802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:03.269968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa322-7863-4b24-a262-6d43845db966 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:03.284541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:03.285244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:03.285532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:03.285815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:03.309427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:03.311760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:03.338623 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2795/5575] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:03:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:07.233466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45718f37-a30e-4220-a9e2-d2b65a02cc0b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:07.234061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45718f37-a30e-4220-a9e2-d2b65a02cc0b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:07.234591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45718f37-a30e-4220-a9e2-d2b65a02cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:07.281063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-45718f37-a30e-4220-a9e2-d2b65a02cc0b None None] MFA Rules not processed for user `520cc191a5b24d52b73ad4c0c5d4e9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:07.283093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-45718f37-a30e-4220-a9e2-d2b65a02cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:07.292564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:07.296557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:07.397669 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2781/5576] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:07.785576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57563127-f536-49b6-be22-75bae1f666f1 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:07.815358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:07.816339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:07.816620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:07.817174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] PATH_INFO: `/v3/users/1ff808e4d52d47c484f252e5f7b1d8c9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:07.825163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff808e4d52d47c484f252e5f7b1d8c9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:07.845397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:08.062586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff808e4d52d47c484f252e5f7b1d8c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:08.116749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff808e4d52d47c484f252e5f7b1d8c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:08.155620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff808e4d52d47c484f252e5f7b1d8c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:08.157019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff808e4d52d47c484f252e5f7b1d8c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:08.185786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff808e4d52d47c484f252e5f7b1d8c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:08.217080 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2796/5577] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:03:07 2022] DELETE /identity/v3/users/1ff808e4d52d47c484f252e5f7b1d8c9 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:08.223743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:08.224132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:08.224558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:08.290244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:08.292842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:08.628913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2782/5578] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:09.084554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:09.089630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:09.255491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a11e5f-44ab-47fe-ad13-b11460146140 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:09.281076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:09.283071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:09.283503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:09.283888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:09.305316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:09.322757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:09.334564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:09.385566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2797/5579] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:03:12.787628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:12.789490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:13.076991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6cf7c-d449-4528-9525-cbddd948a778 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:13.098270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:13.098977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:13.099304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:13.099547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:13.102109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:13.145868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:13.156752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:13.218477 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2783/5580] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:03:13.867338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:13.870395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:13.971827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31348-73a2-4946-a620-61fa039ef511 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:14.002833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:14.005376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:14.007887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:14.009986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] PATH_INFO: `/v3/projects/be5bd4f3088341d9985b4d4710fd289a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:14.015752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5bd4f3088341d9985b4d4710fd289a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:14.077101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:14.297192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5bd4f3088341d9985b4d4710fd289a', 'request_id': 'req-2e0423d6-bde4-462c-a702-2194cc240fd5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.311999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5bd4f3088341d9985b4d4710fd289a', 'request_id': 'req-2e0423d6-bde4-462c-a702-2194cc240fd5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.327023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5bd4f3088341d9985b4d4710fd289a', 'request_id': 'req-2e0423d6-bde4-462c-a702-2194cc240fd5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.385392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] The token cache is being invalidate because project be5bd4f3088341d9985b4d4710fd289a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:03:14.385934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.395591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.412427 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2798/5581] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:03:13 2022] DELETE /identity/v3/projects/be5bd4f3088341d9985b4d4710fd289a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:14.420306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:14.473162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2aae-608a-40d2-b776-ab60d09bce77 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:14.505600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:14.643541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:14.644820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:14.645318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:14.647881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] PATH_INFO: `/v3/users/f7bcb11cee724815af34bc850b317c90` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:14.653966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bcb11cee724815af34bc850b317c90)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:14.662296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:14.828012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bcb11cee724815af34bc850b317c90'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.856104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bcb11cee724815af34bc850b317c90'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.857011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bcb11cee724815af34bc850b317c90'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.889786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bcb11cee724815af34bc850b317c90'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.890592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8916444-ca17-45a1-be6b-ca9065bbc1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bcb11cee724815af34bc850b317c90'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:14.917913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2784/5582] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:03:14 2022] DELETE /identity/v3/users/f7bcb11cee724815af34bc850b317c90 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:18.301680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:18.304614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:18.336154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0423d6-bde4-462c-a702-2194cc240fd5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:18.489930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:18.491424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:18.492510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:18.494614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] PATH_INFO: `/v3/projects/ea22a12ff4a848139ab442a78d1920e4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:18.500712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea22a12ff4a848139ab442a78d1920e4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:18.506289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:18.655055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea22a12ff4a848139ab442a78d1920e4', 'request_id': 'req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:18.692055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea22a12ff4a848139ab442a78d1920e4', 'request_id': 'req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:18.712630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea22a12ff4a848139ab442a78d1920e4', 'request_id': 'req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:18.764447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] The token cache is being invalidate because project ea22a12ff4a848139ab442a78d1920e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:03:18.764721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:18.765440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-edcd8a3d-c102-43d7-9a61-d61a01b2e79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:18.778855 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2799/5583] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:03:18 2022] DELETE /identity/v3/projects/ea22a12ff4a848139ab442a78d1920e4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:18.780816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737489-c4fe-467e-937b-f216f2ee1a07 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:18.781342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737489-c4fe-467e-937b-f216f2ee1a07 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:18.781428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737489-c4fe-467e-937b-f216f2ee1a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:18.893588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d5737489-c4fe-467e-937b-f216f2ee1a07 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:18.896742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d5737489-c4fe-467e-937b-f216f2ee1a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:19.128538 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2785/5584] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:19.152076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b62d3-61d4-4c93-8882-e9e8fcd09f14 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:19.152891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b62d3-61d4-4c93-8882-e9e8fcd09f14 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:19.154069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b62d3-61d4-4c93-8882-e9e8fcd09f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:19.250730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:19.292744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d98b62d3-61d4-4c93-8882-e9e8fcd09f14 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:19.297281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d98b62d3-61d4-4c93-8882-e9e8fcd09f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:19.350567 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2800/5585] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:19.355361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737489-c4fe-467e-937b-f216f2ee1a07 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:19.378835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737489-c4fe-467e-937b-f216f2ee1a07 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:19.417052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:19.417905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:19.424865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:19.425151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:19.426003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:03:19.426323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:19.428153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:19.494326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2786/5586] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:03:19.496115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b62d3-61d4-4c93-8882-e9e8fcd09f14 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:19.534529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b62d3-61d4-4c93-8882-e9e8fcd09f14 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:19.541542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:19.542573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:19.543059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:19.544205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:19.545574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:19.551021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:19.693639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2801/5587] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:03:19 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:03:19.698513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:19.716016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b921079-e965-4545-870b-2a0b74c9644b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:19.783371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:19.835438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:19.838684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:19.913268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:19.915298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:19.915601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:19.919730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:19.922452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:19.930520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:20.006991 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2787/5588] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:03:19 2022] POST /identity/v3/users => generated 286 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:03:20.009180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:20.059089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45d83-2a42-4233-ba34-e45c4db87e1d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:20.086468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:20.088061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:20.092645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:20.093422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:20.095383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:20.105507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:20.221788 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2788/5589] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:03:20.229066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:20.263402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be1c4-c294-40be-98e2-572ce59e44ed admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:20.277734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbc50-7ce1-4705-9c2c-af67fa887d8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:20.279510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbc50-7ce1-4705-9c2c-af67fa887d8e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:20.280919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbc50-7ce1-4705-9c2c-af67fa887d8e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:20.281568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbc50-7ce1-4705-9c2c-af67fa887d8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:20.284941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07472b80-17ad-461c-a2e9-f700bff2a84a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:20.285688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b35fbc50-7ce1-4705-9c2c-af67fa887d8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:20.311141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:20.313604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:20.313954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:20.314258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:20.318396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:20.330027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:20.342173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fbc50-7ce1-4705-9c2c-af67fa887d8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:20.346385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fbc50-7ce1-4705-9c2c-af67fa887d8e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:20.384009 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2789/5590] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:03:20.388034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:20.410920 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2802/5591] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:03:20.426074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3d824-afee-428d-a0fd-47b338f7e585 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:20.456961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:20.461905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:20.462229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:20.462493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] PATH_INFO: `/v3/projects/ba94ac0e43594ff4857c9c07f45ee75b/users/1407591403fd4497ac13ed22bef567e1/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:20.526472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba94ac0e43594ff4857c9c07f45ee75b, user_id=1407591403fd4497ac13ed22bef567e1, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:20.537869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:20.608361 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2790/5592] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:03:20 2022] PUT /identity/v3/projects/ba94ac0e43594ff4857c9c07f45ee75b/users/1407591403fd4497ac13ed22bef567e1/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:20.624509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7df-2bfd-49d5-b26a-063f86e27cda None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:20.627053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7df-2bfd-49d5-b26a-063f86e27cda None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:20.627919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7df-2bfd-49d5-b26a-063f86e27cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:20.740184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ad48c7df-2bfd-49d5-b26a-063f86e27cda None None] MFA Rules not processed for user `1407591403fd4497ac13ed22bef567e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:20.745239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad48c7df-2bfd-49d5-b26a-063f86e27cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:21.062887 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2803/5593] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:21.115981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:21.120591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:21.500215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373be1b-b98e-42de-a07e-ed83044e95f3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:21.507900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:21.509402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:21.510095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:21.510653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:21.546903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:21.548654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:21.604654 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2791/5594] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:03:25.051227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf491-49b8-4b23-930f-40c414a94acd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:25.052287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf491-49b8-4b23-930f-40c414a94acd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:25.052827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf491-49b8-4b23-930f-40c414a94acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:25.160383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-848bf491-49b8-4b23-930f-40c414a94acd None None] MFA Rules not processed for user `515dbc74a0544243bba03ae2974c218c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:25.163708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-848bf491-49b8-4b23-930f-40c414a94acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:25.364487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:25.486249 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2804/5595] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:25.491636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:25.493202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:25.740605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b255-c999-4e8b-8d17-36ce20457f88 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:25.756635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:25.758845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:25.759414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:25.759877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:25.760852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:25.763899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:25.789595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:25.837324 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2792/5596] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:03:25 2022] POST /identity/v3/projects => generated 379 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:03:25.842625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf491-49b8-4b23-930f-40c414a94acd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:25.861070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf491-49b8-4b23-930f-40c414a94acd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:26.019640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:26.020418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:26.021387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:26.021740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:26.022479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:26.025457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:26.119347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:26.127815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2805/5597] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:03:25 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:03:26.147073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5458a-35f8-466a-a9fe-b159db1f275e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:26.176141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:26.179943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:26.181864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:26.183816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:26.207316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:26.235205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:26.285968 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2793/5598] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:03:26.289500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:26.336358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5127-a616-49e7-8141-f0881ee158ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:26.361528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:26.363852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:26.364997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:26.365977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] PATH_INFO: `/v3/projects/eb2fce848197475b8396271aed9a664b/users/3116fb08842f484fa9490b20962917f8/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:26.483068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2fce848197475b8396271aed9a664b, user_id=3116fb08842f484fa9490b20962917f8, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:26.494178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:26.603981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2806/5599] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:03:26 2022] PUT /identity/v3/projects/eb2fce848197475b8396271aed9a664b/users/3116fb08842f484fa9490b20962917f8/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:26.612174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:26.661037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc41134-e794-454c-90a0-7bfe0359d9c9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:26.831228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:26.831996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:26.832368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:26.832658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:26.833418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:26.837353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:26.853378 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2794/5600] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:03:26.857688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:26.880562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a4dd-8643-4e8d-b3c4-51ce978ef58a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:26.900013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377a378-7f78-499d-bba6-420f33e4cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:26.904718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377a378-7f78-499d-bba6-420f33e4cfdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:26.905178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377a378-7f78-499d-bba6-420f33e4cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:26.907064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377a378-7f78-499d-bba6-420f33e4cfdf admin admin] PATH_INFO: `/v3/projects/eb2fce848197475b8396271aed9a664b/users/3116fb08842f484fa9490b20962917f8/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:26.921690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377a378-7f78-499d-bba6-420f33e4cfdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2fce848197475b8396271aed9a664b, user_id=3116fb08842f484fa9490b20962917f8, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:26.940684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377a378-7f78-499d-bba6-420f33e4cfdf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:26.980445 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2807/5601] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:03:26 2022] PUT /identity/v3/projects/eb2fce848197475b8396271aed9a664b/users/3116fb08842f484fa9490b20962917f8/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:30.868912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:30.888811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:30.993308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1611f9-9dd8-40bf-9e96-b093351f0e44 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:31.385184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:31.386940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:31.387571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:31.388045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] PATH_INFO: `/v3/users/3447d58457ea4481932fe7284de47a2d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:31.391505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3447d58457ea4481932fe7284de47a2d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:31.397516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:31.621006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3447d58457ea4481932fe7284de47a2d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:31.666476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3447d58457ea4481932fe7284de47a2d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:31.669351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3447d58457ea4481932fe7284de47a2d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:31.687422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3447d58457ea4481932fe7284de47a2d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:31.688664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3447d58457ea4481932fe7284de47a2d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:31.692978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:31.726756 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2795/5602] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:03:30 2022] DELETE /identity/v3/users/3447d58457ea4481932fe7284de47a2d => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:31.729803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:31.738671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:31.739969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:31.807719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:31.824825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:32.103692 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2808/5603] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:32.232829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:32.238009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:32.579639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dcaf8-6bf3-4c83-a344-717a95934fe2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:32.596618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:32.597906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:32.601078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:32.601602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:32.644619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:32.649937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:32.677433 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2796/5604] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:03:34.079231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:34.082809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:34.116727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701b03-0bb4-4048-9b5b-8513e39f2d7a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:34.125939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:34.127418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:34.127787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:34.128284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] PATH_INFO: `/v3/projects/2a7b6676d96646db83dce13331e32c64` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:34.130150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7b6676d96646db83dce13331e32c64)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:34.136276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:34.235772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:34.252247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7b6676d96646db83dce13331e32c64', 'request_id': 'req-0d950450-6d42-46b2-9dd2-99a6afadf72c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.268271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7b6676d96646db83dce13331e32c64', 'request_id': 'req-0d950450-6d42-46b2-9dd2-99a6afadf72c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.277389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7b6676d96646db83dce13331e32c64', 'request_id': 'req-0d950450-6d42-46b2-9dd2-99a6afadf72c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.302192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] The token cache is being invalidate because project 2a7b6676d96646db83dce13331e32c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:03:34.303409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.304581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.306963 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2809/5605] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:03:34 2022] DELETE /identity/v3/projects/2a7b6676d96646db83dce13331e32c64 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:34.313379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:34.333449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b06fae-6820-4257-918c-ce00b47770b6 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:34.601281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:34.606668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:34.607206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:34.607761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] PATH_INFO: `/v3/users/97a8457e503141799ff10bc7e9263417` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:34.616212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a8457e503141799ff10bc7e9263417)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:34.625640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:34.857753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a8457e503141799ff10bc7e9263417'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.921279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a8457e503141799ff10bc7e9263417'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.924780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a8457e503141799ff10bc7e9263417'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.966286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a8457e503141799ff10bc7e9263417'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:34.970945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fc79f404-cd82-4f4b-a833-f952cedc54c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a8457e503141799ff10bc7e9263417'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:35.007238 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2797/5606] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:03:34 2022] DELETE /identity/v3/users/97a8457e503141799ff10bc7e9263417 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:37.035488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:37.038751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:37.083726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950450-6d42-46b2-9dd2-99a6afadf72c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:37.282725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:37.283851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:37.284249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:37.284609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] PATH_INFO: `/v3/projects/21462d1cc49b44a59f4115198e57717d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:37.288191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21462d1cc49b44a59f4115198e57717d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:37.289439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:37.400204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21462d1cc49b44a59f4115198e57717d', 'request_id': 'req-7f065222-2e3b-484b-ae87-42583d3fb6c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:37.420113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21462d1cc49b44a59f4115198e57717d', 'request_id': 'req-7f065222-2e3b-484b-ae87-42583d3fb6c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:37.436626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21462d1cc49b44a59f4115198e57717d', 'request_id': 'req-7f065222-2e3b-484b-ae87-42583d3fb6c9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:37.478220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] The token cache is being invalidate because project 21462d1cc49b44a59f4115198e57717d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:03:37.478753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:37.481903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f065222-2e3b-484b-ae87-42583d3fb6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:03:37.486678 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2810/5607] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:03:37 2022] DELETE /identity/v3/projects/21462d1cc49b44a59f4115198e57717d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:03:37.502234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dc8db-1df4-4255-92f9-633f016c160a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:37.502748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dc8db-1df4-4255-92f9-633f016c160a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:37.503242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dc8db-1df4-4255-92f9-633f016c160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:37.591208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:37.604217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cc7dc8db-1df4-4255-92f9-633f016c160a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:37.608365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc7dc8db-1df4-4255-92f9-633f016c160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:37.766233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a16bea-bc4c-421e-b6bb-32605ee0e6ce None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:37.766749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a16bea-bc4c-421e-b6bb-32605ee0e6ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:37.767365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a16bea-bc4c-421e-b6bb-32605ee0e6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:37.775850 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2798/5608] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:03:37.792193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a7a16bea-bc4c-421e-b6bb-32605ee0e6ce None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:37.794085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7a16bea-bc4c-421e-b6bb-32605ee0e6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:37.813182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dc8db-1df4-4255-92f9-633f016c160a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:37.822388 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2811/5609] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:37.827912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dc8db-1df4-4255-92f9-633f016c160a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:37.836395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:37.837518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:37.838004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:37.838550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:37.839929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:03:37.840553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:37.843683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:37.874848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a16bea-bc4c-421e-b6bb-32605ee0e6ce None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:37.882139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2799/5610] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:03:37.888846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a16bea-bc4c-421e-b6bb-32605ee0e6ce None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:37.896243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:37.897363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:37.898239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:37.898715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:37.900149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:37.902828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:37.951122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:37.959048 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2812/5611] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:03:37 2022] POST /identity/v3/projects => generated 397 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:03:37.964971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df397da-79d5-4075-81d4-9c6ac3e60211 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:38.132447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:38.134432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:38.137531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:38.138433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:38.140629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:38.143834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:38.199127 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2800/5612] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:03:37 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:03:38.203476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:38.219517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c43e2-1537-4777-ac52-b488cb69cf2e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:38.232797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:38.233547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:38.233833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:38.234107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:38.235083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:38.243336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:38.288922 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2813/5613] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:03:38.293618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:38.316062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655865b-3264-4c85-af09-f24bcadbe983 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:38.325753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b7877-db2f-49da-9680-c3f25714795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:38.325952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7877-db2f-49da-9680-c3f25714795f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:38.327111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7877-db2f-49da-9680-c3f25714795f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:38.328761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7877-db2f-49da-9680-c3f25714795f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:38.343348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b7877-db2f-49da-9680-c3f25714795f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:38.343348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b7877-db2f-49da-9680-c3f25714795f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:38.389166 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2801/5614] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:03:38.393893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:38.409771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bbd58-d034-4d83-a842-bc5aadef1d2e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:38.446702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:38.449015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:38.449957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:38.450479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] PATH_INFO: `/v3/projects/13cdc2c2b85842e387fbfd35f4dc1d2a/users/6b8781e0fef04a40a80199b79bdc242a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:38.497556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:38.533119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cdc2c2b85842e387fbfd35f4dc1d2a, user_id=6b8781e0fef04a40a80199b79bdc242a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:38.535986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:38.573229 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2814/5615] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:03:38 2022] PUT /identity/v3/projects/13cdc2c2b85842e387fbfd35f4dc1d2a/users/6b8781e0fef04a40a80199b79bdc242a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:03:38.596685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62f76-5c86-4d48-a9b4-59608d197586 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:38.602032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62f76-5c86-4d48-a9b4-59608d197586 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:38.602642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62f76-5c86-4d48-a9b4-59608d197586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:38.697001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-40d62f76-5c86-4d48-a9b4-59608d197586 None None] MFA Rules not processed for user `6b8781e0fef04a40a80199b79bdc242a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:38.700062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-40d62f76-5c86-4d48-a9b4-59608d197586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:38.935489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2802/5616] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:38.970967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:38.973466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:39.197689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08344b-af65-46a7-b3b7-a316a431e119 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:39.208691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:39.210121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:39.210740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:39.211755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:39.277202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:39.281895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:39.305354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2815/5617] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:03:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:03:45.301278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed706b9-a7b6-4767-9332-37944031cb09 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:45.301855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed706b9-a7b6-4767-9332-37944031cb09 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:45.302183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed706b9-a7b6-4767-9332-37944031cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:45.341729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:45.405885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fed706b9-a7b6-4767-9332-37944031cb09 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:45.410699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fed706b9-a7b6-4767-9332-37944031cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:45.670866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2803/5618] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:45.703406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:45.705316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:45.881071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0789-40cf-4777-8f7a-d6b09520fbdc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:45.891250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:45.891990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:45.892307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:45.892634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:45.913342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:45.915208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:45.938403 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2816/5619] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:55.657481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=27 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:55.823989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:55.825030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:55.825762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:55.933884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:55.938081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] MFA Rules not processed for user `3116fb08842f484fa9490b20962917f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:03:55.950059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:56.352059 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2804/5620] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:03:56.375235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:03:56.378091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:56.582661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe9807-2252-4253-a544-850a9b002bff service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:03:56.591965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:03:56.592698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:03:56.592993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:03:56.593280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:03:56.605470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:03:56.774328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:03:56.776250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:03:56.799025 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2817/5621] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:06.331515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=34 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:06.784231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=52 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:13.684179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:13.686883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:14.212280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e750cf-158c-4f68-aabe-10aad65b70ca None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:14.264529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4828c3-fcdf-4e5b-b9dc-cf22170372c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:14.266270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4828c3-fcdf-4e5b-b9dc-cf22170372c6 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:14.266926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4828c3-fcdf-4e5b-b9dc-cf22170372c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:14.268217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4828c3-fcdf-4e5b-b9dc-cf22170372c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:14.289685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b4828c3-fcdf-4e5b-b9dc-cf22170372c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:14.599803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4828c3-fcdf-4e5b-b9dc-cf22170372c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:14.602591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4828c3-fcdf-4e5b-b9dc-cf22170372c6 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:14.646960 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2805/5622] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 964 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:16.616988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:16.649703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b89a38-3089-4ebf-8657-3468f1318de7 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:16.677314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:16.678544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:16.680412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:16.682502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:16.700506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:16.992370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:16.994140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:17.009300 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2818/5623] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 15:04:16 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:24.630004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=70 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:27.003429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=28 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:28.035743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:28.036512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:28.036887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:28.166751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:04:28.169651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:28.201003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2806/5624] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:04:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:04:28.259066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:28.284701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0c11-290b-421d-bab3-d39193eaafc2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:28.301115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:28.301817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:28.302106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:28.302392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:28.325045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:28.330289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:28.355543 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2819/5625] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:04:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:33.428416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:33.432945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:33.508755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:33.512107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:33.531391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf2e3-6dce-4fb6-8f2a-3bce6089c7b4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:33.559116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:33.561009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:33.561767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:33.567886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:33.581136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:33.622382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:33.629376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:33.679816 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2807/5626] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:33.752123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c02d8-4481-4ab7-b1f1-948f28ef21ae service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:33.772078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:33.773073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:33.776030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:33.778305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:33.784384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:33.837106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:33.876333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:33.942996 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2820/5627] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:04:34.276886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:34.307900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e663cf-c830-4486-80bf-6908c00bbe6d service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:34.333176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae5fa4-8cba-48a0-90d1-b1d3ee9a7625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:34.335216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5fa4-8cba-48a0-90d1-b1d3ee9a7625 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:34.340144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5fa4-8cba-48a0-90d1-b1d3ee9a7625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:34.340551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5fa4-8cba-48a0-90d1-b1d3ee9a7625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:34.346284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d9ae5fa4-8cba-48a0-90d1-b1d3ee9a7625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:34.674514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae5fa4-8cba-48a0-90d1-b1d3ee9a7625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:34.676138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae5fa4-8cba-48a0-90d1-b1d3ee9a7625 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:34.720111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2808/5628] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:42.619262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:42.636373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761de90-7dd2-44ee-9a52-b1dcd62bf600 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:42.652248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:42.653356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:42.658693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:42.659255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] PATH_INFO: `/v3/users/6b8781e0fef04a40a80199b79bdc242a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:42.662112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8781e0fef04a40a80199b79bdc242a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:42.664497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:42.789865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8781e0fef04a40a80199b79bdc242a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:42.817696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8781e0fef04a40a80199b79bdc242a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:42.842989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8781e0fef04a40a80199b79bdc242a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:42.844072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8781e0fef04a40a80199b79bdc242a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:42.857520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8781e0fef04a40a80199b79bdc242a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:42.868835 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2821/5629] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:04:42 2022] DELETE /identity/v3/users/6b8781e0fef04a40a80199b79bdc242a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:04:42.873703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:42.874226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:42.874310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:42.905853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:04:42.906988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:43.000133 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2809/5630] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:04:43.056934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:43.059216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:43.214858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:43.218115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a0539-c985-4be9-bc62-56916e44dfd5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:43.226932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444c73a-ef98-4737-968c-63afa21eed93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:43.227909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444c73a-ef98-4737-968c-63afa21eed93 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:43.228444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444c73a-ef98-4737-968c-63afa21eed93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:43.230281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444c73a-ef98-4737-968c-63afa21eed93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:43.251206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444c73a-ef98-4737-968c-63afa21eed93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:43.252776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444c73a-ef98-4737-968c-63afa21eed93 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:43.267206 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2822/5631] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:04:46.414024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:46.415915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:46.444077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75147cb2-8dd8-4479-833b-bbcb3fadd172 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:46.462748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:46.468691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:46.468995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:46.469286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] PATH_INFO: `/v3/projects/13cdc2c2b85842e387fbfd35f4dc1d2a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:46.482177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cdc2c2b85842e387fbfd35f4dc1d2a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:46.482177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:46.598348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cdc2c2b85842e387fbfd35f4dc1d2a', 'request_id': 'req-4de403d7-042e-4acf-baf7-122d85d5dc27'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:46.614481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cdc2c2b85842e387fbfd35f4dc1d2a', 'request_id': 'req-4de403d7-042e-4acf-baf7-122d85d5dc27'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:46.633253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cdc2c2b85842e387fbfd35f4dc1d2a', 'request_id': 'req-4de403d7-042e-4acf-baf7-122d85d5dc27'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:46.639106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:46.659333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] The token cache is being invalidate because project 13cdc2c2b85842e387fbfd35f4dc1d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:04:46.659989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:46.661486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4de403d7-042e-4acf-baf7-122d85d5dc27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:46.666952 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2810/5632] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:04:46 2022] DELETE /identity/v3/projects/13cdc2c2b85842e387fbfd35f4dc1d2a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:04:46.673932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc6b9c-a2b3-4ff2-879b-7f0f1fd08c41 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:46.675167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc6b9c-a2b3-4ff2-879b-7f0f1fd08c41 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:46.675648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc6b9c-a2b3-4ff2-879b-7f0f1fd08c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:46.853509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-01bc6b9c-a2b3-4ff2-879b-7f0f1fd08c41 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:04:46.875676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01bc6b9c-a2b3-4ff2-879b-7f0f1fd08c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:47.039716 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2823/5633] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:04:47.049153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85432f8-4fed-4c78-8b3f-ec31549a1b0b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.049484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85432f8-4fed-4c78-8b3f-ec31549a1b0b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.049773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85432f8-4fed-4c78-8b3f-ec31549a1b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.086687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d85432f8-4fed-4c78-8b3f-ec31549a1b0b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:04:47.088067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d85432f8-4fed-4c78-8b3f-ec31549a1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:47.106893 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2811/5634] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:04:47.111526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc6b9c-a2b3-4ff2-879b-7f0f1fd08c41 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:47.124163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc6b9c-a2b3-4ff2-879b-7f0f1fd08c41 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:47.130165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:47.131156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.134612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.134612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.134612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:04:47.134612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:47.136646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:47.155905 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2824/5635] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:04:47.160175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85432f8-4fed-4c78-8b3f-ec31549a1b0b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:47.174062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85432f8-4fed-4c78-8b3f-ec31549a1b0b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:47.180337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:47.181305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.181800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.182267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.183660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:47.186027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:47.254708 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2812/5636] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:04:47 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:04:47.268808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:47.287147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc468-6adb-41dc-bb32-7478db1c4866 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:47.458921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:47.461133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.461133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.461133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.461654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:47.467766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:47.510632 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2825/5637] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:04:47 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:04:47.514470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:47.535233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c460f21-64c5-4964-94dc-563cfe1be146 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:47.546726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:47.553361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.553708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.554435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.555483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:47.559062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:47.592611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:47.602959 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2813/5638] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:04:47.615094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e29276-ead0-45eb-a2d8-22db6271232d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:47.633073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817fc9c-d16d-4f7d-80a9-93a791d07a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:47.633950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817fc9c-d16d-4f7d-80a9-93a791d07a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.635773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817fc9c-d16d-4f7d-80a9-93a791d07a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.638601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817fc9c-d16d-4f7d-80a9-93a791d07a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.639655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817fc9c-d16d-4f7d-80a9-93a791d07a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:47.641768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817fc9c-d16d-4f7d-80a9-93a791d07a26 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:47.697165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2826/5639] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:04:47.698987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:47.725828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe10c4-7be5-4dce-9e14-5483da936aa8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:47.737620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:47.742068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.744110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.744957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] PATH_INFO: `/v3/projects/255b47dfc3f14689baa7648c0042db12/users/fbdd481439bb44f387a928492c309ad5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.813867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=255b47dfc3f14689baa7648c0042db12, user_id=fbdd481439bb44f387a928492c309ad5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:47.826226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:47.865845 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2814/5640] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:04:47 2022] PUT /identity/v3/projects/255b47dfc3f14689baa7648c0042db12/users/fbdd481439bb44f387a928492c309ad5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:04:47.876576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:47.876907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:47.877278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:47.973003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] MFA Rules not processed for user `fbdd481439bb44f387a928492c309ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:04:47.985130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:48.095414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:48.180561 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2827/5641] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:04:48.240125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:48.242334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:48.460425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf57b-2ff9-4e75-ade6-c60ccb1258bb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:48.471418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:48.471418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:48.471418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:48.472002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:48.488331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:48.489387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:48.506573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2815/5642] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:54.050755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:54.054911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:54.118667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1d07-8900-4b7f-a96b-6e7af307fdb5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:54.131251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:54.143878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:54.144764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:54.145469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:54.151958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:54.362136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:54.365970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:54.389534 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2828/5643] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:58.342753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:58.345100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:58.373510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15df858-cc5b-4a21-a2bc-99728dfaa1d7 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:58.385461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:58.388843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:58.391014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:58.391909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] PATH_INFO: `/v3/users/520cc191a5b24d52b73ad4c0c5d4e9a6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:58.399924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=520cc191a5b24d52b73ad4c0c5d4e9a6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:58.403143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:58.547707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520cc191a5b24d52b73ad4c0c5d4e9a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:58.580303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520cc191a5b24d52b73ad4c0c5d4e9a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:58.582468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520cc191a5b24d52b73ad4c0c5d4e9a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:58.604231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520cc191a5b24d52b73ad4c0c5d4e9a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:58.605336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520cc191a5b24d52b73ad4c0c5d4e9a6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:04:58.640052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:58.650377 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2816/5644] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:04:58 2022] DELETE /identity/v3/users/520cc191a5b24d52b73ad4c0c5d4e9a6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:04:59.084169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:59.114603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee447c-9e88-47ac-bdff-c1b899ee1066 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:04:59.385469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fc13b-838c-4b0d-bf4e-01429d20d684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:04:59.386719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc13b-838c-4b0d-bf4e-01429d20d684 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:04:59.387176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc13b-838c-4b0d-bf4e-01429d20d684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:04:59.387701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc13b-838c-4b0d-bf4e-01429d20d684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:04:59.393163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b0fc13b-838c-4b0d-bf4e-01429d20d684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:04:59.719035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fc13b-838c-4b0d-bf4e-01429d20d684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:04:59.722362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fc13b-838c-4b0d-bf4e-01429d20d684 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:04:59.787338 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2829/5645] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:04:59 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:04:59.871115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:04:59.872870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:00.060544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d888fca-f0a5-45f3-84e1-09d48031d3ee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:00.073391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:00.076674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:00.077766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:00.079544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] PATH_INFO: `/v3/projects/b25ee6783ea3416dbef5c8ae62244367` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:00.083941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25ee6783ea3416dbef5c8ae62244367)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:00.091500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:00.212675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25ee6783ea3416dbef5c8ae62244367', 'request_id': 'req-3e68cb97-cd57-4a1d-9756-8f5979b7587b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:00.240040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25ee6783ea3416dbef5c8ae62244367', 'request_id': 'req-3e68cb97-cd57-4a1d-9756-8f5979b7587b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:00.262879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25ee6783ea3416dbef5c8ae62244367', 'request_id': 'req-3e68cb97-cd57-4a1d-9756-8f5979b7587b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:00.280995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] The token cache is being invalidate because project b25ee6783ea3416dbef5c8ae62244367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:05:00.281297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:00.282746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e68cb97-cd57-4a1d-9756-8f5979b7587b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:00.285782 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2817/5646] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:04:59 2022] DELETE /identity/v3/projects/b25ee6783ea3416dbef5c8ae62244367 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:00.292351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefad9-37b6-4291-a937-2a844f49c3d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:00.298847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefad9-37b6-4291-a937-2a844f49c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:00.299727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefad9-37b6-4291-a937-2a844f49c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:00.361025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13cefad9-37b6-4291-a937-2a844f49c3d7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:00.363920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13cefad9-37b6-4291-a937-2a844f49c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:00.384516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:00.512110 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2830/5647] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:00.526822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053bff6-36ac-44a8-bb2c-84cadf923f80 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:00.527132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053bff6-36ac-44a8-bb2c-84cadf923f80 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:00.527540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053bff6-36ac-44a8-bb2c-84cadf923f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:00.568553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5053bff6-36ac-44a8-bb2c-84cadf923f80 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:00.570098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5053bff6-36ac-44a8-bb2c-84cadf923f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:00.597071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2818/5648] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:00.603351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefad9-37b6-4291-a937-2a844f49c3d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:00.618998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefad9-37b6-4291-a937-2a844f49c3d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:00.624789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:00.625692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:00.626091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:00.626476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:00.627511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:05:00.627938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:00.629823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:00.645125 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2831/5649] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:05:00.651245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053bff6-36ac-44a8-bb2c-84cadf923f80 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:00.669148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053bff6-36ac-44a8-bb2c-84cadf923f80 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:00.684256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:00.685148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:00.685574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:00.685961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:00.687348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:00.689625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:00.758555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2819/5650] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:05:00 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:00.765140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:00.783966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfbfc2-1f25-4a91-804c-1c4666767b36 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:00.956459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:00.958171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:00.958779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:00.959464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:00.960400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:00.966979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:01.019151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2832/5651] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:05:00 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:01.024666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:01.043975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba27fd-e6ce-4c86-bbbc-01f9bd86e050 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:01.055653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:01.056829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:01.057541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:01.058265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:01.059213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:01.063379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:01.083876 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2820/5652] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:01.087621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:01.113133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9652ae1-431f-4e9d-82c6-3ba61cec09fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:01.119488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2e82-95f0-4a2a-be06-9d0201a9aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:01.122544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2e82-95f0-4a2a-be06-9d0201a9aba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:01.125241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2e82-95f0-4a2a-be06-9d0201a9aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:01.135404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2e82-95f0-4a2a-be06-9d0201a9aba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:01.139376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2e82-95f0-4a2a-be06-9d0201a9aba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:01.148388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2e82-95f0-4a2a-be06-9d0201a9aba7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:01.188074 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2833/5653] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:01.193443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:01.255542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef13c5-8d1f-4a97-9954-8a29cc6060ff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:01.280253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:01.282509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:01.283886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:01.287861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] PATH_INFO: `/v3/projects/faa511d1382c4963adb7977038e4be1b/users/2e8db41673814667bd60069370262487/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:01.368635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa511d1382c4963adb7977038e4be1b, user_id=2e8db41673814667bd60069370262487, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:01.382987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:01.450318 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2821/5654] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:05:01 2022] PUT /identity/v3/projects/faa511d1382c4963adb7977038e4be1b/users/2e8db41673814667bd60069370262487/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:01.458688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:01.459629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:01.460298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:01.505781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:01.508358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:01.798693 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2834/5655] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:01.899924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:01.912345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:02.122022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:02.226383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dd159-96e7-4490-97c4-cebc89f763a0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:02.249178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18853fa-92f1-4e26-998b-9599d255807f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:02.249894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18853fa-92f1-4e26-998b-9599d255807f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:02.250185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18853fa-92f1-4e26-998b-9599d255807f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:02.250471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18853fa-92f1-4e26-998b-9599d255807f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:02.305380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18853fa-92f1-4e26-998b-9599d255807f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:02.309944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18853fa-92f1-4e26-998b-9599d255807f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:02.346686 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2822/5656] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:08.842997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:08.845519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:08.872902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6e1a-ca5a-47de-bf4b-92f170412aa3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:08.879333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:08.880504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:08.880985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:08.881568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:08.883904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:08.905513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:08.907437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:08.937956 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2835/5657] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:12.328118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=14 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:14.403466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa11626-408c-44a1-84db-aec557a9f26a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:14.404574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa11626-408c-44a1-84db-aec557a9f26a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:14.404574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa11626-408c-44a1-84db-aec557a9f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:14.447944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bfa11626-408c-44a1-84db-aec557a9f26a None None] MFA Rules not processed for user `515dbc74a0544243bba03ae2974c218c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:14.450181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bfa11626-408c-44a1-84db-aec557a9f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:14.579327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:14.581572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:14.594009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:14.606102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f708-00e5-4ced-b7cd-a9ec7274b3aa service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:14.622242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:14.623592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:14.623887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:14.624168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] PATH_INFO: `/v3/users/3917b3597a134b8aa6b02fdad1cb67aa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:14.626634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3917b3597a134b8aa6b02fdad1cb67aa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:14.633285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:14.663122 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2823/5658] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:14.684772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c203-fe13-46e4-a681-9ef601734f37 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:14.685318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c203-fe13-46e4-a681-9ef601734f37 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:14.685830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c203-fe13-46e4-a681-9ef601734f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:14.727943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0114c203-fe13-46e4-a681-9ef601734f37 None None] MFA Rules not processed for user `515dbc74a0544243bba03ae2974c218c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:14.732819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0114c203-fe13-46e4-a681-9ef601734f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:14.769407 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2824/5659] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:14.856821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3917b3597a134b8aa6b02fdad1cb67aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:14.923647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3917b3597a134b8aa6b02fdad1cb67aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:14.965009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3917b3597a134b8aa6b02fdad1cb67aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:14.967171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3917b3597a134b8aa6b02fdad1cb67aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:14.986796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3917b3597a134b8aa6b02fdad1cb67aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:15.054343 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2836/5660] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:05:14 2022] DELETE /identity/v3/users/3917b3597a134b8aa6b02fdad1cb67aa => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:15.057776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:15.058486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:15.059168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:15.103039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:15.105945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:15.313415 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2825/5661] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:15.349184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:15.353043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:15.593755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c51288-7761-4cb6-a9c2-c7f78b542a6b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:15.608518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:15.610905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:15.612608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:15.613361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:15.633461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:15.637277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:15.660221 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2837/5662] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:16.919530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:16.922710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:16.957530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9352a-f39e-443a-8ff9-f79cb5130d36 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:16.972375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:16.973088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:16.973380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:16.974292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:16.981323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:17.020017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:17.028401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:17.064529 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2826/5663] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:17.124402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:17.130385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:17.166779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8f16a-8c83-4d23-bb36-6f5c7e2f9404 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:17.178226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:17.180382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:17.180929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:17.181937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] PATH_INFO: `/v3/users/c1a4b4998ca6479f85adc2b9c65e1e06` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:17.185937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a4b4998ca6479f85adc2b9c65e1e06)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:17.190158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:17.356552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a4b4998ca6479f85adc2b9c65e1e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.428755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a4b4998ca6479f85adc2b9c65e1e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.446225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a4b4998ca6479f85adc2b9c65e1e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.447641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a4b4998ca6479f85adc2b9c65e1e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.450603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:17.461129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3295a8bf-41cd-4738-a0b3-56c1bbdbd683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a4b4998ca6479f85adc2b9c65e1e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.464910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:17.466372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:17.475488 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2838/5664] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:05:17 2022] DELETE /identity/v3/users/c1a4b4998ca6479f85adc2b9c65e1e06 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:17.501660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eadee-967f-4a01-9826-7feed09aea8c service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:17.601339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:17.603787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:17.604079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:17.604364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] PATH_INFO: `/v3/projects/be982066584d4efd889eba2dd065fa0a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:17.606007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be982066584d4efd889eba2dd065fa0a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:17.609832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:17.668719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:17.705642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be982066584d4efd889eba2dd065fa0a', 'request_id': 'req-cb54ca7a-6999-46af-bac9-c2b40208a264'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.718877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be982066584d4efd889eba2dd065fa0a', 'request_id': 'req-cb54ca7a-6999-46af-bac9-c2b40208a264'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.732010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be982066584d4efd889eba2dd065fa0a', 'request_id': 'req-cb54ca7a-6999-46af-bac9-c2b40208a264'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.749301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] The token cache is being invalidate because project be982066584d4efd889eba2dd065fa0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:05:17.749769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.750624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb54ca7a-6999-46af-bac9-c2b40208a264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:17.752930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2827/5665] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:05:17 2022] DELETE /identity/v3/projects/be982066584d4efd889eba2dd065fa0a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:17.758772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973c4c2-69e9-4d23-a277-3daf35109b64 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:17.760298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973c4c2-69e9-4d23-a277-3daf35109b64 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:17.761201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973c4c2-69e9-4d23-a277-3daf35109b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:17.819715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4973c4c2-69e9-4d23-a277-3daf35109b64 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:17.823215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4973c4c2-69e9-4d23-a277-3daf35109b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:18.123406 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2839/5666] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:18.125577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c950ef-3c81-44ca-99e3-4eb076fa28ba None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:18.125577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c950ef-3c81-44ca-99e3-4eb076fa28ba None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:18.126178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c950ef-3c81-44ca-99e3-4eb076fa28ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:18.164654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d1c950ef-3c81-44ca-99e3-4eb076fa28ba None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:18.167344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d1c950ef-3c81-44ca-99e3-4eb076fa28ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:18.195674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2828/5667] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:18.198018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973c4c2-69e9-4d23-a277-3daf35109b64 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:18.212808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973c4c2-69e9-4d23-a277-3daf35109b64 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:18.218453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:18.219557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:18.219795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:18.220232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:18.221036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:05:18.221361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:18.223170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:18.246124 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2840/5668] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:05:18.252069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c950ef-3c81-44ca-99e3-4eb076fa28ba None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:18.264553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c950ef-3c81-44ca-99e3-4eb076fa28ba None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:18.271445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:18.272319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:18.272613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:18.272897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:18.273645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:18.276758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:18.342232 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2829/5669] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:05:18 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:18.344117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:18.377064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825070d-a4b4-45b1-a3f0-fe2fff6540de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:18.604578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:18.608896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:18.614559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:18.615717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:18.618662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:18.625144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:18.767461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2841/5670] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:05:18 2022] POST /identity/v3/users => generated 287 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:18.769945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:18.785329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6aee7-1e99-42b0-89a5-61b016e2dff9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:18.791929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:18.793320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:18.793902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:18.794641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:18.796646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:18.799019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:18.824530 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2830/5671] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:18.825191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:18.857487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e091a-f8de-42e1-b22b-7f70fa3b9e56 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:18.871615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:18.873329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:18.874206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:18.876106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:18.878398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:18.883230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:18.898052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:18.904053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:18.977141 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2842/5672] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:18.980036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:18.982962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f20a28-af6c-4905-9ffd-8402ea0bbdfb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:19.008507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:19.016016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:19.016016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:19.016016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] PATH_INFO: `/v3/projects/c9a2c2bf376243c0ba8c572cc1bca54b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:19.023323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a2c2bf376243c0ba8c572cc1bca54b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:19.027764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa13b-c633-4ef1-aaa1-e80568ee5abd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:19.029515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:19.053365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd42ac-c847-4067-b328-e9e52c0db567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:19.058000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd42ac-c847-4067-b328-e9e52c0db567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:19.060646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd42ac-c847-4067-b328-e9e52c0db567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:19.061147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd42ac-c847-4067-b328-e9e52c0db567 admin admin] PATH_INFO: `/v3/projects/50b80679b2c74e01a6264b4dfd8fcdaa/users/4be017ecfa0c4ce1b5b3bc4c463b2fc7/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:19.122765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd42ac-c847-4067-b328-e9e52c0db567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b80679b2c74e01a6264b4dfd8fcdaa, user_id=4be017ecfa0c4ce1b5b3bc4c463b2fc7, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:19.138833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd42ac-c847-4067-b328-e9e52c0db567 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:19.193547 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2843/5673] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:05:18 2022] PUT /identity/v3/projects/50b80679b2c74e01a6264b4dfd8fcdaa/users/4be017ecfa0c4ce1b5b3bc4c463b2fc7/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:19.205600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:19.206567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:19.206567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:19.223518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'request_id': 'req-8333425b-ba50-4b88-8153-2add910630b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:19.269761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] MFA Rules not processed for user `4be017ecfa0c4ce1b5b3bc4c463b2fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:19.274064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'request_id': 'req-8333425b-ba50-4b88-8153-2add910630b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:19.275987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:19.302823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'request_id': 'req-8333425b-ba50-4b88-8153-2add910630b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:19.331813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] The token cache is being invalidate because project c9a2c2bf376243c0ba8c572cc1bca54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:05:19.332594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:19.336109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8333425b-ba50-4b88-8153-2add910630b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:19.339858 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2831/5674] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:05:18 2022] DELETE /identity/v3/projects/c9a2c2bf376243c0ba8c572cc1bca54b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:05:19.346512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119206d-20a1-4547-8a6a-c0f437356f41 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:19.347123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119206d-20a1-4547-8a6a-c0f437356f41 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:19.347661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119206d-20a1-4547-8a6a-c0f437356f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:19.353190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:19.450996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6119206d-20a1-4547-8a6a-c0f437356f41 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:19.463199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6119206d-20a1-4547-8a6a-c0f437356f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:19.545501 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2844/5675] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:19.565124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:19.566666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:19.714470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c36ed-f3c8-4ed6-ba4c-723a1c179192 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:19.736869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:19.742533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:19.744818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:19.747883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:19.772776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:19.798796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:19.805264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:19.836063 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2832/5676] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:19.838578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067e925-c661-4de9-9f3c-f59c64f910c0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:19.839171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067e925-c661-4de9-9f3c-f59c64f910c0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:19.839641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067e925-c661-4de9-9f3c-f59c64f910c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:19.840121 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2845/5677] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:19.887488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e067e925-c661-4de9-9f3c-f59c64f910c0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:19.889859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e067e925-c661-4de9-9f3c-f59c64f910c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:19.919680 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2833/5678] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:19.927599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:19.961334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851136c-ca12-4245-96c6-7f44f181cca6 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:19.974109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:19.974826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:19.975535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:19.975839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:19.977769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:05:19.978340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:19.987355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:20.034763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2846/5679] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:05:20.036641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067e925-c661-4de9-9f3c-f59c64f910c0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:20.062108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067e925-c661-4de9-9f3c-f59c64f910c0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:20.087580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:20.088291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:20.088581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:20.088857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:20.089578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:20.091627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:20.191343 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2834/5680] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:05:20 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:20.196036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:20.232731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36800-e01e-4d84-9372-6636c1d4a66f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:20.454454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:20.456624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:20.464240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:20.466171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:20.471705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:20.474908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:20.518607 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2847/5681] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:05:20 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:05:20.522529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:20.550333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8469fc1-edb6-49e0-a61f-506f9e465f86 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:20.559802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:20.560531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:20.560827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:20.561373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:20.561868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:20.563678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:20.595217 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2835/5682] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:05:20.599573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:20.615166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c5f0-4e87-42f3-b9fb-dbad5f22560c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:20.628926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed4d1-fc6b-48bd-a987-2e6942b9821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:20.634421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed4d1-fc6b-48bd-a987-2e6942b9821e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:20.634991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed4d1-fc6b-48bd-a987-2e6942b9821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:20.635500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed4d1-fc6b-48bd-a987-2e6942b9821e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:20.636476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed4d1-fc6b-48bd-a987-2e6942b9821e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:20.649300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed4d1-fc6b-48bd-a987-2e6942b9821e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:20.673033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:20.673781 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2848/5683] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:20.686147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44741c2-8b8f-48a6-b9ae-dff0e1a954d6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:20.702143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:20.703494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:20.703956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:20.705243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] PATH_INFO: `/v3/projects/372f6de6cedf4012bf645d6a7dfa978f/users/d13c64c24a39498bab01318fdf97c595/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:20.754503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=372f6de6cedf4012bf645d6a7dfa978f, user_id=d13c64c24a39498bab01318fdf97c595, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:20.764232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:20.842288 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2836/5684] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:05:20 2022] PUT /identity/v3/projects/372f6de6cedf4012bf645d6a7dfa978f/users/d13c64c24a39498bab01318fdf97c595/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:20.844360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5634789-914c-4b50-9024-9b474602e608 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:20.846121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5634789-914c-4b50-9024-9b474602e608 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:20.846121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5634789-914c-4b50-9024-9b474602e608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:20.939167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b5634789-914c-4b50-9024-9b474602e608 None None] MFA Rules not processed for user `d13c64c24a39498bab01318fdf97c595`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:20.946896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b5634789-914c-4b50-9024-9b474602e608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:21.036088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:21.184483 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2849/5685] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:21.207319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:21.210210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:21.589442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba18e3-4bd9-4d7c-ba31-8898d18ca3be admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:21.602515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ffd5d-46e4-40ec-87bc-06bf2f632e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:21.605459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ffd5d-46e4-40ec-87bc-06bf2f632e83 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:21.606245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ffd5d-46e4-40ec-87bc-06bf2f632e83 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:21.607067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ffd5d-46e4-40ec-87bc-06bf2f632e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:21.629538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ffd5d-46e4-40ec-87bc-06bf2f632e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:21.634117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ffd5d-46e4-40ec-87bc-06bf2f632e83 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:21.682254 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2837/5686] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:21.778399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5634789-914c-4b50-9024-9b474602e608 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:21.979132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5634789-914c-4b50-9024-9b474602e608 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:21.992189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:21.995828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:22.009463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:22.010209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] PATH_INFO: `/v3/users/d13c64c24a39498bab01318fdf97c595` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:22.018141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13c64c24a39498bab01318fdf97c595)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:22.020968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:22.136310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13c64c24a39498bab01318fdf97c595'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:22.175436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13c64c24a39498bab01318fdf97c595'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:22.187951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13c64c24a39498bab01318fdf97c595'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:22.189268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13c64c24a39498bab01318fdf97c595'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:22.221155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13c64c24a39498bab01318fdf97c595'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:22.238165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2850/5687] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:05:21 2022] DELETE /identity/v3/users/d13c64c24a39498bab01318fdf97c595 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:22.240938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcd053-ea9d-446c-b8fd-ebf22298618a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:22.241881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcd053-ea9d-446c-b8fd-ebf22298618a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:22.242487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcd053-ea9d-446c-b8fd-ebf22298618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:22.293507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-79bcd053-ea9d-446c-b8fd-ebf22298618a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:22.298126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79bcd053-ea9d-446c-b8fd-ebf22298618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:22.527333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2838/5688] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:22.582692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:22.584615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:22.708932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:22.741680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caf2df-4198-4647-833f-6908de834c04 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:22.762447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78786fae-1c36-4765-8782-2b4ca2d6f6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:22.768307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786fae-1c36-4765-8782-2b4ca2d6f6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:22.770915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786fae-1c36-4765-8782-2b4ca2d6f6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:22.771329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786fae-1c36-4765-8782-2b4ca2d6f6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:22.808865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78786fae-1c36-4765-8782-2b4ca2d6f6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:22.810395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78786fae-1c36-4765-8782-2b4ca2d6f6f7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:22.847823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2851/5689] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:25.609190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:25.610950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:25.611992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:25.721527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:25.744376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] MFA Rules not processed for user `2e8db41673814667bd60069370262487`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:25.745666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:26.065511 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2839/5690] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:26.097347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:26.099008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:26.105013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:26.223681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:26.225182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:26.248795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] MFA Rules not processed for user `2e8db41673814667bd60069370262487`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:26.255982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:26.257815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaef21-353f-437d-a981-6b125501ecbc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:26.270749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:26.271687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:26.271980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:26.272350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] PATH_INFO: `/v3/projects/372f6de6cedf4012bf645d6a7dfa978f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:26.273705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=372f6de6cedf4012bf645d6a7dfa978f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:26.276396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:26.293155 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2852/5691] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:26.310147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:26.312341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:26.398557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372f6de6cedf4012bf645d6a7dfa978f', 'request_id': 'req-4b058e1f-f520-49b7-b4bb-c2c85180e95e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:26.426462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372f6de6cedf4012bf645d6a7dfa978f', 'request_id': 'req-4b058e1f-f520-49b7-b4bb-c2c85180e95e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:26.440534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372f6de6cedf4012bf645d6a7dfa978f', 'request_id': 'req-4b058e1f-f520-49b7-b4bb-c2c85180e95e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:26.467761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] The token cache is being invalidate because project 372f6de6cedf4012bf645d6a7dfa978f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:05:26.468154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:26.469024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4b058e1f-f520-49b7-b4bb-c2c85180e95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:26.475028 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2840/5692] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:05:26 2022] DELETE /identity/v3/projects/372f6de6cedf4012bf645d6a7dfa978f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:05:26.476918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae6bc-81d4-4c76-87e8-8b752eeaa627 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:26.477302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae6bc-81d4-4c76-87e8-8b752eeaa627 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:26.477513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae6bc-81d4-4c76-87e8-8b752eeaa627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:26.522631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cfeae6bc-81d4-4c76-87e8-8b752eeaa627 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:26.523873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cfeae6bc-81d4-4c76-87e8-8b752eeaa627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:26.563093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c89a2-06e7-48ff-a2be-fddc32c77d31 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:26.689519 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2841/5693] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:26.699195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbda21b-891a-448b-99c5-e1cfb032d4d1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:26.699534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbda21b-891a-448b-99c5-e1cfb032d4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:26.700054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbda21b-891a-448b-99c5-e1cfb032d4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:26.713784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:26.714628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:26.715015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:26.715449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:26.725364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:26.744747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8fbda21b-891a-448b-99c5-e1cfb032d4d1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:26.746305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8fbda21b-891a-448b-99c5-e1cfb032d4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:26.783230 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2842/5694] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:26.784880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbda21b-891a-448b-99c5-e1cfb032d4d1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:26.807750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbda21b-891a-448b-99c5-e1cfb032d4d1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:26.826166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:26.826773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:26.827066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:26.827381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:26.828160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:05:26.828772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:26.830354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:26.866858 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2843/5695] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:05:26.872017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:26.907843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3976954-5d6f-4d40-8375-28ff2d0491e2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:26.921743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:26.922931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:26.922931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:26.923135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:26.925996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:26.930808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:26.961962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:27.019109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2844/5696] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:05:26 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:05:27.025715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:27.054477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:27.065673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:27.139222 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2853/5697] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:05:27.195967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00b6e4-2928-4572-b548-c97ba48607a5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:27.198355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:27.202840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:27.212218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:27.212989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:27.213280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:27.213567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:27.214298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:27.216387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:27.279726 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2845/5698] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:05:27 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:27.281544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:27.315762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31600-8465-442d-b9af-49e7b9841154 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:27.338393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:27.340110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:27.346366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:27.347581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:27.349868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:27.351798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:27.356952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:27.411885 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2846/5699] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:27.435708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:27.523508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f18cf-78fc-45e1-a0e8-a5450fff4a91 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:27.544755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:27.547756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:27.548214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:27.548570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:27.550207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:27.551996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:27.553257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680220d7-88d0-46d0-ad28-e7c075f5774b service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:27.585021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2847/5700] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:27.585997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:27.592844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:27.685014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4265bc-e5f7-47e7-8100-9b7b929ea479 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:27.701642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:27.705629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:27.706477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:27.707344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] PATH_INFO: `/v3/users/4813aa5acf744a8dac42de00d7e5a519` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:27.711387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4813aa5acf744a8dac42de00d7e5a519)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:27.716310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:27.717102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:27.718926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:27.719192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:27.722964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:27.727099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:27.917593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4813aa5acf744a8dac42de00d7e5a519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:28.008526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4813aa5acf744a8dac42de00d7e5a519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:28.016645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4813aa5acf744a8dac42de00d7e5a519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:28.074940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4813aa5acf744a8dac42de00d7e5a519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:28.078420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4cd3dc47-3dd0-43c2-bb31-e45867a25573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4813aa5acf744a8dac42de00d7e5a519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:28.107019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:28.108585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:28.141295 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2848/5701] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:05:27 2022] DELETE /identity/v3/users/4813aa5acf744a8dac42de00d7e5a519 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:28.142117 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2854/5702] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 946 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:05:28.142969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:28.162773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84723a5-a237-4a99-bc99-fa919eff4c84 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:28.331899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:28.332748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:28.333036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:28.333317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] PATH_INFO: `/v3/projects/afb7993cc24b45ed889b0b3bf490ac35/users/84dbbbf486c1479b899e3db5eb61f126/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:28.375393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:28.379692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb7993cc24b45ed889b0b3bf490ac35, user_id=84dbbbf486c1479b899e3db5eb61f126, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:28.382616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:28.414441 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2855/5703] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:05:28 2022] PUT /identity/v3/projects/afb7993cc24b45ed889b0b3bf490ac35/users/84dbbbf486c1479b899e3db5eb61f126/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:28.437920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b5d0-9fa5-434b-9218-5f1456c4ace2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:28.441703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b5d0-9fa5-434b-9218-5f1456c4ace2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:28.446268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790b5d0-9fa5-434b-9218-5f1456c4ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:28.539070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5790b5d0-9fa5-434b-9218-5f1456c4ace2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:28.541555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5790b5d0-9fa5-434b-9218-5f1456c4ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:28.584714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:28.731347 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2849/5704] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:28.738010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:28.740673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:28.897825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657d24f-e981-49ae-8389-b857274f0d7b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:28.905865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:28.906569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:28.906854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:28.907136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:28.963348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:28.964901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:29.012148 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2856/5705] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:29.427883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790b5d0-9fa5-434b-9218-5f1456c4ace2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:29.495855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790b5d0-9fa5-434b-9218-5f1456c4ace2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:29.512720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:29.518353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:29.519068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:29.519613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:29.526904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:29.867578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:29.872405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:29.893154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2850/5706] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:30.028868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:30.031396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:30.069812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee4252-a77b-4dc4-8d5c-fabcba563aca service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:30.077860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e9848-f1bc-48d4-b546-4a5803440973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:30.078745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e9848-f1bc-48d4-b546-4a5803440973 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:30.079125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e9848-f1bc-48d4-b546-4a5803440973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:30.079494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e9848-f1bc-48d4-b546-4a5803440973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:30.081976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-846e9848-f1bc-48d4-b546-4a5803440973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:30.095970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:30.098006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:30.117506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e9848-f1bc-48d4-b546-4a5803440973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:30.121758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e9848-f1bc-48d4-b546-4a5803440973 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:30.159753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337ce1-c915-46da-b6b7-aeae5b80aca2 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:30.164411 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2857/5707] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:30.184944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:30.185939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:30.186223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:30.186509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] PATH_INFO: `/v3/projects/95bb8113735e4903aa5919ec567b0b5c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:30.191814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95bb8113735e4903aa5919ec567b0b5c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:30.192551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:30.369415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95bb8113735e4903aa5919ec567b0b5c', 'request_id': 'req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:30.400665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95bb8113735e4903aa5919ec567b0b5c', 'request_id': 'req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:30.411953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95bb8113735e4903aa5919ec567b0b5c', 'request_id': 'req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:30.459436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] The token cache is being invalidate because project 95bb8113735e4903aa5919ec567b0b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:05:30.459783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:30.463169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f6c477a-fed1-4e95-bb2b-3d78d3e42019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:30.467874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2851/5708] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:05:30 2022] DELETE /identity/v3/projects/95bb8113735e4903aa5919ec567b0b5c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:30.473204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0ec4-3d33-4140-bb26-08063ff18d3b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:30.473506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0ec4-3d33-4140-bb26-08063ff18d3b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:30.473788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0ec4-3d33-4140-bb26-08063ff18d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:30.517171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bfca0ec4-3d33-4140-bb26-08063ff18d3b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:30.530713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bfca0ec4-3d33-4140-bb26-08063ff18d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:30.732142 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2858/5709] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:30.741131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5667ac-5fb4-44dd-afd4-a8a3313c6a57 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:30.741422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5667ac-5fb4-44dd-afd4-a8a3313c6a57 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:30.741900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5667ac-5fb4-44dd-afd4-a8a3313c6a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:30.825133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7e5667ac-5fb4-44dd-afd4-a8a3313c6a57 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:30.831690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e5667ac-5fb4-44dd-afd4-a8a3313c6a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:30.869697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0ec4-3d33-4140-bb26-08063ff18d3b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:30.894617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2852/5710] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:30.915603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0ec4-3d33-4140-bb26-08063ff18d3b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:30.957452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:30.974006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:30.974403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:30.974699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:30.977536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:05:30.977877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:30.987462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:31.034750 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2859/5711] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:05:31.040491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5667ac-5fb4-44dd-afd4-a8a3313c6a57 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:31.077008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5667ac-5fb4-44dd-afd4-a8a3313c6a57 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:31.104365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:31.104835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:31.105130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:31.113392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:31.118582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:31.133888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:31.266202 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2853/5712] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:05:31 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:05:31.268894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:31.323111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678a2b8-26dd-448a-a948-f42cbd31f30d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:31.543166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:31.546933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:31.547527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:31.553869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:31.558977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:31.573722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:31.627333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:31.639573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2860/5713] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:05:31 2022] POST /identity/v3/users => generated 292 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:31.644146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:31.717587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:31.767476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533b401-156f-45c8-8436-27af9cb5640c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:31.810761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:31.812024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:31.834944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:31.835875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:31.837887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:31.844881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:31.923522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:31.930478 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2854/5714] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:31.941269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b610649-7a66-4a0a-b4e6-79766423f936 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:31.954946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503bdbd-8bb3-4cd1-9f4e-212f831eed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:31.955856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503bdbd-8bb3-4cd1-9f4e-212f831eed38 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:31.956175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503bdbd-8bb3-4cd1-9f4e-212f831eed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:31.956646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503bdbd-8bb3-4cd1-9f4e-212f831eed38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:31.961518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503bdbd-8bb3-4cd1-9f4e-212f831eed38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:31.963511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503bdbd-8bb3-4cd1-9f4e-212f831eed38 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:32.000108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:32.014809 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2861/5715] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:32.022151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0ba8-2209-49da-b112-4e69219fa742 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:32.044905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:32.063359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:32.065149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:32.067169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] PATH_INFO: `/v3/projects/7f6e79cec08a4434be9d586deda74073/users/c4adbe311c48409aa9956980fc3cbaaa/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:32.168169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6e79cec08a4434be9d586deda74073, user_id=c4adbe311c48409aa9956980fc3cbaaa, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:32.187488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:32.278661 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2855/5716] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:05:31 2022] PUT /identity/v3/projects/7f6e79cec08a4434be9d586deda74073/users/c4adbe311c48409aa9956980fc3cbaaa/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:32.285342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4159-b22e-4d70-8f09-1c3c24b1e515 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:32.286950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4159-b22e-4d70-8f09-1c3c24b1e515 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:32.287757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4159-b22e-4d70-8f09-1c3c24b1e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:32.377955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-23cb4159-b22e-4d70-8f09-1c3c24b1e515 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:32.384505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23cb4159-b22e-4d70-8f09-1c3c24b1e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:32.751699 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2862/5717] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:32.898966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:32.906549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:33.168147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb05eb-6187-456c-bfdd-f2056e038cc4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:33.182527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:33.183333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:33.183623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:33.183908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:33.217299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:33.220507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:33.262428 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2856/5718] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:33.324662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbe0e-a6fb-4127-8ce7-f7a47e3409d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:33.325322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbe0e-a6fb-4127-8ce7-f7a47e3409d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:33.325322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbe0e-a6fb-4127-8ce7-f7a47e3409d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:33.404611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6a8cbe0e-a6fb-4127-8ce7-f7a47e3409d6 None None] MFA Rules not processed for user `84dbbbf486c1479b899e3db5eb61f126`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:33.405965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a8cbe0e-a6fb-4127-8ce7-f7a47e3409d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:33.550175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:33.564807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712ce7a-529f-48e0-a466-b2c1ae0fd9d2 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:33.579430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:33.580122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:33.580416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:33.580703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:33.584913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:33.615763 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2863/5719] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:33.617600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:33.617922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:33.618205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:33.659316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] MFA Rules not processed for user `84dbbbf486c1479b899e3db5eb61f126`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:33.660568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:33.686498 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2864/5720] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:33.717329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:33.719461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:33.909709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:33.912258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:33.926154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893a9c-d507-4672-931c-b3f0342f6df8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:33.929879 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2857/5721] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:33.935548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:33.936523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:33.937469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:33.937926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:33.946301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:33.950633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:33.952913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:33.968336 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2865/5722] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:37.780213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:37.781738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:37.814246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0285a-00dd-4e39-ab08-5b264721d694 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:37.831560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:37.834055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:37.834633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:37.835486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] PATH_INFO: `/v3/users/84dbbbf486c1479b899e3db5eb61f126` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:37.840699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84dbbbf486c1479b899e3db5eb61f126)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:37.847674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:37.984696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84dbbbf486c1479b899e3db5eb61f126'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:38.003563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:38.028451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84dbbbf486c1479b899e3db5eb61f126'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:38.030944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84dbbbf486c1479b899e3db5eb61f126'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:38.054062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84dbbbf486c1479b899e3db5eb61f126'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:38.057036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84dbbbf486c1479b899e3db5eb61f126'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:38.106786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2858/5723] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:05:37 2022] DELETE /identity/v3/users/84dbbbf486c1479b899e3db5eb61f126 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:39.697104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:39.702680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:39.736458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd1457-ac7c-4454-8e42-0b22f6b8636c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:39.888457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ce458-c3e1-4894-8c13-0ff5a8367344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:39.889722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ce458-c3e1-4894-8c13-0ff5a8367344 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:39.889936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ce458-c3e1-4894-8c13-0ff5a8367344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:39.890257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ce458-c3e1-4894-8c13-0ff5a8367344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:39.895857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-731ce458-c3e1-4894-8c13-0ff5a8367344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:39.997577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:39.999188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:40.028086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ce458-c3e1-4894-8c13-0ff5a8367344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:40.035978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ce458-c3e1-4894-8c13-0ff5a8367344 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:40.083206 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2866/5724] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:40.203186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ba34-160a-44f8-b0b3-d6730698b6cd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:40.222266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:40.223125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:40.228578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:40.229164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] PATH_INFO: `/v3/projects/afb7993cc24b45ed889b0b3bf490ac35` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:40.240848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb7993cc24b45ed889b0b3bf490ac35)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:40.245280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:40.446929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb7993cc24b45ed889b0b3bf490ac35', 'request_id': 'req-4fea50a9-ed17-4b91-bf45-4becd124c57d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:40.469327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb7993cc24b45ed889b0b3bf490ac35', 'request_id': 'req-4fea50a9-ed17-4b91-bf45-4becd124c57d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:40.491324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb7993cc24b45ed889b0b3bf490ac35', 'request_id': 'req-4fea50a9-ed17-4b91-bf45-4becd124c57d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:40.558796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] The token cache is being invalidate because project afb7993cc24b45ed889b0b3bf490ac35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:05:40.559327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:40.560587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4fea50a9-ed17-4b91-bf45-4becd124c57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:05:40.571174 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2859/5725] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:05:39 2022] DELETE /identity/v3/projects/afb7993cc24b45ed889b0b3bf490ac35 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:05:40.579871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4351a-03ef-4fd6-a874-4b28f95db246 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:40.580324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4351a-03ef-4fd6-a874-4b28f95db246 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:40.580733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4351a-03ef-4fd6-a874-4b28f95db246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:40.627538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45b4351a-03ef-4fd6-a874-4b28f95db246 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:40.631533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45b4351a-03ef-4fd6-a874-4b28f95db246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:40.951836 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2867/5726] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:05:40.963842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bc8b0-d35f-461e-ae9d-f83bb1fa6334 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:40.964299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bc8b0-d35f-461e-ae9d-f83bb1fa6334 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:40.965171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bc8b0-d35f-461e-ae9d-f83bb1fa6334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:41.012831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-494bc8b0-d35f-461e-ae9d-f83bb1fa6334 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:41.021235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-494bc8b0-d35f-461e-ae9d-f83bb1fa6334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:41.042176 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2860/5727] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:41.047970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4351a-03ef-4fd6-a874-4b28f95db246 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:41.062633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4351a-03ef-4fd6-a874-4b28f95db246 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:41.082838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:41.083777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:41.084181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:41.084594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:41.085535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:05:41.085975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:41.088016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:41.107206 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2868/5728] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:05:41.111623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bc8b0-d35f-461e-ae9d-f83bb1fa6334 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:41.139525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bc8b0-d35f-461e-ae9d-f83bb1fa6334 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:41.168157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:41.169714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:41.170414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:41.171828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:41.173601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:41.182903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:41.328506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:41.349489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2861/5729] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:05:41 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:05:41.371346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9f335-470b-420f-9032-6dbd7aad0792 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:41.588534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:41.707107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:41.708471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:41.708912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:41.710244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:41.711604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:41.719201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:41.860909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:41.871978 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2869/5730] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:05:41 2022] POST /identity/v3/users => generated 293 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:05:41.917221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909a80e-ca2d-4a41-b416-19d2b5edb63c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:41.965959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:41.975170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:41.975702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:41.976204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:41.978117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:41.981129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:42.107423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:42.122142 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2862/5731] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:05:42.153055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e317e0-1a60-4bb7-8b20-97324d0ad812 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:42.187510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6389f23-5311-47a6-b6c2-1e9b65a73cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:42.190172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6389f23-5311-47a6-b6c2-1e9b65a73cef admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:42.191170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6389f23-5311-47a6-b6c2-1e9b65a73cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:42.192087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6389f23-5311-47a6-b6c2-1e9b65a73cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:42.196198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6389f23-5311-47a6-b6c2-1e9b65a73cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:42.200513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6389f23-5311-47a6-b6c2-1e9b65a73cef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:42.299100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:42.313177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2870/5732] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:05:42.347432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291c071-9ffd-452a-a180-7c38508a1d87 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:42.380862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:42.386595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:42.396522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:42.397412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] PATH_INFO: `/v3/projects/a800489ef5a24105b8f9eaee334937c1/users/ed79aa2ea715471bb970282c9e8dfd7d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:42.490845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a800489ef5a24105b8f9eaee334937c1, user_id=ed79aa2ea715471bb970282c9e8dfd7d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:42.505645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:42.521051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:42.564000 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2863/5733] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:05:42 2022] PUT /identity/v3/projects/a800489ef5a24105b8f9eaee334937c1/users/ed79aa2ea715471bb970282c9e8dfd7d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:05:42.573305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:42.574084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:42.574624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:42.643320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:05:42.645336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:42.943660 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2871/5734] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:05:42.992962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:05:42.996604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:05:43.269931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1d31f-a440-4ae6-9661-8b3e59b40f66 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:05:43.283973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:05:43.292280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:05:43.292944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:05:43.293589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:05:43.336546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:05:43.340676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:05:43.407357 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2864/5735] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:05:52.905943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:53.376240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=28 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:04.815515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:04.817711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:04.939171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45f8a-66e4-41c2-b7fc-1b89a8022a9a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:04.948335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b03e5-49ca-4491-9b23-474b5f87808f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:04.949469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b03e5-49ca-4491-9b23-474b5f87808f service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:04.950006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b03e5-49ca-4491-9b23-474b5f87808f service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:04.950481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b03e5-49ca-4491-9b23-474b5f87808f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:04.954199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-583b03e5-49ca-4491-9b23-474b5f87808f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:04.971183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b03e5-49ca-4491-9b23-474b5f87808f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:04.973761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b03e5-49ca-4491-9b23-474b5f87808f service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:04.996413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2872/5736] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:05.547988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:05.549581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:05.576958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73012c-a75a-4db4-8df9-0214c67a7842 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:05.582190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94e98-94f1-4d41-8047-7fb3a4923930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:05.583365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94e98-94f1-4d41-8047-7fb3a4923930 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:05.584171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94e98-94f1-4d41-8047-7fb3a4923930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:05.584680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94e98-94f1-4d41-8047-7fb3a4923930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:05.587234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aae94e98-94f1-4d41-8047-7fb3a4923930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:05.614959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94e98-94f1-4d41-8047-7fb3a4923930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:05.617371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94e98-94f1-4d41-8047-7fb3a4923930 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:05.642294 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2865/5737] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:06:08.472669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:08.473540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:08.473693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:08.572100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] MFA Rules not processed for user `c4adbe311c48409aa9956980fc3cbaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:08.574269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:08.862151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2873/5738] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:08.876251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ea96-7e59-40f9-8eb2-1ea71cdbcb50 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:08.876874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ea96-7e59-40f9-8eb2-1ea71cdbcb50 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:08.877139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ea96-7e59-40f9-8eb2-1ea71cdbcb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:08.966815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2735ea96-7e59-40f9-8eb2-1ea71cdbcb50 None None] MFA Rules not processed for user `c4adbe311c48409aa9956980fc3cbaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:08.969494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2735ea96-7e59-40f9-8eb2-1ea71cdbcb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:08.995707 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2866/5739] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:09.022534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:09.026529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:09.216088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b8dce-1672-4a96-88c9-7fe1df520f83 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:09.236370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:09.237084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:09.237379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:09.237657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:09.262307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:09.265880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:09.298151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2874/5740] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:06:12.545223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ea96-7e59-40f9-8eb2-1ea71cdbcb50 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:12.635651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ea96-7e59-40f9-8eb2-1ea71cdbcb50 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:12.677100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144bcd-868e-407f-90ca-4403d8b683fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:12.679415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144bcd-868e-407f-90ca-4403d8b683fa service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:12.680210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144bcd-868e-407f-90ca-4403d8b683fa service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:12.681211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144bcd-868e-407f-90ca-4403d8b683fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:12.685244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46144bcd-868e-407f-90ca-4403d8b683fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:12.725171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144bcd-868e-407f-90ca-4403d8b683fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:12.737555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144bcd-868e-407f-90ca-4403d8b683fa service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:12.779888 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2867/5741] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:19.288131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:19.586959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:19.644142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd04-aadc-4e6a-b828-4cac19864317 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:19.662799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:19.666258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:19.666258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:19.667322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:19.672822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:19.709768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:19.716938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:19.763768 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2875/5742] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:22.764315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=15 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:24.106585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbcf5-6051-4844-a730-635899f10afb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:24.107618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbcf5-6051-4844-a730-635899f10afb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:24.107618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbcf5-6051-4844-a730-635899f10afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:24.234204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7e3dbcf5-6051-4844-a730-635899f10afb None None] MFA Rules not processed for user `ed79aa2ea715471bb970282c9e8dfd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:24.279198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e3dbcf5-6051-4844-a730-635899f10afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:24.649003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2868/5743] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:24.669758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:24.675854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:24.737369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22cd6-c359-4aa6-a1ae-c71511835c02 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:24.753108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8cfb7-8a7b-4fc0-912e-10c58faba197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:24.755206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cfb7-8a7b-4fc0-912e-10c58faba197 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:24.764039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cfb7-8a7b-4fc0-912e-10c58faba197 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:24.765310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cfb7-8a7b-4fc0-912e-10c58faba197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:24.826289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8cfb7-8a7b-4fc0-912e-10c58faba197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:24.829784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8cfb7-8a7b-4fc0-912e-10c58faba197 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:24.888920 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2876/5744] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:26.814514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbcf5-6051-4844-a730-635899f10afb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:26.838834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbcf5-6051-4844-a730-635899f10afb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:26.869320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:26.870272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:26.873963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:26.874638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:26.880470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:26.938609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:26.940610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:26.972627 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2869/5745] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:33.313681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516c92-654f-4f55-94f0-3404e1d2d97f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:33.314332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516c92-654f-4f55-94f0-3404e1d2d97f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:33.314693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516c92-654f-4f55-94f0-3404e1d2d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:33.346975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-22516c92-654f-4f55-94f0-3404e1d2d97f None None] MFA Rules not processed for user `ed79aa2ea715471bb970282c9e8dfd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:33.350419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22516c92-654f-4f55-94f0-3404e1d2d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:33.380132 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2877/5746] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:35.204295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:35.210873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:35.274139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67049-5399-4c51-bd73-036cb9650205 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:35.284914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:35.285950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:35.286505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:35.286795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] PATH_INFO: `/v3/users/2e8db41673814667bd60069370262487` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:35.288501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8db41673814667bd60069370262487)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:35.293729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:35.388340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8db41673814667bd60069370262487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:35.406955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8db41673814667bd60069370262487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:35.407884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8db41673814667bd60069370262487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:35.421450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8db41673814667bd60069370262487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:35.422777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8db41673814667bd60069370262487'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:35.462522 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2870/5747] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:06:35 2022] DELETE /identity/v3/users/2e8db41673814667bd60069370262487 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:06:36.831706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22516c92-654f-4f55-94f0-3404e1d2d97f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:36.851788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22516c92-654f-4f55-94f0-3404e1d2d97f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:37.011817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:37.013564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:37.013564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:37.013934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] PATH_INFO: `/v3/projects/faa511d1382c4963adb7977038e4be1b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:37.017069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa511d1382c4963adb7977038e4be1b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:37.020519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:37.120678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa511d1382c4963adb7977038e4be1b', 'request_id': 'req-9651ab8e-030e-4a41-9203-195bdeeba706'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:37.130034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa511d1382c4963adb7977038e4be1b', 'request_id': 'req-9651ab8e-030e-4a41-9203-195bdeeba706'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:37.141965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa511d1382c4963adb7977038e4be1b', 'request_id': 'req-9651ab8e-030e-4a41-9203-195bdeeba706'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:37.164957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:37.166746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:37.177987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] The token cache is being invalidate because project faa511d1382c4963adb7977038e4be1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:06:37.178384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:37.180050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9651ab8e-030e-4a41-9203-195bdeeba706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:37.186508 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2878/5748] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:06:36 2022] DELETE /identity/v3/projects/faa511d1382c4963adb7977038e4be1b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:06:37.195743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd40da-6188-49f1-8022-b0d5fb4c09bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:37.196316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd40da-6188-49f1-8022-b0d5fb4c09bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:37.197008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd40da-6188-49f1-8022-b0d5fb4c09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:37.283252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-83dd40da-6188-49f1-8022-b0d5fb4c09bc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:37.285410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83dd40da-6188-49f1-8022-b0d5fb4c09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:37.345641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:37.408823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce80a80-3aa1-47e4-bb65-29d360deb895 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:37.502301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:37.537771 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2879/5749] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:37.551148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d089b62-f41a-4bcb-8478-1b30c1253f75 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:37.552201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d089b62-f41a-4bcb-8478-1b30c1253f75 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:37.552678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d089b62-f41a-4bcb-8478-1b30c1253f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:37.608976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6d089b62-f41a-4bcb-8478-1b30c1253f75 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:37.611914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d089b62-f41a-4bcb-8478-1b30c1253f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:37.633984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:37.634810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:37.635464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:37.635934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:37.639371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:37.651619 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2880/5750] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:37.655970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d089b62-f41a-4bcb-8478-1b30c1253f75 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:37.673585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:37.675822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:37.685182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d089b62-f41a-4bcb-8478-1b30c1253f75 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:37.705625 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2871/5751] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:37.706829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:37.711757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:37.712611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:37.713317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:37.716145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:06:37.718810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:37.728147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:37.772098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2881/5752] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:06:37.778712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:37.801194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea126aca-07b3-4777-a707-a23294e97e88 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:37.823951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:37.824703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:37.825199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:37.825431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:37.826075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:37.828303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:37.896297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2872/5753] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:06:37 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:06:37.903026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:37.925994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b490a-9d21-4c9e-9a24-65c8b016068f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:38.035200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:38.037345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:38.104874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:38.105871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:38.106167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:38.106447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:38.107176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:38.109304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:38.208678 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2882/5754] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:06:37 2022] POST /identity/v3/users => generated 299 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:06:38.214369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:38.243189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac8a37-7aa4-42d2-bf27-2a46f3c4f273 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:38.278496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:38.279327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:38.279538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:38.279901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:38.280577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:38.282462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:38.328915 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2883/5755] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:06:38.329942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:38.354575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3cc72-c359-4063-8244-b3997b18a5e3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:38.372401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:38.373128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:38.373416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:38.373918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:38.374632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:38.376399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:38.380228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c10507-680e-4d06-b544-302ec9c333ed admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:38.396438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:38.398644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:38.399307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:38.400491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] PATH_INFO: `/v3/users/4be017ecfa0c4ce1b5b3bc4c463b2fc7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:38.406564 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2884/5756] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:06:38.414445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:38.426362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be017ecfa0c4ce1b5b3bc4c463b2fc7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:38.438156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:38.452136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e715c6-48c5-4ce3-a317-baeab477f256 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:38.469164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2bd4b-c9d6-45d7-8b5d-db72645706ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:38.470125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2bd4b-c9d6-45d7-8b5d-db72645706ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:38.470397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2bd4b-c9d6-45d7-8b5d-db72645706ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:38.470680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2bd4b-c9d6-45d7-8b5d-db72645706ab admin admin] PATH_INFO: `/v3/projects/945e45f9ecb94ff49e934ff41ce5b97c/users/db35ea89c4554a03abdcfe78d9a83e60/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:38.508216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2bd4b-c9d6-45d7-8b5d-db72645706ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=945e45f9ecb94ff49e934ff41ce5b97c, user_id=db35ea89c4554a03abdcfe78d9a83e60, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:38.511738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2bd4b-c9d6-45d7-8b5d-db72645706ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:38.557420 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2885/5757] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:06:38 2022] PUT /identity/v3/projects/945e45f9ecb94ff49e934ff41ce5b97c/users/db35ea89c4554a03abdcfe78d9a83e60/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:06:38.567038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:38.567511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:38.567820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:38.624771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:38.626255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:38.650815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be017ecfa0c4ce1b5b3bc4c463b2fc7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:38.665855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:38.705281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be017ecfa0c4ce1b5b3bc4c463b2fc7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:38.707668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be017ecfa0c4ce1b5b3bc4c463b2fc7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:38.743645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be017ecfa0c4ce1b5b3bc4c463b2fc7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:38.745768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-411a9bbc-bd12-4f69-998c-ab293546c49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be017ecfa0c4ce1b5b3bc4c463b2fc7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:38.788053 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2873/5758] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:06:38 2022] DELETE /identity/v3/users/4be017ecfa0c4ce1b5b3bc4c463b2fc7 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:06:38.795503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4421c-230b-444c-9099-85219e9e1b00 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:38.796181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4421c-230b-444c-9099-85219e9e1b00 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:38.796715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4421c-230b-444c-9099-85219e9e1b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:38.862102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2886/5759] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:38.882147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b1d4421c-230b-444c-9099-85219e9e1b00 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:38.885240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b1d4421c-230b-444c-9099-85219e9e1b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:38.922710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:38.925890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:38.993599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:39.128260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0df5-da55-4f3f-9df8-ad333f7ebe52 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:39.141117 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2874/5760] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:06:39.200660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4421c-230b-444c-9099-85219e9e1b00 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:39.297184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:39.297991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:39.298356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:39.298740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:39.333839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:39.336121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:39.362767 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2887/5761] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:39.395410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4421c-230b-444c-9099-85219e9e1b00 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:39.408385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86bab-259b-43fc-8245-7e5e028cbb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:39.409189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86bab-259b-43fc-8245-7e5e028cbb47 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:39.409854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86bab-259b-43fc-8245-7e5e028cbb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:39.410296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86bab-259b-43fc-8245-7e5e028cbb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:39.428931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86bab-259b-43fc-8245-7e5e028cbb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:39.433291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86bab-259b-43fc-8245-7e5e028cbb47 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:39.444331 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2875/5762] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:40.758914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:40.760568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:40.795132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1091-aaa5-40b9-a5b4-7da17ac654fd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:40.840632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:40.844928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:40.848974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:40.849720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] PATH_INFO: `/v3/projects/50b80679b2c74e01a6264b4dfd8fcdaa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:40.865224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b80679b2c74e01a6264b4dfd8fcdaa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:40.893127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:41.074464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b80679b2c74e01a6264b4dfd8fcdaa', 'request_id': 'req-348fc772-b373-4d46-ad19-dece962e4517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:41.097676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b80679b2c74e01a6264b4dfd8fcdaa', 'request_id': 'req-348fc772-b373-4d46-ad19-dece962e4517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:41.116281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b80679b2c74e01a6264b4dfd8fcdaa', 'request_id': 'req-348fc772-b373-4d46-ad19-dece962e4517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:41.154919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] The token cache is being invalidate because project 50b80679b2c74e01a6264b4dfd8fcdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:06:41.156294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:41.158229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-348fc772-b373-4d46-ad19-dece962e4517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:06:41.163365 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2888/5763] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:06:40 2022] DELETE /identity/v3/projects/50b80679b2c74e01a6264b4dfd8fcdaa => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:06:41.168326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c4f6-141e-4904-bfee-77a535712550 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.169147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c4f6-141e-4904-bfee-77a535712550 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.169147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c4f6-141e-4904-bfee-77a535712550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.194732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8b85c4f6-141e-4904-bfee-77a535712550 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:41.198295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b85c4f6-141e-4904-bfee-77a535712550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:41.327392 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2876/5764] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:06:41.337385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528359d2-15f4-4aaa-b6a3-8ef7182b05b2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.337385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528359d2-15f4-4aaa-b6a3-8ef7182b05b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.337902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528359d2-15f4-4aaa-b6a3-8ef7182b05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.368701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-528359d2-15f4-4aaa-b6a3-8ef7182b05b2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:41.369843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-528359d2-15f4-4aaa-b6a3-8ef7182b05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:41.381589 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2889/5765] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:06:41.385823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85c4f6-141e-4904-bfee-77a535712550 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:41.397881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85c4f6-141e-4904-bfee-77a535712550 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:41.406355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:41.407637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.408223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.408679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.409673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:06:41.410263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:41.412399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:41.425063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:41.436103 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2877/5766] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:06:41.438298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528359d2-15f4-4aaa-b6a3-8ef7182b05b2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:41.461349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528359d2-15f4-4aaa-b6a3-8ef7182b05b2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:41.472041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:41.474088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.474468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.474726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.475743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:41.478676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:41.524696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:41.534019 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2890/5767] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:06:41 2022] POST /identity/v3/projects => generated 361 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:06:41.539984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea8ba-ab23-46b8-88de-e3be4ae066dc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:41.623847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:41.624669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.625022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.626286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.627184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:41.629590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:41.681952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:41.688320 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2878/5768] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:06:41 2022] POST /identity/v3/users => generated 281 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:06:41.701026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5750-ca98-4429-925c-4da2aa86d945 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:41.715954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:41.716725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.717013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.717314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.718220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:41.720103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:41.745252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:41.749957 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2891/5769] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:06:41.779559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdc320-0534-4189-8331-5aaff4c53c4e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:41.795638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2ef12-1845-4417-a126-1ef39779395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:41.796356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2ef12-1845-4417-a126-1ef39779395c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.796649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2ef12-1845-4417-a126-1ef39779395c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.796937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2ef12-1845-4417-a126-1ef39779395c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.797721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2ef12-1845-4417-a126-1ef39779395c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:41.799513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2ef12-1845-4417-a126-1ef39779395c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:41.831185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:41.832917 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2879/5770] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:06:41.844829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38fd5-c25d-4546-b50c-f4fcee3b5652 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:41.855131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:41.856103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.856712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.857155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] PATH_INFO: `/v3/projects/7dc0ebb497fa47e48fc1001196b1ed7f/users/cf4863be733446ef9ce1d2db0ea17fb7/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:41.900439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc0ebb497fa47e48fc1001196b1ed7f, user_id=cf4863be733446ef9ce1d2db0ea17fb7, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:41.904583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:41.922909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:41.932207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2892/5771] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:06:41 2022] PUT /identity/v3/projects/7dc0ebb497fa47e48fc1001196b1ed7f/users/cf4863be733446ef9ce1d2db0ea17fb7/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:06:41.951407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:41.951407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:41.951407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:42.013280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] MFA Rules not processed for user `cf4863be733446ef9ce1d2db0ea17fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:06:42.016953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:42.144010 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2880/5772] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:06:42.199516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:42.202488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:42.298790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac8ca-4a1b-4e3e-a58e-918191540a69 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:42.304345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:42.309024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:42.309842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:42.309842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:42.327459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:42.330200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:42.344673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2893/5773] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:48.828998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:06:48.830580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:49.234379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973d5a1-3a17-4f68-868b-d5c89f9a6786 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:06:49.273920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d25486-c84e-4a6d-85e1-8dc953ecff31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:06:49.275686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d25486-c84e-4a6d-85e1-8dc953ecff31 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:06:49.276217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d25486-c84e-4a6d-85e1-8dc953ecff31 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:06:49.276734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d25486-c84e-4a6d-85e1-8dc953ecff31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:06:49.290678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9d25486-c84e-4a6d-85e1-8dc953ecff31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:06:49.319829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:49.344013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d25486-c84e-4a6d-85e1-8dc953ecff31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:06:49.354977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d25486-c84e-4a6d-85e1-8dc953ecff31 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:06:49.403345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2881/5774] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:06:52.340110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=26 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:59.384758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:09.033742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:09.037270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:09.253817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894e1f1-7d64-483b-8d7b-95b4513735a5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:09.265847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:09.270073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:09.270953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:09.271844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] PATH_INFO: `/v3/users/c4adbe311c48409aa9956980fc3cbaaa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:09.277214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4adbe311c48409aa9956980fc3cbaaa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:09.287870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:09.416656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4adbe311c48409aa9956980fc3cbaaa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:09.439119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4adbe311c48409aa9956980fc3cbaaa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:09.454593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4adbe311c48409aa9956980fc3cbaaa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:09.455511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4adbe311c48409aa9956980fc3cbaaa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:09.474769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4adbe311c48409aa9956980fc3cbaaa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:09.491567 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2894/5775] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:07:09 2022] DELETE /identity/v3/users/c4adbe311c48409aa9956980fc3cbaaa => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:10.968349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09e5df-7f4c-46c3-9b02-c87bf6cd7652 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:10.969843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09e5df-7f4c-46c3-9b02-c87bf6cd7652 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:10.970328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09e5df-7f4c-46c3-9b02-c87bf6cd7652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:11.030105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0b09e5df-7f4c-46c3-9b02-c87bf6cd7652 None None] MFA Rules not processed for user `db35ea89c4554a03abdcfe78d9a83e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:11.033508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b09e5df-7f4c-46c3-9b02-c87bf6cd7652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:11.052501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:11.055174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:11.199438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904dc43-8fd7-4976-97c3-a14908ac96aa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:11.229708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:11.230928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:11.231218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:11.231734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] PATH_INFO: `/v3/projects/7f6e79cec08a4434be9d586deda74073` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:11.238911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6e79cec08a4434be9d586deda74073)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:11.241893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:11.314896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:11.316966 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2882/5776] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:11.318968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:11.319334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:11.319624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:11.350141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] MFA Rules not processed for user `db35ea89c4554a03abdcfe78d9a83e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:11.354538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:11.360400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6e79cec08a4434be9d586deda74073', 'request_id': 'req-80856864-e20a-40cb-8a12-c834434ec020'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:11.378206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6e79cec08a4434be9d586deda74073', 'request_id': 'req-80856864-e20a-40cb-8a12-c834434ec020'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:11.398481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6e79cec08a4434be9d586deda74073', 'request_id': 'req-80856864-e20a-40cb-8a12-c834434ec020'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:11.443248 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2883/5777] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:11.466305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:11.469735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:11.477747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] The token cache is being invalidate because project 7f6e79cec08a4434be9d586deda74073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:07:11.477747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:11.481193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80856864-e20a-40cb-8a12-c834434ec020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:11.490457 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2895/5778] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:07:11 2022] DELETE /identity/v3/projects/7f6e79cec08a4434be9d586deda74073 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:11.512766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbd95-bd88-4b31-ad9f-fd0a854ad4f4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:11.514220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbd95-bd88-4b31-ad9f-fd0a854ad4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:11.516273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbd95-bd88-4b31-ad9f-fd0a854ad4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:11.619902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0ccbd95-bd88-4b31-ad9f-fd0a854ad4f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:11.622119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0ccbd95-bd88-4b31-ad9f-fd0a854ad4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:11.690503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1223ee-1436-43e2-8d99-2b46943da736 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:11.705383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0d1b9-f77f-45ee-b12d-69411ca7ac4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:11.706653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d1b9-f77f-45ee-b12d-69411ca7ac4f service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:11.707098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d1b9-f77f-45ee-b12d-69411ca7ac4f service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:11.707523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d1b9-f77f-45ee-b12d-69411ca7ac4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:11.711449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81e0d1b9-f77f-45ee-b12d-69411ca7ac4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:11.743591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0d1b9-f77f-45ee-b12d-69411ca7ac4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:11.743591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0d1b9-f77f-45ee-b12d-69411ca7ac4f service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:11.759161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2884/5779] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:07:11.836101 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2896/5780] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:07:11.848419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0b3c5-6da9-489d-bef2-06e3f22a0e34 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:11.848726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0b3c5-6da9-489d-bef2-06e3f22a0e34 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:11.849539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0b3c5-6da9-489d-bef2-06e3f22a0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:11.904555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-91d0b3c5-6da9-489d-bef2-06e3f22a0e34 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:11.907174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-91d0b3c5-6da9-489d-bef2-06e3f22a0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:11.928259 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2885/5781] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:11.937084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccbd95-bd88-4b31-ad9f-fd0a854ad4f4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:11.962228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccbd95-bd88-4b31-ad9f-fd0a854ad4f4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:11.971864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:11.972579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:11.972870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:11.973152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:11.984305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:07:11.984705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:11.987436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:12.039449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2897/5782] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:07:12.040084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0b3c5-6da9-489d-bef2-06e3f22a0e34 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:12.059571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0b3c5-6da9-489d-bef2-06e3f22a0e34 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:12.078478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:12.082287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:12.082679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:12.082986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:12.085837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:12.095751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:12.132217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:12.204792 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2886/5783] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:07:12 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:07:12.207231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:12.246648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c107c-a3d5-473b-b808-5d11b6b65e20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:12.393499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:12.394220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:12.394513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:12.394801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:12.395586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:12.398301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:12.451439 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2898/5784] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:07:12 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:12.453408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:12.496871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ca509-b809-4a56-9c59-a0bf42c6e2e2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:12.529032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:12.531163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:12.532040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:12.532839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:12.534622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:12.539139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:12.584234 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2887/5785] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:12.586444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:12.606545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d562cf2-79c6-449d-bd7a-b932e20fca7a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:12.614136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf2eed-deff-40ac-9db1-c6bb14962eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:12.614845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2eed-deff-40ac-9db1-c6bb14962eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:12.615206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2eed-deff-40ac-9db1-c6bb14962eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:12.615523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2eed-deff-40ac-9db1-c6bb14962eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:12.616312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf2eed-deff-40ac-9db1-c6bb14962eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:12.618017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf2eed-deff-40ac-9db1-c6bb14962eb1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:12.642273 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2899/5786] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:12.648793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:12.669919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b1f4c-05a4-44e2-8966-30ecd2fa5d24 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:12.681484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aab73c-b088-49b8-8a5c-1d3339744390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:12.682446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab73c-b088-49b8-8a5c-1d3339744390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:12.682739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab73c-b088-49b8-8a5c-1d3339744390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:12.683042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab73c-b088-49b8-8a5c-1d3339744390 admin admin] PATH_INFO: `/v3/projects/47a3e6ad267248838d4f940165a008c2/users/a473c0bffe29419e8abe282cc07df700/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:12.715933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aab73c-b088-49b8-8a5c-1d3339744390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a3e6ad267248838d4f940165a008c2, user_id=a473c0bffe29419e8abe282cc07df700, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:12.718844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aab73c-b088-49b8-8a5c-1d3339744390 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:12.747717 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2888/5787] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:12 2022] PUT /identity/v3/projects/47a3e6ad267248838d4f940165a008c2/users/a473c0bffe29419e8abe282cc07df700/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:07:12.774227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:12.774634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:12.774808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:12.835507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] MFA Rules not processed for user `a473c0bffe29419e8abe282cc07df700`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:12.836861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:12.841605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:13.089911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2900/5788] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:07:13.116555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:13.116555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:13.116555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:13.164951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] MFA Rules not processed for user `a473c0bffe29419e8abe282cc07df700`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:13.166512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:13.193956 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2889/5789] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:13.879895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:13.882235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:14.217618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aca8a-7731-43ed-8332-d50708e27826 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:14.249349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b35d47-4a8d-4bb3-a0e6-212e157fb762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:14.250550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35d47-4a8d-4bb3-a0e6-212e157fb762 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:14.251135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35d47-4a8d-4bb3-a0e6-212e157fb762 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:14.251729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35d47-4a8d-4bb3-a0e6-212e157fb762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:14.285075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b35d47-4a8d-4bb3-a0e6-212e157fb762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:14.293274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b35d47-4a8d-4bb3-a0e6-212e157fb762 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:14.339517 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2901/5790] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:07:23.140883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=21,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:24.318586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=59 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:33.817542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:33.819761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:34.071238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597973d-4f39-40a9-beec-fef4e0062e38 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:34.080250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:34.082855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:34.084021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:34.085127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] PATH_INFO: `/v3/users/cf4863be733446ef9ce1d2db0ea17fb7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:34.087756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4863be733446ef9ce1d2db0ea17fb7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:34.091408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:34.180500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4863be733446ef9ce1d2db0ea17fb7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:34.221254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4863be733446ef9ce1d2db0ea17fb7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:34.224051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4863be733446ef9ce1d2db0ea17fb7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:34.255026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4863be733446ef9ce1d2db0ea17fb7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:34.260406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4863be733446ef9ce1d2db0ea17fb7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:34.307965 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2890/5791] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:07:33 2022] DELETE /identity/v3/users/cf4863be733446ef9ce1d2db0ea17fb7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:34.315089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:34.315995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:34.316190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:34.388674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:34.392533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:34.577570 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2902/5792] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:34.596022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:34.597618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:34.784290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467d594-ac52-4fd9-b3ca-fd3d4c76b0ea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:34.801960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03cb55-a82f-4024-86c5-8ff19e6d8a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:34.805344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cb55-a82f-4024-86c5-8ff19e6d8a6b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:34.805701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cb55-a82f-4024-86c5-8ff19e6d8a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:34.807324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cb55-a82f-4024-86c5-8ff19e6d8a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:34.839040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03cb55-a82f-4024-86c5-8ff19e6d8a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:34.840609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03cb55-a82f-4024-86c5-8ff19e6d8a6b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:34.877701 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2891/5793] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:07:35.504289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:35.507794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:35.526411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca3b96-c7a3-4642-a11f-9acf983c0606 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:35.532913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:35.534312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:35.534753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:35.535205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] PATH_INFO: `/v3/projects/7dc0ebb497fa47e48fc1001196b1ed7f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:35.536899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc0ebb497fa47e48fc1001196b1ed7f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:35.539239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:35.629643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc0ebb497fa47e48fc1001196b1ed7f', 'request_id': 'req-cf6fda58-ce78-45cf-8999-772e820336e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:35.652684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc0ebb497fa47e48fc1001196b1ed7f', 'request_id': 'req-cf6fda58-ce78-45cf-8999-772e820336e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:35.665805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc0ebb497fa47e48fc1001196b1ed7f', 'request_id': 'req-cf6fda58-ce78-45cf-8999-772e820336e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:35.694846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] The token cache is being invalidate because project 7dc0ebb497fa47e48fc1001196b1ed7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:07:35.696059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:35.697313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf6fda58-ce78-45cf-8999-772e820336e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:35.700137 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2903/5794] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:07:35 2022] DELETE /identity/v3/projects/7dc0ebb497fa47e48fc1001196b1ed7f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:35.706953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d49a-f7f7-451b-8eab-7a956cb15b7a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:35.709736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d49a-f7f7-451b-8eab-7a956cb15b7a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:35.709736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d49a-f7f7-451b-8eab-7a956cb15b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:35.752808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c935d49a-f7f7-451b-8eab-7a956cb15b7a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:35.757087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c935d49a-f7f7-451b-8eab-7a956cb15b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:35.829901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:36.008694 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2892/5795] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:36.025652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637dd39-6c7b-4d1e-b453-29dccef5fdc4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:36.026175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637dd39-6c7b-4d1e-b453-29dccef5fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:36.026713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637dd39-6c7b-4d1e-b453-29dccef5fdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:36.114182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9637dd39-6c7b-4d1e-b453-29dccef5fdc4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:36.119682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9637dd39-6c7b-4d1e-b453-29dccef5fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:36.155701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2904/5796] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:36.159001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d49a-f7f7-451b-8eab-7a956cb15b7a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:36.200299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d49a-f7f7-451b-8eab-7a956cb15b7a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:36.213697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:36.215336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:36.216104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:36.216844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:36.221010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:07:36.221848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:36.255784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:36.403137 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2893/5797] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:07:36.403620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637dd39-6c7b-4d1e-b453-29dccef5fdc4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:36.428161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637dd39-6c7b-4d1e-b453-29dccef5fdc4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:36.453598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:36.456138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:36.456927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:36.457839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:36.461953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:36.473602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:36.594778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2905/5798] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:07:36 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:36.599713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:36.628423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dcbc1-ef25-4080-9e37-5dd5b82d30ac admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:36.923464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:36.924740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:36.925289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:36.925759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:36.936790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:36.947914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:37.084443 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2894/5799] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:07:36 2022] POST /identity/v3/users => generated 288 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:37.087805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:37.127757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d14af-0b72-4738-ae95-25b980f648d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:37.138207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:37.139663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:37.140174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:37.140695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:37.142147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:37.156709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:37.294145 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2906/5800] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:37.296913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:37.351532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3efb73-f444-4ea6-b5f3-6777d9123792 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:37.366911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3858-247b-474d-aa52-8838546b25b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:37.368483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3858-247b-474d-aa52-8838546b25b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:37.369893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3858-247b-474d-aa52-8838546b25b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:37.370563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3858-247b-474d-aa52-8838546b25b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:37.372267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3858-247b-474d-aa52-8838546b25b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:37.376075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3858-247b-474d-aa52-8838546b25b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:37.418635 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2895/5801] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:07:37.422457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:37.450070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63e8e4-9368-4208-87cf-5819685fae0a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:37.491292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:37.493493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:37.494490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:37.495356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] PATH_INFO: `/v3/projects/71d38be9ba07400da8d359bc186009e8/users/d855fab449564583a2ff787ee54bd778/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:37.551451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d38be9ba07400da8d359bc186009e8, user_id=d855fab449564583a2ff787ee54bd778, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:37.555307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:37.591043 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2907/5802] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:37 2022] PUT /identity/v3/projects/71d38be9ba07400da8d359bc186009e8/users/d855fab449564583a2ff787ee54bd778/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:37.594609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050750-585d-4bdf-9013-c74f69750608 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:37.595140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050750-585d-4bdf-9013-c74f69750608 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:37.595683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050750-585d-4bdf-9013-c74f69750608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:37.710932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e4050750-585d-4bdf-9013-c74f69750608 None None] MFA Rules not processed for user `d855fab449564583a2ff787ee54bd778`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:37.718284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4050750-585d-4bdf-9013-c74f69750608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:38.026999 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2896/5803] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:38.101690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:38.103844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:38.161315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:38.305737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854ae6-e412-4249-a7ef-5802c6f7e0f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:38.316421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899347d1-aa9d-4bea-83b1-33e224f27161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:38.317545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899347d1-aa9d-4bea-83b1-33e224f27161 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:38.318464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899347d1-aa9d-4bea-83b1-33e224f27161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:38.318976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899347d1-aa9d-4bea-83b1-33e224f27161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:38.345905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899347d1-aa9d-4bea-83b1-33e224f27161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:38.350478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899347d1-aa9d-4bea-83b1-33e224f27161 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:38.373728 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2908/5804] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:07:40.301354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050750-585d-4bdf-9013-c74f69750608 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:40.351359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:40.464204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050750-585d-4bdf-9013-c74f69750608 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:40.484172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:40.489505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:40.490908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:40.492166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] PATH_INFO: `/v3/users/d855fab449564583a2ff787ee54bd778` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:40.495618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d855fab449564583a2ff787ee54bd778)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:40.503367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:40.703317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd855fab449564583a2ff787ee54bd778'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:40.762124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd855fab449564583a2ff787ee54bd778'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:40.765530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd855fab449564583a2ff787ee54bd778'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:40.778687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd855fab449564583a2ff787ee54bd778'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:40.780066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd855fab449564583a2ff787ee54bd778'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:40.813750 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2897/5805] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:07:40 2022] DELETE /identity/v3/users/d855fab449564583a2ff787ee54bd778 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:40.817448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf032-8f3b-445d-9f12-b6c6342f4a27 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:40.819556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf032-8f3b-445d-9f12-b6c6342f4a27 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:40.820666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf032-8f3b-445d-9f12-b6c6342f4a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:40.879452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c2bf032-8f3b-445d-9f12-b6c6342f4a27 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:40.891605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c2bf032-8f3b-445d-9f12-b6c6342f4a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:41.086270 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2909/5806] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:41.150861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:41.155904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:41.225486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2f6d-12a5-440d-9119-b172aa39a5d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:41.226265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2f6d-12a5-440d-9119-b172aa39a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:41.226786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2f6d-12a5-440d-9119-b172aa39a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:41.272910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d80a2f6d-12a5-440d-9119-b172aa39a5d7 None None] MFA Rules not processed for user `db35ea89c4554a03abdcfe78d9a83e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:41.275446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d80a2f6d-12a5-440d-9119-b172aa39a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:41.350019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1c539-b56e-4ffa-9a35-cb1395a39375 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:41.365405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42bcb5-5e23-4669-b2de-333c04802dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:41.366423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42bcb5-5e23-4669-b2de-333c04802dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:41.366711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42bcb5-5e23-4669-b2de-333c04802dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:41.366992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42bcb5-5e23-4669-b2de-333c04802dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:41.398698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42bcb5-5e23-4669-b2de-333c04802dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:41.402789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42bcb5-5e23-4669-b2de-333c04802dfd service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:41.436722 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2910/5807] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:07:41.446735 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2898/5808] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:07:41.554409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59ea39-6f6a-44db-9528-d0bd1919678d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:41.554780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59ea39-6f6a-44db-9528-d0bd1919678d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:41.555183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59ea39-6f6a-44db-9528-d0bd1919678d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:41.597179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1e59ea39-6f6a-44db-9528-d0bd1919678d None None] MFA Rules not processed for user `db35ea89c4554a03abdcfe78d9a83e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:41.601882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e59ea39-6f6a-44db-9528-d0bd1919678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:41.629005 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2911/5809] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:41.690958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee142-453b-43e4-9740-ee74e1582a2b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:41.691409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee142-453b-43e4-9740-ee74e1582a2b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:41.691701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee142-453b-43e4-9740-ee74e1582a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:41.721009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c8cee142-453b-43e4-9740-ee74e1582a2b None None] MFA Rules not processed for user `db35ea89c4554a03abdcfe78d9a83e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:41.723634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8cee142-453b-43e4-9740-ee74e1582a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:41.739450 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2899/5810] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:41.793010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:41.794059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:41.794888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:41.879766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] MFA Rules not processed for user `db35ea89c4554a03abdcfe78d9a83e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:41.896916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:41.928870 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2912/5811] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:42.234325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d548-bfec-4810-9bae-7b6474332740 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:42.234967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d548-bfec-4810-9bae-7b6474332740 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:42.236822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d548-bfec-4810-9bae-7b6474332740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:42.284059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ce11d548-bfec-4810-9bae-7b6474332740 None None] MFA Rules not processed for user `db35ea89c4554a03abdcfe78d9a83e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:42.287025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce11d548-bfec-4810-9bae-7b6474332740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:42.299951 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2900/5812] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:43.159700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:43.165768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:43.266319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf29c3-4909-4ada-ac4d-1f9a2d98b4ed None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:43.319036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:43.320994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:43.324146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:43.324883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] PATH_INFO: `/v3/projects/71d38be9ba07400da8d359bc186009e8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:43.328865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d38be9ba07400da8d359bc186009e8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:43.339572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:43.504248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d38be9ba07400da8d359bc186009e8', 'request_id': 'req-46237148-bc07-4c85-a3c1-66b99bf826ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:43.507371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:43.523657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d38be9ba07400da8d359bc186009e8', 'request_id': 'req-46237148-bc07-4c85-a3c1-66b99bf826ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:43.536985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d38be9ba07400da8d359bc186009e8', 'request_id': 'req-46237148-bc07-4c85-a3c1-66b99bf826ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:43.558706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] The token cache is being invalidate because project 71d38be9ba07400da8d359bc186009e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:07:43.559032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:43.559862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46237148-bc07-4c85-a3c1-66b99bf826ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:43.561823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2913/5813] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:07:43 2022] DELETE /identity/v3/projects/71d38be9ba07400da8d359bc186009e8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:43.568508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae75edb-cbd5-4878-92d4-e6f83f3f3f26 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:43.569072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae75edb-cbd5-4878-92d4-e6f83f3f3f26 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:43.569178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae75edb-cbd5-4878-92d4-e6f83f3f3f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:43.599186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0ae75edb-cbd5-4878-92d4-e6f83f3f3f26 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:43.601228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ae75edb-cbd5-4878-92d4-e6f83f3f3f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:43.659844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:43.737161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2901/5814] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:43.746509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dffef-a0a9-42a1-a9a0-b6ecdd8ea469 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:43.746925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dffef-a0a9-42a1-a9a0-b6ecdd8ea469 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:43.751615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dffef-a0a9-42a1-a9a0-b6ecdd8ea469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:43.793168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-754dffef-a0a9-42a1-a9a0-b6ecdd8ea469 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:43.794781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-754dffef-a0a9-42a1-a9a0-b6ecdd8ea469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:43.804696 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2914/5815] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:43.810772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae75edb-cbd5-4878-92d4-e6f83f3f3f26 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:43.822701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae75edb-cbd5-4878-92d4-e6f83f3f3f26 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:43.828689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:43.829471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:43.829989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:43.830364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:43.831213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:07:43.831642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:43.833411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:43.852267 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2902/5816] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:07:43.858388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dffef-a0a9-42a1-a9a0-b6ecdd8ea469 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:43.872249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dffef-a0a9-42a1-a9a0-b6ecdd8ea469 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:43.878491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:43.879440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:43.879849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:43.880261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:43.881800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:43.884580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:43.931481 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2915/5817] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:07:43 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:43.934158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:43.948606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6bae-7f20-44ea-882f-5e4ca80e8278 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:44.028426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:44.029149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:44.029453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:44.029734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:44.030486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:44.032615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:44.055746 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2903/5818] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:07:43 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:07:44.061389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:44.081522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45e7b-4b9e-458b-838d-e4081ea503d0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:44.089388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:44.090481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:44.090966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:44.091492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:44.092856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:44.096128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:44.121742 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2916/5819] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:44.123551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:44.137978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5a13d-78ec-4466-98bb-ae09e1734fe1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:44.144014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a4cc0-84b1-4adb-aadc-856d68a887df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:44.144769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4cc0-84b1-4adb-aadc-856d68a887df admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:44.145060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4cc0-84b1-4adb-aadc-856d68a887df admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:44.145371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4cc0-84b1-4adb-aadc-856d68a887df admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:44.146152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a4cc0-84b1-4adb-aadc-856d68a887df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:44.147908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a4cc0-84b1-4adb-aadc-856d68a887df admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:44.160824 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2904/5820] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:44.167754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:44.187222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393b42-fd78-4645-9b9d-fdc605b13510 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:44.197576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:44.198614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:44.198984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:44.199384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] PATH_INFO: `/v3/projects/f75351d759284c559bc0d30753199a9e/users/3beed07f732444eea334f34ea75e0c8e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:44.226222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75351d759284c559bc0d30753199a9e, user_id=3beed07f732444eea334f34ea75e0c8e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:44.231402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:44.256740 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2917/5821] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:44 2022] PUT /identity/v3/projects/f75351d759284c559bc0d30753199a9e/users/3beed07f732444eea334f34ea75e0c8e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:44.271158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3d8d3-b245-431b-aa35-7ac352951e4e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:44.272075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3d8d3-b245-431b-aa35-7ac352951e4e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:44.272665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3d8d3-b245-431b-aa35-7ac352951e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:44.324797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7cf3d8d3-b245-431b-aa35-7ac352951e4e None None] MFA Rules not processed for user `3beed07f732444eea334f34ea75e0c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:44.326301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7cf3d8d3-b245-431b-aa35-7ac352951e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:44.477132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2905/5822] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:44.487134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:44.607438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3aa04-c1cc-45dc-8118-cb08a946758c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:44.613482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:44.614317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:44.615017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:44.616091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:44.617185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:44.620639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:44.682500 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2918/5823] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:07:44 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:44.684402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3d8d3-b245-431b-aa35-7ac352951e4e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:44.747504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3d8d3-b245-431b-aa35-7ac352951e4e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:44.808182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:44.933809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:44.934777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:44.935143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:44.935530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:44.936337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:44.938820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:44.974780 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2906/5824] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:07:44 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:44.980181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:45.005074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2371d21-86ba-45bf-9b73-20580cb2074d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:45.016615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:45.017951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:45.018416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:45.018879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:45.022256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:45.026493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:45.083308 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2919/5825] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:45.086437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:45.105803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a89812-5f9f-4f3f-bfae-113a1abad426 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:45.118628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:45.119593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:45.119883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:45.120174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] PATH_INFO: `/v3/projects/38b7544530fe4bfa889fb61de3649740/users/405461c4f4764ab3bcb2c53cee5d4869/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:45.143832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b7544530fe4bfa889fb61de3649740, user_id=405461c4f4764ab3bcb2c53cee5d4869, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:45.148237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:45.183116 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2907/5826] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:45 2022] PUT /identity/v3/projects/38b7544530fe4bfa889fb61de3649740/users/405461c4f4764ab3bcb2c53cee5d4869/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:45.186245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:45.244587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677777a-579a-44b3-861c-6a934d767368 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:45.465763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:45.508777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fdd19-3497-4433-ba17-a7926bc12d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:45.510558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fdd19-3497-4433-ba17-a7926bc12d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:45.511214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fdd19-3497-4433-ba17-a7926bc12d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:45.512199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fdd19-3497-4433-ba17-a7926bc12d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:45.515377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fdd19-3497-4433-ba17-a7926bc12d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:45.519005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fdd19-3497-4433-ba17-a7926bc12d0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:45.563534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:45.576003 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2920/5827] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:45.607470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2d4b-9a2b-4748-8214-8dc046c6d8c2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:45.629965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:45.632724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:45.633803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:45.635321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] PATH_INFO: `/v3/projects/38b7544530fe4bfa889fb61de3649740/users/405461c4f4764ab3bcb2c53cee5d4869/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:45.639916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b7544530fe4bfa889fb61de3649740, user_id=405461c4f4764ab3bcb2c53cee5d4869, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:45.647166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:45.676584 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2908/5828] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:45 2022] PUT /identity/v3/projects/38b7544530fe4bfa889fb61de3649740/users/405461c4f4764ab3bcb2c53cee5d4869/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:45.702406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b3b34-3680-44d4-943c-573c66992504 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:45.712443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b3b34-3680-44d4-943c-573c66992504 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:45.712965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b3b34-3680-44d4-943c-573c66992504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:45.818916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-250b3b34-3680-44d4-943c-573c66992504 None None] MFA Rules not processed for user `405461c4f4764ab3bcb2c53cee5d4869`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:45.822218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-250b3b34-3680-44d4-943c-573c66992504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:46.084971 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2921/5829] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:46.106136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:46.111772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:46.327500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b3b34-3680-44d4-943c-573c66992504 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:46.330256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-250b3b34-3680-44d4-943c-573c66992504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:46.460619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef55f43-ea5d-4246-83dd-c0dd36a2ee1e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:46.471224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:46.475197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:46.475197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:46.475197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:46.520121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:46.525840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:46.577974 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2909/5830] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:07:46.692869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b3b34-3680-44d4-943c-573c66992504 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:46.729126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:46.734025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:46.734488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:46.736860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] PATH_INFO: `/v3/users/1407591403fd4497ac13ed22bef567e1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:46.742659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1407591403fd4497ac13ed22bef567e1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:46.750175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:46.975334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:46.997134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1407591403fd4497ac13ed22bef567e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:47.013687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ca8d3-4248-44da-949b-9c482cbee3a7 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:47.035194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:47.037652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:47.038865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:47.039684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:47.056513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1407591403fd4497ac13ed22bef567e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:47.080064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1407591403fd4497ac13ed22bef567e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:47.081440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1407591403fd4497ac13ed22bef567e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:47.086719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:47.118377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6d1a3453-9327-4832-8c91-9d2be3e78229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1407591403fd4497ac13ed22bef567e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:47.146739 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2922/5831] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:07:46 2022] DELETE /identity/v3/users/1407591403fd4497ac13ed22bef567e1 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:47.159161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:47.160036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:47.160172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:47.220344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:47.220344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:47.384134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:47.396135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:47.434270 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2923/5832] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:07:47.469401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2910/5833] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:07:47.480635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:47.483936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:47.583179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bd880-14a8-4ea1-a54d-525999d4bc9d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:47.589451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b414c6-9b42-4c64-ba7b-4658837bbfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:47.590472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b414c6-9b42-4c64-ba7b-4658837bbfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:47.590765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b414c6-9b42-4c64-ba7b-4658837bbfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:47.591075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b414c6-9b42-4c64-ba7b-4658837bbfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:47.604427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b414c6-9b42-4c64-ba7b-4658837bbfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:47.606006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b414c6-9b42-4c64-ba7b-4658837bbfa5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:47.637695 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2924/5834] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:07:48.961778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:48.969160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:48.981836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb02a45-6ef4-42a7-a51b-50d44ae2c5e5 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:48.995982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:48.996890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:48.997402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:48.997852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] PATH_INFO: `/v3/projects/ba94ac0e43594ff4857c9c07f45ee75b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:48.999680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba94ac0e43594ff4857c9c07f45ee75b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:49.002978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:49.146242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba94ac0e43594ff4857c9c07f45ee75b', 'request_id': 'req-d7381025-0826-4b99-8890-08a24861dc9d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:49.178218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba94ac0e43594ff4857c9c07f45ee75b', 'request_id': 'req-d7381025-0826-4b99-8890-08a24861dc9d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:49.198624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba94ac0e43594ff4857c9c07f45ee75b', 'request_id': 'req-d7381025-0826-4b99-8890-08a24861dc9d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:49.229316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] The token cache is being invalidate because project ba94ac0e43594ff4857c9c07f45ee75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:07:49.229610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:49.243993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d7381025-0826-4b99-8890-08a24861dc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:49.247060 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2911/5835] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:07:48 2022] DELETE /identity/v3/projects/ba94ac0e43594ff4857c9c07f45ee75b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:49.255691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368fdb5-1951-4747-bed7-9deac1bd9ce6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:49.257607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368fdb5-1951-4747-bed7-9deac1bd9ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:49.258284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368fdb5-1951-4747-bed7-9deac1bd9ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:49.334246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b368fdb5-1951-4747-bed7-9deac1bd9ce6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:49.337030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b368fdb5-1951-4747-bed7-9deac1bd9ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:49.778737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4edb-8603-415a-a45a-b052c608d40a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:49.779167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4edb-8603-415a-a45a-b052c608d40a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:49.779715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4edb-8603-415a-a45a-b052c608d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:49.784169 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2925/5836] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:49.855989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-725e4edb-8603-415a-a45a-b052c608d40a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:49.858266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-725e4edb-8603-415a-a45a-b052c608d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:49.925101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368fdb5-1951-4747-bed7-9deac1bd9ce6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:49.933196 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2912/5837] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:49.968618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368fdb5-1951-4747-bed7-9deac1bd9ce6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:49.994732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:49.999735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:50.000713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:50.002328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:50.006397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:07:50.008793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:50.012440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:50.067897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4edb-8603-415a-a45a-b052c608d40a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:50.089478 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2926/5838] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:07:50.094263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4edb-8603-415a-a45a-b052c608d40a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:50.136031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:50.137249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:50.137755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:50.138243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:50.139627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:50.143644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:50.243302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:50.244264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2913/5839] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:07:50 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:07:50.280086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632bb50-56b0-4f2d-ad95-e36f02536336 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:50.382198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:50.520361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:50.523855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:50.530944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:50.531822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:50.551155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:50.561878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:50.651991 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2927/5840] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:07:50 2022] POST /identity/v3/users => generated 286 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:07:50.657832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:50.692517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa08f5-0c61-49a0-98ed-b9aad46d759e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:50.715599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:50.717152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:50.718115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:50.718789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:50.720612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:50.724148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:50.756705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:50.766063 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2914/5841] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:50.776094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fbdf2-d8aa-407e-9323-83b3afa063ad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:50.792455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d031c-2a5d-4107-9a2b-ceb67c4cea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:50.794081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d031c-2a5d-4107-9a2b-ceb67c4cea8d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:50.796566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d031c-2a5d-4107-9a2b-ceb67c4cea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:50.799459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d031c-2a5d-4107-9a2b-ceb67c4cea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:50.801112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d031c-2a5d-4107-9a2b-ceb67c4cea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:50.806667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d031c-2a5d-4107-9a2b-ceb67c4cea8d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:50.857034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:50.867804 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2928/5842] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:07:50.894449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb46a-a912-4537-a862-95957cf8175d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:50.897782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:50.899878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:50.900411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:50.901063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] PATH_INFO: `/v3/projects/9b033eac677b40189d2380c9312f67f3/users/0f4052005600450c9a66bdadf237fbaa/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:50.946887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b033eac677b40189d2380c9312f67f3, user_id=0f4052005600450c9a66bdadf237fbaa, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:50.953205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:51.011322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2915/5843] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:50 2022] PUT /identity/v3/projects/9b033eac677b40189d2380c9312f67f3/users/0f4052005600450c9a66bdadf237fbaa/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:51.198627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b5bf-0afd-4153-8038-6270d08888f3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:51.199151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b5bf-0afd-4153-8038-6270d08888f3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:51.199598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b5bf-0afd-4153-8038-6270d08888f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:51.278780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-abb9b5bf-0afd-4153-8038-6270d08888f3 None None] MFA Rules not processed for user `0f4052005600450c9a66bdadf237fbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:51.284279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-abb9b5bf-0afd-4153-8038-6270d08888f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:51.551514 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2929/5844] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:51.557780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:51.798759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba94fd-e9c1-4e21-bb07-b81c19d86cf6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:51.808712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:51.810323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:51.810851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:51.811332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:51.812528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:51.815587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:51.873046 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2916/5845] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:07:51 2022] POST /identity/v3/projects => generated 373 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:51.877494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9b5bf-0afd-4153-8038-6270d08888f3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:51.930300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9b5bf-0afd-4153-8038-6270d08888f3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:52.180807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:52.182075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:52.182545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:52.183030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:52.184414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:52.188333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:52.286347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2930/5846] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:07:51 2022] POST /identity/v3/users => generated 293 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:07:52.295881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:52.381355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca7356-ca64-4574-8643-24c4cf3301b5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:52.421557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:52.424016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:52.426323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:52.426926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:52.433787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:52.442649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:52.460103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:52.501323 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2917/5847] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:07:52.503698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:52.541465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd102c-04d7-41f3-9ce2-ab28fdf2f7ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:52.572502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:52.574034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:52.574508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:52.575771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] PATH_INFO: `/v3/projects/ae31e275b709402c9a995bce896b3ba9/users/de1bbbe785274f7f954506f1f9757036/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:52.661915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae31e275b709402c9a995bce896b3ba9, user_id=de1bbbe785274f7f954506f1f9757036, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:52.673293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:52.688394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:52.758183 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2931/5848] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:52 2022] PUT /identity/v3/projects/ae31e275b709402c9a995bce896b3ba9/users/de1bbbe785274f7f954506f1f9757036/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:52.764296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:52.801936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce4ee5-3d9d-4192-909b-39d574d8b03c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:53.089967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613263c4-4d57-482b-b907-b38c09cad4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:53.095633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613263c4-4d57-482b-b907-b38c09cad4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:53.096235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613263c4-4d57-482b-b907-b38c09cad4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:53.096778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613263c4-4d57-482b-b907-b38c09cad4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:53.102674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613263c4-4d57-482b-b907-b38c09cad4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:53.111765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613263c4-4d57-482b-b907-b38c09cad4c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:53.165720 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2918/5849] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:07:53.167263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:53.192394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9269-c616-4436-96ec-99a4f8ab1a0b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:53.220840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:53.226174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:53.227779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:53.228396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] PATH_INFO: `/v3/projects/ae31e275b709402c9a995bce896b3ba9/users/de1bbbe785274f7f954506f1f9757036/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:53.237763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae31e275b709402c9a995bce896b3ba9, user_id=de1bbbe785274f7f954506f1f9757036, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:53.259821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:53.305631 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2932/5850] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:07:53 2022] PUT /identity/v3/projects/ae31e275b709402c9a995bce896b3ba9/users/de1bbbe785274f7f954506f1f9757036/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:07:53.323877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2565-25cd-4d4f-8dba-87d7e4f3057b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:53.324776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2565-25cd-4d4f-8dba-87d7e4f3057b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:53.325508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2565-25cd-4d4f-8dba-87d7e4f3057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:53.458419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4b9a2565-25cd-4d4f-8dba-87d7e4f3057b None None] MFA Rules not processed for user `de1bbbe785274f7f954506f1f9757036`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:53.461179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b9a2565-25cd-4d4f-8dba-87d7e4f3057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:53.824353 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2919/5851] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:53.841120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:53.844724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:54.164908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa0a3-f168-4845-940b-b4a922d07aba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:54.192690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfb8e-8cfd-4a08-be0e-458c2391105e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:54.194418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfb8e-8cfd-4a08-be0e-458c2391105e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:54.194950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfb8e-8cfd-4a08-be0e-458c2391105e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:54.198412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfb8e-8cfd-4a08-be0e-458c2391105e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:54.246298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfb8e-8cfd-4a08-be0e-458c2391105e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:54.255560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfb8e-8cfd-4a08-be0e-458c2391105e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:54.321255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2933/5852] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:07:57.095948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2565-25cd-4d4f-8dba-87d7e4f3057b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:57.238507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2565-25cd-4d4f-8dba-87d7e4f3057b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:57.247927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:57.250150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:57.251047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:57.251964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] PATH_INFO: `/v3/users/0f4052005600450c9a66bdadf237fbaa` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:57.254563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4052005600450c9a66bdadf237fbaa)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:57.258873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:57.317802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:57.378668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4052005600450c9a66bdadf237fbaa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:57.409147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4052005600450c9a66bdadf237fbaa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:57.410418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4052005600450c9a66bdadf237fbaa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:57.424597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4052005600450c9a66bdadf237fbaa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:57.425972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4052005600450c9a66bdadf237fbaa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:57.455082 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2920/5853] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:07:57 2022] DELETE /identity/v3/users/0f4052005600450c9a66bdadf237fbaa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:07:57.462427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c955-1357-4994-8097-9f590e364fad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:57.463577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c955-1357-4994-8097-9f590e364fad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:57.464100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29c955-1357-4994-8097-9f590e364fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:57.503399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1b29c955-1357-4994-8097-9f590e364fad None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:57.505072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b29c955-1357-4994-8097-9f590e364fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:57.760038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2934/5854] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:07:57.807082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:57.813721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:58.028572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa5a3-dff6-41c5-be1f-e651c358368a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:58.040962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:58.042134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:58.042566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:58.042786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:58.064070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:58.065738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:58.085705 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2921/5855] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:07:58.777334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29c955-1357-4994-8097-9f590e364fad None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:58.779718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b29c955-1357-4994-8097-9f590e364fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:58.851529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29c955-1357-4994-8097-9f590e364fad None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:58.867615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:58.869217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:58.869639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:58.870489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] PATH_INFO: `/v3/projects/9b033eac677b40189d2380c9312f67f3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:58.873174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b033eac677b40189d2380c9312f67f3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:58.877584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:59.011373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:59.016539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:59.017338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b033eac677b40189d2380c9312f67f3', 'request_id': 'req-3223d865-73dd-45dd-9b37-6452375787f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.032042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b033eac677b40189d2380c9312f67f3', 'request_id': 'req-3223d865-73dd-45dd-9b37-6452375787f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.045093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53050b-eb43-4803-b676-6565144dd120 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:59.055893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b033eac677b40189d2380c9312f67f3', 'request_id': 'req-3223d865-73dd-45dd-9b37-6452375787f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.095490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] The token cache is being invalidate because project 9b033eac677b40189d2380c9312f67f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:07:59.096872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.100767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.106197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2935/5856] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:07:58 2022] DELETE /identity/v3/projects/9b033eac677b40189d2380c9312f67f3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:59.112734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:07:59.114777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:59.142106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:59.216262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:59.217184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:59.217474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:59.217759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] PATH_INFO: `/v3/users/84a833be8bf245af87264bb1d0bb2240` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:59.221454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a833be8bf245af87264bb1d0bb2240)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:59.223939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:59.318319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223d865-73dd-45dd-9b37-6452375787f6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:07:59.337135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:07:59.338069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:59.338417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:59.338642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] PATH_INFO: `/v3/users/de1bbbe785274f7f954506f1f9757036` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:59.340049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1bbbe785274f7f954506f1f9757036)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:07:59.342192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:07:59.378687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:59.390273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a833be8bf245af87264bb1d0bb2240'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.446426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1bbbe785274f7f954506f1f9757036'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.453452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a833be8bf245af87264bb1d0bb2240'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.454291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a833be8bf245af87264bb1d0bb2240'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.471699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a833be8bf245af87264bb1d0bb2240'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.472818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c13cc018-53c3-4d35-b26a-838626ee6699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a833be8bf245af87264bb1d0bb2240'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.477743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1bbbe785274f7f954506f1f9757036'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.491926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1bbbe785274f7f954506f1f9757036'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.493230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1bbbe785274f7f954506f1f9757036'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.497749 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2922/5857] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:07:59 2022] DELETE /identity/v3/users/84a833be8bf245af87264bb1d0bb2240 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:07:59.503308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:07:59.503751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:07:59.504046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:07:59.508244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1bbbe785274f7f954506f1f9757036'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:07:59.515846 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2936/5858] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:07:59 2022] DELETE /identity/v3/users/de1bbbe785274f7f954506f1f9757036 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:07:59.587625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:07:59.589937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:07:59.936489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2923/5859] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:00.099936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:00.104523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:00.289331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0fc0a-b686-4b73-b668-0b0aea8e525c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:00.302293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad67b88-e394-46de-97a8-e510b0975470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:00.303431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67b88-e394-46de-97a8-e510b0975470 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:00.304013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67b88-e394-46de-97a8-e510b0975470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:00.304306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67b88-e394-46de-97a8-e510b0975470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:00.331921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad67b88-e394-46de-97a8-e510b0975470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:00.333689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad67b88-e394-46de-97a8-e510b0975470 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:00.359133 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2937/5860] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:01.266589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:01.270697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:01.330865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8285-a2ef-458b-aa86-145b92b7333f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:01.356881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:01.358492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:01.358985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:01.359537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] PATH_INFO: `/v3/projects/5a4d6fed279048dfb0e97b1d3cb84deb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:01.371129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4d6fed279048dfb0e97b1d3cb84deb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:01.375319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:01.594412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4d6fed279048dfb0e97b1d3cb84deb', 'request_id': 'req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:01.612022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4d6fed279048dfb0e97b1d3cb84deb', 'request_id': 'req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:01.620687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4d6fed279048dfb0e97b1d3cb84deb', 'request_id': 'req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:01.647131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] The token cache is being invalidate because project 5a4d6fed279048dfb0e97b1d3cb84deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:01.647606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:01.650282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:01.656472 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2924/5861] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:01 2022] DELETE /identity/v3/projects/5a4d6fed279048dfb0e97b1d3cb84deb => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:01.658881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f625ce-85f7-4eaf-8cf6-c9dab05b609a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:01.660144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f625ce-85f7-4eaf-8cf6-c9dab05b609a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:01.660698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f625ce-85f7-4eaf-8cf6-c9dab05b609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:01.700999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66f625ce-85f7-4eaf-8cf6-c9dab05b609a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:01.702696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66f625ce-85f7-4eaf-8cf6-c9dab05b609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:01.792397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:01.844575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:01.846031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:01.928557 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2938/5862] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:01.938566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a23c-f374-49fc-9627-b1942cdaa737 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:01.942288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a23c-f374-49fc-9627-b1942cdaa737 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:01.943164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a23c-f374-49fc-9627-b1942cdaa737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.035826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f26a23c-f374-49fc-9627-b1942cdaa737 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:02.037191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f26a23c-f374-49fc-9627-b1942cdaa737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:02.057437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:02.078192 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2939/5863] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:02.079512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a23c-f374-49fc-9627-b1942cdaa737 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.101815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a23c-f374-49fc-9627-b1942cdaa737 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.118998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.119745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.120040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.120322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.121114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:02.121434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.123161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.139173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbd762-d53a-42e9-b8f5-ba4a10ac3832 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.166008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2940/5864] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:08:02.170498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.170896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.172275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.172864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.173367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] PATH_INFO: `/v3/projects/ae31e275b709402c9a995bce896b3ba9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.180397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae31e275b709402c9a995bce896b3ba9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.184504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.209809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be11e02-3497-46a9-8113-1edb2a69cc73 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.228200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.229272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.229573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.230065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.231652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.243596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.334174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2941/5865] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:02 2022] POST /identity/v3/projects => generated 355 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:02.338668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.409766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae31e275b709402c9a995bce896b3ba9', 'request_id': 'req-3d529597-70d6-48ff-b517-770d9f322023'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:02.429338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae31e275b709402c9a995bce896b3ba9', 'request_id': 'req-3d529597-70d6-48ff-b517-770d9f322023'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:02.440261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae31e275b709402c9a995bce896b3ba9', 'request_id': 'req-3d529597-70d6-48ff-b517-770d9f322023'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:02.488554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] The token cache is being invalidate because project ae31e275b709402c9a995bce896b3ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:02.489559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:02.500873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d529597-70d6-48ff-b517-770d9f322023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:02.509925 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2925/5866] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:01 2022] DELETE /identity/v3/projects/ae31e275b709402c9a995bce896b3ba9 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:02.511188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c131-14c9-4800-920c-f32696b92bb5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.511429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c131-14c9-4800-920c-f32696b92bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.511724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c131-14c9-4800-920c-f32696b92bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.544968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ba28c131-14c9-4800-920c-f32696b92bb5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:02.546110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972409-ff3d-4beb-9e52-7b6c72e7f7c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.547102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba28c131-14c9-4800-920c-f32696b92bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:02.688905 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2926/5867] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:02.699832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbd50f-cf0c-486b-8708-cbecd2c73912 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.700382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbd50f-cf0c-486b-8708-cbecd2c73912 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.701859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbd50f-cf0c-486b-8708-cbecd2c73912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.727437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84dbd50f-cf0c-486b-8708-cbecd2c73912 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:02.729342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84dbd50f-cf0c-486b-8708-cbecd2c73912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:02.751897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.752617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.752911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.753199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.753930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.756128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.760470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2927/5868] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:02.763229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbd50f-cf0c-486b-8708-cbecd2c73912 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.784066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbd50f-cf0c-486b-8708-cbecd2c73912 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.800361 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2942/5869] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:02 2022] POST /identity/v3/users => generated 278 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:02.804788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.806778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.808385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:02.812434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.817020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.817503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.818865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:02.819319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.821156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.835081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fca78d-8894-49cd-9c76-e24933a76c02 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.846642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.847545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.847943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.848333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.850030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.850993 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2928/5870] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:02.853064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.855928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.880068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2943/5871] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:02.882282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.883481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b177d-3cd9-4e99-8a7b-08a2e8db6d1c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.899420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c4ce-41ad-4ee7-ac01-d26b85255518 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.900418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.903423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.903423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.903423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.903423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.906420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.913742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.915083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.915566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.915961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.916838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:02.918794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:02.937537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2944/5872] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:02.944462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:02.952765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:02.961510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2a7d4-aad5-46a4-ac38-b038e40db3b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:02.981552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e91f4-0763-463d-b0b6-03a318f78f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:02.986131 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2929/5873] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:02 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:02.986602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e91f4-0763-463d-b0b6-03a318f78f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:02.987079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e91f4-0763-463d-b0b6-03a318f78f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:02.987614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e91f4-0763-463d-b0b6-03a318f78f5f admin admin] PATH_INFO: `/v3/projects/3098adf812034a0bab4d53438984250b/users/e911c43695be44a7a9b8fab04339cf07/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:02.991621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:03.021552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e91f4-0763-463d-b0b6-03a318f78f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3098adf812034a0bab4d53438984250b, user_id=e911c43695be44a7a9b8fab04339cf07, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:03.026256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e91f4-0763-463d-b0b6-03a318f78f5f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:03.050165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2945/5874] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:02 2022] PUT /identity/v3/projects/3098adf812034a0bab4d53438984250b/users/e911c43695be44a7a9b8fab04339cf07/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:03.072782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:03.073586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:03.073954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:03.081076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:03.165017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f8579-9fec-452d-9d32-5e693f586516 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:03.172466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] MFA Rules not processed for user `e911c43695be44a7a9b8fab04339cf07`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:03.180786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:03.352034 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2946/5875] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:03 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:03.353504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:03.359099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:03.462372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:03.464422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:03.464885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:03.465845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:03.467389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:03.472066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:03.532025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2930/5876] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:02 2022] POST /identity/v3/users => generated 282 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:03.536966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:03.554775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c835ae7-bc2a-48e2-820b-a3a9452bb9e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:03.560300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:03.561404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:03.561882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:03.562733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:03.564001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:03.566019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:03.574565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ebef-57d1-4881-9704-4e23b1683576 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:03.586001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:03.587972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:03.589222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:03.589737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] PATH_INFO: `/v3/users/db35ea89c4554a03abdcfe78d9a83e60` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:03.592394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db35ea89c4554a03abdcfe78d9a83e60)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:03.597876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:03.606395 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2931/5877] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:03 2022] POST /identity/v3/projects => generated 357 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:03.607869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:03.705475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b7a9-e282-4cc7-998e-8a2f8679f4ae admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:03.712774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:03.713804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:03.714410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:03.714845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:03.716488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:03.718596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:03.728264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db35ea89c4554a03abdcfe78d9a83e60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.733605 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2932/5878] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:03.734689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:03.736671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:03.753321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a12ba-415a-4f63-b040-282aecc81785 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:03.759544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:03.761255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:03.761885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:03.762244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db35ea89c4554a03abdcfe78d9a83e60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.762716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] PATH_INFO: `/v3/users/3beed07f732444eea334f34ea75e0c8e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:03.764070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3beed07f732444eea334f34ea75e0c8e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:03.766515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:03.770991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:03.784416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db35ea89c4554a03abdcfe78d9a83e60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.789006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db35ea89c4554a03abdcfe78d9a83e60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.808709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db35ea89c4554a03abdcfe78d9a83e60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.823432 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2947/5879] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:03 2022] DELETE /identity/v3/users/db35ea89c4554a03abdcfe78d9a83e60 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:03.825405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:03.843934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:03.848756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:03.865989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3beed07f732444eea334f34ea75e0c8e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.885159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3beed07f732444eea334f34ea75e0c8e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.887221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3beed07f732444eea334f34ea75e0c8e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.899186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3beed07f732444eea334f34ea75e0c8e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.900280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3beed07f732444eea334f34ea75e0c8e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:03.924635 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2933/5880] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:03 2022] DELETE /identity/v3/users/3beed07f732444eea334f34ea75e0c8e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:03.927620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:03.930626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.033858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2152-f7a3-4614-ab52-00aaa85866f3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.040671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e556bb-486d-4194-ab2d-d00bfbcf414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:04.041590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e556bb-486d-4194-ab2d-d00bfbcf414d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.042022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e556bb-486d-4194-ab2d-d00bfbcf414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.042375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e556bb-486d-4194-ab2d-d00bfbcf414d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.043188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e556bb-486d-4194-ab2d-d00bfbcf414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:04.045027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e556bb-486d-4194-ab2d-d00bfbcf414d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:04.056014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87572-d4b5-4f1a-94fe-a31d1a592402 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.059711 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2934/5881] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:04.061254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.061577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.062097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.064825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:04.065685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.066040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.066389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.067693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:04.071966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:04.101218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:04.104807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.121196 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2948/5882] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:03 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:04.122822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:04.134489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2935/5883] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:04.136277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:04.140165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.155555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752be98-1930-40a4-b87c-3329f8fcb9f6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.177823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:04.179881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.180516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.181244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] PATH_INFO: `/v3/projects/1f830e58be8d464b88b305a8d5a542f2/users/c9a68d71327c4ab0a6c77c0cbaccbc94/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.183155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebfe9a-05b3-4e2a-ab8b-9d9c347240ef None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.207050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:04.209044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.209910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.211920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.216120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:04.222392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:04.247044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f830e58be8d464b88b305a8d5a542f2, user_id=c9a68d71327c4ab0a6c77c0cbaccbc94, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:04.252836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:04.274181 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2936/5884] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:04.287934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:04.291245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.320242 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2949/5885] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:04 2022] PUT /identity/v3/projects/1f830e58be8d464b88b305a8d5a542f2/users/c9a68d71327c4ab0a6c77c0cbaccbc94/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:04.321955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:04.324990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.414482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e982e6-9c55-4e22-b2e7-afec973213d3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.435694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6220224-f59d-4f17-bf66-17f0c927a47d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.441385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:04.442544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.443338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.443631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] PATH_INFO: `/v3/projects/945e45f9ecb94ff49e934ff41ce5b97c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.445247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945e45f9ecb94ff49e934ff41ce5b97c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:04.447264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:04.492360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:04.493543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.493543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.493926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.505083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:04.509533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:04.514497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:04.533847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2937/5886] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:04.535597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:04.549547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7608f-5726-4b50-a351-3bbb8c254c1b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.625921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3bef3-0c3e-4ed8-b61e-2f525e3ee6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:04.628125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3bef3-0c3e-4ed8-b61e-2f525e3ee6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.628683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3bef3-0c3e-4ed8-b61e-2f525e3ee6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.629491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3bef3-0c3e-4ed8-b61e-2f525e3ee6d1 admin admin] PATH_INFO: `/v3/projects/1dea120140fc4e4eb363444d623f4d07/users/16c9fc2ebc424aa8ba48adde94709388/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.650993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945e45f9ecb94ff49e934ff41ce5b97c', 'request_id': 'req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:04.654250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3bef3-0c3e-4ed8-b61e-2f525e3ee6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea120140fc4e4eb363444d623f4d07, user_id=16c9fc2ebc424aa8ba48adde94709388, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:04.658664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3bef3-0c3e-4ed8-b61e-2f525e3ee6d1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:04.679566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:04.683391 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2938/5887] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:04 2022] PUT /identity/v3/projects/1dea120140fc4e4eb363444d623f4d07/users/16c9fc2ebc424aa8ba48adde94709388/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:04.687870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b894798-208d-4cf1-8427-1b08242f036c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.688463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b894798-208d-4cf1-8427-1b08242f036c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.689090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b894798-208d-4cf1-8427-1b08242f036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.696431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945e45f9ecb94ff49e934ff41ce5b97c', 'request_id': 'req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:04.729974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945e45f9ecb94ff49e934ff41ce5b97c', 'request_id': 'req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:04.739325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2b894798-208d-4cf1-8427-1b08242f036c None None] MFA Rules not processed for user `c9a68d71327c4ab0a6c77c0cbaccbc94`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:04.740978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2b894798-208d-4cf1-8427-1b08242f036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.786742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] The token cache is being invalidate because project 945e45f9ecb94ff49e934ff41ce5b97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:04.787610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:04.790016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:04.801737 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2950/5888] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:04 2022] DELETE /identity/v3/projects/945e45f9ecb94ff49e934ff41ce5b97c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:04.807846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:04.810733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.832885 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2939/5889] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:04.839226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:04.839544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:04.839957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:04.863104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ff70-9d6b-4859-85a8-75af51aa46d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:04.863749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:04.867311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.951775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2940/5890] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:04.953053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:04.955837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:04.999033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f651be-01a3-48f2-aa17-35950d5a3137 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.014655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.016604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.017446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.018188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.024941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.034361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.042140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:05.047103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfa400-c992-4d21-b0d0-90684ba3dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.047872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa400-c992-4d21-b0d0-90684ba3dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.048250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa400-c992-4d21-b0d0-90684ba3dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.048493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa400-c992-4d21-b0d0-90684ba3dcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.049664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfa400-c992-4d21-b0d0-90684ba3dcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.054110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfa400-c992-4d21-b0d0-90684ba3dcf7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.075617 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2951/5891] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:05.077873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722850b-6447-427a-8cf0-c04aada6fe04 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.078573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722850b-6447-427a-8cf0-c04aada6fe04 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.079180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722850b-6447-427a-8cf0-c04aada6fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.105785 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2941/5892] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:04 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:05.106772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.106988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d722850b-6447-427a-8cf0-c04aada6fe04 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:05.108831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d722850b-6447-427a-8cf0-c04aada6fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:05.215999 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2952/5893] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:05.217919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722850b-6447-427a-8cf0-c04aada6fe04 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.230147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722850b-6447-427a-8cf0-c04aada6fe04 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.237112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.239005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.239521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.240462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.242044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.244631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.281619 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2953/5894] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:05 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:05.282686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.298773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50a76b-2b17-4692-9d0d-a3ccfb58dddb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.300840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ebebc-941c-4f58-928f-6375aa9f178a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.317151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.317368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.318501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.318956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.319380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] PATH_INFO: `/v3/projects/1dea120140fc4e4eb363444d623f4d07/users/16c9fc2ebc424aa8ba48adde94709388/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.319722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.320079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.320361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.321497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:05.324975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea120140fc4e4eb363444d623f4d07, user_id=16c9fc2ebc424aa8ba48adde94709388, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.329058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.332633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.333275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.354796 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2954/5895] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:05.356168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.376148 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2942/5896] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:05 2022] PUT /identity/v3/projects/1dea120140fc4e4eb363444d623f4d07/users/16c9fc2ebc424aa8ba48adde94709388/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:05.378774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.395162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e215d7-4baa-4406-a6df-29ac6d170051 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.494402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:05.527729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a56778-df82-4523-80ba-d742a61ba845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.528367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56778-df82-4523-80ba-d742a61ba845 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.528662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56778-df82-4523-80ba-d742a61ba845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.528950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56778-df82-4523-80ba-d742a61ba845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.529723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a56778-df82-4523-80ba-d742a61ba845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.531701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a56778-df82-4523-80ba-d742a61ba845 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.547926 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2955/5897] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:05.549578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce335a6-c624-4280-a805-c58e62eccd21 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.549878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce335a6-c624-4280-a805-c58e62eccd21 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.550275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce335a6-c624-4280-a805-c58e62eccd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.555734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb3230-291e-4ab9-8307-ee6c7256da23 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.567730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.569098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.569534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.570005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.570882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.573372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.603198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5ce335a6-c624-4280-a805-c58e62eccd21 None None] MFA Rules not processed for user `16c9fc2ebc424aa8ba48adde94709388`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:05.605147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ce335a6-c624-4280-a805-c58e62eccd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:05.651773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2943/5898] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:05 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:05.653009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.655542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:05.757017 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2956/5899] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:05.761980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce335a6-c624-4280-a805-c58e62eccd21 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.778259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce335a6-c624-4280-a805-c58e62eccd21 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.816959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28653be-6bd1-4011-a894-3f2f5614c0c7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:05.826269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.827488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.828036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.828613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] PATH_INFO: `/v3/users/a473c0bffe29419e8abe282cc07df700` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.830893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a473c0bffe29419e8abe282cc07df700)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.835311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.843794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:05.890576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:05.891872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:05.892268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:05.892762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] PATH_INFO: `/v3/projects/ad3427e27ca04ec898bc105c554e2f3b/users/3d1a1a5040f04fcebe838a6a2f30f742/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:05.926313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3427e27ca04ec898bc105c554e2f3b, user_id=3d1a1a5040f04fcebe838a6a2f30f742, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:05.933739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:05.946874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a473c0bffe29419e8abe282cc07df700'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:05.966146 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2957/5900] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:05 2022] PUT /identity/v3/projects/ad3427e27ca04ec898bc105c554e2f3b/users/3d1a1a5040f04fcebe838a6a2f30f742/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:05.967990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:05.972167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:05.984705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a473c0bffe29419e8abe282cc07df700'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:05.986242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a473c0bffe29419e8abe282cc07df700'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.003390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a473c0bffe29419e8abe282cc07df700'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.006344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a473c0bffe29419e8abe282cc07df700'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.033532 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2944/5901] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:05 2022] DELETE /identity/v3/users/a473c0bffe29419e8abe282cc07df700 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:06.035033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:06.037365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:06.120807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48f59-f6ac-44f8-b624-40f117d76151 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:06.137345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:06.138554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:06.139097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:06.139717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:06.140738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:06.143149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:06.149331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:06.171234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda55d-d066-412a-885f-e15f9a8d3d6e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:06.184077 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2945/5902] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:06 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:06.184077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:06.187669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:06.191999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:06.196693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:06.196693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:06.196693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] PATH_INFO: `/v3/projects/f75351d759284c559bc0d30753199a9e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:06.199851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75351d759284c559bc0d30753199a9e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:06.202701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:06.331467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5e94-2c4c-44c0-9cd5-e87aafd4165a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:06.347036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75351d759284c559bc0d30753199a9e', 'request_id': 'req-fb2f2108-2115-4559-a9c8-2d61a32ba738'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.374406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75351d759284c559bc0d30753199a9e', 'request_id': 'req-fb2f2108-2115-4559-a9c8-2d61a32ba738'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.406406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75351d759284c559bc0d30753199a9e', 'request_id': 'req-fb2f2108-2115-4559-a9c8-2d61a32ba738'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.447954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:06.462520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] The token cache is being invalidate because project f75351d759284c559bc0d30753199a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:06.463425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.466086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:06.469974 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2958/5903] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:05 2022] DELETE /identity/v3/projects/f75351d759284c559bc0d30753199a9e => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:06.491096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:06.501921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:06.591227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:06.592408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:06.592890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:06.593373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:06.596960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:06.769085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f2108-2115-4559-a9c8-2d61a32ba738 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:06.786015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb2650-359c-44c3-ac80-e1fdc7821ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:06.787828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2650-359c-44c3-ac80-e1fdc7821ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:06.788221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2650-359c-44c3-ac80-e1fdc7821ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:06.788607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2650-359c-44c3-ac80-e1fdc7821ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:06.789493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb2650-359c-44c3-ac80-e1fdc7821ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:06.792132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb2650-359c-44c3-ac80-e1fdc7821ca8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:06.799198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:06.801329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:06.830771 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2959/5904] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:06.830771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:06.830771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:06.830771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:06.848930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2946/5905] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:06 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:06.850366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:06.856274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:06.894112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:06.897553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:06.902573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cca04-11e8-44a2-8625-3f9b5a883263 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:06.908868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:06.909867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:06.910479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:06.911024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:06.913429 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2960/5906] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:06.913853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:06.914997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:06.917460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:06.935369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:06.951512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f91f8-3dbb-45e4-84cb-eaac7ad22112 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:06.957275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:06.958354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:06.958723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:06.959012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] PATH_INFO: `/v3/users/405461c4f4764ab3bcb2c53cee5d4869` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:06.960433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405461c4f4764ab3bcb2c53cee5d4869)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:06.963026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:06.985231 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2947/5907] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:06.988797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:07.011887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f086f-afbb-47aa-876b-1334451d09d3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:07.033318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:07.036481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:07.037703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:07.038046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] PATH_INFO: `/v3/projects/ad3427e27ca04ec898bc105c554e2f3b/users/3d1a1a5040f04fcebe838a6a2f30f742/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:07.046003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3427e27ca04ec898bc105c554e2f3b, user_id=3d1a1a5040f04fcebe838a6a2f30f742, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:07.050767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:07.088459 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2948/5908] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:06 2022] PUT /identity/v3/projects/ad3427e27ca04ec898bc105c554e2f3b/users/3d1a1a5040f04fcebe838a6a2f30f742/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:07.088763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:07.091126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:07.102052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405461c4f4764ab3bcb2c53cee5d4869'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:07.130240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405461c4f4764ab3bcb2c53cee5d4869'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:07.134055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:07.151199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405461c4f4764ab3bcb2c53cee5d4869'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:07.153210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405461c4f4764ab3bcb2c53cee5d4869'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:07.164756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405461c4f4764ab3bcb2c53cee5d4869'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:07.186405 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2961/5909] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:06 2022] DELETE /identity/v3/users/405461c4f4764ab3bcb2c53cee5d4869 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:07.186405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:07.187926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:07.230766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2519f-e34c-42db-9236-d18f1bacea8c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:07.362924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:07.366318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:07.366718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:07.368848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:07.375871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:07.397929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4dd75-be5d-48af-aa8f-14dd19ecc2a9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:07.414566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5edd62-2f57-4acf-be4c-c81a14305aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:07.415306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5edd62-2f57-4acf-be4c-c81a14305aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:07.415632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5edd62-2f57-4acf-be4c-c81a14305aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:07.415920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5edd62-2f57-4acf-be4c-c81a14305aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:07.416737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5edd62-2f57-4acf-be4c-c81a14305aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:07.422731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5edd62-2f57-4acf-be4c-c81a14305aa8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:07.445665 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2962/5910] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:07.448325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25812d7-fcad-468b-883e-5620e5336e8a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:07.448639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25812d7-fcad-468b-883e-5620e5336e8a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:07.449816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25812d7-fcad-468b-883e-5620e5336e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:07.450104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:07.454659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:07.486025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2949/5911] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:07.488094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:07.490660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:07.528120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b25812d7-fcad-468b-883e-5620e5336e8a None None] MFA Rules not processed for user `3d1a1a5040f04fcebe838a6a2f30f742`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:07.530083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b25812d7-fcad-468b-883e-5620e5336e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:07.540004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:07.729615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87252cb5-077f-4bf0-af7a-846afdda846b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:07.744130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c882f4-b771-468d-8997-217cd6990e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:07.747060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c882f4-b771-468d-8997-217cd6990e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:07.748186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c882f4-b771-468d-8997-217cd6990e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:07.748915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c882f4-b771-468d-8997-217cd6990e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:07.754598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5c882f4-b771-468d-8997-217cd6990e77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:07.782560 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2963/5912] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:07.783828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25812d7-fcad-468b-883e-5620e5336e8a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:07.808376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25812d7-fcad-468b-883e-5620e5336e8a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:07.820561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:07.821421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:07.821818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:07.822210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] PATH_INFO: `/v3/projects/724eb41089bd40b8855a5c123343ac38/users/f90bad9eb8734186a61e45fa7d915768/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:07.878827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724eb41089bd40b8855a5c123343ac38, user_id=f90bad9eb8734186a61e45fa7d915768, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:07.899006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:07.950244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2964/5913] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:07 2022] PUT /identity/v3/projects/724eb41089bd40b8855a5c123343ac38/users/f90bad9eb8734186a61e45fa7d915768/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:07.957149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:07.965195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:07.970195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c882f4-b771-468d-8997-217cd6990e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:07.971864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c882f4-b771-468d-8997-217cd6990e77 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:07.995383 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2950/5914] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:07 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:07.997401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:07.997600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:07.997784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:08.037715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:08.039223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:08.221141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:08.252176 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2951/5915] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:08.256878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:08.263438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8badc9-acae-4b59-afb1-f895778f5180 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:08.268290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:08.281604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:08.282594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:08.285269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cabd6-5982-4966-b19c-681f1f2a1298 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:08.285735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:08.286314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:08.301451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:08.304208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:08.308245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:08.309525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] PATH_INFO: `/v3/projects/47a3e6ad267248838d4f940165a008c2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:08.313920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a3e6ad267248838d4f940165a008c2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:08.330357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:08.450082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a3e6ad267248838d4f940165a008c2', 'request_id': 'req-12ca5417-b791-4802-9471-7d39317fdf32'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:08.467496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a3e6ad267248838d4f940165a008c2', 'request_id': 'req-12ca5417-b791-4802-9471-7d39317fdf32'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:08.468467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:08.470305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:08.483437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a3e6ad267248838d4f940165a008c2', 'request_id': 'req-12ca5417-b791-4802-9471-7d39317fdf32'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:08.486668 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2965/5916] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:08.488097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:08.489013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:08.492455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:08.514226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] The token cache is being invalidate because project 47a3e6ad267248838d4f940165a008c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:08.515084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:08.518224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12ca5417-b791-4802-9471-7d39317fdf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:08.524557 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2952/5917] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:08 2022] DELETE /identity/v3/projects/47a3e6ad267248838d4f940165a008c2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:08.533433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:08.534025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:08.534413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:08.636251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e88537-b068-4d3d-82ed-e4f5f631b4e4 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:08.665269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:08.667498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:08.705242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:08.705938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:08.707000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:08.707414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:08.710510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:08.829702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:08.831554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:08.839754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:08.867317 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2953/5918] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:08.867317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:08.868851 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2966/5919] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:08.868851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:08.868851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:08.878732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:08.925600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172d3de-fa50-4308-b276-4580a8a5b605 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:08.954073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:08.955117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:08.956643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:08.957579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] PATH_INFO: `/v3/projects/38b7544530fe4bfa889fb61de3649740` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:08.963822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b7544530fe4bfa889fb61de3649740)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:08.974546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:09.122934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624bb54-bbbd-4a5a-840c-f457d12e41d6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:09.169486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b7544530fe4bfa889fb61de3649740', 'request_id': 'req-50d8b771-ce6e-4a18-a559-0ba136e8c892'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:09.188938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b7544530fe4bfa889fb61de3649740', 'request_id': 'req-50d8b771-ce6e-4a18-a559-0ba136e8c892'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:09.214042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b7544530fe4bfa889fb61de3649740', 'request_id': 'req-50d8b771-ce6e-4a18-a559-0ba136e8c892'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:09.274561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] The token cache is being invalidate because project 38b7544530fe4bfa889fb61de3649740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:09.278894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575ad38-a22a-4e2c-bee8-c2804bc0cc31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:09.280730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:09.281868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ad38-a22a-4e2c-bee8-c2804bc0cc31 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.282620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50d8b771-ce6e-4a18-a559-0ba136e8c892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:09.282893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ad38-a22a-4e2c-bee8-c2804bc0cc31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.283415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ad38-a22a-4e2c-bee8-c2804bc0cc31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.286005 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2967/5920] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:08 2022] DELETE /identity/v3/projects/38b7544530fe4bfa889fb61de3649740 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:09.294707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3575ad38-a22a-4e2c-bee8-c2804bc0cc31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:09.297025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990899-a6bc-4d66-9a26-dafb27b372a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.297703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990899-a6bc-4d66-9a26-dafb27b372a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.298005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990899-a6bc-4d66-9a26-dafb27b372a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.353999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8d990899-a6bc-4d66-9a26-dafb27b372a2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:09.357285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d990899-a6bc-4d66-9a26-dafb27b372a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:09.484879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575ad38-a22a-4e2c-bee8-c2804bc0cc31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:09.487719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575ad38-a22a-4e2c-bee8-c2804bc0cc31 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:09.520601 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2954/5921] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:09.527662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f819-b46b-41a1-94e4-86dbb2128c77 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.528460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f819-b46b-41a1-94e4-86dbb2128c77 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.530917 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2968/5922] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:09.532105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f819-b46b-41a1-94e4-86dbb2128c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.535135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990899-a6bc-4d66-9a26-dafb27b372a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:09.556399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:09.581571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990899-a6bc-4d66-9a26-dafb27b372a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:09.598115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b2b4f819-b46b-41a1-94e4-86dbb2128c77 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:09.601611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2b4f819-b46b-41a1-94e4-86dbb2128c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:09.605573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:09.606734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.607226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.622722 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2955/5923] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:09.627230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.632599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f249-2361-4cd9-9158-39329ec7464b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.633593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f249-2361-4cd9-9158-39329ec7464b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.634162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f249-2361-4cd9-9158-39329ec7464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.635744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:09.637369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:09.653165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:09.696390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4786f249-2361-4cd9-9158-39329ec7464b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:09.699154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4786f249-2361-4cd9-9158-39329ec7464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:09.724004 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2969/5924] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:09.742405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:09.742927 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2956/5925] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:08:09.746065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f249-2361-4cd9-9158-39329ec7464b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:09.776149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f249-2361-4cd9-9158-39329ec7464b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:09.794970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:09.796025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.796404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.796703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.805335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:09.805335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:09.805335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:09.838271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e74b6-aca9-49d4-adf5-a5360b199b67 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:09.840680 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2957/5926] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:09.846625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:09.877470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7e9ac-5f34-4f4c-b448-6309fed7450d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:09.894197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:09.895673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:09.902258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.903208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.905250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:09.907120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.907701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:09.908232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:09.911061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:09.915650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:09.920752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:09.933964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.035455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2970/5927] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:09 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:10.037468 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2958/5928] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:09 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:10.042795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.045076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.190059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:10.221592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f9393-62d6-46cf-80bd-37719288b19a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.342569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed993a-52c6-4582-9bfa-ae8bfe29805c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.353583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.354788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.355303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.355864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.357092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.362162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.366557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.368264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.368902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.369535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.371974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.377370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.410511 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2959/5929] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:10 2022] POST /identity/v3/users => generated 288 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:10.413420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.435164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832800ad-a4b4-4604-811f-dd601afd23f6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.439620 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2971/5930] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:10 2022] POST /identity/v3/users => generated 283 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:10.441800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.451291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.453232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.454010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.454714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.456547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.460859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.471023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a265-3e7f-4b4e-a979-0f1db90dba9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.486115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.488482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.489043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.490598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.492333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.498711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.510132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2960/5931] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:10.512270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.535880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8509c4c-bf35-4da3-831f-6db7cfb26088 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.541563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2972/5932] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:10.544053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.549374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.550921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.551251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.551806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.553090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.555876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.563590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beccea5-3301-481b-b280-157b32d519da admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.571413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.572999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.573825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.574545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.576366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.577409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2961/5933] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:10.578509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.580896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.595528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251d84-d6f8-4188-b24a-b374236017fd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.603318 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2973/5934] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:10.605879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.615996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170aaaf-169d-4a10-977b-d76812c76fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.618066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aaaf-169d-4a10-977b-d76812c76fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.619370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aaaf-169d-4a10-977b-d76812c76fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.636574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aaaf-169d-4a10-977b-d76812c76fd5 admin admin] PATH_INFO: `/v3/projects/bdbda1346a1e4373aedb75c850607bb4/users/250dba5cefe7484c904a34f4a83cf84c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.643360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d79ad7-c991-46de-bcbf-d3b23a6e15ab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:10.650148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781540e2-9128-4b7e-aa0c-1be92732b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:10.651217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781540e2-9128-4b7e-aa0c-1be92732b483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.651540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781540e2-9128-4b7e-aa0c-1be92732b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.651935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781540e2-9128-4b7e-aa0c-1be92732b483 admin admin] PATH_INFO: `/v3/projects/ce2d0a04588443b186f4c1d9504835f6/users/8280708212864b22af46b40d71ba07ef/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.679770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781540e2-9128-4b7e-aa0c-1be92732b483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2d0a04588443b186f4c1d9504835f6, user_id=8280708212864b22af46b40d71ba07ef, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.683595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781540e2-9128-4b7e-aa0c-1be92732b483 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.684495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170aaaf-169d-4a10-977b-d76812c76fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbda1346a1e4373aedb75c850607bb4, user_id=250dba5cefe7484c904a34f4a83cf84c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:10.693637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170aaaf-169d-4a10-977b-d76812c76fd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:10.743413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2974/5935] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:10 2022] PUT /identity/v3/projects/ce2d0a04588443b186f4c1d9504835f6/users/8280708212864b22af46b40d71ba07ef/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:10.743643 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2962/5936] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:10 2022] PUT /identity/v3/projects/bdbda1346a1e4373aedb75c850607bb4/users/250dba5cefe7484c904a34f4a83cf84c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:10.746847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.747426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.747965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.756676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:10.757281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:10.757647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:10.799045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] MFA Rules not processed for user `250dba5cefe7484c904a34f4a83cf84c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:10.801112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:10.828575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] MFA Rules not processed for user `8280708212864b22af46b40d71ba07ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:10.832778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:10.870848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:10.911219 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2963/5937] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:10.937972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:10.940644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:11.099001 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2975/5938] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:11.139399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:11.145281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:11.189177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3cf74-5e2f-4751-b268-d8b1cf418307 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:11.199870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2433a1-5af3-473d-8dbb-e8617af3d7cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:11.203001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2433a1-5af3-473d-8dbb-e8617af3d7cf service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:11.203507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2433a1-5af3-473d-8dbb-e8617af3d7cf service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:11.204675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2433a1-5af3-473d-8dbb-e8617af3d7cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:11.257722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2433a1-5af3-473d-8dbb-e8617af3d7cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:11.259416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:11.282908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2433a1-5af3-473d-8dbb-e8617af3d7cf service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:11.363752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2964/5939] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:11.393851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262505b-45cb-4f77-872f-9ca24a5f2c57 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:11.405066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:11.409036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:11.409530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:11.409888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:11.435065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:11.437011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:11.463572 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2976/5940] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:08:11.517608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33e6c3-5a64-4d9a-b652-dc1fa84eaf1a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:11.518439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33e6c3-5a64-4d9a-b652-dc1fa84eaf1a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:11.519165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33e6c3-5a64-4d9a-b652-dc1fa84eaf1a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:11.522257 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2965/5941] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:08:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:08:11.537567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 15:08:11.572105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:11.618688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdffd-6dc1-43a1-83b4-8de30401fe2d service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:11.641033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8280708212864b22af46b40d71ba07ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2d0a04588443b186f4c1d9504835f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:11.642792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:11.644300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:11.644637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] PATH_INFO: `/v3/projects/ce2d0a04588443b186f4c1d9504835f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:11.650674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorizing `identity:get_project(project_id=ce2d0a04588443b186f4c1d9504835f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:11.657415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:11.664257 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2977/5942] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 15:08:11 2022] GET /identity/v3/projects/ce2d0a04588443b186f4c1d9504835f6 => generated 365 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:11.765419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82897a7-f004-43bc-8184-bf64ba113fcd None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:11.765847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82897a7-f004-43bc-8184-bf64ba113fcd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:11.766222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82897a7-f004-43bc-8184-bf64ba113fcd None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:11.768563 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2966/5943] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:08:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:08:11.788923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 15:08:11.792378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:11.843588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:11.876114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81463a-96a8-47a6-8655-173d8bd1d4c6 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:11.892030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8280708212864b22af46b40d71ba07ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2d0a04588443b186f4c1d9504835f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:11.893890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:11.893890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:11.893890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] PATH_INFO: `/v3/projects/ce2d0a04588443b186f4c1d9504835f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:11.899160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorizing `identity:get_project(project_id=ce2d0a04588443b186f4c1d9504835f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:11.902995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:11.917539 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2978/5944] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 15:08:11 2022] GET /identity/v3/projects/ce2d0a04588443b186f4c1d9504835f6 => generated 365 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:12.069711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51234f-7e94-498a-b835-96a92419b5e9 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:12.070533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51234f-7e94-498a-b835-96a92419b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:12.070533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51234f-7e94-498a-b835-96a92419b5e9 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:12.072458 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2967/5945] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:08:12.101915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 15:08:12.136986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:12.166156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbfca4-837d-484e-b8ab-a717b2e965e0 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:12.178976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8280708212864b22af46b40d71ba07ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2d0a04588443b186f4c1d9504835f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:12.184474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:12.188193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:12.189396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] PATH_INFO: `/v3/projects/ce2d0a04588443b186f4c1d9504835f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:12.196173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorizing `identity:get_project(project_id=ce2d0a04588443b186f4c1d9504835f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:12.202654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:12.204739 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2979/5946] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 15:08:12 2022] GET /identity/v3/projects/ce2d0a04588443b186f4c1d9504835f6 => generated 365 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:08:12.328657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19474b03-2878-45bf-8352-27c5dfb00905 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:12.328987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19474b03-2878-45bf-8352-27c5dfb00905 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:12.329219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19474b03-2878-45bf-8352-27c5dfb00905 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:12.331509 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2968/5947] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:08:12.360370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 15:08:12.397007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:12.418920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cf114-9e18-4062-b3d1-7997e983311d tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:12.437624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8280708212864b22af46b40d71ba07ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2d0a04588443b186f4c1d9504835f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:12.442326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:12.443401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:12.444568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] PATH_INFO: `/v3/projects/ce2d0a04588443b186f4c1d9504835f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:12.447609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorizing `identity:get_project(project_id=ce2d0a04588443b186f4c1d9504835f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:12.454626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:12.464184 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2980/5948] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 15:08:12 2022] GET /identity/v3/projects/ce2d0a04588443b186f4c1d9504835f6 => generated 365 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:12.612129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10969c-28bb-4df7-8234-36ed40b5d0bc None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:12.612831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10969c-28bb-4df7-8234-36ed40b5d0bc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:12.613639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10969c-28bb-4df7-8234-36ed40b5d0bc None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:12.617547 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2969/5949] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:08:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:08:12.642668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 15:08:12.668483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:12.695892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d3ede-98e2-4e15-93f2-ea195556807c tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:12.714616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cde6df-a655-4169-a1c2-9918eeab5279 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8280708212864b22af46b40d71ba07ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce2d0a04588443b186f4c1d9504835f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:12.715847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde6df-a655-4169-a1c2-9918eeab5279 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:12.716303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde6df-a655-4169-a1c2-9918eeab5279 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:12.716779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde6df-a655-4169-a1c2-9918eeab5279 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] PATH_INFO: `/v3/projects/ce2d0a04588443b186f4c1d9504835f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:12.723214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cde6df-a655-4169-a1c2-9918eeab5279 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorizing `identity:get_project(project_id=ce2d0a04588443b186f4c1d9504835f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:12.726125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cde6df-a655-4169-a1c2-9918eeab5279 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:12.732935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2981/5950] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 15:08:12 2022] GET /identity/v3/projects/ce2d0a04588443b186f4c1d9504835f6 => generated 365 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:12.797192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10969c-28bb-4df7-8234-36ed40b5d0bc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:12.951138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10969c-28bb-4df7-8234-36ed40b5d0bc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:12.964246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:12.965477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:12.965769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:12.967259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] PATH_INFO: `/v3/users/8280708212864b22af46b40d71ba07ef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:12.972878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8280708212864b22af46b40d71ba07ef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:12.977229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:13.115909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8280708212864b22af46b40d71ba07ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:13.172225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8280708212864b22af46b40d71ba07ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:13.173373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8280708212864b22af46b40d71ba07ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:13.216758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8280708212864b22af46b40d71ba07ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:13.218005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8280708212864b22af46b40d71ba07ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:13.240719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:13.254764 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2970/5951] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:12 2022] DELETE /identity/v3/users/8280708212864b22af46b40d71ba07ef => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:13.257277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:13.258049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:13.258049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:13.341737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:13.344128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:13.606241 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2982/5952] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:13.654837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:13.657030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:13.939086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34925d44-2eb3-423b-b54f-7ad29cc3b0e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:13.948303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4306d-eb6f-4031-847e-dfe9a3acc485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:13.949819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4306d-eb6f-4031-847e-dfe9a3acc485 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:13.950560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4306d-eb6f-4031-847e-dfe9a3acc485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:13.958119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4306d-eb6f-4031-847e-dfe9a3acc485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:14.002163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4306d-eb6f-4031-847e-dfe9a3acc485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:14.015885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4306d-eb6f-4031-847e-dfe9a3acc485 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:14.075312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2971/5953] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:15.788437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:15.792765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:15.855213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b58ace-232a-4a47-a129-40a51fab769d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:15.873687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:15.877467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:15.877909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:15.880004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] PATH_INFO: `/v3/projects/ce2d0a04588443b186f4c1d9504835f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:15.888136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2d0a04588443b186f4c1d9504835f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:15.897606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:16.056607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2d0a04588443b186f4c1d9504835f6', 'request_id': 'req-cbe279f1-4b44-4247-91f1-f300d98db565'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:16.087796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2d0a04588443b186f4c1d9504835f6', 'request_id': 'req-cbe279f1-4b44-4247-91f1-f300d98db565'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:16.113396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2d0a04588443b186f4c1d9504835f6', 'request_id': 'req-cbe279f1-4b44-4247-91f1-f300d98db565'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:16.124069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:16.157701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] The token cache is being invalidate because project ce2d0a04588443b186f4c1d9504835f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:16.158230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:16.163711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbe279f1-4b44-4247-91f1-f300d98db565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:16.175949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2983/5954] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:15 2022] DELETE /identity/v3/projects/ce2d0a04588443b186f4c1d9504835f6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:08:16.179228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0ea8-b193-456e-9da6-ae2baef58491 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:16.180040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0ea8-b193-456e-9da6-ae2baef58491 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:16.180040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0ea8-b193-456e-9da6-ae2baef58491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:16.219950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4f0d0ea8-b193-456e-9da6-ae2baef58491 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:16.221450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f0d0ea8-b193-456e-9da6-ae2baef58491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:16.378175 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2972/5955] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:08:16.378891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ba27-30ab-4ca1-b2ba-e75f405256be None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:16.379257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ba27-30ab-4ca1-b2ba-e75f405256be None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:16.379577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ba27-30ab-4ca1-b2ba-e75f405256be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:16.425541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7fb9ba27-30ab-4ca1-b2ba-e75f405256be None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:16.426896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7fb9ba27-30ab-4ca1-b2ba-e75f405256be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:16.490575 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2984/5956] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:16.494860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0ea8-b193-456e-9da6-ae2baef58491 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:16.524061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0ea8-b193-456e-9da6-ae2baef58491 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:16.539898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:16.541071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:16.541757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:16.542262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:16.543739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:16.544302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:16.558358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:16.600944 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2973/5957] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:08:16.607039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ba27-30ab-4ca1-b2ba-e75f405256be None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:16.646245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ba27-30ab-4ca1-b2ba-e75f405256be None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:16.676903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:16.678632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:16.679763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:16.680194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:16.681447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:16.714850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:16.932556 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2985/5958] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:16 2022] POST /identity/v3/projects => generated 377 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:16.938642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:16.990955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07398d9e-ea2b-41ef-9126-e2afe4731d60 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:17.237642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:17.239577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:17.242092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:17.242595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:17.243626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:17.247429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:17.312297 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2974/5959] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:16 2022] POST /identity/v3/users => generated 289 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:17.322679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:17.343509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c91ab8-e580-4afc-8657-ff1921d6a321 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:17.377746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:17.378718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:17.379207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:17.379739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:17.381439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:17.390718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:17.429793 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2986/5960] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:17.432432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:17.455699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0509c-dab2-4e49-88e7-4c32da1ca55d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:17.472326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70014222-9688-4ecf-bb8b-405500d32190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:17.473605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70014222-9688-4ecf-bb8b-405500d32190 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:17.474303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70014222-9688-4ecf-bb8b-405500d32190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:17.474800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70014222-9688-4ecf-bb8b-405500d32190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:17.476000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70014222-9688-4ecf-bb8b-405500d32190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:17.479193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70014222-9688-4ecf-bb8b-405500d32190 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:17.518997 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2975/5961] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:17.519693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:17.538597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c3e6-cf84-4253-aa60-365e750c7b93 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:17.547904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:17.549289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:17.550142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:17.551531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] PATH_INFO: `/v3/projects/1c251b1b32ea4183baa6f1eb2c7881e1/users/08e61c9a54e44bd28ca10a4cec3b3db6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:17.598713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c251b1b32ea4183baa6f1eb2c7881e1, user_id=08e61c9a54e44bd28ca10a4cec3b3db6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:17.605111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:17.647611 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2987/5962] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:17 2022] PUT /identity/v3/projects/1c251b1b32ea4183baa6f1eb2c7881e1/users/08e61c9a54e44bd28ca10a4cec3b3db6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:17.666946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab15-a68e-481b-9372-107e13547f35 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:17.666946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab15-a68e-481b-9372-107e13547f35 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:17.666946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab15-a68e-481b-9372-107e13547f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:17.757595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:17.842247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:17.844862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:17.851878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c48fab15-a68e-481b-9372-107e13547f35 None None] MFA Rules not processed for user `08e61c9a54e44bd28ca10a4cec3b3db6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:17.854061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c48fab15-a68e-481b-9372-107e13547f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:18.155134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffb4d9-9035-4ce8-a68b-82ce6f9e4c9e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:18.180704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a6fd1-01b8-4437-a7ce-c8c31d2b2a4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:18.186168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a6fd1-01b8-4437-a7ce-c8c31d2b2a4c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:18.187046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a6fd1-01b8-4437-a7ce-c8c31d2b2a4c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:18.187591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a6fd1-01b8-4437-a7ce-c8c31d2b2a4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:18.198569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da0a6fd1-01b8-4437-a7ce-c8c31d2b2a4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:18.270521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a6fd1-01b8-4437-a7ce-c8c31d2b2a4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:18.272993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a6fd1-01b8-4437-a7ce-c8c31d2b2a4c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:18.282355 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2976/5963] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 628 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:18.288625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fab15-a68e-481b-9372-107e13547f35 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:18.341443 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2988/5964] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:18.685651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fab15-a68e-481b-9372-107e13547f35 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:18.741165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:18.742385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:18.742905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:18.743461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:18.744865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:18.767533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:18.800854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73901193-988e-4ef7-9d3c-de7996b2a0ec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:18.801652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73901193-988e-4ef7-9d3c-de7996b2a0ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:18.802200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73901193-988e-4ef7-9d3c-de7996b2a0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:18.864635 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2977/5965] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:18 2022] POST /identity/v3/projects => generated 375 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:18.866215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:18.884117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-73901193-988e-4ef7-9d3c-de7996b2a0ec None None] MFA Rules not processed for user `ed79aa2ea715471bb970282c9e8dfd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:18.887831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73901193-988e-4ef7-9d3c-de7996b2a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:19.114336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d169d9-9ab1-4fda-b612-dc7b5aeb9bc1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:19.141577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:19.142409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:19.142921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:19.143458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:19.144739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:19.149629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:19.211759 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2989/5966] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:19.237729 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2978/5967] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:18 2022] POST /identity/v3/users => generated 294 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:19.244256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73901193-988e-4ef7-9d3c-de7996b2a0ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:19.304866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73901193-988e-4ef7-9d3c-de7996b2a0ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:19.337687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:19.338876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:19.339436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:19.339934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:19.341343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:19.347744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:19.402660 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2990/5968] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:19.407484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:19.450360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d533-1a39-4918-b0ce-690b7f4228d3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:19.489432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:19.491160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:19.492243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:19.493053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] PATH_INFO: `/v3/projects/15a30bf89c4a476780ce986e20df5b7d/users/543a7a520e4045f38c58e165115fd85d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:19.516383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:19.549860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a30bf89c4a476780ce986e20df5b7d, user_id=543a7a520e4045f38c58e165115fd85d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:19.558932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:19.631360 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2979/5969] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:19 2022] PUT /identity/v3/projects/15a30bf89c4a476780ce986e20df5b7d/users/543a7a520e4045f38c58e165115fd85d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:19.646523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:19.693225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dab7fc-a239-4a9d-98ac-6a8a9a4f125d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:19.731572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:19.965214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1b7d-d63c-4b75-821e-ebc93ab38dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:19.966433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1b7d-d63c-4b75-821e-ebc93ab38dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:19.977522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1b7d-d63c-4b75-821e-ebc93ab38dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:19.979843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1b7d-d63c-4b75-821e-ebc93ab38dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:19.983783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1b7d-d63c-4b75-821e-ebc93ab38dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:19.992370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1b7d-d63c-4b75-821e-ebc93ab38dbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:20.058040 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2991/5970] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:20.063044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:20.114884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d945d-b864-4f24-b879-6f395dd73605 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:20.138771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:20.139765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:20.140057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:20.140344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] PATH_INFO: `/v3/projects/15a30bf89c4a476780ce986e20df5b7d/users/543a7a520e4045f38c58e165115fd85d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:20.158286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a30bf89c4a476780ce986e20df5b7d, user_id=543a7a520e4045f38c58e165115fd85d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:20.174674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:20.218239 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2980/5971] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:20 2022] PUT /identity/v3/projects/15a30bf89c4a476780ce986e20df5b7d/users/543a7a520e4045f38c58e165115fd85d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:20.233397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24bb7a-81d7-4aa6-9a8e-1b292c25c095 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:20.234002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24bb7a-81d7-4aa6-9a8e-1b292c25c095 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:20.234289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24bb7a-81d7-4aa6-9a8e-1b292c25c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:20.407531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ab24bb7a-81d7-4aa6-9a8e-1b292c25c095 None None] MFA Rules not processed for user `543a7a520e4045f38c58e165115fd85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:20.416737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab24bb7a-81d7-4aa6-9a8e-1b292c25c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:20.689845 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2992/5972] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:20.707070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:20.743660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf1c69-15b0-4660-a0dd-51f1710d4585 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:20.785586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:20.790650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:20.791524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:20.792300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:20.796460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:20.811686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:20.909087 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2981/5973] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:08:20 2022] POST /identity/v3/domains => generated 245 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:20.916964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24bb7a-81d7-4aa6-9a8e-1b292c25c095 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:20.942207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24bb7a-81d7-4aa6-9a8e-1b292c25c095 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:21.244155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:21.245044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:21.245256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:21.245415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:21.246477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:21.250588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:21.364898 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2993/5974] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:20 2022] POST /identity/v3/projects => generated 408 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:21.366214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:21.391608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e23af-7ff0-4624-ae4c-f5c9f0eaf76d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:21.625697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:21.626433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:21.627306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:21.627306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:21.627977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:21.630862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:21.728098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2982/5975] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:21 2022] POST /identity/v3/users => generated 348 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:21.736286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:21.762161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315212-0aa6-4955-9394-6b556ccb0da6 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:21.780708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fa62e-4e35-48da-8c29-a70ca7cffa1d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:21.781451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa62e-4e35-48da-8c29-a70ca7cffa1d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:21.781752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa62e-4e35-48da-8c29-a70ca7cffa1d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:21.782044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa62e-4e35-48da-8c29-a70ca7cffa1d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:21.786081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fa62e-4e35-48da-8c29-a70ca7cffa1d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:21.789787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fa62e-4e35-48da-8c29-a70ca7cffa1d tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:21.810611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:21.886297 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2994/5976] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:21.901391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:21.953211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647737-6d9a-49bb-97f1-1f59e1b96f06 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:21.993613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed57ec-e302-4d18-a96b-496624dba1de tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:21.997324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed57ec-e302-4d18-a96b-496624dba1de tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:21.998317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed57ec-e302-4d18-a96b-496624dba1de tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:22.001016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed57ec-e302-4d18-a96b-496624dba1de tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/projects/d0f3e2b9a1dd41389de9e64918cb3c5f/users/b3f09575bb0846bc8877d1039c80f95d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:22.068495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed57ec-e302-4d18-a96b-496624dba1de tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d0f3e2b9a1dd41389de9e64918cb3c5f, user_id=b3f09575bb0846bc8877d1039c80f95d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:22.090265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed57ec-e302-4d18-a96b-496624dba1de tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:22.163136 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2983/5977] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:21 2022] PUT /identity/v3/projects/d0f3e2b9a1dd41389de9e64918cb3c5f/users/b3f09575bb0846bc8877d1039c80f95d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:22.166090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e48ca-07e3-4299-b08e-d87e83acc38e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:22.166378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e48ca-07e3-4299-b08e-d87e83acc38e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:22.166894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e48ca-07e3-4299-b08e-d87e83acc38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:22.601416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-177e48ca-07e3-4299-b08e-d87e83acc38e None None] MFA Rules not processed for user `b3f09575bb0846bc8877d1039c80f95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:22.602309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-177e48ca-07e3-4299-b08e-d87e83acc38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:22.662678 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2995/5978] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:22.682923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a16f2-4c46-4388-ba7c-8ff7fa032c71 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:22.683455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a16f2-4c46-4388-ba7c-8ff7fa032c71 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:22.683883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a16f2-4c46-4388-ba7c-8ff7fa032c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:22.768913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-810a16f2-4c46-4388-ba7c-8ff7fa032c71 None None] MFA Rules not processed for user `b3f09575bb0846bc8877d1039c80f95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:22.772075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-810a16f2-4c46-4388-ba7c-8ff7fa032c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:22.834239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e48ca-07e3-4299-b08e-d87e83acc38e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:22.834544 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2984/5979] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:22.891590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e48ca-07e3-4299-b08e-d87e83acc38e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:22.932883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3f09575bb0846bc8877d1039c80f95d', 'user_domain_id': 'a7986c4c7f274624b5c7c8de549a92cb', 'system_scope': None, 'project_id': 'd0f3e2b9a1dd41389de9e64918cb3c5f', 'project_domain_id': 'a7986c4c7f274624b5c7c8de549a92cb', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:22.934074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:22.934535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:22.935084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:22.994794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:22.998104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:23.068252 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2996/5980] 10.222.0.98 () {56 vars in 1283 bytes} [Thu Jul 14 15:08:22 2022] GET /identity/v3/auth/tokens => generated 3350 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:23.069830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a16f2-4c46-4388-ba7c-8ff7fa032c71 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:23.346061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a16f2-4c46-4388-ba7c-8ff7fa032c71 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:23.356426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:23.357280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:23.357571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:23.357860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/users/b3f09575bb0846bc8877d1039c80f95d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:23.361552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b3f09575bb0846bc8877d1039c80f95d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:23.366789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:23.437140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:23.541562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f09575bb0846bc8877d1039c80f95d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:23.595320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f09575bb0846bc8877d1039c80f95d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:23.597059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f09575bb0846bc8877d1039c80f95d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:23.635843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f09575bb0846bc8877d1039c80f95d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:23.637808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f09575bb0846bc8877d1039c80f95d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:23.693642 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2985/5981] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:23 2022] DELETE /identity/v3/users/b3f09575bb0846bc8877d1039c80f95d => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:23.695263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:23.781670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2abdd-54f9-4bde-a073-b15ce530db52 tempest-test_project-187217633 tempest-user-1297329762] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:24.199041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:24.200725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:24.205162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:24.206064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/projects/d0f3e2b9a1dd41389de9e64918cb3c5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:24.251556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d0f3e2b9a1dd41389de9e64918cb3c5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:24.264451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:24.556001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f3e2b9a1dd41389de9e64918cb3c5f', 'request_id': 'req-50e34709-fd96-41eb-82a6-df74f5878617'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:24.583771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:24.593288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f3e2b9a1dd41389de9e64918cb3c5f', 'request_id': 'req-50e34709-fd96-41eb-82a6-df74f5878617'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:24.695331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f3e2b9a1dd41389de9e64918cb3c5f', 'request_id': 'req-50e34709-fd96-41eb-82a6-df74f5878617'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:24.746713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] The token cache is being invalidate because project d0f3e2b9a1dd41389de9e64918cb3c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:24.748666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:24.752762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:24.765601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:24.766442 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2997/5982] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:23 2022] DELETE /identity/v3/projects/d0f3e2b9a1dd41389de9e64918cb3c5f => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:24.768258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:24.812974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec638b4-6741-4d88-9099-4f2f2e5f8e41 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:25.224564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:25.225527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:25.225818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:25.226119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/domains/a7986c4c7f274624b5c7c8de549a92cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:25.230857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a7986c4c7f274624b5c7c8de549a92cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:25.283353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:25.392324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:25.398914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:25.492879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:25.495389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:25.509353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:25.510607 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2986/5983] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:08:24 2022] PATCH /identity/v3/domains/a7986c4c7f274624b5c7c8de549a92cb => generated 246 bytes in 745 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:25.512859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:25.566206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e34709-fd96-41eb-82a6-df74f5878617 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:25.608237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:25.610618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:25.823309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543a7a520e4045f38c58e165115fd85d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a30bf89c4a476780ce986e20df5b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:25.824491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:25.824491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:25.825199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] PATH_INFO: `/v3/domains/a7986c4c7f274624b5c7c8de549a92cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:25.858179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a7986c4c7f274624b5c7c8de549a92cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:25.861455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:25.981138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:25.995097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.007962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0faf-a2d8-4a16-871d-7f48d91c75a8 tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:26.057579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:26.059881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:26.060772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:26.064670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:26.090767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:26.146619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:26.168657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:26.177500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb', 'request_id': 'req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.189215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:26.216821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb', 'request_id': 'req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.242732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb', 'request_id': 'req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.287213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] The token cache is being invalidate because project a7986c4c7f274624b5c7c8de549a92cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:26.287593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.289119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.343082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb', 'request_id': 'req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.361188 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2987/5984] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:26.372006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb', 'request_id': 'req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.379920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb tempest-TestDefaultProjectId-880984774 tempest-TestDefaultProjectId-880984774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a7986c4c7f274624b5c7c8de549a92cb', 'request_id': 'req-741fc5de-704f-4b66-a8bf-57c7c4f10bcb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:26.408178 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2998/5985] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:08:25 2022] DELETE /identity/v3/domains/a7986c4c7f274624b5c7c8de549a92cb => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:26.411998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:26.417675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:26.771461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129f7f-b7a0-472d-812d-f5b907d05dd6 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:26.992989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:26.994273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:26.994762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:26.995247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] PATH_INFO: `/v3/users/08e61c9a54e44bd28ca10a4cec3b3db6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:26.997119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e61c9a54e44bd28ca10a4cec3b3db6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:26.999478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:27.114325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e61c9a54e44bd28ca10a4cec3b3db6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:27.149326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e61c9a54e44bd28ca10a4cec3b3db6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:27.150423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e61c9a54e44bd28ca10a4cec3b3db6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:27.165825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e61c9a54e44bd28ca10a4cec3b3db6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:27.166926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e61c9a54e44bd28ca10a4cec3b3db6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:27.199403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2988/5986] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:26 2022] DELETE /identity/v3/users/08e61c9a54e44bd28ca10a4cec3b3db6 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:27.205971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:27.206575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:27.206943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:27.275371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:27.281412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:27.386238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:27.552032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2999/5987] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:27.608490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:27.610026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:27.701961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:27.834170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6764a71-8c40-4427-bd8b-41f41139c063 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:27.879312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:27.882616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:27.883734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:27.884030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:27.943542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:27.945187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:27.988706 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2989/5988] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:29.841143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:29.843450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:29.873348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250ebb2-27cf-4d35-9320-0a36d065b95d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:29.882457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:29.887071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:29.887653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:29.888114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] PATH_INFO: `/v3/projects/1c251b1b32ea4183baa6f1eb2c7881e1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:29.903261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c251b1b32ea4183baa6f1eb2c7881e1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:29.907796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:30.093508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c251b1b32ea4183baa6f1eb2c7881e1', 'request_id': 'req-1acad338-e05c-4888-aa93-a8272166d337'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.125039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c251b1b32ea4183baa6f1eb2c7881e1', 'request_id': 'req-1acad338-e05c-4888-aa93-a8272166d337'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.171560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c251b1b32ea4183baa6f1eb2c7881e1', 'request_id': 'req-1acad338-e05c-4888-aa93-a8272166d337'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.262142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] The token cache is being invalidate because project 1c251b1b32ea4183baa6f1eb2c7881e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:30.262576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.267130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.288279 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3000/5989] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:29 2022] DELETE /identity/v3/projects/1c251b1b32ea4183baa6f1eb2c7881e1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:30.289307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:30.305518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27046f-90a5-45a7-99bf-7a6db91087d0 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:30.543322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:30.544609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:30.545096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:30.545564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] PATH_INFO: `/v3/users/543a7a520e4045f38c58e165115fd85d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:30.551395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543a7a520e4045f38c58e165115fd85d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:30.554551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:30.700761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543a7a520e4045f38c58e165115fd85d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.741162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543a7a520e4045f38c58e165115fd85d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.743590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543a7a520e4045f38c58e165115fd85d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.764944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543a7a520e4045f38c58e165115fd85d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.772147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-57715e26-dee5-4b29-83a2-e9b67abff7a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543a7a520e4045f38c58e165115fd85d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:30.814939 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2990/5990] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:30 2022] DELETE /identity/v3/users/543a7a520e4045f38c58e165115fd85d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:31.178670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:31.181890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:31.277248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acad338-e05c-4888-aa93-a8272166d337 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:31.604628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:31.606477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:31.606984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:31.607526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] PATH_INFO: `/v3/users/fbdd481439bb44f387a928492c309ad5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:31.611606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdd481439bb44f387a928492c309ad5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:31.616543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:31.766416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdd481439bb44f387a928492c309ad5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:31.769050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:31.831142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdd481439bb44f387a928492c309ad5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:31.869522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdd481439bb44f387a928492c309ad5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:31.876609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdd481439bb44f387a928492c309ad5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:31.951693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46b33b98-75da-4e83-972b-57ebd61f4bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdd481439bb44f387a928492c309ad5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:31.980718 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3001/5991] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:31 2022] DELETE /identity/v3/users/fbdd481439bb44f387a928492c309ad5 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:31.981465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:31.982196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:31.982196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:32.024481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:32.025958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:32.100932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:32.101293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:32.101519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:32.253390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] MFA Rules not processed for user `f90bad9eb8734186a61e45fa7d915768`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:32.262568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:32.284349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:32.394301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2991/5992] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:08:32.395780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:32.397424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:32.426340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc693-b4a5-43da-bd2b-e44613d3a510 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:32.446421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:32.447793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:32.448300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:32.448838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] PATH_INFO: `/v3/projects/15a30bf89c4a476780ce986e20df5b7d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:32.450509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a30bf89c4a476780ce986e20df5b7d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:32.453214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:32.597166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a30bf89c4a476780ce986e20df5b7d', 'request_id': 'req-8553c037-4d4e-42aa-83ea-d54d764763b2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:32.602106 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3002/5993] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:08:32.606489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:32.610454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:32.644805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a30bf89c4a476780ce986e20df5b7d', 'request_id': 'req-8553c037-4d4e-42aa-83ea-d54d764763b2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:32.655930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a30bf89c4a476780ce986e20df5b7d', 'request_id': 'req-8553c037-4d4e-42aa-83ea-d54d764763b2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:32.714769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] The token cache is being invalidate because project 15a30bf89c4a476780ce986e20df5b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:32.718680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:32.725222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8553c037-4d4e-42aa-83ea-d54d764763b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:32.741160 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2992/5994] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:32 2022] DELETE /identity/v3/projects/15a30bf89c4a476780ce986e20df5b7d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:32.747684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59418a80-8b8f-4c08-afe1-249ae2a794b5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:32.747684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59418a80-8b8f-4c08-afe1-249ae2a794b5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:32.747684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59418a80-8b8f-4c08-afe1-249ae2a794b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:32.795241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-59418a80-8b8f-4c08-afe1-249ae2a794b5 None None] MFA Rules not processed for user `f90bad9eb8734186a61e45fa7d915768`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:32.810621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-59418a80-8b8f-4c08-afe1-249ae2a794b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:33.005455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a77ea-e3d0-466d-9b27-20f9bdda693a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:33.094894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2993/5995] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:33.099261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104800cb-a259-4083-a865-54a18dedca4e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:33.101072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104800cb-a259-4083-a865-54a18dedca4e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:33.102522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104800cb-a259-4083-a865-54a18dedca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:33.137224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:33.141743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:33.142059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:33.142324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:33.150465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:33.228547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-104800cb-a259-4083-a865-54a18dedca4e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:33.236593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-104800cb-a259-4083-a865-54a18dedca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:33.248287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:33.338360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:33.342114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:33.375671 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3003/5996] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:33.393472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:33.397666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:33.509288 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2994/5997] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:33.528904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a7be-1945-4b50-9326-6efd832a1f47 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:33.533322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a7be-1945-4b50-9326-6efd832a1f47 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:33.543397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a7be-1945-4b50-9326-6efd832a1f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:33.750239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c264a7be-1945-4b50-9326-6efd832a1f47 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:33.783185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c264a7be-1945-4b50-9326-6efd832a1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:33.785409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8f7ca-efea-4022-887b-0a5cd730934e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:33.805860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:33.808036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:33.808355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:33.808664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:33.813883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:33.833280 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2995/5998] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:33.841791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a7be-1945-4b50-9326-6efd832a1f47 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:33.853327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:33.856473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:33.874095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:33.898120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a7be-1945-4b50-9326-6efd832a1f47 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:33.905368 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3004/5999] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:33.924423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:33.925222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:33.928366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:33.930561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:33.931666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:33.932111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:33.940036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:34.000583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:34.005918 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2996/6000] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:34.020464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402887-1e3d-44b6-9f44-6c2b2beadddb service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:34.039412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:34.041008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:34.051195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:34.053681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:34.058765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:34.059181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:34.061918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:34.084619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f168c30-df9b-4b5e-960c-ae5e0184e4f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:34.098440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:34.112066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:34.112981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:34.113350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:34.113914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] PATH_INFO: `/v3/projects/255b47dfc3f14689baa7648c0042db12` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:34.116560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=255b47dfc3f14689baa7648c0042db12)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:34.120175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:34.229135 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3005/6001] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:33 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:34.233922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:34.334114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255b47dfc3f14689baa7648c0042db12', 'request_id': 'req-7ee15a9f-c054-4130-a404-fecb9568d94e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:34.346962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255b47dfc3f14689baa7648c0042db12', 'request_id': 'req-7ee15a9f-c054-4130-a404-fecb9568d94e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:34.360668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255b47dfc3f14689baa7648c0042db12', 'request_id': 'req-7ee15a9f-c054-4130-a404-fecb9568d94e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:34.382664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] The token cache is being invalidate because project 255b47dfc3f14689baa7648c0042db12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:34.383963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:34.385903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ee15a9f-c054-4130-a404-fecb9568d94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:34.392454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2997/6002] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:34 2022] DELETE /identity/v3/projects/255b47dfc3f14689baa7648c0042db12 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:08:34.416281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270643f-c47e-469f-a80e-888fd62a63ea None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:34.418056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270643f-c47e-469f-a80e-888fd62a63ea None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:34.420467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270643f-c47e-469f-a80e-888fd62a63ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:34.548713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c270643f-c47e-469f-a80e-888fd62a63ea None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:34.553421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c270643f-c47e-469f-a80e-888fd62a63ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:34.568137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdec1b7-ddff-404b-a516-594af6f54043 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:34.704347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:34.841044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:34.842036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:34.842299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:34.842775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:34.844015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:34.848600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:34.903528 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2998/6003] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:34.908625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bae471-c298-4f43-91d6-c32d92f154b5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:34.908992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bae471-c298-4f43-91d6-c32d92f154b5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:34.909393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bae471-c298-4f43-91d6-c32d92f154b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:34.935131 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3006/6004] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:34 2022] POST /identity/v3/users => generated 293 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:34.944148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:34.955829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b3bae471-c298-4f43-91d6-c32d92f154b5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:34.957255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b3bae471-c298-4f43-91d6-c32d92f154b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:34.975660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:34.984711 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2999/6005] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:34.986060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bae471-c298-4f43-91d6-c32d92f154b5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:35.015562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bae471-c298-4f43-91d6-c32d92f154b5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:35.043982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:35.045386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:35.045684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:35.048599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:35.049471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:35.055081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:35.057613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42b607-8507-4c64-a786-63ed80a91d77 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:35.058642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:35.072820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:35.073754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:35.074049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:35.074334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:35.076761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:35.081331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:35.098331 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3000/6006] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:35.103904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:35.122495 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3007/6007] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:35.124015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:35.140821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9ab11-d506-4c6d-866d-3767b3c8d79c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:35.156779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:35.157653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:35.158067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:35.158363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:35.159139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:35.161713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:35.182103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801584d-cb10-4f41-8ddf-88ce65532884 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:35.216159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:35.217657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:35.218204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:35.218670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:35.220864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:35.225313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:35.247349 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3001/6008] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:35 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:35.247349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:35.375795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3008/6009] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:35.387862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:35.505625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:35.517137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c10345-87ee-4ec0-a65d-e1bf5347997e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:35.628425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae1bce-2730-4282-ae22-350155b0b297 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:35.683615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:35.692906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:35.697166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:35.697347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:35.704228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:35.711109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:35.841181 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3002/6010] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:35 2022] POST /identity/v3/users => generated 290 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:35.842943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:35.880271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f85a-070f-4d15-9436-bfd14aa2ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:35.881313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f85a-070f-4d15-9436-bfd14aa2ba27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:35.881694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f85a-070f-4d15-9436-bfd14aa2ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:35.882028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f85a-070f-4d15-9436-bfd14aa2ba27 admin admin] PATH_INFO: `/v3/projects/032bf865f7b7452aac91b106ae15f705/users/74a62d6dc0804ac2b14a57d5592e58f2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:35.906653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4fb62-65e4-4ef3-80ee-59d523e983b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:35.951946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f85a-070f-4d15-9436-bfd14aa2ba27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032bf865f7b7452aac91b106ae15f705, user_id=74a62d6dc0804ac2b14a57d5592e58f2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:35.975011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f85a-070f-4d15-9436-bfd14aa2ba27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:35.994316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:36.008791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:36.016322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:36.017038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:36.025513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:36.037523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:36.076451 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3009/6011] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:35 2022] PUT /identity/v3/projects/032bf865f7b7452aac91b106ae15f705/users/74a62d6dc0804ac2b14a57d5592e58f2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:36.091224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8889d-da58-4cfb-a143-82c0b44e0a23 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:36.091911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8889d-da58-4cfb-a143-82c0b44e0a23 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:36.093179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8889d-da58-4cfb-a143-82c0b44e0a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:36.141243 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3003/6012] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:36.151781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:36.232338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67c8da-9d4f-4dea-b16e-e2c5a9d75cab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:36.243547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0d8889d-da58-4cfb-a143-82c0b44e0a23 None None] MFA Rules not processed for user `74a62d6dc0804ac2b14a57d5592e58f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:36.248128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0d8889d-da58-4cfb-a143-82c0b44e0a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:36.604038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:36.612202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:36.612439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:36.612921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:36.616741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:36.619874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:36.646134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3010/6013] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 558 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:36.647229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8889d-da58-4cfb-a143-82c0b44e0a23 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:36.668583 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3004/6014] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:36.672380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:36.684546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8889d-da58-4cfb-a143-82c0b44e0a23 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:36.696679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94778b24-ac04-457b-b251-997688d3f852 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:36.703815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:36.705589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:36.727322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:36.728835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:36.730124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:36.730296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7f2c-0d13-4a95-a545-da38515a4ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:36.736006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7f2c-0d13-4a95-a545-da38515a4ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:36.737149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7f2c-0d13-4a95-a545-da38515a4ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:36.740272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7f2c-0d13-4a95-a545-da38515a4ce7 admin admin] PATH_INFO: `/v3/projects/cf8e6d97f2cb4df89013c6a5b96ac764/users/9662b54ad7af42a9b094fa841be7e1a0/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:36.747444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:36.778859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:36.811217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7f2c-0d13-4a95-a545-da38515a4ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8e6d97f2cb4df89013c6a5b96ac764, user_id=9662b54ad7af42a9b094fa841be7e1a0, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:36.825903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7f2c-0d13-4a95-a545-da38515a4ce7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:36.854041 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3011/6015] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:36 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:36.858363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:36.885431 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3005/6016] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:36 2022] PUT /identity/v3/projects/cf8e6d97f2cb4df89013c6a5b96ac764/users/9662b54ad7af42a9b094fa841be7e1a0/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:36.887083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:36.887410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:36.887755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:37.023735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] MFA Rules not processed for user `9662b54ad7af42a9b094fa841be7e1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:37.033433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:37.212302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dac4d-441a-4e43-98f4-e9c4d341bdbf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:37.315381 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3006/6017] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:37.321024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:37.323657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:37.407834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:37.554722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:37.556032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:37.556663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:37.557652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:37.558827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:37.561289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:37.641009 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3012/6018] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:36 2022] POST /identity/v3/users => generated 300 bytes in 786 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:37.645945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:37.661288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366986e-e661-46de-a769-6b9b8e30de49 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:37.669063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e9714-33ba-43f7-8921-ba3ed1f20898 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:37.673776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:37.675511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:37.676034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:37.677245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:37.685187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:37.686412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:37.686720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:37.687004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:37.688027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:37.689839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:37.722522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:37.739741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:37.766732 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3013/6019] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:37.772052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:37.816732 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3007/6020] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:37.871048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4eb6b-2d7c-4ba6-adb5-0d4ba194e752 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:37.913147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:37.924112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:37.925807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:37.926435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] PATH_INFO: `/v3/projects/ec81977d7a824387ba23b444c608b681/users/531e8aa12c6f47149a5004f609a52b2f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:38.018982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec81977d7a824387ba23b444c608b681, user_id=531e8aa12c6f47149a5004f609a52b2f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:38.033773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:38.115843 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3014/6021] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:37 2022] PUT /identity/v3/projects/ec81977d7a824387ba23b444c608b681/users/531e8aa12c6f47149a5004f609a52b2f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:08:38.121072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:38.232888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f378c-f63c-405e-88ca-14b2c7dcb341 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:38.771420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf451677-8f21-49ad-8a62-6e909ed59019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:38.772665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf451677-8f21-49ad-8a62-6e909ed59019 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:38.773174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf451677-8f21-49ad-8a62-6e909ed59019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:38.773684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf451677-8f21-49ad-8a62-6e909ed59019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:38.778099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf451677-8f21-49ad-8a62-6e909ed59019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:38.781782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf451677-8f21-49ad-8a62-6e909ed59019 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:38.824424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:38.843840 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3008/6022] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 724 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:38.863195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5325-a3f8-444e-b83d-f37f02511357 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:38.893429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:38.901656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:38.902069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:38.903004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] PATH_INFO: `/v3/projects/ec81977d7a824387ba23b444c608b681/users/531e8aa12c6f47149a5004f609a52b2f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:38.913794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec81977d7a824387ba23b444c608b681, user_id=531e8aa12c6f47149a5004f609a52b2f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:38.932494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:38.974842 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3015/6023] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:38 2022] PUT /identity/v3/projects/ec81977d7a824387ba23b444c608b681/users/531e8aa12c6f47149a5004f609a52b2f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:38.989721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd7b26-18f2-4269-a793-268244e7dcad None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:38.991041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd7b26-18f2-4269-a793-268244e7dcad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:38.991849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd7b26-18f2-4269-a793-268244e7dcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:39.201783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bbbd7b26-18f2-4269-a793-268244e7dcad None None] MFA Rules not processed for user `531e8aa12c6f47149a5004f609a52b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:39.204632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bbbd7b26-18f2-4269-a793-268244e7dcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:39.702934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:39.704688 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3009/6024] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 717 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:39.736150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd7b26-18f2-4269-a793-268244e7dcad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:39.760180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea4d81-1b57-4e5d-9c45-78d5a48b6051 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:39.784812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:39.793976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:39.794411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:39.794710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:39.796066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:39.797887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:39.934531 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3016/6025] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:39 2022] POST /identity/v3/services => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:39.939600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:39.988751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:40.069878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471330d5-2d50-42ad-9c9a-64129d012a75 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:40.111107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:40.111848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:40.116166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:40.116690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:40.122338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:40.134189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:40.148838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd7b26-18f2-4269-a793-268244e7dcad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: On instance['enabled']: Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: On instance['enabled']: Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: 'False' Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise error Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.179459 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:08:40.182850 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 14 15:08:40.189605 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.211141 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3017/6026] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 15:08:39 2022] POST /identity/v3/endpoints => generated 283 bytes in 275 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 14 15:08:40.214272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:40.269147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:40.284259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:40.285018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:40.286401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] PATH_INFO: `/v3/users/9662b54ad7af42a9b094fa841be7e1a0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:40.289879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e347-9541-41a7-8e7b-2082182f9508 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:40.300425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9662b54ad7af42a9b094fa841be7e1a0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:40.313678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:40.317228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:40.322469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:40.323811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:40.324580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:40.326024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:40.328066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: On instance['enabled']: Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: On instance['enabled']: Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: 'True' Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise error Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'True' Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.407592 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:08:40.414428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'True' Jul 14 15:08:40.416042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:40.427774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3018/6027] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 15:08:40 2022] POST /identity/v3/endpoints => generated 281 bytes in 210 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:08:40.429015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:40.464817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8b15-3856-44fb-bac1-267d17e798ee tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:40.487700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:40.492540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:40.505092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:40.534024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:40.542129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:40.557144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:40.565974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:40.608460 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-175495371. To ensure interoperability, identifiers should be a valid uuid. Jul 14 15:08:40.608460 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 15:08:40.608460 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:08:40.630859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9662b54ad7af42a9b094fa841be7e1a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:40.719917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9662b54ad7af42a9b094fa841be7e1a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:40.724420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9662b54ad7af42a9b094fa841be7e1a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:40.752993 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3019/6028] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 15:08:40 2022] POST /identity/v3/endpoints => generated 357 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:40.757593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:40.781240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9662b54ad7af42a9b094fa841be7e1a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:40.791400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1fe44d-1544-4cc9-b353-e908ebdb546d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9662b54ad7af42a9b094fa841be7e1a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:40.819806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fffea-c812-45e0-8284-b98aefa9df02 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:40.836074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:40.838648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:40.842083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:40.843039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/regions/tempest-region-175495371` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:40.848320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-175495371)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:40.853929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:40.860240 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3020/6029] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 15:08:40 2022] GET /identity/v3/regions/tempest-region-175495371 => generated 178 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:40.871147 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3010/6030] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:39 2022] DELETE /identity/v3/users/9662b54ad7af42a9b094fa841be7e1a0 => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:40.871674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:40.883455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:40.886366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:40.892329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:40.893909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:40.921013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77f7f0-6634-4320-ba8b-437cb88fe666 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:41.038099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:41.041344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:41.129156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:41.133646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:41.134604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:41.134604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints/e170dd03be0d469e9a3241a3801cb706` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:41.144840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e170dd03be0d469e9a3241a3801cb706)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:41.150110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: On instance['enabled']: Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: On instance['enabled']: Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: 'False' Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise error Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:41.168924 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:08:41.173142 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3021/6031] 10.222.0.98 () {60 vars in 1254 bytes} [Thu Jul 14 15:08:40 2022] PATCH /identity/v3/endpoints/e170dd03be0d469e9a3241a3801cb706 => generated 283 bytes in 310 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:08:41.176694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:41.194567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9197d-3660-4070-a2ed-009a6e0dbce2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:41.201810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:41.202798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:41.203092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:41.203521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints/e170dd03be0d469e9a3241a3801cb706` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:41.206221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e170dd03be0d469e9a3241a3801cb706)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:41.209212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:41.239864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e170dd03be0d469e9a3241a3801cb706', 'request_id': 'req-7e4b098a-3cfe-49a6-9358-005f35e2928a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:41.285916 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3022/6032] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:41 2022] DELETE /identity/v3/endpoints/e170dd03be0d469e9a3241a3801cb706 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:41.292287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:41.378565 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3011/6033] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:41.403922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:41.407922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:41.421340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b098a-3cfe-49a6-9358-005f35e2928a tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:41.450398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:41.457066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:41.458618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:41.459707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/regions/tempest-region-175495371` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:41.464953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-175495371)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:41.473798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:41.568067 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3023/6034] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 15:08:41 2022] DELETE /identity/v3/regions/tempest-region-175495371 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:41.586427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:41.593049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:41.666286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8543e3f-62cc-4f50-9b4f-b34dec684eca tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:41.680569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:41.682777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:41.683043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:41.684810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:41.687494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:41.692055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:41.712612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868a4b-1295-4235-9a7d-783545f76fd2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:41.759070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:41.759957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:41.760253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:41.760579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:41.762126 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-101197856. To ensure interoperability, identifiers should be a valid uuid. Jul 14 15:08:41.762126 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 15:08:41.762126 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:08:41.798975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:41.800840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:41.838700 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3024/6035] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 15:08:41 2022] POST /identity/v3/endpoints => generated 359 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:41.847086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:41.873572 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3012/6036] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:41 2022] GET /identity/v3/auth/tokens => generated 3544 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:41.914324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52ec08-6272-40c1-8317-6a60a667f6bb tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:41.930565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:41.931368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:41.931791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:41.932015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/regions/tempest-region-101197856` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:41.932635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-101197856)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:41.933784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:41.939574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3025/6037] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 15:08:41 2022] GET /identity/v3/regions/tempest-region-101197856 => generated 178 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:41.945410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:42.030750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5d86-0fa6-4244-8db1-bfa72b4383c4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:42.052724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:42.053694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:42.053986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:42.054270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints/3e877f9901744ba99bd6bc7ed57338d9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:42.078590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=3e877f9901744ba99bd6bc7ed57338d9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:42.079812 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:08:42.079812 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:08:42.079812 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:08:42.080742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: On instance['enabled']: Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: On instance['enabled']: Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: 'True' Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise error Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application 'True' Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:08:42.104091 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:08:42.111006 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application On instance['enabled']: Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application 'True' Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:08:42.112628 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3013/6038] 10.222.0.98 () {60 vars in 1254 bytes} [Thu Jul 14 15:08:41 2022] PATCH /identity/v3/endpoints/3e877f9901744ba99bd6bc7ed57338d9 => generated 281 bytes in 169 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:08:42.113365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:42.145103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:42.156921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4205-74d7-4a69-866b-4ff51afd02e2 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:42.185920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:42.187046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:42.187403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:42.187713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/endpoints/3e877f9901744ba99bd6bc7ed57338d9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:42.191451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=3e877f9901744ba99bd6bc7ed57338d9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:42.193974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:42.228634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '3e877f9901744ba99bd6bc7ed57338d9', 'request_id': 'req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:42.268785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3026/6039] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:42 2022] DELETE /identity/v3/endpoints/3e877f9901744ba99bd6bc7ed57338d9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:42.269090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:42.292300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cab158-7c4c-4001-a04d-137be657f4e5 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:42.337232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:42.340769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:42.342059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:42.342766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/regions/tempest-region-101197856` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:42.347622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-101197856)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:42.352458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:42.422498 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-101197856. To ensure interoperability, identifiers should be a valid uuid. Jul 14 15:08:42.422498 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 14 15:08:42.422498 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:08:42.454356 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3014/6040] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 15:08:42 2022] DELETE /identity/v3/regions/tempest-region-101197856 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:42.460405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:42.498479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1ae36-1c82-4ab9-af68-098c4fb65b91 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:42.574874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531e8aa12c6f47149a5004f609a52b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec81977d7a824387ba23b444c608b681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:42.578348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:42.578645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:42.578981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] PATH_INFO: `/v3/services/cef0246638424e0d823cfeb1b76fda00` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:42.579721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cef0246638424e0d823cfeb1b76fda00)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:42.586486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:42.635437 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3027/6041] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:42 2022] DELETE /identity/v3/services/cef0246638424e0d823cfeb1b76fda00 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:42.637108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:42.641240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:42.737368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91596d-be3b-4557-b6b8-6263ba282917 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:42.799098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:42.801015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:42.801913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:42.802526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] PATH_INFO: `/v3/users/74a62d6dc0804ac2b14a57d5592e58f2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:42.805321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a62d6dc0804ac2b14a57d5592e58f2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:42.810378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:42.863702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:42.867794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:42.932303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b15e8-73da-4b35-9fc8-b32b2c26fe29 tempest-EndpointsNegativeTestJSON-1737242223 tempest-EndpointsNegativeTestJSON-1737242223-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:42.960709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:42.962089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:42.965085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:42.965854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] PATH_INFO: `/v3/projects/cf8e6d97f2cb4df89013c6a5b96ac764` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:42.968383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8e6d97f2cb4df89013c6a5b96ac764)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:42.973064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:43.025453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a62d6dc0804ac2b14a57d5592e58f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.076385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a62d6dc0804ac2b14a57d5592e58f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.083744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a62d6dc0804ac2b14a57d5592e58f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.106519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a62d6dc0804ac2b14a57d5592e58f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.108619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8188cc4a-4c70-4122-bcb6-1ed9bf4fffee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a62d6dc0804ac2b14a57d5592e58f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.143394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8e6d97f2cb4df89013c6a5b96ac764', 'request_id': 'req-8a6ee028-7fb1-4002-82e9-704f8d902579'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.161645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8e6d97f2cb4df89013c6a5b96ac764', 'request_id': 'req-8a6ee028-7fb1-4002-82e9-704f8d902579'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.172960 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3015/6042] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:42 2022] DELETE /identity/v3/users/74a62d6dc0804ac2b14a57d5592e58f2 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:43.180102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecc44d-2d6f-43e8-b564-387a9ad4a93d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:43.180619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecc44d-2d6f-43e8-b564-387a9ad4a93d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:43.181116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecc44d-2d6f-43e8-b564-387a9ad4a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:43.181473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8e6d97f2cb4df89013c6a5b96ac764', 'request_id': 'req-8a6ee028-7fb1-4002-82e9-704f8d902579'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.212785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] The token cache is being invalidate because project cf8e6d97f2cb4df89013c6a5b96ac764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:43.213353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.215163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a6ee028-7fb1-4002-82e9-704f8d902579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:43.234185 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3028/6043] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:42 2022] DELETE /identity/v3/projects/cf8e6d97f2cb4df89013c6a5b96ac764 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:43.236390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29bfd7-0783-4908-b479-6e7918c608fa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:43.237390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29bfd7-0783-4908-b479-6e7918c608fa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:43.240651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29bfd7-0783-4908-b479-6e7918c608fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:43.268821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-06ecc44d-2d6f-43e8-b564-387a9ad4a93d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:43.272373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-06ecc44d-2d6f-43e8-b564-387a9ad4a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:43.413391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:43.487212 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3016/6044] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:08:43.530344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ba29bfd7-0783-4908-b479-6e7918c608fa None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:43.543911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba29bfd7-0783-4908-b479-6e7918c608fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:43.579722 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3029/6045] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:43.598999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:43.599876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:43.600597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:43.683646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:43.687727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:43.719729 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3017/6046] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:43.725375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29bfd7-0783-4908-b479-6e7918c608fa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:43.737908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:43.745267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:43.759456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29bfd7-0783-4908-b479-6e7918c608fa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:43.786520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:43.788823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:43.792836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:43.793768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:43.796010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:43.800178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:43.810810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:43.852796 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3030/6047] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:43.857847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:43.885844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a614-98a8-4a72-8dbd-6bd81b3a9d37 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:43.892420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:43.893655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:43.894240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:43.894790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:43.895817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:43.911955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:43.967553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3031/6048] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:43 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:43.974034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:43.977660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0733b-a046-4772-8c70-0d738249aa26 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:44.106189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:44.137684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0618818-baa7-402e-8149-c9fe46a4fe60 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:44.150403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:44.150608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:44.151164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:44.151606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:44.152758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:44.157743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:44.209700 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3032/6049] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:43 2022] POST /identity/v3/users => generated 281 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:44.216261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:44.252952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc4ea-cd66-435a-bb56-8957ce92e46a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:44.273971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:44.281856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:44.282245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:44.282526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:44.286088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:44.298965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:44.298965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:44.298965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:44.298965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:44.302773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:44.349698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:44.352855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:44.359334 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3033/6050] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:08:44.361080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:44.386961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b857-9853-47f2-a3a0-d047f4905f2c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:44.415159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede453a-d266-4b41-afba-205b26086a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:44.415758 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3018/6051] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:44.415950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede453a-d266-4b41-afba-205b26086a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:44.417194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede453a-d266-4b41-afba-205b26086a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:44.417542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede453a-d266-4b41-afba-205b26086a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:44.418628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede453a-d266-4b41-afba-205b26086a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:44.420681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede453a-d266-4b41-afba-205b26086a54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:44.477472 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3034/6052] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:44.486746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:44.528264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc50f9-91fa-4550-80e8-bf250784825e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:44.558494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:44.560618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:44.562546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:44.571495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] PATH_INFO: `/v3/projects/b671035050a44cd9ab78debecf203e2d/users/3d09f924225c4abb90f04ed4859179b6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:44.652320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b671035050a44cd9ab78debecf203e2d, user_id=3d09f924225c4abb90f04ed4859179b6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:44.666671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:44.725342 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3019/6053] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:44 2022] PUT /identity/v3/projects/b671035050a44cd9ab78debecf203e2d/users/3d09f924225c4abb90f04ed4859179b6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:44.766124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:44.766463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:44.766644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:44.861448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] MFA Rules not processed for user `3d09f924225c4abb90f04ed4859179b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:44.873151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:45.136440 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3035/6054] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:45.151545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:45.155831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:45.388537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa44-cef8-438f-bc36-1d2e7d8b9c67 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:45.404996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:45.406186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:45.406684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:45.407263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:45.428130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:45.451074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:45.453669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:45.491895 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3020/6055] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:47.397590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:47.400202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:47.688274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120b15d-b66a-4925-9322-8051c9b2376e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:47.699479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:47.701544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:47.701544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:47.701983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] PATH_INFO: `/v3/projects/032bf865f7b7452aac91b106ae15f705` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:47.704581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032bf865f7b7452aac91b106ae15f705)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:47.711873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:47.840307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032bf865f7b7452aac91b106ae15f705', 'request_id': 'req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:47.845086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:47.855063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032bf865f7b7452aac91b106ae15f705', 'request_id': 'req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:47.871242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032bf865f7b7452aac91b106ae15f705', 'request_id': 'req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:47.905624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] The token cache is being invalidate because project 032bf865f7b7452aac91b106ae15f705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:47.907388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:47.908965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:47.912514 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3036/6056] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:47 2022] DELETE /identity/v3/projects/032bf865f7b7452aac91b106ae15f705 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:47.917649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:47.932962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbd0c-9d4a-463f-a763-fa30f4f8d8ca service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:48.020565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:48.021866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:48.022329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:48.022785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] PATH_INFO: `/v3/users/531e8aa12c6f47149a5004f609a52b2f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:48.025360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=531e8aa12c6f47149a5004f609a52b2f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:48.029833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:48.137003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531e8aa12c6f47149a5004f609a52b2f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:48.164141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531e8aa12c6f47149a5004f609a52b2f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:48.164953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531e8aa12c6f47149a5004f609a52b2f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:48.175483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531e8aa12c6f47149a5004f609a52b2f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:48.176902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cda65db5-11a9-4522-99a9-5dc2111eed7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531e8aa12c6f47149a5004f609a52b2f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:48.213427 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3021/6057] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:47 2022] DELETE /identity/v3/users/531e8aa12c6f47149a5004f609a52b2f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:49.396038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:49.398438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:49.445764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fa346-1096-4ffa-9e7c-632b09e2a5c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:49.781163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:49.782732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:49.783219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:49.783786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] PATH_INFO: `/v3/projects/ec81977d7a824387ba23b444c608b681` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:49.789804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec81977d7a824387ba23b444c608b681)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:49.793592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:50.106940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec81977d7a824387ba23b444c608b681', 'request_id': 'req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:50.141778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec81977d7a824387ba23b444c608b681', 'request_id': 'req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:50.182304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec81977d7a824387ba23b444c608b681', 'request_id': 'req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:50.275188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] The token cache is being invalidate because project ec81977d7a824387ba23b444c608b681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:50.275761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:50.277007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ca21bed-b309-4998-a7da-ed03ad4ba6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:50.292578 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3037/6058] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:49 2022] DELETE /identity/v3/projects/ec81977d7a824387ba23b444c608b681 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:50.294687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7d86-7af5-44ce-9a86-2c3b49ae8edf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:50.296303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7d86-7af5-44ce-9a86-2c3b49ae8edf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:50.297078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7d86-7af5-44ce-9a86-2c3b49ae8edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:50.368598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-333a7d86-7af5-44ce-9a86-2c3b49ae8edf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:50.370701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-333a7d86-7af5-44ce-9a86-2c3b49ae8edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:50.610091 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3022/6059] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:50.631561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d3b5c-97b3-43e5-b5cc-6fdf4e97c4aa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:50.633274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d3b5c-97b3-43e5-b5cc-6fdf4e97c4aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:50.634040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d3b5c-97b3-43e5-b5cc-6fdf4e97c4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:50.713534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c06d3b5c-97b3-43e5-b5cc-6fdf4e97c4aa None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:50.715347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c06d3b5c-97b3-43e5-b5cc-6fdf4e97c4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:50.733487 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3038/6060] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:50.740130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7d86-7af5-44ce-9a86-2c3b49ae8edf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:50.755623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7d86-7af5-44ce-9a86-2c3b49ae8edf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:50.775313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:50.776056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:50.776411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:50.776806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:50.777689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:50.778134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:50.779993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:50.809936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:50.835078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3023/6061] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:50.836498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d3b5c-97b3-43e5-b5cc-6fdf4e97c4aa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:50.847765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d3b5c-97b3-43e5-b5cc-6fdf4e97c4aa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:50.880640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:50.882227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:50.882227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:50.882227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:50.882750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:50.890089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:50.970593 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3039/6062] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:50 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:50.972471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:51.005122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b675e70-eebc-4632-ac73-dd8f2035130b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:51.372621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:51.382735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:51.384015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:51.385209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:51.398649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:51.407698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:51.536767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3024/6063] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:50 2022] POST /identity/v3/users => generated 294 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:51.537136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:51.583819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45022-5336-490a-a9c9-f9fdfc461567 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:51.633423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:51.636133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:51.636658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:51.637221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:51.639025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:51.643051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:51.697602 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3040/6064] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:51.702396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:51.734999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85dc2c-0b48-4a81-b9b5-0c0a579de71e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:51.755534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82055dfa-8f99-4780-ab84-1d705d3a2dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:51.757999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82055dfa-8f99-4780-ab84-1d705d3a2dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:51.759079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82055dfa-8f99-4780-ab84-1d705d3a2dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:51.761445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82055dfa-8f99-4780-ab84-1d705d3a2dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:51.763613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82055dfa-8f99-4780-ab84-1d705d3a2dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:51.778918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82055dfa-8f99-4780-ab84-1d705d3a2dcd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:51.818113 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3025/6065] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:51.821273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:51.845698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605082-3fe9-4e7e-aa31-d60cd2d9df20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:51.885556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:51.886653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:51.886948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:51.887238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] PATH_INFO: `/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f/users/f546e4fb17c74e61972bc9a0a0b9d84f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:51.981312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d88ed19a66f44b18a0954b21a2a1b7f, user_id=f546e4fb17c74e61972bc9a0a0b9d84f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:51.984097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:52.050166 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3041/6066] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:51 2022] PUT /identity/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f/users/f546e4fb17c74e61972bc9a0a0b9d84f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:52.062819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50c4ed-8982-4dcd-84e2-6a97a4db6b17 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:52.063677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50c4ed-8982-4dcd-84e2-6a97a4db6b17 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:52.064477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50c4ed-8982-4dcd-84e2-6a97a4db6b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:52.168819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6b50c4ed-8982-4dcd-84e2-6a97a4db6b17 None None] MFA Rules not processed for user `f546e4fb17c74e61972bc9a0a0b9d84f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:52.171206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6b50c4ed-8982-4dcd-84e2-6a97a4db6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:52.421520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3026/6067] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:52.425958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:52.441097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:52.662189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b8983-9953-45c9-97d0-7b721473fb64 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:52.676592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:52.678723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:52.679110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:52.681523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:52.682439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:52.685986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:52.740002 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3042/6068] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:08:52 2022] POST /identity/v3/projects => generated 387 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:52.740315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50c4ed-8982-4dcd-84e2-6a97a4db6b17 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:52.761329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50c4ed-8982-4dcd-84e2-6a97a4db6b17 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:52.974318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:52.975359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:52.975766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:52.976125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:52.977555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:52.981643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:53.023404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:53.037417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:53.049301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3027/6069] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:08:52 2022] POST /identity/v3/users => generated 300 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:08:53.056194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01ea7-3a2a-4077-9667-691abd3ca1f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:53.068750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:53.069632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:53.069949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:53.070198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:53.071146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:53.075083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:53.101818 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3043/6070] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:53.103310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:53.118901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f896cd-c1ed-4ae8-a161-b6158337d20f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:53.139715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:53.140776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:53.141341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:53.141640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] PATH_INFO: `/v3/projects/790713f53b684970a52684f2c86825a4/users/5622f08e1e4e4219ad8734b9333e3087/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:53.168167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790713f53b684970a52684f2c86825a4, user_id=5622f08e1e4e4219ad8734b9333e3087, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:53.171876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:53.202344 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3028/6071] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:53 2022] PUT /identity/v3/projects/790713f53b684970a52684f2c86825a4/users/5622f08e1e4e4219ad8734b9333e3087/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:53.208325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:53.249223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d89c6-a04e-4515-a8fd-ea10d638766a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:53.467258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb55a-2c2d-4e1d-8c8b-62f20ced3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:53.468003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb55a-2c2d-4e1d-8c8b-62f20ced3048 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:53.468298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb55a-2c2d-4e1d-8c8b-62f20ced3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:53.468582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb55a-2c2d-4e1d-8c8b-62f20ced3048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:53.469343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb55a-2c2d-4e1d-8c8b-62f20ced3048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:53.487146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb55a-2c2d-4e1d-8c8b-62f20ced3048 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:53.531067 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3044/6072] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:53.537585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:53.554152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65d7ce-8ff9-45be-af33-7cadb9586028 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:53.575238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:53.576214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:53.576796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:53.577184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] PATH_INFO: `/v3/projects/790713f53b684970a52684f2c86825a4/users/5622f08e1e4e4219ad8734b9333e3087/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:53.587469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=790713f53b684970a52684f2c86825a4, user_id=5622f08e1e4e4219ad8734b9333e3087, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:53.591515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:53.630608 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3029/6073] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:08:53 2022] PUT /identity/v3/projects/790713f53b684970a52684f2c86825a4/users/5622f08e1e4e4219ad8734b9333e3087/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:53.651931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f93b4f-64af-4f29-a4a4-2a17c6ae28ee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:53.652723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f93b4f-64af-4f29-a4a4-2a17c6ae28ee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:53.653365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f93b4f-64af-4f29-a4a4-2a17c6ae28ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:53.785962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a1f93b4f-64af-4f29-a4a4-2a17c6ae28ee None None] MFA Rules not processed for user `5622f08e1e4e4219ad8734b9333e3087`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:53.787117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1f93b4f-64af-4f29-a4a4-2a17c6ae28ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:54.162479 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3045/6074] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:54.164700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:54.225063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104b92-2f4d-45ce-9a7a-444a9a65e6ea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:54.292797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:54.294294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:54.294796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:54.295320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:54.303713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:get_project(project_id=7d88ed19a66f44b18a0954b21a2a1b7f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:54.310855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:54.321462 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3030/6075] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:08:54 2022] GET /identity/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f => generated 387 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:54.325912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f93b4f-64af-4f29-a4a4-2a17c6ae28ee None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:54.331752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:54.339856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f93b4f-64af-4f29-a4a4-2a17c6ae28ee None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:54.361446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:54.362168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:54.362528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:54.362869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:54.363733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:54.369335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:54.433106 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3046/6076] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:08:54 2022] POST /identity/v3/projects => generated 339 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:08:54.434890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:54.451391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0d581-8f74-4483-80eb-467730f17734 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:54.686879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:54.689505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:54.689709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:54.689909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:54.690690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:54.696159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:54.749462 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3031/6077] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:08:54 2022] GET /identity/v3/projects => generated 7206 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:54.755081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:54.774092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67d0f3-ef1b-4bf0-be33-19f4bdd0b45a tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:54.781984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:54.783184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:54.783679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:54.784179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:54.785775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:get_project(project_id=7d88ed19a66f44b18a0954b21a2a1b7f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:54.789167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:54.796486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:54.808637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3047/6078] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:08:54 2022] GET /identity/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f => generated 387 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:54.811747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2338c4f-dc11-42aa-92cf-8274c744b702 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:54.821812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:54.823040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:54.823655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:54.824128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects/8d0389dfc725448c99a9285dd48537c5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:54.828551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:get_project(project_id=8d0389dfc725448c99a9285dd48537c5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:54.831436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:54.839151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:54.840058 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3032/6079] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:08:54 2022] GET /identity/v3/projects/8d0389dfc725448c99a9285dd48537c5 => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:54.858851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f8898-b605-4da0-8b71-f25eaeaf82e5 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:54.868811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:54.873185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:54.873828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:54.874388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:54.875490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:54.881640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:54.915209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:54.930011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2ae82-8e86-4894-8e5b-5a802819516f tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:54.930306 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3048/6080] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:08:54 2022] GET /identity/v3/projects => generated 7206 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:54.937596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:54.938584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:54.939049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:54.939580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:54.940928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:54.941661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:54.945267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:54.983299 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3033/6081] 10.222.0.98 () {58 vars in 1165 bytes} [Thu Jul 14 15:08:54 2022] GET /identity/v3/projects?domain_id=default => generated 6875 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:54.985037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:55.033911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4eae-f0e8-4b3e-b437-b56cfbec26de tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:55.096648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:55.097845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:55.098358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:55.098865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:55.100365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:55.114799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:55.244586 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3049/6082] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:08:54 2022] GET /identity/v3/projects => generated 7206 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:55.246080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:55.259016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ef2df-2354-46dd-a05f-3685ecb6122b tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:55.281031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:55.282385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:55.283668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:55.286812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:55.288500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:55.290921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:55.293388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:55.356151 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3034/6083] 10.222.0.98 () {58 vars in 1165 bytes} [Thu Jul 14 15:08:55 2022] GET /identity/v3/projects?domain_id=default => generated 6875 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:55.367664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:55.398420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fba685-a95d-422c-90d4-4f48b58db873 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:55.436512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:55.437510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:55.438048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:55.438610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:55.440365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:55.446957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:55.519516 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3050/6084] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:08:55 2022] GET /identity/v3/projects => generated 7206 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:08:55.525399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:55.548200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3629d4-1443-4166-9baf-a07a91255869 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:55.576021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:55.576918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:55.579044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:55.579437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:55.585185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-361640299) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:08:55.586814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:55.600087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:55.660414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:55.660636 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3035/6085] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:08:55 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-361640299 => generated 534 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:08:55.680230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb51321-324e-45d5-87cb-f067f6c5eee3 tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:55.701937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5622f08e1e4e4219ad8734b9333e3087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790713f53b684970a52684f2c86825a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:55.703002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:55.703452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:55.703855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] PATH_INFO: `/v3/projects/8d0389dfc725448c99a9285dd48537c5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:55.705897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8d0389dfc725448c99a9285dd48537c5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:55.709331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:55.815696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0389dfc725448c99a9285dd48537c5', 'request_id': 'req-a8a6a684-6d34-459d-ab80-38d57d99f2bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:55.825929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0389dfc725448c99a9285dd48537c5', 'request_id': 'req-a8a6a684-6d34-459d-ab80-38d57d99f2bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:55.834867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0389dfc725448c99a9285dd48537c5', 'request_id': 'req-a8a6a684-6d34-459d-ab80-38d57d99f2bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:55.859501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] The token cache is being invalidate because project 8d0389dfc725448c99a9285dd48537c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:08:55.862223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:55.864542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8a6a684-6d34-459d-ab80-38d57d99f2bf tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:55.868780 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3051/6086] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:08:55 2022] DELETE /identity/v3/projects/8d0389dfc725448c99a9285dd48537c5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:55.874423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:55.877979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:56.136953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36e79b-f0c1-44e9-b7fb-0cddbdc8786d tempest-ListProjectsStaticTestJSON-189576061 tempest-ListProjectsStaticTestJSON-189576061-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:56.164784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:56.362129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:56.363821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:56.364390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:56.364685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] PATH_INFO: `/v3/users/f546e4fb17c74e61972bc9a0a0b9d84f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:56.369339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f546e4fb17c74e61972bc9a0a0b9d84f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:56.374078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:56.542673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f546e4fb17c74e61972bc9a0a0b9d84f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:56.589393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f546e4fb17c74e61972bc9a0a0b9d84f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:56.593543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f546e4fb17c74e61972bc9a0a0b9d84f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:56.630407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f546e4fb17c74e61972bc9a0a0b9d84f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:56.632741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f546e4fb17c74e61972bc9a0a0b9d84f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:56.684098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3036/6087] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:55 2022] DELETE /identity/v3/users/f546e4fb17c74e61972bc9a0a0b9d84f => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:56.689314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:56.690054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:56.690857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:56.740063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:56.742604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:56.940339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3052/6088] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:56.977970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:56.980058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:57.209318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70361-648a-40a0-8917-e5904a96852b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:57.232215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:57.238145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:57.249799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:57.249799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:57.282515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:57.284378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:57.332965 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3037/6089] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:57.479599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:57.481370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:57.555803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:57.799467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d520f-4d35-4cd5-a374-d8865f057250 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:57.821138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb840db-3773-4529-a086-039d30e289fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:57.821949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb840db-3773-4529-a086-039d30e289fe service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:57.822371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb840db-3773-4529-a086-039d30e289fe service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:57.822765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb840db-3773-4529-a086-039d30e289fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:57.835992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cb840db-3773-4529-a086-039d30e289fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:58.176727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb840db-3773-4529-a086-039d30e289fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:58.180093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb840db-3773-4529-a086-039d30e289fe service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:58.243339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:58.243339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:58.317130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d42da5-921d-4da4-aa91-5d4df4061f2e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:58.340657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:58.342156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:58.342593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:58.343065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] PATH_INFO: `/v3/users/e911c43695be44a7a9b8fab04339cf07` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:58.344037 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3053/6090] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 860 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:08:58.347285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e911c43695be44a7a9b8fab04339cf07)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:58.356574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:58.521034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:58.580282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e911c43695be44a7a9b8fab04339cf07'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:58.626188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e911c43695be44a7a9b8fab04339cf07'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:58.627876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e911c43695be44a7a9b8fab04339cf07'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:58.666080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e911c43695be44a7a9b8fab04339cf07'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:58.666946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e911c43695be44a7a9b8fab04339cf07'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:08:58.710302 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3038/6091] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:08:58 2022] DELETE /identity/v3/users/e911c43695be44a7a9b8fab04339cf07 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:08:58.713603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:58.714132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:58.715075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:58.803570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:08:58.805915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:59.000323 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3054/6092] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:08:59.037040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:08:59.040007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:08:59.335597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423b594-eb57-4f8e-89e1-639ffb7270e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:08:59.369038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:08:59.369948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:08:59.370249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:08:59.370877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:08:59.412211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:08:59.414044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:08:59.442905 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3039/6093] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:00.206908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:00.209496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:00.230149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f3ec-478b-425c-a198-5a2097afe2b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:00.257359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:00.258706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:00.259252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:00.259846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] PATH_INFO: `/v3/projects/3098adf812034a0bab4d53438984250b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:00.261603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3098adf812034a0bab4d53438984250b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:00.266652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:00.449387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:00.474550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:00.486892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:00.507058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea813f-4c0c-4410-90a5-b8accf4e653e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:00.513983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3098adf812034a0bab4d53438984250b', 'request_id': 'req-7047ab6c-99ff-4650-94b9-5e938f17e92e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.527066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3098adf812034a0bab4d53438984250b', 'request_id': 'req-7047ab6c-99ff-4650-94b9-5e938f17e92e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.543787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3098adf812034a0bab4d53438984250b', 'request_id': 'req-7047ab6c-99ff-4650-94b9-5e938f17e92e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.583543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] The token cache is being invalidate because project 3098adf812034a0bab4d53438984250b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:00.584377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.586344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.590659 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3055/6094] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:00 2022] DELETE /identity/v3/projects/3098adf812034a0bab4d53438984250b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:00.597130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:00.602691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:00.679258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:00.681040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:00.681427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:00.681790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] PATH_INFO: `/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:00.689961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d88ed19a66f44b18a0954b21a2a1b7f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:00.692413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:00.824281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d88ed19a66f44b18a0954b21a2a1b7f', 'request_id': 'req-7f754fa6-8860-4316-8994-d2fc74e1a6a1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.827678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:00.838806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d88ed19a66f44b18a0954b21a2a1b7f', 'request_id': 'req-7f754fa6-8860-4316-8994-d2fc74e1a6a1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.847302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d88ed19a66f44b18a0954b21a2a1b7f', 'request_id': 'req-7f754fa6-8860-4316-8994-d2fc74e1a6a1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.875005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] The token cache is being invalidate because project 7d88ed19a66f44b18a0954b21a2a1b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:00.879541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.880582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:00.889701 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3040/6095] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:00 2022] DELETE /identity/v3/projects/7d88ed19a66f44b18a0954b21a2a1b7f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:00.891043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:00.892950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:00.984340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047ab6c-99ff-4650-94b9-5e938f17e92e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:01.062023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f754fa6-8860-4316-8994-d2fc74e1a6a1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:01.080236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:01.081916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:01.082970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:01.083503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] PATH_INFO: `/v3/users/5622f08e1e4e4219ad8734b9333e3087` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:01.085193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5622f08e1e4e4219ad8734b9333e3087)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:01.087590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:01.201173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:01.204833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:01.205321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:01.205785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] PATH_INFO: `/v3/users/16c9fc2ebc424aa8ba48adde94709388` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:01.208808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c9fc2ebc424aa8ba48adde94709388)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:01.214012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:01.286434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5622f08e1e4e4219ad8734b9333e3087'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.331095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5622f08e1e4e4219ad8734b9333e3087'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.336594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5622f08e1e4e4219ad8734b9333e3087'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.336902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c9fc2ebc424aa8ba48adde94709388'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.356291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c9fc2ebc424aa8ba48adde94709388'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.376281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c9fc2ebc424aa8ba48adde94709388'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.384675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c9fc2ebc424aa8ba48adde94709388'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.388820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5622f08e1e4e4219ad8734b9333e3087'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.396082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:01.398025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20db5d62-0be3-48dd-be30-1a611d229bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5622f08e1e4e4219ad8734b9333e3087'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.425665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-803eacfa-0b3d-4917-b415-d9a0f5fda574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c9fc2ebc424aa8ba48adde94709388'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:01.452790 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3041/6096] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:00 2022] DELETE /identity/v3/users/5622f08e1e4e4219ad8734b9333e3087 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:01.459398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9cc72-fb51-4245-a713-0adb2c50bd75 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:01.459903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9cc72-fb51-4245-a713-0adb2c50bd75 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:01.460178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9cc72-fb51-4245-a713-0adb2c50bd75 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:01.461604 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3056/6097] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:00 2022] DELETE /identity/v3/users/16c9fc2ebc424aa8ba48adde94709388 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:01.472336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:01.472845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:01.473340 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3042/6098] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:09:01 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:09:01.475227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:01.593624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:01.597711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:01.733807 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3057/6099] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:09:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:01.746369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9cc72-fb51-4245-a713-0adb2c50bd75 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:01.748637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74a9cc72-fb51-4245-a713-0adb2c50bd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:01.792261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9cc72-fb51-4245-a713-0adb2c50bd75 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:01.809375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:01.810340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:01.812532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:01.813419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:01.842774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:01.847678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:01.871711 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3043/6100] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:02.479473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:02.484437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:02.523607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:02.525653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:02.707632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7053fc8-bd84-47c0-8d42-6329771cb81e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:02.724906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:02.728175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:02.729874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:02.732417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:02.733153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] PATH_INFO: `/v3/projects/790713f53b684970a52684f2c86825a4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:02.738984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] RBAC: Authorizing `identity:delete_project(project_id=790713f53b684970a52684f2c86825a4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:02.746794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:02.799038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d9ad-b035-4e50-863c-0c62a6b83373 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:02.814136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:02.815453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:02.815950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:02.817008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] PATH_INFO: `/v3/projects/1dea120140fc4e4eb363444d623f4d07` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:02.820121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dea120140fc4e4eb363444d623f4d07)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:02.825021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:02.873573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790713f53b684970a52684f2c86825a4', 'request_id': 'req-998c7df9-8575-434c-b667-eec9f3cd653a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:02.891698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790713f53b684970a52684f2c86825a4', 'request_id': 'req-998c7df9-8575-434c-b667-eec9f3cd653a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:02.909973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790713f53b684970a52684f2c86825a4', 'request_id': 'req-998c7df9-8575-434c-b667-eec9f3cd653a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:02.959336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] The token cache is being invalidate because project 790713f53b684970a52684f2c86825a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:02.961495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:02.969828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:02.982699 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3058/6101] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:02 2022] DELETE /identity/v3/projects/790713f53b684970a52684f2c86825a4 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:02.985329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:03.000446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:03.039465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dea120140fc4e4eb363444d623f4d07', 'request_id': 'req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.055430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dea120140fc4e4eb363444d623f4d07', 'request_id': 'req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.062831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:03.074316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dea120140fc4e4eb363444d623f4d07', 'request_id': 'req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.104932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] The token cache is being invalidate because project 1dea120140fc4e4eb363444d623f4d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:03.105253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.111719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9524dfd6-95ec-415f-a62a-5c5e1afffcf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.114700 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3044/6102] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:02 2022] DELETE /identity/v3/projects/1dea120140fc4e4eb363444d623f4d07 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:03.116226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1af6-c669-404e-925f-04100a147d4f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.116543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1af6-c669-404e-925f-04100a147d4f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.116841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1af6-c669-404e-925f-04100a147d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.165559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fcef1af6-c669-404e-925f-04100a147d4f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:03.167162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fcef1af6-c669-404e-925f-04100a147d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:03.211141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7df9-8575-434c-b667-eec9f3cd653a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:03.325246 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3045/6103] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:03.326739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474af9-1573-4f69-adc4-ffe19365bc6f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.327055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474af9-1573-4f69-adc4-ffe19365bc6f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.327393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474af9-1573-4f69-adc4-ffe19365bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.363770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:03.364904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.365204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.365504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] PATH_INFO: `/v3/users/c9a68d71327c4ab0a6c77c0cbaccbc94` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.367566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a68d71327c4ab0a6c77c0cbaccbc94)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:03.369040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-31474af9-1573-4f69-adc4-ffe19365bc6f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:03.370140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:03.370407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31474af9-1573-4f69-adc4-ffe19365bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:03.407733 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3046/6104] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:03.408956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b665d-b8f4-42db-b0c6-2da1459d0962 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.409344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b665d-b8f4-42db-b0c6-2da1459d0962 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.409817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b665d-b8f4-42db-b0c6-2da1459d0962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.507190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cc1b665d-b8f4-42db-b0c6-2da1459d0962 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:03.507831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc1b665d-b8f4-42db-b0c6-2da1459d0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:03.559062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a68d71327c4ab0a6c77c0cbaccbc94'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.586374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a68d71327c4ab0a6c77c0cbaccbc94'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.587405 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3047/6105] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:03.589774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b721-4d37-41b9-a089-bcfafcfdbeb0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.590486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b721-4d37-41b9-a089-bcfafcfdbeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.590814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b721-4d37-41b9-a089-bcfafcfdbeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.604996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a68d71327c4ab0a6c77c0cbaccbc94'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.606510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a68d71327c4ab0a6c77c0cbaccbc94'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.630087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a68d71327c4ab0a6c77c0cbaccbc94'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:03.660508 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3059/6106] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:02 2022] DELETE /identity/v3/users/c9a68d71327c4ab0a6c77c0cbaccbc94 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:03.668253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:03.670961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e3d6b721-4d37-41b9-a089-bcfafcfdbeb0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:03.671419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:03.673646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e3d6b721-4d37-41b9-a089-bcfafcfdbeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:03.855862 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3048/6107] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:03.857366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9caa6-72f4-410f-9537-f7e4ee244f87 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.857667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9caa6-72f4-410f-9537-f7e4ee244f87 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.857960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9caa6-72f4-410f-9537-f7e4ee244f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.873872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:03.876599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:03.898043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2ac9caa6-72f4-410f-9537-f7e4ee244f87 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:03.899353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ac9caa6-72f4-410f-9537-f7e4ee244f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:03.917778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3049/6108] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:03.918795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9caa6-72f4-410f-9537-f7e4ee244f87 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:03.938500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed8338-cffe-4856-a8b9-3af649b30808 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:03.945766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9caa6-72f4-410f-9537-f7e4ee244f87 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:03.951469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:03.952180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.952534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.952800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.953584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:03.953897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:03.958427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:03.959138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:03.959505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:03.959842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:03.960490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:03.960792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:03.962470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:03.967831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:03.984822 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3050/6109] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:03.985678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:03.996181 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3060/6110] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:03.996772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.000522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:04.032286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf605e-d75d-45ec-b309-e47e2c064322 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.048105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.049272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.049982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.050458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:04.062371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:04.071344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:04.131840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ba6e3-fcac-4520-b04d-bab6b5bf19f7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.140510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.141342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.141701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.141908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:04.162614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:04.175204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:04.190846 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3061/6111] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:03 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:04.192872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.204660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3051/6112] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:04.207469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.234265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d883-b5f8-4d35-8261-23104295cc3d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.412767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.413478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.415964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.416577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:04.417269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:04.422137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:04.478663 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3052/6113] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:04 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:04.483177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.505883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da15b1-98c0-46ab-97b9-5d628ecb7885 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.522195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.522964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.523283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.523562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:04.524491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:04.526372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:04.527707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681704-b6cb-4b3e-9a00-e15d283bb8fa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.555207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3053/6114] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:04.558744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.559508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.560058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.560058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:04.560789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:04.561064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.568380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:04.589884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441f82-7e29-4c77-9811-341716ae651f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.628673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.629856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.630352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.630840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:04.640649 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3062/6115] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:04 2022] POST /identity/v3/projects => generated 381 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:04.648509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:04.650168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.659371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:04.698093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3054/6116] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:04.699457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.744843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967721-5577-4ccb-bbf4-d047b661c759 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.858508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683958-dfe7-4e28-a836-e6d5efe438aa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:04.883989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.884811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.885134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.885439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:04.886120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:04.888234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:04.927555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:04.966325 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3063/6117] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:04 2022] POST /identity/v3/users => generated 291 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:04.970240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcd5c4-c81e-4bad-90d8-082b954a0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:04.972539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:04.973351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd5c4-c81e-4bad-90d8-082b954a0aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:04.973990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd5c4-c81e-4bad-90d8-082b954a0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:04.975472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd5c4-c81e-4bad-90d8-082b954a0aba admin admin] PATH_INFO: `/v3/projects/04785fa6e17b4f97aa36d0b5c729fd26/users/35ff72a6dff34f44895eae7233b8a7d2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.001629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c5099-87fa-4b0e-a06d-1f247f39bf48 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:05.015362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:05.016222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.016410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.016633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.017398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.019216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.020759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcd5c4-c81e-4bad-90d8-082b954a0aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=04785fa6e17b4f97aa36d0b5c729fd26, user_id=35ff72a6dff34f44895eae7233b8a7d2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.053898 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3064/6118] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:05.055164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcd5c4-c81e-4bad-90d8-082b954a0aba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.055334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.075108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede54a6-7283-4436-8c3d-d60c8acb60f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:05.099927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:05.101911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.102201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.104278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.105127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.109743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.118280 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3055/6119] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:04 2022] PUT /identity/v3/projects/04785fa6e17b4f97aa36d0b5c729fd26/users/35ff72a6dff34f44895eae7233b8a7d2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:05.121251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c517b-f233-4404-a37f-4c2824c16439 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.121551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c517b-f233-4404-a37f-4c2824c16439 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.121837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c517b-f233-4404-a37f-4c2824c16439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.141676 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3065/6120] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:05.145346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.166244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63c7f-752d-4837-8233-92eb6d4d5e4b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:05.172262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3e6c517b-f233-4404-a37f-4c2824c16439 None None] MFA Rules not processed for user `35ff72a6dff34f44895eae7233b8a7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:05.173541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e6c517b-f233-4404-a37f-4c2824c16439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:05.173853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:05.284486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add061b6-af00-420f-84c5-679e0ac1ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:05.285579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add061b6-af00-420f-84c5-679e0ac1ee9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.285990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add061b6-af00-420f-84c5-679e0ac1ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.286246 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3056/6121] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:05.288447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add061b6-af00-420f-84c5-679e0ac1ee9d admin admin] PATH_INFO: `/v3/projects/27b858e0b4f348dba7f7e6f8d83c65ab/users/7a5dd75f665a44049e23c6cd5569abff/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.292138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c517b-f233-4404-a37f-4c2824c16439 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.319825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add061b6-af00-420f-84c5-679e0ac1ee9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b858e0b4f348dba7f7e6f8d83c65ab, user_id=7a5dd75f665a44049e23c6cd5569abff, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.322207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c517b-f233-4404-a37f-4c2824c16439 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:05.324193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add061b6-af00-420f-84c5-679e0ac1ee9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.336577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:05.337234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.337596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.337911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.338624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.340982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.365076 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3066/6122] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:05 2022] PUT /identity/v3/projects/27b858e0b4f348dba7f7e6f8d83c65ab/users/7a5dd75f665a44049e23c6cd5569abff/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:05.381157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.381461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.383506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.403217 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3057/6123] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:05 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:09:05.411187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.485055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] MFA Rules not processed for user `7a5dd75f665a44049e23c6cd5569abff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:05.487868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:05.595532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10459-6ff7-42a4-8b57-344a6058c401 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:05.616256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:05.618203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.618795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.619261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.621233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.625209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.633298 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3067/6124] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:05.635195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.637025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:05.660642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88415c-c069-4f7f-b8c3-511b783e78e7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:05.666518 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3058/6125] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:05 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:05.671669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.681905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:05.683373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.683883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.684339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] PATH_INFO: `/v3/projects/1f830e58be8d464b88b305a8d5a542f2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.687246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f830e58be8d464b88b305a8d5a542f2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.689861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.703090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699e28a-7d5d-42c1-9543-cda441d8589d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:05.716345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:05.717164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:05.717502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:05.717693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:05.718375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:05.723665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:05.802372 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3059/6126] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:05 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:05.807445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.818668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f830e58be8d464b88b305a8d5a542f2', 'request_id': 'req-b1ab03c1-5004-4fe2-9a74-6469e5468b73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:05.833642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f830e58be8d464b88b305a8d5a542f2', 'request_id': 'req-b1ab03c1-5004-4fe2-9a74-6469e5468b73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:05.836582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:05.869186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f830e58be8d464b88b305a8d5a542f2', 'request_id': 'req-b1ab03c1-5004-4fe2-9a74-6469e5468b73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:05.896017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] The token cache is being invalidate because project 1f830e58be8d464b88b305a8d5a542f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:05.896358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:05.897307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:05.904287 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3068/6127] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:05 2022] DELETE /identity/v3/projects/1f830e58be8d464b88b305a8d5a542f2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:05.904287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:05.912202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:05.926934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:06.016631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a30929-99f2-44ce-9d50-d08efe6d5da7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:06.038959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:06.039702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.039987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.040269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.041048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:06.042748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:06.072607 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3060/6128] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:06.073587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:06.078401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:06.130717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab03c1-5004-4fe2-9a74-6469e5468b73 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:06.136942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:06.137750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.138139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.138706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.141073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:06.143411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:06.145898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c015614-78eb-43c1-9c74-8373f5de3db9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:06.153006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:06.153965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.154739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.155087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] PATH_INFO: `/v3/users/3d1a1a5040f04fcebe838a6a2f30f742` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.159618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1a1a5040f04fcebe838a6a2f30f742)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:06.162496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:06.187574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3069/6129] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:05 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:06.194710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:06.197874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:06.227176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0470a8-2643-41da-b937-86d3003665df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:06.249375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:06.250451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.253465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.254606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] PATH_INFO: `/v3/projects/d1420c68e3b14318ad6b27de54137b0b/users/c490a81e6d524f77b74b78cce86ac6a0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.302331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1420c68e3b14318ad6b27de54137b0b, user_id=c490a81e6d524f77b74b78cce86ac6a0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:06.307225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:06.329861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1a1a5040f04fcebe838a6a2f30f742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:06.376644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1a1a5040f04fcebe838a6a2f30f742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:06.378350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1a1a5040f04fcebe838a6a2f30f742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:06.391518 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3070/6130] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:06 2022] PUT /identity/v3/projects/d1420c68e3b14318ad6b27de54137b0b/users/c490a81e6d524f77b74b78cce86ac6a0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:06.391518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:06.419052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1a1a5040f04fcebe838a6a2f30f742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:06.421407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1a1a5040f04fcebe838a6a2f30f742'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:06.488275 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3061/6131] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:06 2022] DELETE /identity/v3/users/3d1a1a5040f04fcebe838a6a2f30f742 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:06.494303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:06.500665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:06.664081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24152066-5afb-4a60-8be3-909bd061e0a4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:06.802722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a0886-178b-4ec8-b97d-20bfec468968 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:06.815597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:06.816428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.816727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.816997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.820231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:06.824470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:06.851511 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3062/6132] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:06.852705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:06.874080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56544a45-7538-42f7-9d61-57dd13f6089f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:06.883027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af9030-85f5-4763-93b0-244730120749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:06.884058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af9030-85f5-4763-93b0-244730120749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.884348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af9030-85f5-4763-93b0-244730120749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.886042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:06.886691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af9030-85f5-4763-93b0-244730120749 admin admin] PATH_INFO: `/v3/projects/d1420c68e3b14318ad6b27de54137b0b/users/c490a81e6d524f77b74b78cce86ac6a0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.888350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.888953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.889527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.891011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:06.892062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af9030-85f5-4763-93b0-244730120749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1420c68e3b14318ad6b27de54137b0b, user_id=c490a81e6d524f77b74b78cce86ac6a0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:06.898714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:06.901999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af9030-85f5-4763-93b0-244730120749 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:06.932839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3071/6133] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:06.934877 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3063/6134] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:06 2022] PUT /identity/v3/projects/d1420c68e3b14318ad6b27de54137b0b/users/c490a81e6d524f77b74b78cce86ac6a0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:06.939865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:06.945964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:06.946586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:06.947125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:06.949814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:06.960432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:07.010755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] MFA Rules not processed for user `c490a81e6d524f77b74b78cce86ac6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:07.012602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:07.033230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a57a-7d5c-495a-9ad6-09d4ff0a2953 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:07.060186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:07.173295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:07.174374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:07.174711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:07.175410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] PATH_INFO: `/v3/projects/3d77364b4f044bc39406c952f29069e7/users/af521822f083406da6650caa7a3dcae3/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:07.201416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d77364b4f044bc39406c952f29069e7, user_id=af521822f083406da6650caa7a3dcae3, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:07.204393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:07.211490 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3064/6135] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:09:07.216280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:07.216280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:07.238364 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3072/6136] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:06 2022] PUT /identity/v3/projects/3d77364b4f044bc39406c952f29069e7/users/af521822f083406da6650caa7a3dcae3/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:07.240799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:07.251303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3107a4e-60b0-4765-9d0b-ea47b0c19647 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:07.273258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:07.396631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:07.396631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:07.396631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:07.396631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] PATH_INFO: `/v3/projects/ad3427e27ca04ec898bc105c554e2f3b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:07.408307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3427e27ca04ec898bc105c554e2f3b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:07.411098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:07.483897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400950c7-39dd-495e-8883-981bee3c79d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:07.507342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf01086-49d0-41f1-895e-fd1c6f765e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:07.508346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01086-49d0-41f1-895e-fd1c6f765e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:07.510330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01086-49d0-41f1-895e-fd1c6f765e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:07.514160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01086-49d0-41f1-895e-fd1c6f765e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:07.558190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3427e27ca04ec898bc105c554e2f3b', 'request_id': 'req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:07.596499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3427e27ca04ec898bc105c554e2f3b', 'request_id': 'req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:07.620765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3427e27ca04ec898bc105c554e2f3b', 'request_id': 'req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:07.655307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] The token cache is being invalidate because project ad3427e27ca04ec898bc105c554e2f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:07.655307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:07.659012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:07.660663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf01086-49d0-41f1-895e-fd1c6f765e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:07.663876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf01086-49d0-41f1-895e-fd1c6f765e58 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:07.674892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3065/6137] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:07 2022] DELETE /identity/v3/projects/ad3427e27ca04ec898bc105c554e2f3b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:07.676645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:07.692344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:07.699594 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3073/6138] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:07.703360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:07.703617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:07.705723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:07.787326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:07.795107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:07.816888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:07.957502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:08.008175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c3c5e-097b-4ba7-869f-78bf5ec7aeab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:08.017120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf9206-bfe5-42d5-8ed2-7ca9f6990153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:08.018333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9206-bfe5-42d5-8ed2-7ca9f6990153 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.018862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9206-bfe5-42d5-8ed2-7ca9f6990153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.019433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9206-bfe5-42d5-8ed2-7ca9f6990153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.020871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf9206-bfe5-42d5-8ed2-7ca9f6990153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:08.024118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf9206-bfe5-42d5-8ed2-7ca9f6990153 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:08.062094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3074/6139] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:08.064004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:08.074084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:08.091413 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3066/6140] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:08.093836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bf51-cbf9-4e0a-b9ba-f36877f2d5ab None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.097417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116115-fa76-407b-b2bb-2bec3874e87f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:08.099322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bf51-cbf9-4e0a-b9ba-f36877f2d5ab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.100058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bf51-cbf9-4e0a-b9ba-f36877f2d5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.124899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:08.125834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.126139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.126414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] PATH_INFO: `/v3/users/35ff72a6dff34f44895eae7233b8a7d2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.128460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ff72a6dff34f44895eae7233b8a7d2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:08.130527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:08.140167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0716bf51-cbf9-4e0a-b9ba-f36877f2d5ab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:08.143217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0716bf51-cbf9-4e0a-b9ba-f36877f2d5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:08.164650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3067/6141] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:08.166131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bf51-cbf9-4e0a-b9ba-f36877f2d5ab None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:08.184205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bf51-cbf9-4e0a-b9ba-f36877f2d5ab None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:08.203993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:08.205492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.205953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.206369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] PATH_INFO: `/v3/projects/3d77364b4f044bc39406c952f29069e7/users/af521822f083406da6650caa7a3dcae3/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.218547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d77364b4f044bc39406c952f29069e7, user_id=af521822f083406da6650caa7a3dcae3, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:08.224383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:08.293144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ff72a6dff34f44895eae7233b8a7d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:08.303450 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3068/6142] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:08 2022] PUT /identity/v3/projects/3d77364b4f044bc39406c952f29069e7/users/af521822f083406da6650caa7a3dcae3/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:08.305413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:08.318272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ff72a6dff34f44895eae7233b8a7d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:08.334301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ff72a6dff34f44895eae7233b8a7d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:08.340084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ff72a6dff34f44895eae7233b8a7d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:08.371750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-617b248d-d0be-4cd2-ab6c-37a7b773e812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ff72a6dff34f44895eae7233b8a7d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:08.398659 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3075/6143] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:08 2022] DELETE /identity/v3/users/35ff72a6dff34f44895eae7233b8a7d2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:08.399711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ebbe-2f8c-44ff-89e9-4dfc89bc68ac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.400441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ebbe-2f8c-44ff-89e9-4dfc89bc68ac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.401297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ebbe-2f8c-44ff-89e9-4dfc89bc68ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.486783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0753ebbe-2f8c-44ff-89e9-4dfc89bc68ac None None] MFA Rules not processed for user `af521822f083406da6650caa7a3dcae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:08.489811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0753ebbe-2f8c-44ff-89e9-4dfc89bc68ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:08.629602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055516a-5de3-4d44-8054-d8ac7a1d8270 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:08.765834 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3076/6144] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:08.768323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.769318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.770359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.807608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:08.813244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:08.830591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:08.833214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.833833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.834344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.835433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:08.836205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:08.838846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:08.867047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:08.884061 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3069/6145] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:08.885714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:08.911400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1caf-f99d-4f4f-8485-d2c9cbb1b172 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:08.946673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af521822f083406da6650caa7a3dcae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d77364b4f044bc39406c952f29069e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:08.952017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.952017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.952017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:08.952017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:08.952520 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3077/6146] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:08.953646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:08.956462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:08.958814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:08.985832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387c89d-ed18-42a6-92e4-fa4cfa31d65e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:08.998163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:08.998931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:08.999219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:08.999713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:09.000564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:09.002590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:09.053223 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3070/6147] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:08 2022] POST /identity/v3/projects => generated 360 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:09.061293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.067178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:09.091398 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3078/6148] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:08 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:09.093353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.104355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:09.157869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:09.248512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca7678-c411-4657-9dec-7a5fedcaed5f tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:09.323521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c134a-2ca9-428f-b554-6196b56078f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:09.337024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5dd75f665a44049e23c6cd5569abff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b858e0b4f348dba7f7e6f8d83c65ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:09.337858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:09.338198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:09.338486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] PATH_INFO: `/v3/projects/e0245648326b4eee8d4a1984e217a9df` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:09.340916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] RBAC: Authorizing `identity:delete_project(project_id=e0245648326b4eee8d4a1984e217a9df)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 14 15:09:09.355424 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 14 15:09:09.356669 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:09:09.357654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3079/6149] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:09 2022] DELETE /identity/v3/projects/e0245648326b4eee8d4a1984e217a9df => generated 136 bytes in 268 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:09:09.358627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.396063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:09.399320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:09.399691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:09.399982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:09.529532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af555f6-0c95-48ea-8bd6-4d846d070889 tempest-ProjectsNegativeTestJSON-46126627 tempest-ProjectsNegativeTestJSON-46126627-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:09.536689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:09.538434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:09.539361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:09.539836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:09.541344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:09.543951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:09.589072 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3080/6150] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:09 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:09.589796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:09.589944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.593610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:09.628614 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3071/6151] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:09.633110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.661342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:09.669930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3739b-7aa7-41a7-9d9b-a7ca6a026a58 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:09.691704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:09.692802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:09.693047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:09.693319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:09.697206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:09.699590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:09.706585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16134e64-c6fa-4df3-9464-ea38f5b947df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:09.720825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af521822f083406da6650caa7a3dcae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d77364b4f044bc39406c952f29069e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:09.724238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:09.726284 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3072/6152] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:09.728565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:09.730494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] PATH_INFO: `/v3/projects/e0245648326b4eee8d4a1984e217a9df` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:09.731015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.733257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e0245648326b4eee8d4a1984e217a9df)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:09.736404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:09.763108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379242-fa01-4a2c-bdaf-7209f84213f6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:09.776020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:09.778212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:09.780181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:09.780181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:09.782439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:09.784684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:09.811851 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3073/6153] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:09.816378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.864999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0245648326b4eee8d4a1984e217a9df', 'request_id': 'req-35fd417b-c5a0-4988-8e7f-62366d7efc28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:09.866308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b420a-6e36-4907-af16-9369f77d46d4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:09.873591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0245648326b4eee8d4a1984e217a9df', 'request_id': 'req-35fd417b-c5a0-4988-8e7f-62366d7efc28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:09.886135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0245648326b4eee8d4a1984e217a9df', 'request_id': 'req-35fd417b-c5a0-4988-8e7f-62366d7efc28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:09.929345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] The token cache is being invalidate because project e0245648326b4eee8d4a1984e217a9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:09.932672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:09.933726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:09.935729 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3081/6154] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:09 2022] DELETE /identity/v3/projects/e0245648326b4eee8d4a1984e217a9df => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:09.942377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:09.948049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:10.006406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af764d84-2102-407a-84e1-e677f8fef7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:10.008426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764d84-2102-407a-84e1-e677f8fef7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.008759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764d84-2102-407a-84e1-e677f8fef7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.009086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764d84-2102-407a-84e1-e677f8fef7e2 admin admin] PATH_INFO: `/v3/projects/3f6098bd72264c8a9325b9ab9c84e38b/users/8bd4c0fb413140b8a1291c7dfd64e244/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.015128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:10.049632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af764d84-2102-407a-84e1-e677f8fef7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6098bd72264c8a9325b9ab9c84e38b, user_id=8bd4c0fb413140b8a1291c7dfd64e244, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:10.053337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af764d84-2102-407a-84e1-e677f8fef7e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:10.085039 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3074/6155] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:09 2022] PUT /identity/v3/projects/3f6098bd72264c8a9325b9ab9c84e38b/users/8bd4c0fb413140b8a1291c7dfd64e244/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:10.087676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.088232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.088746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.120001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd417b-c5a0-4988-8e7f-62366d7efc28 tempest-ProjectsNegativeTestJSON-60927829 tempest-ProjectsNegativeTestJSON-60927829-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:10.131190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] MFA Rules not processed for user `8bd4c0fb413140b8a1291c7dfd64e244`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:10.132728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:10.299225 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3075/6156] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:10.302387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:10.304162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:10.304695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:10.305640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.306024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.307525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] PATH_INFO: `/v3/users/7a5dd75f665a44049e23c6cd5569abff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.314304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5dd75f665a44049e23c6cd5569abff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:10.317657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:10.328053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4d946-23be-4f40-a9c2-1f57f95f20ae None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:10.337082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:10.339151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.339792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.340083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.341010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:10.344915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:10.397253 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3076/6157] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:10 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:10.401074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:10.406693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:10.477878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5dd75f665a44049e23c6cd5569abff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:10.515855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5dd75f665a44049e23c6cd5569abff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:10.543620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5dd75f665a44049e23c6cd5569abff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:10.544561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5dd75f665a44049e23c6cd5569abff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:10.555329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1818db6-2d17-42ee-bea4-b2bc0852a37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5dd75f665a44049e23c6cd5569abff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:10.563895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3082/6158] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:09 2022] DELETE /identity/v3/users/7a5dd75f665a44049e23c6cd5569abff => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:10.569117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.569564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.570074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.598828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:10.600310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:10.601666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67274d5-3404-4928-84e6-bcf1337216c3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:10.689882 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3083/6159] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:10.711452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:10.713429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:10.745168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:10.754015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:10.754379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.754952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.756330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.756968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:10.766086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:10.818396 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3077/6160] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:10 2022] POST /identity/v3/users => generated 297 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:10.822180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:10.829169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:10.853990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b891-4ec1-46c5-824f-66aed19e63f5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:10.862695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b88c-a634-400e-8bc5-331751b861aa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:10.866794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:10.867741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.868936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.869328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.875381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:10.877346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.878868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.880546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.885037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:10.890688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:10.907302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:10.907302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:10.922996 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3078/6161] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:09:10.925446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:10.938298 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3084/6162] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:09:10.945518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927159-dd7b-4151-bb74-deb2e0c6916f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:10.951091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:10.952098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:10.952385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:10.952665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] PATH_INFO: `/v3/projects/b533a94b62aa446f98c026b09ac5afab/users/eb7f4eccb7ee4ff7a12518c5e36470b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:10.975255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b533a94b62aa446f98c026b09ac5afab, user_id=eb7f4eccb7ee4ff7a12518c5e36470b5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:10.979044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:11.012062 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3079/6163] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:10 2022] PUT /identity/v3/projects/b533a94b62aa446f98c026b09ac5afab/users/eb7f4eccb7ee4ff7a12518c5e36470b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:11.012935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:11.025828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6387c3-2ea7-45ce-8058-b15191ddedaa service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:11.027605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:11.030034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:11.155167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:11.201893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:11.202664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:11.202973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:11.204585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:11.204585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:11.206347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:11.239812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141415-a216-4240-8c18-4ada484fe448 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:11.245027 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3085/6164] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:11.249535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:11.253128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:11.255850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:11.256778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:11.257775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] PATH_INFO: `/v3/projects/04785fa6e17b4f97aa36d0b5c729fd26` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:11.260641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04785fa6e17b4f97aa36d0b5c729fd26)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:11.294527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:11.298303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7ed9-1b27-4edb-aa5e-08bfe19926f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:11.323194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821e482-6d54-4381-98f9-55e5ceb3e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:11.328110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821e482-6d54-4381-98f9-55e5ceb3e43d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:11.328573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821e482-6d54-4381-98f9-55e5ceb3e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:11.329356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821e482-6d54-4381-98f9-55e5ceb3e43d admin admin] PATH_INFO: `/v3/projects/b533a94b62aa446f98c026b09ac5afab/users/eb7f4eccb7ee4ff7a12518c5e36470b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:11.333196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821e482-6d54-4381-98f9-55e5ceb3e43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b533a94b62aa446f98c026b09ac5afab, user_id=eb7f4eccb7ee4ff7a12518c5e36470b5, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:11.336755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821e482-6d54-4381-98f9-55e5ceb3e43d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:11.356602 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3086/6165] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:11 2022] PUT /identity/v3/projects/b533a94b62aa446f98c026b09ac5afab/users/eb7f4eccb7ee4ff7a12518c5e36470b5/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:11.372705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:11.372975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:11.373282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:11.429857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04785fa6e17b4f97aa36d0b5c729fd26', 'request_id': 'req-541a29e0-e03c-4378-ab77-dcc30594f816'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.453587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] MFA Rules not processed for user `eb7f4eccb7ee4ff7a12518c5e36470b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:11.456564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:11.457793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04785fa6e17b4f97aa36d0b5c729fd26', 'request_id': 'req-541a29e0-e03c-4378-ab77-dcc30594f816'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.473065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04785fa6e17b4f97aa36d0b5c729fd26', 'request_id': 'req-541a29e0-e03c-4378-ab77-dcc30594f816'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.503442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] The token cache is being invalidate because project 04785fa6e17b4f97aa36d0b5c729fd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:11.508190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.509393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.513799 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3080/6166] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:11 2022] DELETE /identity/v3/projects/04785fa6e17b4f97aa36d0b5c729fd26 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:11.519412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:11.525681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:11.655789 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3087/6167] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:11.667738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:11.669283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:11.680032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:11.781661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a29e0-e03c-4378-ab77-dcc30594f816 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:11.793622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:11.794908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:11.797951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:11.798321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] PATH_INFO: `/v3/users/c490a81e6d524f77b74b78cce86ac6a0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:11.805376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c490a81e6d524f77b74b78cce86ac6a0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:11.807071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:11.817946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f208c-0e3a-4637-a8f1-31bdca2aa6b0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:11.831729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:11.832497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:11.832807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:11.833103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:11.858264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:11.859604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:11.893482 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3088/6168] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:11.931605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c490a81e6d524f77b74b78cce86ac6a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.951568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c490a81e6d524f77b74b78cce86ac6a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.953422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c490a81e6d524f77b74b78cce86ac6a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.966543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c490a81e6d524f77b74b78cce86ac6a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.967928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c490a81e6d524f77b74b78cce86ac6a0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:11.997148 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3081/6169] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:11 2022] DELETE /identity/v3/users/c490a81e6d524f77b74b78cce86ac6a0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:12.361123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:12.363470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:12.408760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc488b3-1804-47f0-b228-42bc63cc61a0 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:12.465079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:12.469301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:12.616528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:12.619528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:12.620376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:12.623728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] PATH_INFO: `/v3/projects/27b858e0b4f348dba7f7e6f8d83c65ab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:12.629645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b858e0b4f348dba7f7e6f8d83c65ab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:12.636329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:12.642035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:12.673867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872bdf-cdb5-4461-be23-add637054b4a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:12.689140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:12.693329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:12.693631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:12.694037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] PATH_INFO: `/v3/users/250dba5cefe7484c904a34f4a83cf84c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:12.699577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] RBAC: Authorizing `identity:delete_user(user_id=250dba5cefe7484c904a34f4a83cf84c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:12.706178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:12.863949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b858e0b4f348dba7f7e6f8d83c65ab', 'request_id': 'req-5559a990-63cb-4829-99af-afe3f4b5683d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.878666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250dba5cefe7484c904a34f4a83cf84c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.891925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b858e0b4f348dba7f7e6f8d83c65ab', 'request_id': 'req-5559a990-63cb-4829-99af-afe3f4b5683d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.911355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:12.913590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250dba5cefe7484c904a34f4a83cf84c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.914646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250dba5cefe7484c904a34f4a83cf84c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.914954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b858e0b4f348dba7f7e6f8d83c65ab', 'request_id': 'req-5559a990-63cb-4829-99af-afe3f4b5683d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.937803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250dba5cefe7484c904a34f4a83cf84c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.938663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250dba5cefe7484c904a34f4a83cf84c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.961267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] The token cache is being invalidate because project 27b858e0b4f348dba7f7e6f8d83c65ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:12.962301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.964451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5559a990-63cb-4829-99af-afe3f4b5683d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:12.971727 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3082/6171] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:12 2022] DELETE /identity/v3/users/250dba5cefe7484c904a34f4a83cf84c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:12.971727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:12.974299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:12.975489 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3089/6171] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:12 2022] DELETE /identity/v3/projects/27b858e0b4f348dba7f7e6f8d83c65ab => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:12.978968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:12.979398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:12.980349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:13.025679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:13.030866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:13.225508 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3090/6172] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:13.226511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:13.230005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:13.257511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355cb2-df19-4e05-b44c-0d4000785347 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:13.272025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:13.273196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:13.273543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:13.273872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] PATH_INFO: `/v3/users/af521822f083406da6650caa7a3dcae3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:13.275878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af521822f083406da6650caa7a3dcae3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:13.277950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:13.313247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb53357-9d5c-4298-9698-c128d73c301a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:13.333722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb7f4eccb7ee4ff7a12518c5e36470b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b533a94b62aa446f98c026b09ac5afab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:13.335862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:13.336364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:13.336883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:13.344612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:13.345182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:13.352311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:13.403337 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3083/6173] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:13.403337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:13.406925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:13.419123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af521822f083406da6650caa7a3dcae3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:13.452196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af521822f083406da6650caa7a3dcae3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:13.470586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af521822f083406da6650caa7a3dcae3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:13.474284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af521822f083406da6650caa7a3dcae3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:13.499783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af521822f083406da6650caa7a3dcae3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:13.528960 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3091/6174] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:13 2022] DELETE /identity/v3/users/af521822f083406da6650caa7a3dcae3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:13.530083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:13.532256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:13.546203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:13.611695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ccb27-4b92-4f3a-ae66-6c63fa285195 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:13.726909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d4c4-38a4-40cc-8587-95cec976ba06 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:13.741520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb7f4eccb7ee4ff7a12518c5e36470b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b533a94b62aa446f98c026b09ac5afab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:13.743558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:13.744245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:13.745068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:13.748472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:13.753017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:13.802365 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3092/6175] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:13 2022] POST /identity/v3/projects => generated 354 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:13.807799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:13.828205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:13.829674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:13.830415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:13.831119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:13.843135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:14.064459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:14.087291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b637-c5ba-4698-bd28-32448a0b0c92 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:14.112387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb7f4eccb7ee4ff7a12518c5e36470b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b533a94b62aa446f98c026b09ac5afab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:14.114431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:14.114902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:14.115404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:14.116721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:14.117232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:14.122477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:14.135235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:14.140012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:14.181656 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3093/6176] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:14.183260 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3084/6177] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:14.288982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:14.291448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:14.298052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:14.335488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3e0b-0f00-4151-81c9-d26089b28ee8 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:14.357397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb7f4eccb7ee4ff7a12518c5e36470b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b533a94b62aa446f98c026b09ac5afab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:14.359067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:14.359596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:14.360112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] PATH_INFO: `/v3/projects/3e217604c3ee49dd831977c7e0768d85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:14.372349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e217604c3ee49dd831977c7e0768d85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:14.376234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:14.573313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e217604c3ee49dd831977c7e0768d85', 'request_id': 'req-03c7105f-6a04-4734-b916-7cd76e170268'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:14.582672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e086c0c-94d7-42e8-98bf-a1a10e590435 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:14.598651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e217604c3ee49dd831977c7e0768d85', 'request_id': 'req-03c7105f-6a04-4734-b916-7cd76e170268'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:14.641358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e217604c3ee49dd831977c7e0768d85', 'request_id': 'req-03c7105f-6a04-4734-b916-7cd76e170268'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:14.690322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] The token cache is being invalidate because project 3e217604c3ee49dd831977c7e0768d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:14.690843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:14.694455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-03c7105f-6a04-4734-b916-7cd76e170268 tempest-VolumeQuotaClassesTest-1301962862 tempest-VolumeQuotaClassesTest-1301962862-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:14.708032 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3085/6178] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:14 2022] DELETE /identity/v3/projects/3e217604c3ee49dd831977c7e0768d85 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:14.715066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:14.831058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:14.834486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:14.837851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:14.841793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] PATH_INFO: `/v3/projects/d1420c68e3b14318ad6b27de54137b0b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:14.848186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1420c68e3b14318ad6b27de54137b0b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:14.862860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:14.999089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1420c68e3b14318ad6b27de54137b0b', 'request_id': 'req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.008874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1420c68e3b14318ad6b27de54137b0b', 'request_id': 'req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.017174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1420c68e3b14318ad6b27de54137b0b', 'request_id': 'req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.059150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] The token cache is being invalidate because project d1420c68e3b14318ad6b27de54137b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:15.059627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.060498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.062546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3094/6179] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:14 2022] DELETE /identity/v3/projects/d1420c68e3b14318ad6b27de54137b0b => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:15.075183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd395e1-47db-4668-bd79-24a444a9a7a4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:15.081970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd395e1-47db-4668-bd79-24a444a9a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:15.082880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd395e1-47db-4668-bd79-24a444a9a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:15.144135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5dd395e1-47db-4668-bd79-24a444a9a7a4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:15.146322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5dd395e1-47db-4668-bd79-24a444a9a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:15.383581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:15.386472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:15.439205 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3086/6180] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:15.457653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4d46-7704-43f3-a2a5-83a24c04ddbd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:15.464234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4d46-7704-43f3-a2a5-83a24c04ddbd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:15.466610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4d46-7704-43f3-a2a5-83a24c04ddbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:15.529062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff85d98-6062-4f2e-a2f9-c67a0a7e275b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:15.535770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b2ae4d46-7704-43f3-a2a5-83a24c04ddbd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:15.537299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2ae4d46-7704-43f3-a2a5-83a24c04ddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:15.538561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:15.541921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:15.542550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:15.543177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] PATH_INFO: `/v3/users/8bd4c0fb413140b8a1291c7dfd64e244` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:15.546143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd4c0fb413140b8a1291c7dfd64e244)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:15.552639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:15.554071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3087/6181] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:15.558557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4d46-7704-43f3-a2a5-83a24c04ddbd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:15.573590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4d46-7704-43f3-a2a5-83a24c04ddbd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:15.581182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:15.582782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:15.583155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:15.583410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:15.584197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:15.584510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:15.588167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:15.641288 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3088/6182] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:15.642554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:15.660950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb1fd-f340-4f35-a614-df64a4720483 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:15.676839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:15.677978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:15.678584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:15.684621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:15.685739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:15.688561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:15.761828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd4c0fb413140b8a1291c7dfd64e244'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.818022 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3089/6183] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:15 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:15.818810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:15.822650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:15.826020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd4c0fb413140b8a1291c7dfd64e244'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.850969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd4c0fb413140b8a1291c7dfd64e244'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.852518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd4c0fb413140b8a1291c7dfd64e244'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.869004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f995696-b328-4f16-95a5-5ed89012d8f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd4c0fb413140b8a1291c7dfd64e244'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:15.895779 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3095/6184] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:15 2022] DELETE /identity/v3/users/8bd4c0fb413140b8a1291c7dfd64e244 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:15.903692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:15.904210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:15.904968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:15.930772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:15.963785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:15.977811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:16.039928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410c076-28ae-4ea7-8a3d-d22db5720426 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:16.292293 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3096/6185] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:09:16.312766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:16.319302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:16.369831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:16.370699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:16.371095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:16.371529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:16.372364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:16.374531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:16.417786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3090/6186] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:15 2022] POST /identity/v3/users => generated 292 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:16.428641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:16.436574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:16.470147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a78c-22ed-4747-8b9d-b7e6a17d775b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:16.482327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:16.483225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:16.483649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:16.484045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:16.484942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:16.486769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:16.517582 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3091/6187] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:09:16.519118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:16.549807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d4867-a7bc-4eab-8c13-4a6528a9fec4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:16.564042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2992-e4f7-4cec-b5a4-c9d5185aec63 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:16.570147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:16.572091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:16.572591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:16.573150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:16.576700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:16.580075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:16.582107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:16.582466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:16.582751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:16.582877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:16.610601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:16.615905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:16.623894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3092/6188] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:16.625025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:16.632207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:16.646418 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3097/6189] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:09:16.652239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:16.670584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1843-2f55-41e2-812a-4812429d650d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:16.673240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5501b-7dfe-411b-9da4-14e7d418396d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:16.688192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:16.689289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:16.689711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475a1d7-17a6-4298-b36c-9603dfbac8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:16.689984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:16.690370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] PATH_INFO: `/v3/projects/3d77364b4f044bc39406c952f29069e7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:16.690989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a1d7-17a6-4298-b36c-9603dfbac8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:16.691212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a1d7-17a6-4298-b36c-9603dfbac8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:16.691939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a1d7-17a6-4298-b36c-9603dfbac8ab admin admin] PATH_INFO: `/v3/projects/da2d3d763cce449e8dc468e7ee9bd540/users/f67abbd9d9744bbbb5f6da91ef5b8ca2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:16.694606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d77364b4f044bc39406c952f29069e7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:16.700240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:16.745794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475a1d7-17a6-4298-b36c-9603dfbac8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2d3d763cce449e8dc468e7ee9bd540, user_id=f67abbd9d9744bbbb5f6da91ef5b8ca2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:16.754402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475a1d7-17a6-4298-b36c-9603dfbac8ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:16.788021 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3098/6190] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:16 2022] PUT /identity/v3/projects/da2d3d763cce449e8dc468e7ee9bd540/users/f67abbd9d9744bbbb5f6da91ef5b8ca2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:16.790145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811481-78b8-4640-a773-90ecf15dc0c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:16.790516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811481-78b8-4640-a773-90ecf15dc0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:16.791138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811481-78b8-4640-a773-90ecf15dc0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:16.846191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d77364b4f044bc39406c952f29069e7', 'request_id': 'req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:16.870375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-71811481-78b8-4640-a773-90ecf15dc0c2 None None] MFA Rules not processed for user `f67abbd9d9744bbbb5f6da91ef5b8ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:16.872095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71811481-78b8-4640-a773-90ecf15dc0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:16.877263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d77364b4f044bc39406c952f29069e7', 'request_id': 'req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:16.887760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d77364b4f044bc39406c952f29069e7', 'request_id': 'req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:16.927507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] The token cache is being invalidate because project 3d77364b4f044bc39406c952f29069e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:16.927930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:16.929947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:16.938004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3093/6191] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:16 2022] DELETE /identity/v3/projects/3d77364b4f044bc39406c952f29069e7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:16.938004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:16.941945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.015654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:17.041987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:17.114293 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3099/6192] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:17.115835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.116134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.116418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.149446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9abde8-f488-4b3e-93de-5b8fdbad64bd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:17.150669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:17.152075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.155584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:17.157335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.157772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.158165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] PATH_INFO: `/v3/projects/bdbda1346a1e4373aedb75c850607bb4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.160583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbda1346a1e4373aedb75c850607bb4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:17.162903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:17.173785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3100/6193] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:17.175031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:17.177049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.193454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52d0c-e895-4443-bf27-c17f7628f855 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:17.201000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a197a23-3dee-434e-9fb6-d9853f19ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:17.201845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197a23-3dee-434e-9fb6-d9853f19ecff admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.202146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197a23-3dee-434e-9fb6-d9853f19ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.202475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197a23-3dee-434e-9fb6-d9853f19ecff admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.203742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a197a23-3dee-434e-9fb6-d9853f19ecff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:17.208773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a197a23-3dee-434e-9fb6-d9853f19ecff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:17.257949 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3101/6194] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:17 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:17.263076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b861-b8f7-4de3-9845-49ceb25d837e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.263404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b861-b8f7-4de3-9845-49ceb25d837e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.263698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b861-b8f7-4de3-9845-49ceb25d837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.266834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbda1346a1e4373aedb75c850607bb4', 'request_id': 'req-2e5fcd62-f748-4117-b362-396893983abf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.280148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbda1346a1e4373aedb75c850607bb4', 'request_id': 'req-2e5fcd62-f748-4117-b362-396893983abf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.291823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbda1346a1e4373aedb75c850607bb4', 'request_id': 'req-2e5fcd62-f748-4117-b362-396893983abf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.311476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] The token cache is being invalidate because project bdbda1346a1e4373aedb75c850607bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:17.312166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.313151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.318555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3094/6195] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:16 2022] DELETE /identity/v3/projects/bdbda1346a1e4373aedb75c850607bb4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:17.320192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:17.323602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.329096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7668b861-b8f7-4de3-9845-49ceb25d837e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:17.332937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7668b861-b8f7-4de3-9845-49ceb25d837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.453698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3102/6196] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:17.455364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c326813-38ad-4065-bd84-39b31870052d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.455837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c326813-38ad-4065-bd84-39b31870052d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.456230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c326813-38ad-4065-bd84-39b31870052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.484844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fcd62-f748-4117-b362-396893983abf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:17.502416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19e3d5-e7d5-44dd-b34d-c9705f6a4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:17.503125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19e3d5-e7d5-44dd-b34d-c9705f6a4e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.503452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19e3d5-e7d5-44dd-b34d-c9705f6a4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.504421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19e3d5-e7d5-44dd-b34d-c9705f6a4e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.504706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3c326813-38ad-4065-bd84-39b31870052d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:17.505158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19e3d5-e7d5-44dd-b34d-c9705f6a4e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:17.505989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c326813-38ad-4065-bd84-39b31870052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.508105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19e3d5-e7d5-44dd-b34d-c9705f6a4e59 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:17.528508 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3103/6197] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:17.529842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c326813-38ad-4065-bd84-39b31870052d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:17.544828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c326813-38ad-4065-bd84-39b31870052d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:17.564787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:17.568418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.573002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.576473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.577233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:17.577564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:17.579317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:17.582801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3095/6198] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:17 2022] POST /identity/v3/users => generated 299 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:17.588839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c838-f32b-4759-a327-f55aa8fb4c1b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.589249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c838-f32b-4759-a327-f55aa8fb4c1b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.592311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c838-f32b-4759-a327-f55aa8fb4c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.617096 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3104/6199] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:17.618058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:17.622731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.653022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683d4c8-d1d0-4509-a7cb-3b50850dab91 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:17.656138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a352c838-f32b-4759-a327-f55aa8fb4c1b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:17.660064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a352c838-f32b-4759-a327-f55aa8fb4c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.666865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:17.667849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.668364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.668657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] PATH_INFO: `/v3/projects/3f6098bd72264c8a9325b9ab9c84e38b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.671630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6098bd72264c8a9325b9ab9c84e38b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:17.673665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:17.683451 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3096/6200] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:17.687072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352c838-f32b-4759-a327-f55aa8fb4c1b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:17.734005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352c838-f32b-4759-a327-f55aa8fb4c1b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:17.769936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:17.771945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:17.772772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:17.773254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:17.774620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:17.784180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:17.788656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6098bd72264c8a9325b9ab9c84e38b', 'request_id': 'req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.829869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6098bd72264c8a9325b9ab9c84e38b', 'request_id': 'req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.862012 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3097/6201] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:17.866285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6098bd72264c8a9325b9ab9c84e38b', 'request_id': 'req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.867723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:17.897541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] The token cache is being invalidate because project 3f6098bd72264c8a9325b9ab9c84e38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:17.898268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.899316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:17.902458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b51c50-18b6-404b-ad08-0a8b49c43509 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:17.909587 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3105/6202] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:17 2022] DELETE /identity/v3/projects/3f6098bd72264c8a9325b9ab9c84e38b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:17.909587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:17.909587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:17.978465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:18.016965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:18.061453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22354a-d3ce-4d8b-95cb-b0acd8ea4e10 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:18.074943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:18.076743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:18.094917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:18.095652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:18.097146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:18.099849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:18.105211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:18.110273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:18.111251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:18.111588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:18.111877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:18.114246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:18.115449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:18.142350 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3106/6203] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:18.143470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:18.149861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:18.199752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3098/6204] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:17 2022] POST /identity/v3/projects => generated 371 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:18.201602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:18.207651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:18.215553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cf4bb-2823-4bcb-a60b-41c227b66043 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:18.411744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:18.412693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:18.412980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:18.413248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] PATH_INFO: `/v3/projects/5e21be5f66fc41b8a3361f48b6cc8a06/users/97b29f05aaca46a7816218ac7049c7f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:18.448228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e21be5f66fc41b8a3361f48b6cc8a06, user_id=97b29f05aaca46a7816218ac7049c7f6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:18.454628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:18.487770 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3107/6205] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:18 2022] PUT /identity/v3/projects/5e21be5f66fc41b8a3361f48b6cc8a06/users/97b29f05aaca46a7816218ac7049c7f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:18.491794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:18.560169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b601-a537-43cf-b7bc-c45469feca6b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:18.633444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cbdf1-3932-429c-8441-625cd3466e92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:18.645104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:18.646622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:18.646622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:18.646907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:18.647896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:18.651040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:18.703206 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3108/6206] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:18.704658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:18.710157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:18.759924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:18.762085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:18.763350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:18.764548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] PATH_INFO: `/v3/users/eb7f4eccb7ee4ff7a12518c5e36470b5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:18.767813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7f4eccb7ee4ff7a12518c5e36470b5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:18.774964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:18.793239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:18.923228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7f4eccb7ee4ff7a12518c5e36470b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:18.932489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533fe6-1375-45d0-9e21-7d81f73a1ae3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:18.941869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:18.944068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:18.944456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:18.945051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:18.945849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:18.946715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:18.949407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:18.961150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7f4eccb7ee4ff7a12518c5e36470b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:18.963593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7f4eccb7ee4ff7a12518c5e36470b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:18.973556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7f4eccb7ee4ff7a12518c5e36470b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:18.975894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7f4eccb7ee4ff7a12518c5e36470b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:19.002068 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3099/6207] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:18 2022] DELETE /identity/v3/users/eb7f4eccb7ee4ff7a12518c5e36470b5 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:19.003086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.014701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3109/6208] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:18 2022] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:19.015844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.018578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:19.027027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:19.045412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0af0d-ca19-4139-b385-1b40875c6f25 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.217376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.218178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.218554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.218844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.219843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.228748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.271882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda491-991b-4e22-b31e-fcdb76a7352c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.278863 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3110/6209] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:19 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:19.282952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.287332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.287332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.292263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:19.293107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.296215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.297010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.298810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.325745 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3100/6210] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:19.328423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.339125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690362-0a6d-4e2c-9adf-f896a810122d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.351725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.353175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.354668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.355316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.356777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.368123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.407912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc15e-f3ea-4a78-b261-b1a5cce0a3dc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.413843 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3111/6211] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:19.415668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.418887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.420125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.420698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.421214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.422304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.424668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.440505 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3101/6212] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:19.441877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.450720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e1a16-40db-4dd3-9886-8af1eb887c65 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.469831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae830-8608-46d9-8d0c-8b5805e7feda admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.477770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.479450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.480854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.481373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] PATH_INFO: `/v3/projects/5e21be5f66fc41b8a3361f48b6cc8a06/users/97b29f05aaca46a7816218ac7049c7f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.490036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e21be5f66fc41b8a3361f48b6cc8a06, user_id=97b29f05aaca46a7816218ac7049c7f6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.499640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.500417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.500712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.501004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.501477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.503061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.507088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.537937 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3102/6213] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:19.546476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.572148 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3112/6214] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:19 2022] PUT /identity/v3/projects/5e21be5f66fc41b8a3361f48b6cc8a06/users/97b29f05aaca46a7816218ac7049c7f6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:19.572148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.579014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09e7ce-05f6-429a-a4b4-e4e1faba8c95 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.781867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e1c05-06fa-4066-a4f0-7ddd000f843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.784303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1c05-06fa-4066-a4f0-7ddd000f843c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.785124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1c05-06fa-4066-a4f0-7ddd000f843c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.786259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1c05-06fa-4066-a4f0-7ddd000f843c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.788772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b4d95-54f9-4973-959d-04660c171e1e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:19.792154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e1c05-06fa-4066-a4f0-7ddd000f843c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.803256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e1c05-06fa-4066-a4f0-7ddd000f843c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.824585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:19.825823 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3103/6215] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:19.827156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.828514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c378d4-6abd-4e75-95cf-e6103f24a65e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:19.829076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c378d4-6abd-4e75-95cf-e6103f24a65e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.829518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c378d4-6abd-4e75-95cf-e6103f24a65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.830275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:19.833148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] PATH_INFO: `/v3/projects/ebd6507a09254c3f8b9a9172a487cfd8/users/be856afa3b5c41da9560578526d92c4e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:19.874930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-68c378d4-6abd-4e75-95cf-e6103f24a65e None None] MFA Rules not processed for user `97b29f05aaca46a7816218ac7049c7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:19.877318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-68c378d4-6abd-4e75-95cf-e6103f24a65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:19.880257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd6507a09254c3f8b9a9172a487cfd8, user_id=be856afa3b5c41da9560578526d92c4e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:19.889233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:19.934764 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3113/6216] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:19 2022] PUT /identity/v3/projects/ebd6507a09254c3f8b9a9172a487cfd8/users/be856afa3b5c41da9560578526d92c4e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:19.937188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:19.943130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:19.948009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:19.960593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:20.020786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3104/6217] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:20.022721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c378d4-6abd-4e75-95cf-e6103f24a65e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:20.051587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c378d4-6abd-4e75-95cf-e6103f24a65e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:20.116815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd69869-96be-41d9-ab9c-d998f204c6eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:20.122284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:20.124439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:20.126457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:20.126457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] PATH_INFO: `/v3/projects/b533a94b62aa446f98c026b09ac5afab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:20.130724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b533a94b62aa446f98c026b09ac5afab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:20.135940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:20.245394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:20.264328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:20.264722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:20.265017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] PATH_INFO: `/v3/projects/5cca49305bdc49d58a7ec8312b415c56/users/f71c92b14e2c4e4e80c148f0d49a2013/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:20.329480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b533a94b62aa446f98c026b09ac5afab', 'request_id': 'req-5e5858af-a789-47e0-8715-2ffca24b18cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:20.334805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cca49305bdc49d58a7ec8312b415c56, user_id=f71c92b14e2c4e4e80c148f0d49a2013, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:20.339076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b533a94b62aa446f98c026b09ac5afab', 'request_id': 'req-5e5858af-a789-47e0-8715-2ffca24b18cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:20.346372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:20.359138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b533a94b62aa446f98c026b09ac5afab', 'request_id': 'req-5e5858af-a789-47e0-8715-2ffca24b18cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:20.384742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] The token cache is being invalidate because project b533a94b62aa446f98c026b09ac5afab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:20.385582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:20.386654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e5858af-a789-47e0-8715-2ffca24b18cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:20.392474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3114/6219] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:19 2022] DELETE /identity/v3/projects/b533a94b62aa446f98c026b09ac5afab => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:20.395755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:20.396340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:20.397335 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3105/6219] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:20 2022] PUT /identity/v3/projects/5cca49305bdc49d58a7ec8312b415c56/users/f71c92b14e2c4e4e80c148f0d49a2013/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:20.398400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:20.399772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:20.404504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:20.452530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] MFA Rules not processed for user `be856afa3b5c41da9560578526d92c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:20.459030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:20.585954 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3115/6220] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:20.591751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:20.595183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:20.647726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:20.655920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc681db-dcf4-47ff-9ea2-010877154828 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:20.662169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865358d5-e8e9-4fc1-8992-8f2ae9517ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:20.663163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865358d5-e8e9-4fc1-8992-8f2ae9517ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:20.663597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865358d5-e8e9-4fc1-8992-8f2ae9517ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:20.663982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865358d5-e8e9-4fc1-8992-8f2ae9517ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:20.667413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-865358d5-e8e9-4fc1-8992-8f2ae9517ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:20.757450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe8f7-b8a0-4e76-ae66-a1596df23c6a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:20.769403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865358d5-e8e9-4fc1-8992-8f2ae9517ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:20.770104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:20.771044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:20.771358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:20.771644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] PATH_INFO: `/v3/users/f90bad9eb8734186a61e45fa7d915768` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:20.771994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865358d5-e8e9-4fc1-8992-8f2ae9517ceb service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:20.775954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90bad9eb8734186a61e45fa7d915768)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:20.783141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:20.784782 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3106/6221] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:20.786781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41053c9-dc92-4bb4-9d73-59b751ee2d6d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:20.787179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41053c9-dc92-4bb4-9d73-59b751ee2d6d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:20.787674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41053c9-dc92-4bb4-9d73-59b751ee2d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:20.806367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:20.827913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e41053c9-dc92-4bb4-9d73-59b751ee2d6d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:20.832150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e41053c9-dc92-4bb4-9d73-59b751ee2d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:20.880018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3107/6222] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:20.882690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a00a-0d16-4afa-9c13-c4de2ad1b5b2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:20.883297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a00a-0d16-4afa-9c13-c4de2ad1b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:20.883984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a00a-0d16-4afa-9c13-c4de2ad1b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.006726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90bad9eb8734186a61e45fa7d915768'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:21.014864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a196a00a-0d16-4afa-9c13-c4de2ad1b5b2 None None] MFA Rules not processed for user `f71c92b14e2c4e4e80c148f0d49a2013`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:21.017356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a196a00a-0d16-4afa-9c13-c4de2ad1b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:21.056463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90bad9eb8734186a61e45fa7d915768'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:21.078428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90bad9eb8734186a61e45fa7d915768'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:21.079730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90bad9eb8734186a61e45fa7d915768'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:21.112189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90bad9eb8734186a61e45fa7d915768'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:21.146543 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3116/6223] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:20 2022] DELETE /identity/v3/users/f90bad9eb8734186a61e45fa7d915768 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:21.148719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:21.151793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:21.207622 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3108/6224] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:21.214661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:21.217463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:21.218167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.283613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:21.285988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655518f1-37c0-4491-8fbd-409d6d8b98ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:21.289684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:21.294730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:21.297678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:21.298568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:21.299226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.302808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:create_application_credential(user_id=be856afa3b5c41da9560578526d92c4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:21.305975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:21.446860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:21.469004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3109/6225] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:21.469004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:21.470388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:21.560702 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3117/6226] 10.222.0.98 () {60 vars in 1314 bytes} [Thu Jul 14 15:09:21 2022] POST /identity/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials => generated 921 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:21.562490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:21.618530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75153c-f313-4b94-b765-1d1834aba631 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:21.654767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:21.654767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:21.654767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:21.654767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.657913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:21.658689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:21.662941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:21.690618 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3118/6227] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:21.693218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:21.719743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a91719-ad11-4a9d-8053-03449b211f6e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:21.733213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:21.735489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:21.736244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:21.736971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules/303605e5689040889752f8558a3af36e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.738118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4457-fb0d-4bc1-a6aa-6dffe61b94ae None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:21.740572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:delete_access_rule(user_id=be856afa3b5c41da9560578526d92c4e, access_rule_id=303605e5689040889752f8558a3af36e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:21.743230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:21.743977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:21.744268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:21.744556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:21.744734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.828716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:21.868280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:21.870449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.delete(ref) Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:09:21.889531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:09:21.892341 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._synchronize( Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise AssertionError( Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 14 15:09:21.895490 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:09:21.901330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3119/6228] 10.222.0.98 () {58 vars in 1361 bytes} [Thu Jul 14 15:09:21 2022] DELETE /identity/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules/303605e5689040889752f8558a3af36e => generated 89 bytes in 205 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:09:21.905009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:21.915598 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3110/6229] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:21.916463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:21.931211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd35ab-af69-4ab1-843b-ad7901a7f416 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:21.937103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:21.938477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:21.938994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:21.939577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edbc38-7df8-45e0-8b59-00bca1a9eabc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:21.939915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials/7156eeae56284256b65435162cd8718b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.958249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:21.959637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:21.961146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:21.961697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:21.964361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:21.968588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:21.973787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:delete_application_credential(user_id=be856afa3b5c41da9560578526d92c4e, application_credential_id=7156eeae56284256b65435162cd8718b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:21.975545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.044710 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3111/6230] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:09:21 2022] DELETE /identity/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials/7156eeae56284256b65435162cd8718b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:22.044710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.050412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:22.053347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3120/6231] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:21 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:22.058626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.077632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94891e0-e268-4a33-8913-f5a9bbab46bf tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.216749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242465-b848-47d5-92f2-f9c8d2926038 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.251086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.256560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.257025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.258777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.260620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.263338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:list_access_rules(user_id=be856afa3b5c41da9560578526d92c4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.265656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.266176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.266462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] PATH_INFO: `/v3/projects/724eb41089bd40b8855a5c123343ac38` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.271711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.273632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724eb41089bd40b8855a5c123343ac38)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.277196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.291492 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3121/6232] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 15:09:22 2022] GET /identity/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules => generated 369 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:22.291492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.312426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda129-3410-4194-9033-2766c4825313 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.321801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.323086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.323467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.323975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.324778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.327437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.366948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3122/6233] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:22 2022] POST /identity/v3/users => generated 290 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:22.367805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724eb41089bd40b8855a5c123343ac38', 'request_id': 'req-973ce13f-91d1-4b49-9d44-0f176df73127'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:22.368719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.381760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724eb41089bd40b8855a5c123343ac38', 'request_id': 'req-973ce13f-91d1-4b49-9d44-0f176df73127'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:22.390967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724eb41089bd40b8855a5c123343ac38', 'request_id': 'req-973ce13f-91d1-4b49-9d44-0f176df73127'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:22.398001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0748-ad47-4897-bffd-8a104daa8c59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.407470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] The token cache is being invalidate because project 724eb41089bd40b8855a5c123343ac38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:22.407955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:22.408630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:22.417356 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3112/6234] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:22 2022] DELETE /identity/v3/projects/724eb41089bd40b8855a5c123343ac38 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:22.417356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.427686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:22.580166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb36222-46cb-4e38-8ab5-3eb811fb487e tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.584910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb36222-46cb-4e38-8ab5-3eb811fb487e tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.585209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb36222-46cb-4e38-8ab5-3eb811fb487e tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.585489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb36222-46cb-4e38-8ab5-3eb811fb487e tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules/303605e5689040889752f8558a3af36e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.597897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb36222-46cb-4e38-8ab5-3eb811fb487e tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:delete_access_rule(user_id=be856afa3b5c41da9560578526d92c4e, access_rule_id=303605e5689040889752f8558a3af36e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.600050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb36222-46cb-4e38-8ab5-3eb811fb487e tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.613442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:22.659995 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3123/6235] 10.222.0.98 () {58 vars in 1361 bytes} [Thu Jul 14 15:09:22 2022] DELETE /identity/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules/303605e5689040889752f8558a3af36e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:22.668516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d0c5-2663-45e7-8260-276f6792c18c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.669132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d0c5-2663-45e7-8260-276f6792c18c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.669635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d0c5-2663-45e7-8260-276f6792c18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.676246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce13f-91d1-4b49-9d44-0f176df73127 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.692233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.693296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.693696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.694013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.694921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.696561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.714680 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3113/6236] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:22.714680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.722094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:22.746281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-60d4d0c5-2663-45e7-8260-276f6792c18c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:22.756838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60d4d0c5-2663-45e7-8260-276f6792c18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:22.759487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dc32e-d481-4fa6-9ce6-e612e6e0c768 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.765387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.766626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.773314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.774845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.776983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:list_access_rules(user_id=be856afa3b5c41da9560578526d92c4e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.779870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.792855 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3114/6237] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 15:09:22 2022] GET /identity/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules => generated 158 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:22.803564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.803976 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3124/6238] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:22.810030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d0c5-2663-45e7-8260-276f6792c18c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:22.819014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=8,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:22.833225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d0c5-2663-45e7-8260-276f6792c18c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.843740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05d85a-3702-415b-9b2a-794475da99d2 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:22.845526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.848155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.849626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.850829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.857327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:create_application_credential(user_id=be856afa3b5c41da9560578526d92c4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.859010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b32133-b407-416c-9f8a-d6310242e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:22.860385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.860870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b32133-b407-416c-9f8a-d6310242e02c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.861626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b32133-b407-416c-9f8a-d6310242e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.862407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b32133-b407-416c-9f8a-d6310242e02c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.864199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b32133-b407-416c-9f8a-d6310242e02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:22.868380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b32133-b407-416c-9f8a-d6310242e02c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:22.905738 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3115/6239] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:22.908311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed583-58fb-47e8-b6a0-bcecef2533d3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:22.908942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed583-58fb-47e8-b6a0-bcecef2533d3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:22.909578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed583-58fb-47e8-b6a0-bcecef2533d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:22.990097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-259ed583-58fb-47e8-b6a0-bcecef2533d3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:23.000722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-259ed583-58fb-47e8-b6a0-bcecef2533d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:23.038577 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3116/6240] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:23.038577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed583-58fb-47e8-b6a0-bcecef2533d3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.051552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3125/6241] 10.222.0.98 () {60 vars in 1314 bytes} [Thu Jul 14 15:09:22 2022] POST /identity/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials => generated 921 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:23.052921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.070828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb8aae-698c-4209-8cb9-a2e54757cbe1 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:23.071907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed583-58fb-47e8-b6a0-bcecef2533d3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:23.078412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:23.079402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.079773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.080132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.080356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:23.081076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:23.081644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:23.083038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.083744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.083957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:23.084328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] PATH_INFO: `/v3/projects/b89042f551ca437693fa4121647a7adc/users/bfd1711522ef4e3b90942047855af259/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.105824 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3126/6242] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:23.105824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.125560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89042f551ca437693fa4121647a7adc, user_id=bfd1711522ef4e3b90942047855af259, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:23.135027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:23.137291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191827-98c5-43e9-af0f-4413f077b345 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:23.145495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:23.146758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.147044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.147442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.150132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:list_access_rules(user_id=be856afa3b5c41da9560578526d92c4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:23.152399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:23.169197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3127/6243] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 15:09:23 2022] GET /identity/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:23.169197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.184135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3117/6244] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:23 2022] PUT /identity/v3/projects/b89042f551ca437693fa4121647a7adc/users/bfd1711522ef4e3b90942047855af259/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:23.184340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b5ce-75bb-42c4-8d86-b371d3549202 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:23.185791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.335677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa089b85-bcce-4f14-b1ab-82b95a06c83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:23.336922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa089b85-bcce-4f14-b1ab-82b95a06c83e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.337331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa089b85-bcce-4f14-b1ab-82b95a06c83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.337729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa089b85-bcce-4f14-b1ab-82b95a06c83e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.339068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa089b85-bcce-4f14-b1ab-82b95a06c83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:23.341346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa089b85-bcce-4f14-b1ab-82b95a06c83e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:23.343298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5522f5e-e5b6-48d9-98c2-e97ae84dabfe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:23.349778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:23.350809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.351105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.351421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.352195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:create_application_credential(user_id=be856afa3b5c41da9560578526d92c4e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:23.353409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:23.381838 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3128/6245] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:23 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:23.385659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290a30d-3992-4384-ae68-c43d4bf44225 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.385944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290a30d-3992-4384-ae68-c43d4bf44225 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.386272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290a30d-3992-4384-ae68-c43d4bf44225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.424230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c290a30d-3992-4384-ae68-c43d4bf44225 None None] MFA Rules not processed for user `bfd1711522ef4e3b90942047855af259`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:23.426798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c290a30d-3992-4384-ae68-c43d4bf44225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:23.511824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:23.548177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3129/6246] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:23.549238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290a30d-3992-4384-ae68-c43d4bf44225 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.584125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3118/6247] 10.222.0.98 () {60 vars in 1314 bytes} [Thu Jul 14 15:09:23 2022] POST /identity/v3/users/be856afa3b5c41da9560578526d92c4e/application_credentials => generated 921 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:23.585374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.619744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7b2e-d99b-48c9-b646-abb43ecd9ffc tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:23.662190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:23.677524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290a30d-3992-4384-ae68-c43d4bf44225 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:23.685988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:23.688052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.688568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.689029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.691368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:23.694674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:23.737637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3130/6248] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:23 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:23.738723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.815330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:23.816002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:23.816448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:23.816890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:23.817894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:23.823089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:23.887730 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3119/6249] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:23 2022] POST /identity/v3/projects => generated 379 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:23.892553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:23.910723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0296b8-ee17-4103-86b8-5e77afee920d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.023323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e026c-c3cd-4ac4-86d7-1c81bf08dd64 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.047390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.048366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.048920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.049626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.050640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.051408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be856afa3b5c41da9560578526d92c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebd6507a09254c3f8b9a9172a487cfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.052447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.052759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.053197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules/5f1a9ae4d34f48e88c78442bd0f4197b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.054090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.056006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorizing `identity:get_access_rule(user_id=be856afa3b5c41da9560578526d92c4e, access_rule_id=5f1a9ae4d34f48e88c78442bd0f4197b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.058352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.071732 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3120/6250] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:24.072928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.080584 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3131/6251] 10.222.0.98 () {58 vars in 1358 bytes} [Thu Jul 14 15:09:23 2022] GET /identity/v3/users/be856afa3b5c41da9560578526d92c4e/access_rules/5f1a9ae4d34f48e88c78442bd0f4197b => generated 229 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:24.082153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.092761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4c62a-4b2b-4836-b431-55e51ff74a65 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.114226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.116009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.116731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.117385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.119190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.125114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010aaf8-da88-4711-9546-6bd885715089 tempest-AccessRulesV3Test-1933727961 tempest-AccessRulesV3Test-1933727961-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.125553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.132110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.132807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.133097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.133378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.134625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.136748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.157289 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3132/6252] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:24.159189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.163062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:24.171410 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3121/6253] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:24 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:24.171410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.182667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cc88f-1f43-41e9-8535-7bf8cbb6c715 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.190435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861475-9030-4030-90f7-62c46c0598c1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.195045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.196162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.196467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.196812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] PATH_INFO: `/v3/projects/2e413ee06c0848c3bbdad2e46c394e69/users/0110507279914488aca33cec9a2fc9f0/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.214318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.215336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.215633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.215921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] PATH_INFO: `/v3/users/be856afa3b5c41da9560578526d92c4e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.217519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be856afa3b5c41da9560578526d92c4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.219853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.236974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e413ee06c0848c3bbdad2e46c394e69, user_id=0110507279914488aca33cec9a2fc9f0, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.243206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:24.245870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.284731 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3122/6254] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:24 2022] PUT /identity/v3/projects/2e413ee06c0848c3bbdad2e46c394e69/users/0110507279914488aca33cec9a2fc9f0/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:24.286086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.341573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be856afa3b5c41da9560578526d92c4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:24.410143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7be4d-9895-401c-9a20-52c16858805a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.417522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f8799-b7eb-44f1-8ddd-7d5629383bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.418713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f8799-b7eb-44f1-8ddd-7d5629383bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.419139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f8799-b7eb-44f1-8ddd-7d5629383bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.419646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f8799-b7eb-44f1-8ddd-7d5629383bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.420439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be856afa3b5c41da9560578526d92c4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:24.420708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f8799-b7eb-44f1-8ddd-7d5629383bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.422543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f8799-b7eb-44f1-8ddd-7d5629383bf4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.447426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:24.448045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be856afa3b5c41da9560578526d92c4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:24.449551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be856afa3b5c41da9560578526d92c4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:24.461241 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3123/6255] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:24.462907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdec3a-3a48-4b59-8cb0-2b82eb99377f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.464022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdec3a-3a48-4b59-8cb0-2b82eb99377f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.464330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdec3a-3a48-4b59-8cb0-2b82eb99377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.482276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be856afa3b5c41da9560578526d92c4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:24.496582 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3133/6256] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:24 2022] DELETE /identity/v3/users/be856afa3b5c41da9560578526d92c4e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:24.498082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.500865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:24.520747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-44cdec3a-3a48-4b59-8cb0-2b82eb99377f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:24.522076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44cdec3a-3a48-4b59-8cb0-2b82eb99377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:24.621671 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3124/6257] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:24.626747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.627692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.628452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.653283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:24.654727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:24.660126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d02a3f-14b6-47ef-ad68-70e7bacdc158 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.665248 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3125/6258] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:24.666250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.668257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.668896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:24.672764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.673407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.673840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.675012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.678644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.716450 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3134/6259] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:24.716450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.719253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:24.751621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42addaa-408c-4d4f-ad33-be80b16d81ca None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.757720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.758413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.758748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.759038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.770822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.772461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.784730 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3126/6260] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:24.785638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:24.801131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a712b4-7f5a-472f-b946-b0e5c47a4519 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.808650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27320ed4-a13e-4138-8dd3-cab17dec336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:24.809762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27320ed4-a13e-4138-8dd3-cab17dec336e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.810105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27320ed4-a13e-4138-8dd3-cab17dec336e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.810459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27320ed4-a13e-4138-8dd3-cab17dec336e admin admin] PATH_INFO: `/v3/projects/c1ac755beb9340d78a647c9fb784b8e6/users/c7cb5a8012a24a4786583f3eb33b2cbb/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.846571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27320ed4-a13e-4138-8dd3-cab17dec336e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ac755beb9340d78a647c9fb784b8e6, user_id=c7cb5a8012a24a4786583f3eb33b2cbb, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:24.851114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27320ed4-a13e-4138-8dd3-cab17dec336e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:24.867499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7e84-e0e8-4bb1-bded-b0944622121f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:24.901292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:24.907247 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3127/6261] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:24 2022] PUT /identity/v3/projects/c1ac755beb9340d78a647c9fb784b8e6/users/c7cb5a8012a24a4786583f3eb33b2cbb/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:24.929799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cf40-2287-4c61-bf1e-3e2f71dc9c33 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:24.930708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cf40-2287-4c61-bf1e-3e2f71dc9c33 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:24.931524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cf40-2287-4c61-bf1e-3e2f71dc9c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:24.985484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3853cf40-2287-4c61-bf1e-3e2f71dc9c33 None None] MFA Rules not processed for user `c7cb5a8012a24a4786583f3eb33b2cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:24.988910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3853cf40-2287-4c61-bf1e-3e2f71dc9c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:25.063171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:25.064698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:25.065338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:25.065904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:25.242761 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3128/6262] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:25.251670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853cf40-2287-4c61-bf1e-3e2f71dc9c33 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:25.256200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:25.259121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:25.288750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:25.312813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853cf40-2287-4c61-bf1e-3e2f71dc9c33 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:25.324170 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3135/6263] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:25.328728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:25.329925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:25.331529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:25.332039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:25.333562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:25.337857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:25.429238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:25.439135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3129/6264] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:25 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:25.452015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1c31a-bf07-4bab-b7f4-aebc6efe721b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:25.790660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:25.792234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:25.792531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:25.792813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:25.794168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:25.796938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:25.884743 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3136/6265] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:25 2022] POST /identity/v3/users => generated 296 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:25.887450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:25.941149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8fe52-c312-4543-bd9f-5ebaf3196900 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:25.998254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:26.017981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:26.028390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:26.032054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:26.042220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:26.045171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:26.102531 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3130/6266] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:26.104109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:26.121013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bf395-c0c9-4a8a-b34b-fd1781de60f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:26.165583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:26.165583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:26.166842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:26.167412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] PATH_INFO: `/v3/projects/af7fdbb297564a139962ad2a04db5f10/users/1c01e30d5497462a9ddd19b173703580/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:26.299585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7fdbb297564a139962ad2a04db5f10, user_id=1c01e30d5497462a9ddd19b173703580, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:26.314478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:26.363527 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3137/6267] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:26 2022] PUT /identity/v3/projects/af7fdbb297564a139962ad2a04db5f10/users/1c01e30d5497462a9ddd19b173703580/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:26.369175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:26.411517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0749c9-8472-45a2-995d-d8038f053661 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:26.659112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ba903-9890-47b8-ba49-272d94385dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:26.661189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba903-9890-47b8-ba49-272d94385dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:26.661709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba903-9890-47b8-ba49-272d94385dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:26.662134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba903-9890-47b8-ba49-272d94385dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:26.663674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ba903-9890-47b8-ba49-272d94385dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:26.667088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ba903-9890-47b8-ba49-272d94385dd1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:26.698772 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3131/6268] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:26.700260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:26.832557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09cc5c-24d8-46b7-8e45-4e5fdcb1afdd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:26.843367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:26.844523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:26.844821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:26.845107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] PATH_INFO: `/v3/projects/af7fdbb297564a139962ad2a04db5f10/users/1c01e30d5497462a9ddd19b173703580/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:26.848925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7fdbb297564a139962ad2a04db5f10, user_id=1c01e30d5497462a9ddd19b173703580, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:26.854244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:26.857228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:26.895883 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3138/6269] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:26 2022] PUT /identity/v3/projects/af7fdbb297564a139962ad2a04db5f10/users/1c01e30d5497462a9ddd19b173703580/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:26.902899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271421-2468-4923-bcf6-f28f78911a2c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:26.903795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271421-2468-4923-bcf6-f28f78911a2c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:26.904622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271421-2468-4923-bcf6-f28f78911a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:26.982732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d3271421-2468-4923-bcf6-f28f78911a2c None None] MFA Rules not processed for user `1c01e30d5497462a9ddd19b173703580`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:26.985290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d3271421-2468-4923-bcf6-f28f78911a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:27.333905 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3132/6270] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:09:27.348685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:27.352461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:27.516823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c941c95-7502-4ce6-866e-88b6b0cc9783 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:27.522120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:27.522826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:27.523133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:27.523704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:27.536455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:27.538004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:27.551702 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3139/6271] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:27.688052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271421-2468-4923-bcf6-f28f78911a2c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:27.721959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271421-2468-4923-bcf6-f28f78911a2c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:27.757839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1727e7-b0dc-4774-9b43-ea09856466a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:27.765728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1727e7-b0dc-4774-9b43-ea09856466a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:27.766626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1727e7-b0dc-4774-9b43-ea09856466a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:27.767607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1727e7-b0dc-4774-9b43-ea09856466a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:27.775595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e1727e7-b0dc-4774-9b43-ea09856466a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:27.877140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:27.879755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:27.939842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:28.033126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1727e7-b0dc-4774-9b43-ea09856466a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:28.041985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1727e7-b0dc-4774-9b43-ea09856466a9 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:28.066241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d3b81-5cc9-41ad-a180-c311a21faa78 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:28.073089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:28.074271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:28.074769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:28.075423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] PATH_INFO: `/v3/projects/ebd6507a09254c3f8b9a9172a487cfd8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:28.088822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd6507a09254c3f8b9a9172a487cfd8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:28.091923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:28.098083 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3133/6272] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:28.216528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd6507a09254c3f8b9a9172a487cfd8', 'request_id': 'req-5d555d0d-14bb-48e8-b862-f230ed255d68'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:28.264638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd6507a09254c3f8b9a9172a487cfd8', 'request_id': 'req-5d555d0d-14bb-48e8-b862-f230ed255d68'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:28.296200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd6507a09254c3f8b9a9172a487cfd8', 'request_id': 'req-5d555d0d-14bb-48e8-b862-f230ed255d68'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:28.370577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] The token cache is being invalidate because project ebd6507a09254c3f8b9a9172a487cfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:28.371638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:28.372428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d555d0d-14bb-48e8-b862-f230ed255d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:28.387976 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3140/6273] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:27 2022] DELETE /identity/v3/projects/ebd6507a09254c3f8b9a9172a487cfd8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:28.395350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0534f-c3d6-4050-a909-463dcf7d92a2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:28.400144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0534f-c3d6-4050-a909-463dcf7d92a2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:28.403575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0534f-c3d6-4050-a909-463dcf7d92a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:28.499452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-53d0534f-c3d6-4050-a909-463dcf7d92a2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:28.506314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53d0534f-c3d6-4050-a909-463dcf7d92a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:28.822801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3134/6274] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:28.830118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5fac9-d464-452a-b931-1c6a1b6e70b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:28.830565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5fac9-d464-452a-b931-1c6a1b6e70b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:28.831033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5fac9-d464-452a-b931-1c6a1b6e70b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:28.918262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8ec5fac9-d464-452a-b931-1c6a1b6e70b7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:28.921017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ec5fac9-d464-452a-b931-1c6a1b6e70b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:28.945854 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3141/6275] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:28.949794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0534f-c3d6-4050-a909-463dcf7d92a2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:28.967154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0534f-c3d6-4050-a909-463dcf7d92a2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:28.983567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:28.984476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:28.984789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:28.985056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:28.985846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:28.986330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:28.988353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:29.021160 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3135/6276] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:09:29.028241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5fac9-d464-452a-b931-1c6a1b6e70b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:29.047990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5fac9-d464-452a-b931-1c6a1b6e70b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:29.062965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:29.063924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:29.064239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:29.064510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:29.066559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:29.068915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:29.141384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:29.152418 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3142/6277] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:29 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:09:29.156691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:29.177615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9063cc-5c32-46b3-9f1e-599d102e0fd7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:29.342455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:29.343212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:29.346805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:29.347963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:29.352522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:29.353711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:29.409820 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3136/6278] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:29 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:29.414602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:29.430025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514dce-a92a-43d8-b899-d922637296eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:29.443941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:29.444593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:29.444911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:29.445204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:29.447527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:29.451765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:29.479227 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3143/6279] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:29.483484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:29.499923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1144da3-5b38-43b3-93e9-dc98873bbd12 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:29.515477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fb8e3-73b3-4896-8858-479a7e9be7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:29.516351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fb8e3-73b3-4896-8858-479a7e9be7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:29.516638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fb8e3-73b3-4896-8858-479a7e9be7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:29.516921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fb8e3-73b3-4896-8858-479a7e9be7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:29.517690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fb8e3-73b3-4896-8858-479a7e9be7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:29.520107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fb8e3-73b3-4896-8858-479a7e9be7b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:29.541930 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3137/6280] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:29.542788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:29.562163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e27b-758f-4b27-adab-b25ecf1a53ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:29.573950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:29.574902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:29.577601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:29.577896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] PATH_INFO: `/v3/projects/df05f31c2752460e91936bc41ebf7787/users/cb34f3140917492ea0f287df50e9a0e2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:29.620613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df05f31c2752460e91936bc41ebf7787, user_id=cb34f3140917492ea0f287df50e9a0e2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:29.626362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:29.664041 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3144/6281] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:29 2022] PUT /identity/v3/projects/df05f31c2752460e91936bc41ebf7787/users/cb34f3140917492ea0f287df50e9a0e2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:29.678344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57555-d040-4012-8f5d-68eb2f676354 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:29.678705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57555-d040-4012-8f5d-68eb2f676354 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:29.678997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57555-d040-4012-8f5d-68eb2f676354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:29.759058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-63e57555-d040-4012-8f5d-68eb2f676354 None None] MFA Rules not processed for user `cb34f3140917492ea0f287df50e9a0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:29.772451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63e57555-d040-4012-8f5d-68eb2f676354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:29.908761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:30.070201 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3138/6282] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:30.102274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:30.105441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:30.344671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e45e5-b1b2-45c7-ba64-223ea3f442a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:30.359546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:30.360250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:30.360622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:30.360805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:30.406974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:30.410981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:30.440009 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3145/6283] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:09:30.700183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e57555-d040-4012-8f5d-68eb2f676354 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:30.899743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e57555-d040-4012-8f5d-68eb2f676354 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:30.910187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:30.913381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:30.913760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:30.915038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] PATH_INFO: `/v3/users/cb34f3140917492ea0f287df50e9a0e2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:30.924435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb34f3140917492ea0f287df50e9a0e2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:30.927048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:31.076069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb34f3140917492ea0f287df50e9a0e2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:31.109613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb34f3140917492ea0f287df50e9a0e2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:31.110442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb34f3140917492ea0f287df50e9a0e2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:31.158700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb34f3140917492ea0f287df50e9a0e2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:31.160156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-23e5af90-a2fb-444c-8b8a-307fe6e3fc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb34f3140917492ea0f287df50e9a0e2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:31.168234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:31.170110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:31.297663 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3139/6284] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:30 2022] DELETE /identity/v3/users/cb34f3140917492ea0f287df50e9a0e2 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:31.303002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:31.310123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:31.310309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:31.366761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:31.372206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:31.413406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11017-cb3f-4340-b3f3-f755d03d6b41 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:31.513280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:31.536647 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3140/6285] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:31.551309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:31.553312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:31.609271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8ce1c-d4a7-4dee-9139-e6b977dd83e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:31.610069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ce1c-d4a7-4dee-9139-e6b977dd83e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:31.610659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ce1c-d4a7-4dee-9139-e6b977dd83e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:31.611013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ce1c-d4a7-4dee-9139-e6b977dd83e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:31.616301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8a8ce1c-d4a7-4dee-9139-e6b977dd83e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:31.700830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435a262-c3eb-4b95-b658-47110640b80c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:31.713771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:31.715319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:31.716533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:31.726953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:31.730290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:31.784332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:31.787872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:31.882781 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3141/6286] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:09:31.898465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8ce1c-d4a7-4dee-9139-e6b977dd83e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:31.900777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8ce1c-d4a7-4dee-9139-e6b977dd83e1 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:31.920064 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3146/6287] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:33.897597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:33.899254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:33.929090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a9774-270e-4290-bee2-140b15b4c1ff service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:33.961064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:33.964263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:33.964664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:33.965127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] PATH_INFO: `/v3/projects/df05f31c2752460e91936bc41ebf7787` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:33.968025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df05f31c2752460e91936bc41ebf7787)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:33.975919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:34.226139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df05f31c2752460e91936bc41ebf7787', 'request_id': 'req-e72bb569-5a36-4c16-b115-214e08b560d2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:34.261911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df05f31c2752460e91936bc41ebf7787', 'request_id': 'req-e72bb569-5a36-4c16-b115-214e08b560d2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:34.285527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df05f31c2752460e91936bc41ebf7787', 'request_id': 'req-e72bb569-5a36-4c16-b115-214e08b560d2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:34.343070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] The token cache is being invalidate because project df05f31c2752460e91936bc41ebf7787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:34.343825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:34.345321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e72bb569-5a36-4c16-b115-214e08b560d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:34.350036 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3142/6288] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:33 2022] DELETE /identity/v3/projects/df05f31c2752460e91936bc41ebf7787 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:34.357071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52474a34-92f4-4e25-93a4-cc37d49f2e11 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:34.358031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52474a34-92f4-4e25-93a4-cc37d49f2e11 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:34.358503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52474a34-92f4-4e25-93a4-cc37d49f2e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:34.416546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52474a34-92f4-4e25-93a4-cc37d49f2e11 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:34.421734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52474a34-92f4-4e25-93a4-cc37d49f2e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:34.599252 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3147/6289] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:34.612490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789043-7a8b-47d6-a0cf-eb16d4301acb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:34.614339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789043-7a8b-47d6-a0cf-eb16d4301acb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:34.614562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6789043-7a8b-47d6-a0cf-eb16d4301acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:34.744636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e6789043-7a8b-47d6-a0cf-eb16d4301acb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:34.749295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6789043-7a8b-47d6-a0cf-eb16d4301acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:34.774879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52474a34-92f4-4e25-93a4-cc37d49f2e11 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:34.780474 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3143/6290] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:34.788353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52474a34-92f4-4e25-93a4-cc37d49f2e11 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:34.820406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:34.821553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:34.822178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:34.822725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:34.825805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:34.826486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:34.830591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:34.863446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3148/6291] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:34.865768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6789043-7a8b-47d6-a0cf-eb16d4301acb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:34.887890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6789043-7a8b-47d6-a0cf-eb16d4301acb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:34.907686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:34.910667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:34.913805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:34.914610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:34.915754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:34.921173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:34.994326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3144/6292] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:34 2022] POST /identity/v3/projects => generated 351 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:34.998460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:35.014430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d76dc-6d48-4cc9-9888-d477d5f55206 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:35.179592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:35.180764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:35.181306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:35.182111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:35.183835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:35.186746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:35.238824 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3149/6293] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:34 2022] POST /identity/v3/users => generated 276 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:35.242755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:35.265377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2915d6-ac95-4d2c-a34e-3059981814f5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:35.294986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:35.296298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:35.296787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:35.297398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:35.300294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:35.313591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:35.346596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:35.360171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3145/6294] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:35.364494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650625-25a5-4e1d-a0ce-ad02893cf854 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:35.380358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f35f9f-f694-4cdd-81e5-dab49180f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:35.385410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35f9f-f694-4cdd-81e5-dab49180f98e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:35.387342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35f9f-f694-4cdd-81e5-dab49180f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:35.387961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35f9f-f694-4cdd-81e5-dab49180f98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:35.391733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f35f9f-f694-4cdd-81e5-dab49180f98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:35.398262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f35f9f-f694-4cdd-81e5-dab49180f98e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:35.441467 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3150/6295] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:35.446349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:35.459558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8cd2e-1334-4b03-bb26-166861d9efb3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:35.477339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:35.479039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:35.482178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:35.485291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] PATH_INFO: `/v3/projects/250787c601d043668e88b7d356ac6e94/users/4beb80aebc7b4be2acf2e3867a89fcb2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:35.538322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=250787c601d043668e88b7d356ac6e94, user_id=4beb80aebc7b4be2acf2e3867a89fcb2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:35.562410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:35.625370 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3146/6296] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:35 2022] PUT /identity/v3/projects/250787c601d043668e88b7d356ac6e94/users/4beb80aebc7b4be2acf2e3867a89fcb2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:35.630432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:35.630757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:35.634715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:35.792765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] MFA Rules not processed for user `4beb80aebc7b4be2acf2e3867a89fcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:35.794400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:35.864409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:36.027038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3151/6297] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:36.079643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:36.083482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:36.252454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:36.487009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4eb0e-1fac-49c9-bb51-eb23ebb9b0d4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:36.492678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cf41c-0fc6-4652-97a7-257c9a300abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:36.493379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cf41c-0fc6-4652-97a7-257c9a300abd service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:36.493729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cf41c-0fc6-4652-97a7-257c9a300abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:36.495072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cf41c-0fc6-4652-97a7-257c9a300abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:36.522833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cf41c-0fc6-4652-97a7-257c9a300abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:36.531247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cf41c-0fc6-4652-97a7-257c9a300abd service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:36.658220 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3147/6298] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:40.221527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:40.224913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:40.655150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db04218-9643-47cf-aa6e-8817a486f4c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:40.699121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:40.700978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:40.701597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:40.702786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] PATH_INFO: `/v3/users/bfd1711522ef4e3b90942047855af259` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:40.712923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd1711522ef4e3b90942047855af259)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:40.721031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:40.950056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd1711522ef4e3b90942047855af259'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:41.025362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd1711522ef4e3b90942047855af259'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:41.059878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd1711522ef4e3b90942047855af259'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:41.068290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd1711522ef4e3b90942047855af259'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:41.127433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd1711522ef4e3b90942047855af259'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:41.188729 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3152/6299] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:40 2022] DELETE /identity/v3/users/bfd1711522ef4e3b90942047855af259 => generated 0 bytes in 963 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:41.190844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:41.192514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:41.193103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:41.288933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:41.298582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:41.567115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3148/6300] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:41.597970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:41.600292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:41.895612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:41.924414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c81c-f3cf-4847-8dd3-87ad722477b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:41.936007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:41.938242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:41.938812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:41.941883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:41.978794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:41.981583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:42.020989 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3153/6301] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:44.655160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:44.657912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:44.782843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a68f5-b73f-4584-8c66-4484af58065e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:44.827377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:44.837536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:44.838809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:44.843432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] PATH_INFO: `/v3/projects/b89042f551ca437693fa4121647a7adc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:44.848546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89042f551ca437693fa4121647a7adc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:44.851953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:45.085993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89042f551ca437693fa4121647a7adc', 'request_id': 'req-3ccd1e43-e865-4244-bac3-afe63036275d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:45.124672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89042f551ca437693fa4121647a7adc', 'request_id': 'req-3ccd1e43-e865-4244-bac3-afe63036275d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:45.134074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89042f551ca437693fa4121647a7adc', 'request_id': 'req-3ccd1e43-e865-4244-bac3-afe63036275d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:45.207175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] The token cache is being invalidate because project b89042f551ca437693fa4121647a7adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:45.218269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:45.219704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:45.224748 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3149/6302] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:44 2022] DELETE /identity/v3/projects/b89042f551ca437693fa4121647a7adc => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:45.229186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:45.256512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b85e6-9841-46f0-a3b4-482e26d20cae service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:45.615723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:45.621693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:45.622054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:45.622258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] PATH_INFO: `/v3/users/c7cb5a8012a24a4786583f3eb33b2cbb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:45.635859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cb5a8012a24a4786583f3eb33b2cbb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:45.645945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:45.954353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cb5a8012a24a4786583f3eb33b2cbb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:46.044170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cb5a8012a24a4786583f3eb33b2cbb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:46.083020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cb5a8012a24a4786583f3eb33b2cbb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:46.091587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cb5a8012a24a4786583f3eb33b2cbb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:46.216884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91694a59-3d1e-47b6-88f4-9ed0c96f4128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cb5a8012a24a4786583f3eb33b2cbb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:46.293054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:46.299091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:46.305555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3154/6303] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:45 2022] DELETE /identity/v3/users/c7cb5a8012a24a4786583f3eb33b2cbb => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:46.384706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd1e43-e865-4244-bac3-afe63036275d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:46.646629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:46.727857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:46.729582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:46.730218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:46.730854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] PATH_INFO: `/v3/users/f71c92b14e2c4e4e80c148f0d49a2013` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:46.735298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71c92b14e2c4e4e80c148f0d49a2013)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:46.752708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:46.996199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71c92b14e2c4e4e80c148f0d49a2013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:47.077825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71c92b14e2c4e4e80c148f0d49a2013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:47.084870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71c92b14e2c4e4e80c148f0d49a2013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:47.109460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71c92b14e2c4e4e80c148f0d49a2013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:47.113363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71c92b14e2c4e4e80c148f0d49a2013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:47.173703 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3150/6304] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:46 2022] DELETE /identity/v3/users/f71c92b14e2c4e4e80c148f0d49a2013 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:47.176559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0016e3-6999-43f1-a537-4b19be1c4811 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:47.177145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0016e3-6999-43f1-a537-4b19be1c4811 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:47.177703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0016e3-6999-43f1-a537-4b19be1c4811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:47.489952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be0016e3-6999-43f1-a537-4b19be1c4811 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:47.492345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be0016e3-6999-43f1-a537-4b19be1c4811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:47.783679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:47.885068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3155/6305] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 711 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:09:47.930901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:47.933484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:48.210915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba729-a138-4c25-9a81-78e59998828d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:48.230319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:48.231550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:48.232225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:48.232838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:48.270089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:48.277595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:48.322048 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3151/6306] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:49.672058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdf4d2-c138-4a3e-ae77-5636d6fbca40 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:49.672666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdf4d2-c138-4a3e-ae77-5636d6fbca40 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:49.673183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdf4d2-c138-4a3e-ae77-5636d6fbca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:49.810561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a9cdf4d2-c138-4a3e-ae77-5636d6fbca40 None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:49.813042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9cdf4d2-c138-4a3e-ae77-5636d6fbca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:49.863867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:49.869031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:49.981000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918767ca-b674-4c0e-81a4-33b813110dbd service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:50.031689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:50.047600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:50.048086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:50.048576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] PATH_INFO: `/v3/users/4beb80aebc7b4be2acf2e3867a89fcb2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:50.062071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4beb80aebc7b4be2acf2e3867a89fcb2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:50.065354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:50.208904 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3156/6307] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:50.233456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:50.233799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:50.234194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:50.280735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:50.287562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:50.304181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4beb80aebc7b4be2acf2e3867a89fcb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:50.320143 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3157/6308] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:50.335751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:50.337431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:50.340185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:50.344289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4beb80aebc7b4be2acf2e3867a89fcb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:50.350957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4beb80aebc7b4be2acf2e3867a89fcb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:50.367258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4beb80aebc7b4be2acf2e3867a89fcb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:50.370070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f31d21a-8707-48d6-bb7b-9cdc47400d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4beb80aebc7b4be2acf2e3867a89fcb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:50.412926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3152/6309] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:49 2022] DELETE /identity/v3/users/4beb80aebc7b4be2acf2e3867a89fcb2 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:50.414762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:50.415058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:50.415369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:50.468358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:50.474161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:50.620147 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3153/6310] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:50.642482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539991-ccd6-4b34-ad05-1b1b7f11cd36 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:50.664300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:50.666470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:50.819911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26f4d5-2b48-46ac-9730-4b877bbd7c1b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:50.834814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:50.835563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:50.836275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:50.836596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:50.859573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:50.861095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:50.882187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:50.883823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:50.884381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:50.884846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:50.889851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:50.907753 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3154/6311] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:50.910938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:50.911356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:50.916335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:50.955488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b309-0fe9-4010-862d-77f283c4e761 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:50.985293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:50.994005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:50.994758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:50.995462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] PATH_INFO: `/v3/projects/5cca49305bdc49d58a7ec8312b415c56` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:50.998876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cca49305bdc49d58a7ec8312b415c56)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:51.018119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:51.117883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:51.121781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:51.160352 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3158/6312] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 825 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:09:51.169489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:51.173681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:51.212798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cca49305bdc49d58a7ec8312b415c56', 'request_id': 'req-d94353a7-975d-4231-93f5-7837d938676f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.216357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9fe89-0f93-4ab0-ba70-42624abd5224 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:51.238906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cca49305bdc49d58a7ec8312b415c56', 'request_id': 'req-d94353a7-975d-4231-93f5-7837d938676f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.250897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cca49305bdc49d58a7ec8312b415c56', 'request_id': 'req-d94353a7-975d-4231-93f5-7837d938676f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.284572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] The token cache is being invalidate because project 5cca49305bdc49d58a7ec8312b415c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:51.284972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.285619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d94353a7-975d-4231-93f5-7837d938676f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.297403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3155/6313] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:50 2022] DELETE /identity/v3/projects/5cca49305bdc49d58a7ec8312b415c56 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:51.299255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8c24-43f7-4e7c-8057-ac6e908f41b9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:51.299729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8c24-43f7-4e7c-8057-ac6e908f41b9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:51.307131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8c24-43f7-4e7c-8057-ac6e908f41b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:51.356085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:51.357024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:51.357357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:51.357559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] PATH_INFO: `/v3/projects/c1ac755beb9340d78a647c9fb784b8e6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:51.359937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ac755beb9340d78a647c9fb784b8e6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:51.367421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:51.368942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:51.391224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cb2b8c24-43f7-4e7c-8057-ac6e908f41b9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:51.392922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb2b8c24-43f7-4e7c-8057-ac6e908f41b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:51.427773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3156/6314] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:51.444165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e63db-ce52-419b-99cb-3d1e88d47248 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:51.444489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e63db-ce52-419b-99cb-3d1e88d47248 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:51.444710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e63db-ce52-419b-99cb-3d1e88d47248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:51.489321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ac755beb9340d78a647c9fb784b8e6', 'request_id': 'req-95897549-d834-44a4-9490-38139e255a8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.505878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ac755beb9340d78a647c9fb784b8e6', 'request_id': 'req-95897549-d834-44a4-9490-38139e255a8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.506183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-579e63db-ce52-419b-99cb-3d1e88d47248 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:51.507563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-579e63db-ce52-419b-99cb-3d1e88d47248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:51.517058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ac755beb9340d78a647c9fb784b8e6', 'request_id': 'req-95897549-d834-44a4-9490-38139e255a8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.541640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] The token cache is being invalidate because project c1ac755beb9340d78a647c9fb784b8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:51.542004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.543706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.548527 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3159/6315] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:51 2022] DELETE /identity/v3/projects/c1ac755beb9340d78a647c9fb784b8e6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:51.553307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:51.555415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:51.693226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:51.730508 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3157/6316] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:51.736511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e63db-ce52-419b-99cb-3d1e88d47248 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:51.762517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e63db-ce52-419b-99cb-3d1e88d47248 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:51.773552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897549-d834-44a4-9490-38139e255a8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:51.776564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:51.778228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:51.778228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:51.778228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:51.778658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:51.778971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:51.780911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:51.787626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:51.788516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:51.788821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:51.789086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] PATH_INFO: `/v3/users/1c01e30d5497462a9ddd19b173703580` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:51.794740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c01e30d5497462a9ddd19b173703580)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:51.796835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:51.819189 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3158/6317] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:51.820250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:51.848082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab585f-8343-4218-8ca0-b8c8ba97cf50 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:51.856233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:51.856939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:51.857227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:51.857507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:51.858235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:51.860462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:51.920109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c01e30d5497462a9ddd19b173703580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:51.927734 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3159/6318] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:51 2022] POST /identity/v3/projects => generated 397 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:51.928764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:51.969363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c01e30d5497462a9ddd19b173703580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.004409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c01e30d5497462a9ddd19b173703580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.005404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c01e30d5497462a9ddd19b173703580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.041065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c01e30d5497462a9ddd19b173703580'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.057136 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3160/6319] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:09:51 2022] DELETE /identity/v3/users/1c01e30d5497462a9ddd19b173703580 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:52.086119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce352e53-5fd7-478d-9b19-b7c4fb6e6274 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:52.291001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:52.291820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:52.292113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:52.292465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:52.293327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:52.295446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:52.383078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3160/6320] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:51 2022] POST /identity/v3/users => generated 299 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:52.387820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:52.389372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:52.416664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a7ade-3213-498a-953d-7cca76e0dc8b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:52.435145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:52.435982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:52.436265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:52.436550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:52.437333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:52.439142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:52.473632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:52.475871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:52.484053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:52.498360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd024-dbf2-4f82-b7b5-7efb4c48e5aa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:52.512769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:52.513995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:52.514600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:52.515056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] PATH_INFO: `/v3/projects/250787c601d043668e88b7d356ac6e94` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:52.516838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=250787c601d043668e88b7d356ac6e94)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:52.534025 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3161/6321] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:09:52.535316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:52.536652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:52.609470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2e9a2-e84c-455b-9be2-c94bb0c21a86 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:52.629441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:52.632193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:52.633628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:52.633628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:52.635469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:52.638791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:52.650033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250787c601d043668e88b7d356ac6e94', 'request_id': 'req-094afa90-0316-4f33-8a4c-7c69f77833d3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.677870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250787c601d043668e88b7d356ac6e94', 'request_id': 'req-094afa90-0316-4f33-8a4c-7c69f77833d3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.693696 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3162/6322] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:52.696925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250787c601d043668e88b7d356ac6e94', 'request_id': 'req-094afa90-0316-4f33-8a4c-7c69f77833d3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.698557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:52.736804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] The token cache is being invalidate because project 250787c601d043668e88b7d356ac6e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:52.738726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.738726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-094afa90-0316-4f33-8a4c-7c69f77833d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:52.747358 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3161/6323] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:52 2022] DELETE /identity/v3/projects/250787c601d043668e88b7d356ac6e94 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:52.749276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96bbbc-f3c1-4499-9079-3927aed5b736 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:52.755306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4752b-2d46-416d-a83e-dbc72fa1d1d3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:52.755596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4752b-2d46-416d-a83e-dbc72fa1d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:52.755971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4752b-2d46-416d-a83e-dbc72fa1d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:52.796904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2bf4752b-2d46-416d-a83e-dbc72fa1d1d3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:52.798188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2bf4752b-2d46-416d-a83e-dbc72fa1d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:52.964167 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3162/6324] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:53.042579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27f799-2280-45ba-b523-a3f766276072 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.042947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27f799-2280-45ba-b523-a3f766276072 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.043119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27f799-2280-45ba-b523-a3f766276072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.090312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5b27f799-2280-45ba-b523-a3f766276072 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:53.092057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b27f799-2280-45ba-b523-a3f766276072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:53.123306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf6f10-ffd8-46e3-a773-0213d8b48470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:53.129333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3163/6325] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:53.130778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27f799-2280-45ba-b523-a3f766276072 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:53.139462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6f10-ffd8-46e3-a773-0213d8b48470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.139981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6f10-ffd8-46e3-a773-0213d8b48470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.140491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6f10-ffd8-46e3-a773-0213d8b48470 admin admin] PATH_INFO: `/v3/projects/1163d6bb44334a1da176b64bce10defa/users/e9146bf176504982835f98712c3ad3da/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.166849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27f799-2280-45ba-b523-a3f766276072 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:53.185149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:53.186083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.186552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.187100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.188128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:53.189493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:53.193487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:53.226449 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3164/6326] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:53.232382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:53.247848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c48bd0-f750-4971-9d15-96eb54b7ceb9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:53.253883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:53.254814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.255535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.255986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.256889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:53.259930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:53.260507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf6f10-ffd8-46e3-a773-0213d8b48470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1163d6bb44334a1da176b64bce10defa, user_id=e9146bf176504982835f98712c3ad3da, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:53.280660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf6f10-ffd8-46e3-a773-0213d8b48470 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:53.311208 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3165/6327] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:53 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:53.313264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:53.341799 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3163/6328] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:52 2022] PUT /identity/v3/projects/1163d6bb44334a1da176b64bce10defa/users/e9146bf176504982835f98712c3ad3da/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:53.350010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.360694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.361336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.485863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] MFA Rules not processed for user `e9146bf176504982835f98712c3ad3da`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:53.492397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:53.505727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:53.508396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:53.563307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729dcc8-8fb1-46d7-aee3-a6ff96b5eb24 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:53.587199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:53.589111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.589300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.589856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.590305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:53.605270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:53.673534 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3166/6329] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:53 2022] POST /identity/v3/users => generated 287 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:09:53.678750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:53.778438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ccb5f-285f-41d0-abe9-d00f96d4aad7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:53.825872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:53.830453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.834486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.835041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.836566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:53.847780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:53.870956 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3164/6330] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:53.870956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:53.870956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:53.910560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3167/6331] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:53.921588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:53.925389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:53.937683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce9862-74e6-40bb-bbc5-57db983abc53 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:53.945022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:53.947432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:53.948751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:53.948751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] PATH_INFO: `/v3/projects/af7fdbb297564a139962ad2a04db5f10` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:53.952413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7fdbb297564a139962ad2a04db5f10)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:53.952413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:54.043246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7fdbb297564a139962ad2a04db5f10', 'request_id': 'req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:54.052737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7fdbb297564a139962ad2a04db5f10', 'request_id': 'req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:54.061945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7fdbb297564a139962ad2a04db5f10', 'request_id': 'req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:54.085697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] The token cache is being invalidate because project af7fdbb297564a139962ad2a04db5f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:09:54.087325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:54.088347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:09:54.091120 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3165/6332] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:09:53 2022] DELETE /identity/v3/projects/af7fdbb297564a139962ad2a04db5f10 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:54.092425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:54.094570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:54.243867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36d76f-98e9-4e1a-add6-fdc8a90ae10c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:54.257032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82180374-1a8f-4dce-8401-b09a4c6ee7c1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:54.260226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2501922-eadb-433f-971d-076b0f1cc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:54.260949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2501922-eadb-433f-971d-076b0f1cc5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:54.261593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2501922-eadb-433f-971d-076b0f1cc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:54.261909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2501922-eadb-433f-971d-076b0f1cc5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:54.262733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2501922-eadb-433f-971d-076b0f1cc5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:54.264777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2501922-eadb-433f-971d-076b0f1cc5d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:54.305290 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3166/6333] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:54.310506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a675f-cc76-4fba-857b-10e956410176 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:54.310506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a675f-cc76-4fba-857b-10e956410176 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:54.311427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a675f-cc76-4fba-857b-10e956410176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:54.377396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bf5a675f-cc76-4fba-857b-10e956410176 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:54.383748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bf5a675f-cc76-4fba-857b-10e956410176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:54.418320 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3167/6334] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:54.419494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a675f-cc76-4fba-857b-10e956410176 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:54.441697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ab678-1b03-43b4-88b0-9038988f8958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:54.442867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab678-1b03-43b4-88b0-9038988f8958 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:54.443094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab678-1b03-43b4-88b0-9038988f8958 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:54.443305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab678-1b03-43b4-88b0-9038988f8958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:54.452203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-db7ab678-1b03-43b4-88b0-9038988f8958 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:54.458281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a675f-cc76-4fba-857b-10e956410176 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:54.478621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffa1c4-d491-4600-a345-7d879b5e8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:54.480039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffa1c4-d491-4600-a345-7d879b5e8398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:54.483391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffa1c4-d491-4600-a345-7d879b5e8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:54.483752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffa1c4-d491-4600-a345-7d879b5e8398 admin admin] PATH_INFO: `/v3/projects/6eb273ba209948f099b4431aa278dcf2/users/2a7848d78b8848ceab09a548efef5641/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:54.532841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffa1c4-d491-4600-a345-7d879b5e8398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb273ba209948f099b4431aa278dcf2, user_id=2a7848d78b8848ceab09a548efef5641, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:54.542194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffa1c4-d491-4600-a345-7d879b5e8398 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:54.551450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:54.595134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3168/6335] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:54 2022] PUT /identity/v3/projects/6eb273ba209948f099b4431aa278dcf2/users/2a7848d78b8848ceab09a548efef5641/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:54.606418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8f964-9ce9-4805-a92c-9841678c528a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:54.606763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8f964-9ce9-4805-a92c-9841678c528a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:54.607015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8f964-9ce9-4805-a92c-9841678c528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:54.705589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ec8f964-9ce9-4805-a92c-9841678c528a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:54.707360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ec8f964-9ce9-4805-a92c-9841678c528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:54.773602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ab678-1b03-43b4-88b0-9038988f8958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:54.780921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ab678-1b03-43b4-88b0-9038988f8958 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:54.850738 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3168/6336] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 943 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:54.855050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ee66-a695-4c4a-8c38-390cc219635f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:54.855790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ee66-a695-4c4a-8c38-390cc219635f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:54.856124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ee66-a695-4c4a-8c38-390cc219635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:55.116546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8db7ee66-a695-4c4a-8c38-390cc219635f None None] MFA Rules not processed for user `2a7848d78b8848ceab09a548efef5641`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:55.135439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8db7ee66-a695-4c4a-8c38-390cc219635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:55.257732 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3169/6337] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 662 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:55.265654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8f964-9ce9-4805-a92c-9841678c528a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:55.303224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8f964-9ce9-4805-a92c-9841678c528a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:55.342560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:55.343678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:55.344348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:55.344642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:55.344928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:55.345844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:09:55.346168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:55.348486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:55.414612 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3170/6338] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:09:55.420131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:55.448284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf04c2-cdc7-4717-a1eb-7489735b4cf2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:55.453874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:55.454577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:55.454869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:55.455153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:55.456528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:55.458643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:55.505617 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3171/6339] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:55 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:55.511806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:55.648047 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3169/6340] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 797 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:55.656508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7ee66-a695-4c4a-8c38-390cc219635f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:55.725993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7ee66-a695-4c4a-8c38-390cc219635f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:55.777813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fee78-3978-4a77-be39-1023eeea9431 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:55.780998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:55.787480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:55.793143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:55.793798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:55.796659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:55.797609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:55.799211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:55.800398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:55.802131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:55.805913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:55.814010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:55.838533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:55.871391 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3172/6341] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:55 2022] POST /identity/v3/users => generated 290 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:55.874358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:55.916779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f355-ad56-4d08-9206-2c4c5ef5fef0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:55.948473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:55.949637 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3170/6342] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:55 2022] POST /identity/v3/projects => generated 369 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:55.952111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:55.952488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:55.953309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:55.955326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:55.958691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:55.960421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:55.988526 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3173/6343] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:55.999748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:56.044430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a34cc-ada9-4311-95da-786034922124 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.160581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f39bbb-0ff3-4613-a5c5-51e6281a1a8b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.187676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:56.192978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:56.193966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:56.195367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:56.197472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:56.201105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:56.211497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:56.257136 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3171/6344] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:55 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:56.263954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:56.268457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:56.269845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:56.270309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:56.270795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:56.271771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:56.276833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:56.309827 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3174/6345] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:56.316519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:56.324989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf8f11-3b93-48f0-a9e5-395c91e489a5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.336953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75207c8-a688-4844-aa48-84083f643cee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.345952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:56.347611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:56.349182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:56.350617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:56.357136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fa271-5345-4ed9-a34d-0eee53b17211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:56.357564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fa271-5345-4ed9-a34d-0eee53b17211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:56.357862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fa271-5345-4ed9-a34d-0eee53b17211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:56.358147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fa271-5345-4ed9-a34d-0eee53b17211 admin admin] PATH_INFO: `/v3/projects/d6c68001e70e4c3688bfe21b37285ac9/users/35c167f3df1b42c28a8879f80b4d21f7/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:56.364539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:56.379085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:56.390739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fa271-5345-4ed9-a34d-0eee53b17211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c68001e70e4c3688bfe21b37285ac9, user_id=35c167f3df1b42c28a8879f80b4d21f7, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:56.394286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fa271-5345-4ed9-a34d-0eee53b17211 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:56.417967 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3172/6346] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:56.422278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:56.441318 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3175/6347] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:56 2022] PUT /identity/v3/projects/d6c68001e70e4c3688bfe21b37285ac9/users/35c167f3df1b42c28a8879f80b4d21f7/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:56.444967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f8f6-d3ab-4233-9c3a-7390d4feecfa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.453883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15a9d8-e7c0-4f3e-9b09-16a66abbce45 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:56.454225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15a9d8-e7c0-4f3e-9b09-16a66abbce45 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:56.454516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15a9d8-e7c0-4f3e-9b09-16a66abbce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:56.505844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5c15a9d8-e7c0-4f3e-9b09-16a66abbce45 None None] MFA Rules not processed for user `35c167f3df1b42c28a8879f80b4d21f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:56.507124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c15a9d8-e7c0-4f3e-9b09-16a66abbce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:56.553785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:56.578404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:56.581256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:56.581256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] PATH_INFO: `/v3/projects/b4ddd9e12f0c4e76906f2b1a415cf71b/users/1ac00b1f2fff4165865eacfcbb2ce548/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:56.625134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ddd9e12f0c4e76906f2b1a415cf71b, user_id=1ac00b1f2fff4165865eacfcbb2ce548, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:56.632490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:56.666611 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3173/6348] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:56 2022] PUT /identity/v3/projects/b4ddd9e12f0c4e76906f2b1a415cf71b/users/1ac00b1f2fff4165865eacfcbb2ce548/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:09:56.667777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:56.681983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:56.707487 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3176/6349] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:09:56.708878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15a9d8-e7c0-4f3e-9b09-16a66abbce45 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:56.759280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15a9d8-e7c0-4f3e-9b09-16a66abbce45 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.859888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564b8cc-7f3f-45cd-838e-19435425df98 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.871787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:56.874550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:56.880227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:56.880968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:56.882040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:56.888192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:56.930491 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3174/6350] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:09:56.938440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:56.979090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c801d-8b4f-4f89-ac03-a62d1715a433 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:56.997169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064afcc-2c9a-4339-b9e3-aa5ae79e9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:57.000787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064afcc-2c9a-4339-b9e3-aa5ae79e9b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.000787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064afcc-2c9a-4339-b9e3-aa5ae79e9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.012822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064afcc-2c9a-4339-b9e3-aa5ae79e9b46 admin admin] PATH_INFO: `/v3/projects/b4ddd9e12f0c4e76906f2b1a415cf71b/users/1ac00b1f2fff4165865eacfcbb2ce548/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.029422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064afcc-2c9a-4339-b9e3-aa5ae79e9b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ddd9e12f0c4e76906f2b1a415cf71b, user_id=1ac00b1f2fff4165865eacfcbb2ce548, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:57.043516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064afcc-2c9a-4339-b9e3-aa5ae79e9b46 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:57.043913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:57.043913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.043913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.043913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.044532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:57.047124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:57.085392 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3175/6351] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:56 2022] PUT /identity/v3/projects/b4ddd9e12f0c4e76906f2b1a415cf71b/users/1ac00b1f2fff4165865eacfcbb2ce548/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:57.104747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.105042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.105401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.166877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3177/6352] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:09:56 2022] POST /identity/v3/projects => generated 379 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:09:57.168265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:57.206531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] MFA Rules not processed for user `1ac00b1f2fff4165865eacfcbb2ce548`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:57.207086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:57.257783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:57.348539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d1c64-c823-4a8b-9f18-fe7283620f20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:57.362846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:57.363601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.367135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.367525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.368479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:57.373975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:57.418863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3176/6353] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:57.420272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:57.422453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:57.437974 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3178/6354] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:09:57 2022] POST /identity/v3/users => generated 296 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:09:57.444400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:57.470990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2312e4-cafa-4350-810c-b2c4e447352f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:57.485334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:57.486546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.488080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.489696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.490682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:57.497486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:57.533000 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3179/6355] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:09:57.537684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:57.617863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a732eb2-40b5-4fb1-a03f-509d82559901 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:57.638674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:57.639770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.640062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.640351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] PATH_INFO: `/v3/projects/571bd3379304420e9897bef4b46e3f35/users/9f8d3a76450c4cfeb785caa6f84cb9cf/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.652347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cc4f1-451d-42d7-b026-eec35378d57a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:57.671993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:57.686887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.688339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.689462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.696621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=571bd3379304420e9897bef4b46e3f35, user_id=9f8d3a76450c4cfeb785caa6f84cb9cf, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:57.702469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:57.753100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:57.757087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:57.781450 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3180/6356] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:57 2022] PUT /identity/v3/projects/571bd3379304420e9897bef4b46e3f35/users/9f8d3a76450c4cfeb785caa6f84cb9cf/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:57.785916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:57.805992 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3177/6357] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:57.957431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fb055-40dd-4781-870c-9ee5e0b9f34a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:57.981590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:57.984702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:57.985888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:57.988020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:57.991226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:57.997603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:58.025137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:58.086650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3181/6358] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:09:58.091009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:58.119174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf5fe9-6034-4774-b484-8be84f8211bd service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:58.155933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5cd32-fb2d-433c-9d06-bf8b167bf80c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:58.190369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837d973-6b40-4e20-9c94-c6a66fa866e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:58.193689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:58.199250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837d973-6b40-4e20-9c94-c6a66fa866e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:58.199654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837d973-6b40-4e20-9c94-c6a66fa866e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:58.199949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837d973-6b40-4e20-9c94-c6a66fa866e8 admin admin] PATH_INFO: `/v3/projects/571bd3379304420e9897bef4b46e3f35/users/9f8d3a76450c4cfeb785caa6f84cb9cf/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:58.219724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837d973-6b40-4e20-9c94-c6a66fa866e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=571bd3379304420e9897bef4b46e3f35, user_id=9f8d3a76450c4cfeb785caa6f84cb9cf, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:58.232983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837d973-6b40-4e20-9c94-c6a66fa866e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:58.364594 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3182/6359] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:09:58 2022] PUT /identity/v3/projects/571bd3379304420e9897bef4b46e3f35/users/9f8d3a76450c4cfeb785caa6f84cb9cf/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:09:58.369262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:58.369560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:58.369849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:58.471695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:58.472911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:58.473413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:58.473912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:58.481261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] MFA Rules not processed for user `9f8d3a76450c4cfeb785caa6f84cb9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:09:58.482953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:58.680652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:58.736326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:58.744342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:58.746566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3183/6360] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:09:58.759726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:09:58.761452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:09:58.802367 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3178/6361] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:09:59.015009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e234c5-399e-43f5-a35b-988aabd35356 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:09:59.061344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:09:59.082142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:09:59.085042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:09:59.086486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:09:59.115050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:09:59.122378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:09:59.152337 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3184/6362] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:00.332289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:00.379217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7621-ed68-46c7-9022-10aa9a0a1991 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:00.558596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:00.560239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:00.880809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:00.897638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f900e-eae6-42a7-805f-0bf3704ea556 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:00.900615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:00.902146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:00.903907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] PATH_INFO: `/v3/users/35c167f3df1b42c28a8879f80b4d21f7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:00.910235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c167f3df1b42c28a8879f80b4d21f7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:00.918356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:00.944254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:00.948460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:00.953016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:00.955814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] PATH_INFO: `/v3/users/f67abbd9d9744bbbb5f6da91ef5b8ca2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:00.982480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67abbd9d9744bbbb5f6da91ef5b8ca2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:00.999908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:01.080242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c167f3df1b42c28a8879f80b4d21f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.167795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c167f3df1b42c28a8879f80b4d21f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.171670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c167f3df1b42c28a8879f80b4d21f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.200493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:01.214442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c167f3df1b42c28a8879f80b4d21f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.216580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e098040d-5a88-45f0-b1c4-45b5bd45f300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c167f3df1b42c28a8879f80b4d21f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.281714 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3179/6363] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:00 2022] DELETE /identity/v3/users/35c167f3df1b42c28a8879f80b4d21f7 => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:01.289494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:01.289981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:01.290312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:01.291339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67abbd9d9744bbbb5f6da91ef5b8ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.352861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:01.354342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:01.366679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67abbd9d9744bbbb5f6da91ef5b8ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.393710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67abbd9d9744bbbb5f6da91ef5b8ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.394938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67abbd9d9744bbbb5f6da91ef5b8ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.424093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7538bf-6e64-4412-89d9-f6a13aa0a2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67abbd9d9744bbbb5f6da91ef5b8ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:01.450964 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3185/6364] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:00 2022] DELETE /identity/v3/users/f67abbd9d9744bbbb5f6da91ef5b8ca2 => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:01.456988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca570-8ae3-4444-9d00-9ca3c4388d95 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:01.457616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca570-8ae3-4444-9d00-9ca3c4388d95 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:01.458064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca570-8ae3-4444-9d00-9ca3c4388d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:01.492462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b7dca570-8ae3-4444-9d00-9ca3c4388d95 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:01.501547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7dca570-8ae3-4444-9d00-9ca3c4388d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:01.517325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:01.560118 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3180/6365] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:01.573296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:01.575352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:01.778309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3186/6366] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:01.779360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca570-8ae3-4444-9d00-9ca3c4388d95 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:01.798957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e894c-9276-4e9e-8f14-a8f8d27d30af None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:02.073238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:02.073936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:02.074237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:02.074529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:02.109074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:02.110645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:02.142429 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3181/6367] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:02.200889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca570-8ae3-4444-9d00-9ca3c4388d95 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:02.230510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:02.239305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:02.240190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:02.240700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:02.328745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:02.337672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:02.408619 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3187/6368] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:03.869766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:03.873756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:03.948847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621a2e7-2688-4257-a5c2-479a5ceae475 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:03.975699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:03.977255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:03.982535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:03.983168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] PATH_INFO: `/v3/projects/da2d3d763cce449e8dc468e7ee9bd540` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:03.986243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2d3d763cce449e8dc468e7ee9bd540)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:03.993850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:04.171378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:04.197991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2d3d763cce449e8dc468e7ee9bd540', 'request_id': 'req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:04.223341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2d3d763cce449e8dc468e7ee9bd540', 'request_id': 'req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:04.285512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2d3d763cce449e8dc468e7ee9bd540', 'request_id': 'req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:04.358224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] The token cache is being invalidate because project da2d3d763cce449e8dc468e7ee9bd540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:04.360154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:04.365697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:04.373824 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3182/6369] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:03 2022] DELETE /identity/v3/projects/da2d3d763cce449e8dc468e7ee9bd540 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:04.380767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:04.436597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa13ff-17ba-410d-93f5-50070ab9ebcc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:04.907977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:04.909632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:04.910135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:04.910622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] PATH_INFO: `/v3/users/97b29f05aaca46a7816218ac7049c7f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:04.927197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b29f05aaca46a7816218ac7049c7f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:04.930709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:05.141066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b29f05aaca46a7816218ac7049c7f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:05.172571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:05.230033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b29f05aaca46a7816218ac7049c7f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:05.276777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b29f05aaca46a7816218ac7049c7f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:05.277965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b29f05aaca46a7816218ac7049c7f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:05.319607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b29f05aaca46a7816218ac7049c7f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:05.386557 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3188/6370] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:04 2022] DELETE /identity/v3/users/97b29f05aaca46a7816218ac7049c7f6 => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:06.572665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:06.576920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:06.606126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24f0d-cb7e-470a-bda7-cf6bc2f94600 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:06.823128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:06.828626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:06.829242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:06.829688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] PATH_INFO: `/v3/projects/d6c68001e70e4c3688bfe21b37285ac9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:06.836833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c68001e70e4c3688bfe21b37285ac9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:06.849785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:07.010531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c68001e70e4c3688bfe21b37285ac9', 'request_id': 'req-3e594812-156b-4b82-a784-962a95397e56'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.036570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c68001e70e4c3688bfe21b37285ac9', 'request_id': 'req-3e594812-156b-4b82-a784-962a95397e56'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.063374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c68001e70e4c3688bfe21b37285ac9', 'request_id': 'req-3e594812-156b-4b82-a784-962a95397e56'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.110048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] The token cache is being invalidate because project d6c68001e70e4c3688bfe21b37285ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:07.110368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.113295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.126044 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3183/6371] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:06 2022] DELETE /identity/v3/projects/d6c68001e70e4c3688bfe21b37285ac9 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:10:07.128125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:07.133713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:07.257543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e9d4a-6a42-4cca-a7bd-defa32589962 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:07.503579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:07.505408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:07.541506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:07.543881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:07.546101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:07.551236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] PATH_INFO: `/v3/users/9f8d3a76450c4cfeb785caa6f84cb9cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:07.556456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8d3a76450c4cfeb785caa6f84cb9cf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:07.588034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:07.718076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e594812-156b-4b82-a784-962a95397e56 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:07.720291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8d3a76450c4cfeb785caa6f84cb9cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.732251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:07.735638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:07.735949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:07.736331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] PATH_INFO: `/v3/projects/5e21be5f66fc41b8a3361f48b6cc8a06` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:07.742285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e21be5f66fc41b8a3361f48b6cc8a06)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:07.744639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:07.750836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:07.761040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8d3a76450c4cfeb785caa6f84cb9cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.786767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8d3a76450c4cfeb785caa6f84cb9cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.788431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8d3a76450c4cfeb785caa6f84cb9cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.834879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b659b51c-3c42-46a5-8e2a-f540bbe78ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8d3a76450c4cfeb785caa6f84cb9cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.851194 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3189/6372] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:07 2022] DELETE /identity/v3/users/9f8d3a76450c4cfeb785caa6f84cb9cf => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:07.899293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e21be5f66fc41b8a3361f48b6cc8a06', 'request_id': 'req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.916161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e21be5f66fc41b8a3361f48b6cc8a06', 'request_id': 'req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.933447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e21be5f66fc41b8a3361f48b6cc8a06', 'request_id': 'req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.983140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] The token cache is being invalidate because project 5e21be5f66fc41b8a3361f48b6cc8a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:07.983787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.987546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d39f58c9-8a0d-4f65-8a5d-94e091e89f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:07.992406 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3184/6373] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:07 2022] DELETE /identity/v3/projects/5e21be5f66fc41b8a3361f48b6cc8a06 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:10:08.003657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:08.003657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:08.004311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:08.147174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:08.154987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:08.405048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:08.464258 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3190/6374] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:08.475732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adf66a-5749-4355-9108-48d0277668d9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:08.476039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adf66a-5749-4355-9108-48d0277668d9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:08.476459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adf66a-5749-4355-9108-48d0277668d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:08.526954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b9adf66a-5749-4355-9108-48d0277668d9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:08.529564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9adf66a-5749-4355-9108-48d0277668d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:08.558396 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3185/6375] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:10:08.560394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:08.563748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:08.564181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adf66a-5749-4355-9108-48d0277668d9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:08.587371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adf66a-5749-4355-9108-48d0277668d9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:08.608206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:08.608921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:08.609207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:08.613960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:08.620118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:10:08.620749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:08.623444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:08.643014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74cad6-3a23-4fc4-a0f7-1dd0171e4859 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:08.671971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:08.679426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3186/6376] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:10:08.679669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:08.679669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:08.679669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] PATH_INFO: `/v3/projects/571bd3379304420e9897bef4b46e3f35` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:08.680739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:08.684036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571bd3379304420e9897bef4b46e3f35)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:08.696824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:08.710508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906afa3-f5d8-441d-a49e-d5a1805846e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:08.724406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:08.725340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:08.725340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:08.725685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:08.726311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:08.728510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:08.805164 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3187/6377] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:08 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:08.810815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:08.936609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571bd3379304420e9897bef4b46e3f35', 'request_id': 'req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:08.961601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571bd3379304420e9897bef4b46e3f35', 'request_id': 'req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:08.973344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f728-403c-41d3-b2be-cf1fb1dc735f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:08.990111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571bd3379304420e9897bef4b46e3f35', 'request_id': 'req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:09.038905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] The token cache is being invalidate because project 571bd3379304420e9897bef4b46e3f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:09.039876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:09.043955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ded0ce5-095e-4bd6-8ce7-f900513eaec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:09.049920 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3191/6378] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:08 2022] DELETE /identity/v3/projects/571bd3379304420e9897bef4b46e3f35 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:09.055716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d876-822e-497c-b7e9-96fd03d2fecd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.056616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d876-822e-497c-b7e9-96fd03d2fecd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.058709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d876-822e-497c-b7e9-96fd03d2fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.151968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5308d876-822e-497c-b7e9-96fd03d2fecd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:09.153678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:09.165411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5308d876-822e-497c-b7e9-96fd03d2fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:09.177619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:09.178323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.178619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.179158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.181349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:09.183257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:09.225063 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3192/6379] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:09.227998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074884f-442c-44fd-9a28-159976609733 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.228679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074884f-442c-44fd-9a28-159976609733 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.229255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074884f-442c-44fd-9a28-159976609733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.293312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3188/6380] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:08 2022] POST /identity/v3/users => generated 289 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:10:09.300095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:09.303525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:09.358068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c90c-d755-4b42-94ec-5f0cec20c001 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:09.372639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:09.375331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.379304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.381637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.383965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:09.389738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:09.422415 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3189/6381] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:09.447560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:09.529806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e074884f-442c-44fd-9a28-159976609733 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:09.531942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc22f9-4aae-4845-862c-947df0105a7d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:09.533385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e074884f-442c-44fd-9a28-159976609733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:09.552680 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3193/6382] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:09.558921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074884f-442c-44fd-9a28-159976609733 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:09.563566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:09.564805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.565320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.571099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.590202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:09.591137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074884f-442c-44fd-9a28-159976609733 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:09.609558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:09.620308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:09.624183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.625675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.627599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.631787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:10:09.632373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:09.654059 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3190/6383] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:09.657440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:09.667564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:09.689733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8a77-0369-48b4-91ca-1f4624e10fe3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:09.722474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642348d2-10b6-4f54-b0c1-c27209c3b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:09.724303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642348d2-10b6-4f54-b0c1-c27209c3b21d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.724809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642348d2-10b6-4f54-b0c1-c27209c3b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.728047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642348d2-10b6-4f54-b0c1-c27209c3b21d admin admin] PATH_INFO: `/v3/projects/9ad4badeda6e45298f93b82412bca3bd/users/3ffac9f83ffa4508949f7aa5ceb2de4b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.731944 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3194/6384] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:10:09.739886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:09.784333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a773b8-728e-4590-82fd-5741885aaa05 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:09.793960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642348d2-10b6-4f54-b0c1-c27209c3b21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad4badeda6e45298f93b82412bca3bd, user_id=3ffac9f83ffa4508949f7aa5ceb2de4b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:09.802464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642348d2-10b6-4f54-b0c1-c27209c3b21d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:09.806951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:09.808135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.809117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.810084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.811516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:09.820000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:09.852857 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3191/6385] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:09 2022] PUT /identity/v3/projects/9ad4badeda6e45298f93b82412bca3bd/users/3ffac9f83ffa4508949f7aa5ceb2de4b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:09.876818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a061f3c-f99d-4e11-b2ad-49f6073a382f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:09.877733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a061f3c-f99d-4e11-b2ad-49f6073a382f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:09.878117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a061f3c-f99d-4e11-b2ad-49f6073a382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:09.937467 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3195/6386] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:09 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:09.941447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:09.983798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7a061f3c-f99d-4e11-b2ad-49f6073a382f None None] MFA Rules not processed for user `3ffac9f83ffa4508949f7aa5ceb2de4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:09.985914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7a061f3c-f99d-4e11-b2ad-49f6073a382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:10.193617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f0bb-9c87-4028-9a8a-61da1ee579b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:10.212588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:10.213754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:10.214250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:10.214749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:10.216169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:10.231800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:10.240344 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3192/6387] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:10.246677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a061f3c-f99d-4e11-b2ad-49f6073a382f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:10.297611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a061f3c-f99d-4e11-b2ad-49f6073a382f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:10.310580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:10.311709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:10.312561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:10.313065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:10.315351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:10.319854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:10.346264 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3196/6388] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:09 2022] POST /identity/v3/users => generated 291 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:10.350053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:10.415247 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3193/6389] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:10 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:10.418885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354d75b-684f-4446-9c96-4edef6fc73d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:10.420256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:10.461342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:10.633729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:10.635412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:10.635745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:10.636041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:10.636893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:10.640145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:10.675366 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3197/6390] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:10.677298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:10.705959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c5a1-8f6b-4c4e-92a9-d11276c82c76 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:10.724829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:10.725560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:10.725880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:10.726176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:10.726892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:10.728656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:10.749421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3198/6391] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:10.757393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:10.785331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cb73a-2b00-41eb-adf9-5457d8f47cbb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:10.806141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbd854-7ac2-4b0a-947d-296595a7da98 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:10.808815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bcc64-84de-46f5-bddd-671e53c46f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:10.809766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcc64-84de-46f5-bddd-671e53c46f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:10.810121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcc64-84de-46f5-bddd-671e53c46f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:10.810326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcc64-84de-46f5-bddd-671e53c46f6a admin admin] PATH_INFO: `/v3/projects/69a01921d0bd49caa79825b1f6b52ece/users/32476a7f97264933a4e1c4d87e87004f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:10.832265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:10.833453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:10.833971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:10.834552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:10.836421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:10.840427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:10.846720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bcc64-84de-46f5-bddd-671e53c46f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a01921d0bd49caa79825b1f6b52ece, user_id=32476a7f97264933a4e1c4d87e87004f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:10.849907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bcc64-84de-46f5-bddd-671e53c46f6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:10.885317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:10.887003 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3199/6392] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:10 2022] PUT /identity/v3/projects/69a01921d0bd49caa79825b1f6b52ece/users/32476a7f97264933a4e1c4d87e87004f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:10.907403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b19418-5a7f-4bb6-9dc8-c32462c6f6e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:10.907747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b19418-5a7f-4bb6-9dc8-c32462c6f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:10.908138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b19418-5a7f-4bb6-9dc8-c32462c6f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:10.954071 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3194/6393] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:10 2022] POST /identity/v3/users => generated 289 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:10.965104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:10.979474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3b19418-5a7f-4bb6-9dc8-c32462c6f6e8 None None] MFA Rules not processed for user `32476a7f97264933a4e1c4d87e87004f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:10.980655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3b19418-5a7f-4bb6-9dc8-c32462c6f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:11.020485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91b31-045f-45cd-adaf-5d3b24554d56 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:11.148536 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3200/6394] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:11.161602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b19418-5a7f-4bb6-9dc8-c32462c6f6e8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:11.172802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:11.173691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.175094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.175094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.175094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:11.177990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:11.192581 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3195/6395] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:11.197598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:11.213342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406f79-f70b-48e2-b6e8-edecfa190a79 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:11.219632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:11.220345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.220659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.221003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.221726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:11.223460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:11.236819 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3196/6396] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:11.243878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:11.272236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7855d0-ab9a-4ca4-bf4d-1de7eaaedfba admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:11.288024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1947847-850f-4146-968d-5749327ed6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:11.290849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947847-850f-4146-968d-5749327ed6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.291139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947847-850f-4146-968d-5749327ed6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.291530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947847-850f-4146-968d-5749327ed6fd admin admin] PATH_INFO: `/v3/projects/c0a4d08284224d1b92bb04d3215fb5bb/users/f8472f9cdf8544b78b4ce07d983572ee/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.359532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1947847-850f-4146-968d-5749327ed6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a4d08284224d1b92bb04d3215fb5bb, user_id=f8472f9cdf8544b78b4ce07d983572ee, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:11.386785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1947847-850f-4146-968d-5749327ed6fd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:11.404813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b19418-5a7f-4bb6-9dc8-c32462c6f6e8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:11.420046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:11.421885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.424149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.425417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.427387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:11.432976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:11.434097 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3197/6397] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:11 2022] PUT /identity/v3/projects/c0a4d08284224d1b92bb04d3215fb5bb/users/f8472f9cdf8544b78b4ce07d983572ee/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:11.449154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4ba2a-7156-42d6-aff2-bfc246cd8a67 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.449989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4ba2a-7156-42d6-aff2-bfc246cd8a67 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.450724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4ba2a-7156-42d6-aff2-bfc246cd8a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.491161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:11.524792 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3201/6398] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:11 2022] POST /identity/v3/projects => generated 383 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:11.533086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:11.569740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-61b4ba2a-7156-42d6-aff2-bfc246cd8a67 None None] MFA Rules not processed for user `f8472f9cdf8544b78b4ce07d983572ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:11.572248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61b4ba2a-7156-42d6-aff2-bfc246cd8a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:11.706353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449468-a154-47ff-b4b4-ff4024fe25ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:11.713575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:11.714950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.715247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.715574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.716484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:11.720159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:11.795372 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3202/6399] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:11 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:11.812097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:11.847674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3198/6400] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:10:11.854734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4ba2a-7156-42d6-aff2-bfc246cd8a67 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:11.859411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d92812-7eef-4409-a08d-305cfb8fddef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:11.878766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4ba2a-7156-42d6-aff2-bfc246cd8a67 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:11.881048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:11.882493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.883024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.883716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.887781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:11.888370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:11.889282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:11.890252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:11.890252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:11.890921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:11.891252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:11.894171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:11.953469 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3203/6401] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:11.953469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:11.954001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3199/6402] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:11 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:11.957994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:11.958760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:12.036346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:12.123695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120582f5-519b-4d11-ad2a-0053bbbc1fd5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:12.130108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:12.131258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.131654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.131946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] PATH_INFO: `/v3/projects/abb3112f73d5469bb2e787bd3bfe7c9b/users/057ea2d7141047e0aceeedf4515930b8/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.151723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb3112f73d5469bb2e787bd3bfe7c9b, user_id=057ea2d7141047e0aceeedf4515930b8, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:12.171593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:12.209660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3200/6403] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:11 2022] PUT /identity/v3/projects/abb3112f73d5469bb2e787bd3bfe7c9b/users/057ea2d7141047e0aceeedf4515930b8/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:12.212792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:12.344502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83477c-b1b7-41c6-96be-ce3d40995b5b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:12.401808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a692-bd88-42f4-8612-797da56df72e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:12.407863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:12.408641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.408938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.409387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.411139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:12.413294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:12.451983 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3201/6404] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:12 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:12.452624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:12.469702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca415dd2-bae4-416a-a2de-0611316f2546 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:12.478355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:12.479200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.479553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.479840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.480634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:12.483235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:12.512152 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3202/6405] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:12.513159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:12.545613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b8ace-c39f-4bcc-9f7e-e4fc93db26aa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:12.552324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:12.553508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.553728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.554019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.554790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:12.557404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:12.574019 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3203/6406] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:12.574923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:12.590446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa2fb-7de3-4a3e-8d26-a658f529952e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:12.594297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1296a-0770-47d7-8355-2e21686b6e4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:12.596646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1296a-0770-47d7-8355-2e21686b6e4e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.598538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:12.599053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1296a-0770-47d7-8355-2e21686b6e4e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.599481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.599814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.600310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] PATH_INFO: `/v3/projects/abb3112f73d5469bb2e787bd3bfe7c9b/users/057ea2d7141047e0aceeedf4515930b8/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.601413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1296a-0770-47d7-8355-2e21686b6e4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.604060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb3112f73d5469bb2e787bd3bfe7c9b, user_id=057ea2d7141047e0aceeedf4515930b8, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:12.606557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3da1296a-0770-47d7-8355-2e21686b6e4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:12.608017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:12.623346 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3204/6407] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:12 2022] PUT /identity/v3/projects/abb3112f73d5469bb2e787bd3bfe7c9b/users/057ea2d7141047e0aceeedf4515930b8/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:12.624629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:12.635898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:12.645989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1296a-0770-47d7-8355-2e21686b6e4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:12.650068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1296a-0770-47d7-8355-2e21686b6e4e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:12.683329 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3204/6408] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:12.691586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.692213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.692413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.757096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] MFA Rules not processed for user `057ea2d7141047e0aceeedf4515930b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:12.758381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:12.826659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8b09-d44f-41e9-8a61-321ae5c09dcc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:12.839195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:12.843242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:12.844579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:12.845201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] PATH_INFO: `/v3/projects/15809ab0cc5a4293ab3269c11d8d51aa/users/e76cdafebe734f27b0f38f035bc8b891/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:12.855046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:12.895633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15809ab0cc5a4293ab3269c11d8d51aa, user_id=e76cdafebe734f27b0f38f035bc8b891, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:12.907546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:12.965223 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3205/6409] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:12 2022] PUT /identity/v3/projects/15809ab0cc5a4293ab3269c11d8d51aa/users/e76cdafebe734f27b0f38f035bc8b891/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:12.972386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:12.974165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3205/6410] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:13.000276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:13.002251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:13.135503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f92f1-92f5-490c-8255-22ae596361d8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:13.243404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e405-a6da-449c-bcd0-a77d6d65ac66 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:13.258088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:13.258961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:13.259449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:13.259748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:13.260582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:13.268841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:13.277553 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3206/6411] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:13.282156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:13.285428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49b29b-3662-49cc-915c-06fc868c7f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:13.286142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49b29b-3662-49cc-915c-06fc868c7f72 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:13.286433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49b29b-3662-49cc-915c-06fc868c7f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:13.286720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49b29b-3662-49cc-915c-06fc868c7f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:13.305737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637cc0b-befd-4bcd-bc06-5e059f174398 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:13.324935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874976a7-a140-4464-be81-9424ea0b3110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:13.326034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874976a7-a140-4464-be81-9424ea0b3110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:13.326431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874976a7-a140-4464-be81-9424ea0b3110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:13.326826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874976a7-a140-4464-be81-9424ea0b3110 admin admin] PATH_INFO: `/v3/projects/15809ab0cc5a4293ab3269c11d8d51aa/users/e76cdafebe734f27b0f38f035bc8b891/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:13.329577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874976a7-a140-4464-be81-9424ea0b3110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15809ab0cc5a4293ab3269c11d8d51aa, user_id=e76cdafebe734f27b0f38f035bc8b891, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:13.333332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874976a7-a140-4464-be81-9424ea0b3110 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:13.360495 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3207/6412] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:13 2022] PUT /identity/v3/projects/15809ab0cc5a4293ab3269c11d8d51aa/users/e76cdafebe734f27b0f38f035bc8b891/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:10:13.386845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:13.387588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:13.388162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:13.397664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:13.424337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49b29b-3662-49cc-915c-06fc868c7f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:13.426483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49b29b-3662-49cc-915c-06fc868c7f72 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:13.451732 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3206/6413] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:13.470549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] MFA Rules not processed for user `e76cdafebe734f27b0f38f035bc8b891`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:13.471913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:13.610143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3208/6414] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:10:13.684294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ab348-1845-4d39-9843-5e80225fa77d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:13.684894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ab348-1845-4d39-9843-5e80225fa77d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:13.684894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ab348-1845-4d39-9843-5e80225fa77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:13.718965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4f5ab348-1845-4d39-9843-5e80225fa77d None None] MFA Rules not processed for user `ed79aa2ea715471bb970282c9e8dfd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:13.720567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f5ab348-1845-4d39-9843-5e80225fa77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:13.751539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:13.753903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:13.909465 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3207/6415] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:13.916964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69dc37-5c1c-4876-bce9-1b5ce7e97f81 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:13.929454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:13.929815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:13.930157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:13.930359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:13.948473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:14.006758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ab348-1845-4d39-9843-5e80225fa77d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:14.024455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ab348-1845-4d39-9843-5e80225fa77d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:14.036629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519a841-533a-4702-803c-2c7243e9e64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:14.037328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a841-533a-4702-803c-2c7243e9e64d service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:14.037616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a841-533a-4702-803c-2c7243e9e64d service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:14.037901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a841-533a-4702-803c-2c7243e9e64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:14.097208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:14.099957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:14.125985 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3209/6416] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:14.282444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519a841-533a-4702-803c-2c7243e9e64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:14.286687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519a841-533a-4702-803c-2c7243e9e64d service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:14.330966 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3208/6417] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:15.405568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:15.660052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c90d7c-23a2-4737-8bf3-868e088b0341 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:15.695600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:15.697561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:15.698309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:15.698883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] PATH_INFO: `/v3/users/32476a7f97264933a4e1c4d87e87004f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:15.701591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32476a7f97264933a4e1c4d87e87004f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:15.706207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:15.793734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32476a7f97264933a4e1c4d87e87004f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:15.832101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32476a7f97264933a4e1c4d87e87004f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:15.836293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32476a7f97264933a4e1c4d87e87004f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:15.868146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32476a7f97264933a4e1c4d87e87004f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:15.879395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32476a7f97264933a4e1c4d87e87004f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:15.927520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3210/6418] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:15 2022] DELETE /identity/v3/users/32476a7f97264933a4e1c4d87e87004f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:15.930132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:15.930785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:15.932135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:16.022552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:16.024704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:16.396863 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3209/6419] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:10:16.461908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:16.464316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:16.634564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:16.714448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c7899-234a-43a8-a4da-5be4ef5c2e4e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:16.735866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:16.737218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:16.737435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:16.737655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:16.764173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:16.765703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:16.787715 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3211/6420] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:18.640228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:18.644415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:18.668207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a807-a747-4126-98ef-09a718ef2fc5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:18.675943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:18.677206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:18.677682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:18.678184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] PATH_INFO: `/v3/projects/69a01921d0bd49caa79825b1f6b52ece` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:18.679969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a01921d0bd49caa79825b1f6b52ece)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:18.694546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:18.750025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:18.832488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a01921d0bd49caa79825b1f6b52ece', 'request_id': 'req-0d2ed78e-cade-4841-83e3-43e21c6d6b34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:18.848234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a01921d0bd49caa79825b1f6b52ece', 'request_id': 'req-0d2ed78e-cade-4841-83e3-43e21c6d6b34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:18.863482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a01921d0bd49caa79825b1f6b52ece', 'request_id': 'req-0d2ed78e-cade-4841-83e3-43e21c6d6b34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:18.904435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] The token cache is being invalidate because project 69a01921d0bd49caa79825b1f6b52ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:18.906425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:18.909995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:18.916737 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3210/6421] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:18 2022] DELETE /identity/v3/projects/69a01921d0bd49caa79825b1f6b52ece => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:18.921208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:18.977871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5f591-947c-4e36-98c0-bf330f2b4e9d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:19.011008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:19.014290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:19.217316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:19.225941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:19.225941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:19.231145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] PATH_INFO: `/v3/users/057ea2d7141047e0aceeedf4515930b8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:19.235716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=057ea2d7141047e0aceeedf4515930b8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:19.253226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:19.259897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed78e-cade-4841-83e3-43e21c6d6b34 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:19.282615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:19.282615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:19.283067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:19.283208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:19.287032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:19.411991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:19.413555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:19.444049 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3211/6422] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:19.476143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057ea2d7141047e0aceeedf4515930b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:19.563913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057ea2d7141047e0aceeedf4515930b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:19.567503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057ea2d7141047e0aceeedf4515930b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:19.601871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057ea2d7141047e0aceeedf4515930b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:19.603400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057ea2d7141047e0aceeedf4515930b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:19.657533 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3212/6423] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:18 2022] DELETE /identity/v3/users/057ea2d7141047e0aceeedf4515930b8 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:20.478066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:20.481876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:20.618768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff0dbb-9286-4b13-b400-92da44785314 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:20.887159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:20.888011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:20.888303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:20.888612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] PATH_INFO: `/v3/users/e9146bf176504982835f98712c3ad3da` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:20.890225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9146bf176504982835f98712c3ad3da)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:20.894751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:20.897172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:21.015456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:21.019834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:21.075313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9146bf176504982835f98712c3ad3da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.112578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9146bf176504982835f98712c3ad3da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.132188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9146bf176504982835f98712c3ad3da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.135032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9146bf176504982835f98712c3ad3da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.158671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9146bf176504982835f98712c3ad3da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.246277 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3212/6424] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:20 2022] DELETE /identity/v3/users/e9146bf176504982835f98712c3ad3da => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:21.256636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:21.266211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:21.304752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:21.321387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052558-0c6f-4827-a5b6-f4512ae8ffe8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:21.475903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429ef2e-1c72-4e8d-8b22-feba81aadb4b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:21.488711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:21.490394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:21.490731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:21.491003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] PATH_INFO: `/v3/projects/abb3112f73d5469bb2e787bd3bfe7c9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:21.492360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb3112f73d5469bb2e787bd3bfe7c9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:21.509537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:21.529548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d8036-e2ab-4b1a-8c3f-81322bb6b805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:21.530600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d8036-e2ab-4b1a-8c3f-81322bb6b805 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:21.534814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d8036-e2ab-4b1a-8c3f-81322bb6b805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:21.534814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d8036-e2ab-4b1a-8c3f-81322bb6b805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:21.550508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-668d8036-e2ab-4b1a-8c3f-81322bb6b805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:21.687633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb3112f73d5469bb2e787bd3bfe7c9b', 'request_id': 'req-8010f023-45e8-4a15-af12-2bb574de53d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.709439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb3112f73d5469bb2e787bd3bfe7c9b', 'request_id': 'req-8010f023-45e8-4a15-af12-2bb574de53d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.734669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb3112f73d5469bb2e787bd3bfe7c9b', 'request_id': 'req-8010f023-45e8-4a15-af12-2bb574de53d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.797887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] The token cache is being invalidate because project abb3112f73d5469bb2e787bd3bfe7c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:21.798503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.806393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8010f023-45e8-4a15-af12-2bb574de53d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:21.815879 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3213/6425] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:21 2022] DELETE /identity/v3/projects/abb3112f73d5469bb2e787bd3bfe7c9b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:21.818711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:21.827454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:21.828201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:21.949156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:21.951129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:21.974186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d8036-e2ab-4b1a-8c3f-81322bb6b805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:21.977063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d8036-e2ab-4b1a-8c3f-81322bb6b805 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:21.978201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:22.046847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3213/6426] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 1033 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:22.052240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacd8f-cc69-4a38-aec5-b3f055400af3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:22.053009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacd8f-cc69-4a38-aec5-b3f055400af3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:22.053696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacd8f-cc69-4a38-aec5-b3f055400af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:22.153567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d5bacd8f-cc69-4a38-aec5-b3f055400af3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:22.156454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d5bacd8f-cc69-4a38-aec5-b3f055400af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:22.404083 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3214/6427] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:22.478170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:22.479651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:22.557085 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3214/6428] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:22.571131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40c9a-46df-4953-bdf2-6b1f5669b0c5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:22.574466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40c9a-46df-4953-bdf2-6b1f5669b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:22.575085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40c9a-46df-4953-bdf2-6b1f5669b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:22.629507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8eb40c9a-46df-4953-bdf2-6b1f5669b0c5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:22.634359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8eb40c9a-46df-4953-bdf2-6b1f5669b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:22.651731 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3215/6429] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:22.656655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40c9a-46df-4953-bdf2-6b1f5669b0c5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:22.680684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40c9a-46df-4953-bdf2-6b1f5669b0c5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:22.689474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99dff-501b-4042-b2e5-9a54f6edfcbd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:22.704565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:22.706282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:22.706739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:22.707228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:22.708156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:22.709040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:22.709344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:22.709638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:22.710863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:10:22.711423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:22.722334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:22.731490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:22.733056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:22.752353 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3215/6430] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:22.790757 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3216/6431] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:10:22.791715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:22.805917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c54543-d1e8-431f-80e9-f6f34b47a139 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:22.840451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:22.841332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:22.841641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:22.841906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:22.842641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:22.844741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:22.940356 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3216/6432] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:22 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:10:22.945560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:22.980395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38707b5-c266-4d25-a4ba-eeeb524561ea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:23.100793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:23.157917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:23.159057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:23.159392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:23.159670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:23.160407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:23.172612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:23.254484 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3217/6433] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:22 2022] POST /identity/v3/users => generated 286 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:23.255794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:23.288382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f64e28-60ca-4cfe-901f-6cdf6efad482 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:23.314123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:23.315844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:23.316345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:23.316820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:23.322951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:23.327493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:23.387295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:23.415579 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3217/6434] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:23.448599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d574-52ce-4875-adef-84e5cc83f5c5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:23.488673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1d535-a13f-4bde-a67d-71a9cb1a0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:23.494111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d535-a13f-4bde-a67d-71a9cb1a0a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:23.497422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d535-a13f-4bde-a67d-71a9cb1a0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:23.497734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d535-a13f-4bde-a67d-71a9cb1a0a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:23.506051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1d535-a13f-4bde-a67d-71a9cb1a0a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:23.532823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1d535-a13f-4bde-a67d-71a9cb1a0a3b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:23.621866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:23.634844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3218/6435] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:23.637305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd839dc-abd4-4d1a-a4f3-ce12380208ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:23.645039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:23.646220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:23.648195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:23.659150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] PATH_INFO: `/v3/projects/799e8d62c4e74aae9ff85abf31e89bd4/users/9295895807c14be089de7f34ee87c06c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:23.712585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=799e8d62c4e74aae9ff85abf31e89bd4, user_id=9295895807c14be089de7f34ee87c06c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:23.724588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:23.766353 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3218/6436] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:23 2022] PUT /identity/v3/projects/799e8d62c4e74aae9ff85abf31e89bd4/users/9295895807c14be089de7f34ee87c06c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:23.781844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:23.782151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:23.782444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:23.883576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] MFA Rules not processed for user `9295895807c14be089de7f34ee87c06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:23.886112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:24.119021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3219/6437] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:24.160375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:24.162450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:24.440570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:24.468228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e211916-07b1-4afd-8efa-5fa1d7ece6bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:24.489147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ad53-0b68-4eb1-bb06-e54983d6e8e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:24.489776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ad53-0b68-4eb1-bb06-e54983d6e8e0 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:24.490066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ad53-0b68-4eb1-bb06-e54983d6e8e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:24.490354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ad53-0b68-4eb1-bb06-e54983d6e8e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:24.510617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169ad53-0b68-4eb1-bb06-e54983d6e8e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:24.512174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169ad53-0b68-4eb1-bb06-e54983d6e8e0 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:24.537940 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3219/6438] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:26.430777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:26.433047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:26.722264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb6706-68e2-4110-9048-6679567aa9ab None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:26.750434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:26.751106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:26.752161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:26.752758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] PATH_INFO: `/v3/projects/1163d6bb44334a1da176b64bce10defa` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:26.765150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1163d6bb44334a1da176b64bce10defa)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:26.811107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:27.060008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:27.075047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1163d6bb44334a1da176b64bce10defa', 'request_id': 'req-ae83d98b-6e26-434e-8fa9-dab1422a2a15'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:27.114145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1163d6bb44334a1da176b64bce10defa', 'request_id': 'req-ae83d98b-6e26-434e-8fa9-dab1422a2a15'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:27.141371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1163d6bb44334a1da176b64bce10defa', 'request_id': 'req-ae83d98b-6e26-434e-8fa9-dab1422a2a15'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:27.202317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] The token cache is being invalidate because project 1163d6bb44334a1da176b64bce10defa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:27.207477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:27.210572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ae83d98b-6e26-434e-8fa9-dab1422a2a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:27.219641 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3220/6439] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:26 2022] DELETE /identity/v3/projects/1163d6bb44334a1da176b64bce10defa => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:10:27.229323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c071e-362a-4eb2-88e9-701d315b17d5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:27.231330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c071e-362a-4eb2-88e9-701d315b17d5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:27.231658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c071e-362a-4eb2-88e9-701d315b17d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:27.336382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-819c071e-362a-4eb2-88e9-701d315b17d5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:27.344026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-819c071e-362a-4eb2-88e9-701d315b17d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:27.824458 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3220/6440] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:27.837552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d99c8-74b4-41b5-ae50-aa30907c5ba9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:27.838469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d99c8-74b4-41b5-ae50-aa30907c5ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:27.839053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d99c8-74b4-41b5-ae50-aa30907c5ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:27.953846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-916d99c8-74b4-41b5-ae50-aa30907c5ba9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:27.963035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-916d99c8-74b4-41b5-ae50-aa30907c5ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:28.031864 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3221/6441] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:28.035557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c071e-362a-4eb2-88e9-701d315b17d5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:28.085802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c071e-362a-4eb2-88e9-701d315b17d5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:28.115259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72af48c-ba1c-43e2-8bdd-ac56a02ce921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:28.116986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72af48c-ba1c-43e2-8bdd-ac56a02ce921 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:28.124023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72af48c-ba1c-43e2-8bdd-ac56a02ce921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:28.124935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72af48c-ba1c-43e2-8bdd-ac56a02ce921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:28.126743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72af48c-ba1c-43e2-8bdd-ac56a02ce921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:10:28.134821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72af48c-ba1c-43e2-8bdd-ac56a02ce921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:28.145397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72af48c-ba1c-43e2-8bdd-ac56a02ce921 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:28.233779 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3221/6442] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:10:28.237864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d99c8-74b4-41b5-ae50-aa30907c5ba9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:28.274617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d99c8-74b4-41b5-ae50-aa30907c5ba9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:28.293319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:28.294784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:28.295602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:28.296338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:28.308442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:28.322082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:28.332511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1bb1-7675-40dd-bb31-d3f4ab53e33c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:28.333583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1bb1-7675-40dd-bb31-d3f4ab53e33c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:28.334498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1bb1-7675-40dd-bb31-d3f4ab53e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:28.446029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c31d1bb1-7675-40dd-bb31-d3f4ab53e33c None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:28.456196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c31d1bb1-7675-40dd-bb31-d3f4ab53e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:28.476291 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3222/6443] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:28 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:28.480521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:28.756378 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3222/6444] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:28.791327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc12e6d-dd7d-429b-a4e9-020dff9ef103 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:28.823174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:28.824010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:28.824310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:28.824602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:28.826374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:28.828585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:28.933088 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3223/6445] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:28 2022] POST /identity/v3/users => generated 292 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:28.937797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1bb1-7675-40dd-bb31-d3f4ab53e33c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:28.965500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1bb1-7675-40dd-bb31-d3f4ab53e33c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:28.971149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:28.974479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:29.011741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:29.020445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:29.021141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:29.023766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:29.025745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:29.033897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:29.110053 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3223/6446] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:10:29.116652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:29.158716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55741bed-95e1-450b-a0fc-d939dad44969 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:29.184087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:29.187615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:29.190085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:29.191616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:29.194180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:29.204743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:29.242785 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3224/6447] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:29.246844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:29.269159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1c2ef-b3d2-4ca2-8574-e7c1e0cbf3ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:29.288220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89157318-a137-4438-a6a6-4284d19034a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:29.293439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157318-a137-4438-a6a6-4284d19034a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:29.294090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157318-a137-4438-a6a6-4284d19034a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:29.294643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157318-a137-4438-a6a6-4284d19034a4 admin admin] PATH_INFO: `/v3/projects/2e30ed5aa78f4ba5bdbeb80ddc88b38f/users/ab2ce820ae4f482283fe985fdb2fee84/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:29.342112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2b57-ef43-4740-812f-22586bed7cb5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:29.348522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89157318-a137-4438-a6a6-4284d19034a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e30ed5aa78f4ba5bdbeb80ddc88b38f, user_id=ab2ce820ae4f482283fe985fdb2fee84, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:29.353620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89157318-a137-4438-a6a6-4284d19034a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:29.358388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:29.364518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:29.364828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:29.365123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:29.374187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:29.394042 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3225/6448] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:29 2022] PUT /identity/v3/projects/2e30ed5aa78f4ba5bdbeb80ddc88b38f/users/ab2ce820ae4f482283fe985fdb2fee84/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:29.401613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:29.402250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:29.403682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:29.481043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:29.482344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:29.613914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:29.617693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:29.715711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:29.724134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3226/6449] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:29.726007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:29.770975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3224/6450] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:29.825151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:29.827704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:30.042059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d44fd-08ae-42c3-91a1-8f929d7d2cbc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:30.060263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:30.061238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:30.062758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:30.062946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:30.063537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:30.098528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:30.100357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:30.125974 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3227/6451] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:30.301092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5436-759d-4017-87c2-d46b47f4ddbf service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:30.323364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:30.326860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:30.327427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:30.331717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:30.342880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:30.634948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:30.638852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:30.717440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3225/6452] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:30.760290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:30.761755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:30.797857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233b6a7-eab5-4ea9-a062-15a6962bee92 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:30.808277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f068-48a7-4164-b125-636ec21648ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:30.808979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f068-48a7-4164-b125-636ec21648ce service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:30.809274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f068-48a7-4164-b125-636ec21648ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:30.809560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f068-48a7-4164-b125-636ec21648ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:30.812470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab76f068-48a7-4164-b125-636ec21648ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:30.842556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f068-48a7-4164-b125-636ec21648ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:30.844443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f068-48a7-4164-b125-636ec21648ce service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:30.870148 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3228/6453] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:32.365273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:32.368714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:32.659516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824e1f-11d6-46dd-bd75-5ccfab4edffa service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:32.666924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:32.667657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:32.668104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:32.668495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:32.671149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:32.690849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:32.690849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:32.696641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:32.709834 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3226/6454] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:33.004156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82a8d-3fb1-494d-a8d9-3ff6d1fd3cc6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:33.004156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82a8d-3fb1-494d-a8d9-3ff6d1fd3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:33.004156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82a8d-3fb1-494d-a8d9-3ff6d1fd3cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:33.027197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:33.034556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5ca82a8d-3fb1-494d-a8d9-3ff6d1fd3cc6 None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:33.036369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ca82a8d-3fb1-494d-a8d9-3ff6d1fd3cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:33.092776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a6778-1451-4c6d-b9c5-43b78388616e service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:33.124271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:33.127542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:33.128211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:33.131377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:33.138948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:33.169650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3229/6455] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:33.229205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:33.253703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:33.326427 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3227/6456] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:10:34.141609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82a8d-3fb1-494d-a8d9-3ff6d1fd3cc6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:34.166591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82a8d-3fb1-494d-a8d9-3ff6d1fd3cc6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:34.196452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fbfdd-fffe-4d00-ab71-ee05abf15be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:34.197562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fbfdd-fffe-4d00-ab71-ee05abf15be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:34.198082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fbfdd-fffe-4d00-ab71-ee05abf15be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:34.198611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fbfdd-fffe-4d00-ab71-ee05abf15be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:34.212825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e07fbfdd-fffe-4d00-ab71-ee05abf15be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:34.251529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fbfdd-fffe-4d00-ab71-ee05abf15be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:34.255935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fbfdd-fffe-4d00-ab71-ee05abf15be1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:34.295764 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3230/6457] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:39.100113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:39.103582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:39.219200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c887a-d26a-4820-87ce-e545590d08d1 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:39.237893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:39.245846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:39.245846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:39.245846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] PATH_INFO: `/v3/users/3ffac9f83ffa4508949f7aa5ceb2de4b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:39.248417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffac9f83ffa4508949f7aa5ceb2de4b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:39.250637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:39.455970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffac9f83ffa4508949f7aa5ceb2de4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:39.528645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffac9f83ffa4508949f7aa5ceb2de4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:39.536005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffac9f83ffa4508949f7aa5ceb2de4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:39.561654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffac9f83ffa4508949f7aa5ceb2de4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:39.562589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffac9f83ffa4508949f7aa5ceb2de4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:39.593781 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3228/6458] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:39 2022] DELETE /identity/v3/users/3ffac9f83ffa4508949f7aa5ceb2de4b => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:39.598621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:39.599153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:39.599249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:39.634150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:39.635726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:39.778043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:39.803942 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3231/6459] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:39.848833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:39.850869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:40.106667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a6e9-4e30-46f3-9165-dbc04a1a0322 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:40.118874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:40.119611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:40.119903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:40.120190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:40.157973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:40.160993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:40.186317 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3229/6460] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:42.807498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:42.809273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:42.842441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415049-67fc-41ec-8af5-2ee8d9ebdc9f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:42.849269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:42.850509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:42.851151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:42.851596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] PATH_INFO: `/v3/projects/9ad4badeda6e45298f93b82412bca3bd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:42.852920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad4badeda6e45298f93b82412bca3bd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:42.858068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:42.977580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad4badeda6e45298f93b82412bca3bd', 'request_id': 'req-3b973cdf-f25a-431f-9e26-6894167d4039'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:42.991639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad4badeda6e45298f93b82412bca3bd', 'request_id': 'req-3b973cdf-f25a-431f-9e26-6894167d4039'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.006728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad4badeda6e45298f93b82412bca3bd', 'request_id': 'req-3b973cdf-f25a-431f-9e26-6894167d4039'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.038258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] The token cache is being invalidate because project 9ad4badeda6e45298f93b82412bca3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:43.038824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.040078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.046728 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3232/6461] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:42 2022] DELETE /identity/v3/projects/9ad4badeda6e45298f93b82412bca3bd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:43.049255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:43.079158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb16f-d46e-4f8d-a5f4-d1d2672e8112 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:43.181685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:43.182977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:43.183372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:43.183845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] PATH_INFO: `/v3/users/f8472f9cdf8544b78b4ce07d983572ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:43.185771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8472f9cdf8544b78b4ce07d983572ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:43.189176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:43.192797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:43.300726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8472f9cdf8544b78b4ce07d983572ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.337989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8472f9cdf8544b78b4ce07d983572ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.339194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8472f9cdf8544b78b4ce07d983572ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.355865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8472f9cdf8544b78b4ce07d983572ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.356986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8472f9cdf8544b78b4ce07d983572ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:43.398553 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3230/6462] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:43 2022] DELETE /identity/v3/users/f8472f9cdf8544b78b4ce07d983572ee => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:45.338573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:45.340610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:45.376224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b973cdf-f25a-431f-9e26-6894167d4039 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:45.557837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:45.559156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:45.559676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:45.561151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] PATH_INFO: `/v3/projects/c0a4d08284224d1b92bb04d3215fb5bb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:45.566222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a4d08284224d1b92bb04d3215fb5bb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:45.568922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:45.689131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a4d08284224d1b92bb04d3215fb5bb', 'request_id': 'req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:45.712294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a4d08284224d1b92bb04d3215fb5bb', 'request_id': 'req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:45.727895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a4d08284224d1b92bb04d3215fb5bb', 'request_id': 'req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:45.758287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] The token cache is being invalidate because project c0a4d08284224d1b92bb04d3215fb5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:45.758645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:45.759422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:45.761446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3233/6463] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:45 2022] DELETE /identity/v3/projects/c0a4d08284224d1b92bb04d3215fb5bb => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:10:45.767684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:45.769780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:45.790368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc5ca-9514-491a-a34f-668160e8fff6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:45.957117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:45.959782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:45.960107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:45.960393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] PATH_INFO: `/v3/users/e76cdafebe734f27b0f38f035bc8b891` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:45.961854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76cdafebe734f27b0f38f035bc8b891)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:45.963994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:46.114392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76cdafebe734f27b0f38f035bc8b891'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:46.150553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76cdafebe734f27b0f38f035bc8b891'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:46.151791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76cdafebe734f27b0f38f035bc8b891'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:46.184644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76cdafebe734f27b0f38f035bc8b891'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:46.185473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd78ce2b-7559-4305-8d15-7276e5d22b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76cdafebe734f27b0f38f035bc8b891'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:46.217081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:46.222900 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3231/6464] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:10:45 2022] DELETE /identity/v3/users/e76cdafebe734f27b0f38f035bc8b891 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:48.126110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:48.141165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:48.254293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2dfd7-542b-4bc9-a2ce-867e58211abe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:48.335060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:48.628959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:48.632893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:48.633410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:48.636506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] PATH_INFO: `/v3/projects/15809ab0cc5a4293ab3269c11d8d51aa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:48.645095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15809ab0cc5a4293ab3269c11d8d51aa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:48.656929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:48.898511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15809ab0cc5a4293ab3269c11d8d51aa', 'request_id': 'req-52ba82d4-b432-430b-88a5-cd41dcf15107'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:48.918673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15809ab0cc5a4293ab3269c11d8d51aa', 'request_id': 'req-52ba82d4-b432-430b-88a5-cd41dcf15107'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:48.950122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15809ab0cc5a4293ab3269c11d8d51aa', 'request_id': 'req-52ba82d4-b432-430b-88a5-cd41dcf15107'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:48.987612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] The token cache is being invalidate because project 15809ab0cc5a4293ab3269c11d8d51aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:10:48.987918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:48.992444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-52ba82d4-b432-430b-88a5-cd41dcf15107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:10:49.002182 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3234/6465] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:10:48 2022] DELETE /identity/v3/projects/15809ab0cc5a4293ab3269c11d8d51aa => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:49.007542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f58c-b354-4de6-8e54-69ccb332f173 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:49.008154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f58c-b354-4de6-8e54-69ccb332f173 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:49.009994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f58c-b354-4de6-8e54-69ccb332f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:49.096629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cd51f58c-b354-4de6-8e54-69ccb332f173 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:49.099094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd51f58c-b354-4de6-8e54-69ccb332f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:49.330300 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3232/6466] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:49.344793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bab17-4e35-4ede-8c3d-b6df15dcc68a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:49.344793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bab17-4e35-4ede-8c3d-b6df15dcc68a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:49.344793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bab17-4e35-4ede-8c3d-b6df15dcc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:49.419791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1c8bab17-4e35-4ede-8c3d-b6df15dcc68a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:49.439944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c8bab17-4e35-4ede-8c3d-b6df15dcc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:49.549001 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3235/6467] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:49.556443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f58c-b354-4de6-8e54-69ccb332f173 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:49.590695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f58c-b354-4de6-8e54-69ccb332f173 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:49.632580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:49.637456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:49.637456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:49.637456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:49.661912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:10:49.662249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:49.676588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:49.791886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3233/6468] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:10:49.797348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bab17-4e35-4ede-8c3d-b6df15dcc68a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:49.838946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bab17-4e35-4ede-8c3d-b6df15dcc68a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:49.876327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:49.878164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:49.878684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:49.879178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:49.880590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:49.898235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:49.996989 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3236/6469] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:49 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:49.998879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:50.052194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789680-bca0-424d-97a5-e3cadff0b298 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:50.228196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513031-51d4-4d1f-ae94-80e320c8457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:50.229947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513031-51d4-4d1f-ae94-80e320c8457c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:50.230478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513031-51d4-4d1f-ae94-80e320c8457c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:50.230938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513031-51d4-4d1f-ae94-80e320c8457c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:50.231907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513031-51d4-4d1f-ae94-80e320c8457c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:50.237198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513031-51d4-4d1f-ae94-80e320c8457c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:50.293975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3234/6470] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:49 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:10:50.299477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:50.320579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c7d7-07f6-4ab5-b9a1-7f1a40ad21b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:50.341018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:50.342266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:50.342760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:50.343201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:50.344451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:50.346488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:50.374492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:50.375016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:50.375765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:50.393754 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3237/6471] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:50.397772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:50.430942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b74b-76a7-4f11-b488-eaa83a63a2fd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:50.440798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:50.442026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:50.442471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:50.442903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:50.443851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:50.445972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:50.448842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] MFA Rules not processed for user `ab2ce820ae4f482283fe985fdb2fee84`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:50.451978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:50.460082 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3238/6472] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:50.465011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:50.490575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83780-72d5-4346-a798-e7ed796852e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:50.497651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2878d-6336-4a0c-acc1-0a38a6688a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:50.499145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2878d-6336-4a0c-acc1-0a38a6688a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:50.500024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2878d-6336-4a0c-acc1-0a38a6688a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:50.500496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2878d-6336-4a0c-acc1-0a38a6688a35 admin admin] PATH_INFO: `/v3/projects/311be4cdeacf4d23b29b2ec466b2836b/users/4e25d7c41fc74859a6a0bed6e2fea16f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:50.521745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2878d-6336-4a0c-acc1-0a38a6688a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311be4cdeacf4d23b29b2ec466b2836b, user_id=4e25d7c41fc74859a6a0bed6e2fea16f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:50.525238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2878d-6336-4a0c-acc1-0a38a6688a35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:50.563358 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3239/6473] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:50 2022] PUT /identity/v3/projects/311be4cdeacf4d23b29b2ec466b2836b/users/4e25d7c41fc74859a6a0bed6e2fea16f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:10:50.585243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:50.585505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:50.585804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:50.674240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] MFA Rules not processed for user `4e25d7c41fc74859a6a0bed6e2fea16f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:10:50.676892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:50.712757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:50.782179 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3235/6474] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:10:50.791044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:50.804811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:50.852269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:50.880231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19e251-aefe-4f59-b7a6-34b336b1e667 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:50.937561 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3240/6475] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:10:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:10:50.959132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:50.961191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:10:51.122410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4410644-f710-4b1d-9ff3-ccf01baacc9e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:51.129566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:51.130799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:51.131157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:51.132065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:51.153051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:51.154814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:51.175026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:51.178273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:51.178559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:51.179039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:51.179789 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3241/6476] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:10:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:10:51.183725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:51.195960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:51.356448 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3236/6477] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:10:50 2022] POST /identity/v3/projects => generated 381 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:51.368432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:51.413800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7753c6-cdc0-4302-bb7f-c069cd48704e service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:51.647349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:51.648068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:51.648355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:51.648649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:51.649356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:51.651430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:51.736120 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3242/6478] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:10:51 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:10:51.740631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:51.765696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0cd25-ecf8-4b3c-8df3-0d37cb3ab407 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:51.796243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:51.797228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:51.797432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:51.797718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:51.798520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:51.808144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:51.854862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:51.866599 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3237/6479] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:51.870993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa349d5d-d228-46d6-be40-52addc652ea1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:51.888894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:51.889823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:51.890109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:51.890392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] PATH_INFO: `/v3/projects/da1c226717844d699b5cabb95f51bb98/users/7a36eebeb29b4d3ab18d1f8419407c30/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:51.977575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1c226717844d699b5cabb95f51bb98, user_id=7a36eebeb29b4d3ab18d1f8419407c30, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:51.989365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:52.037901 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3243/6480] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:51 2022] PUT /identity/v3/projects/da1c226717844d699b5cabb95f51bb98/users/7a36eebeb29b4d3ab18d1f8419407c30/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:10:52.042308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:52.059140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf6d69-12de-49eb-a100-a11dd48f3938 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:52.364245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:52.365430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:52.365430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:52.365725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:52.366385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:52.370379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:52.465565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:10:52.485963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3238/6481] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:10:52.529238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab66c0-411b-417b-b4db-6bac655f5424 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:10:52.570488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f63f3-038a-4bfe-975b-aa2cd98496a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:10:52.574299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f63f3-038a-4bfe-975b-aa2cd98496a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:10:52.576409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f63f3-038a-4bfe-975b-aa2cd98496a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:10:52.581598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f63f3-038a-4bfe-975b-aa2cd98496a7 admin admin] PATH_INFO: `/v3/projects/da1c226717844d699b5cabb95f51bb98/users/7a36eebeb29b4d3ab18d1f8419407c30/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:10:52.593846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f63f3-038a-4bfe-975b-aa2cd98496a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1c226717844d699b5cabb95f51bb98, user_id=7a36eebeb29b4d3ab18d1f8419407c30, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:10:52.612498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f63f3-038a-4bfe-975b-aa2cd98496a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:10:52.682326 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3244/6482] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:10:52 2022] PUT /identity/v3/projects/da1c226717844d699b5cabb95f51bb98/users/7a36eebeb29b4d3ab18d1f8419407c30/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:11:02.396600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:02.662269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:07.258992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:07.261125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:07.410291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:07.411140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:07.411140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:07.557221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] MFA Rules not processed for user `7a36eebeb29b4d3ab18d1f8419407c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:07.558537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:07.599896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7587b-78f0-450b-8b08-3e3efbdc3dac admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:07.828606 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3245/6483] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:11:07.875432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:07.884180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:07.927630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c866fd3-ea23-43b6-8402-b71c6db86ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:07.929303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c866fd3-ea23-43b6-8402-b71c6db86ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:07.929798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c866fd3-ea23-43b6-8402-b71c6db86ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:07.930290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c866fd3-ea23-43b6-8402-b71c6db86ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:07.933073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c866fd3-ea23-43b6-8402-b71c6db86ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:07.950990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c866fd3-ea23-43b6-8402-b71c6db86ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:07.953153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c866fd3-ea23-43b6-8402-b71c6db86ba6 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:07.991126 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3239/6484] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:08.110866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4b019-8b49-417f-93c4-03681fb76c1d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:08.120844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:08.122026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:08.122584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:08.122797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:08.289645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:08.289645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:08.314516 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3246/6485] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:11:10.634250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:10.635053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:10.635053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:10.710553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:10.712061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:10.905593 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3240/6486] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:11:18.293244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:20.896573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=71 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:22.336983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:22.341188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:22.405445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904b136-4fee-4e84-8123-79e079364e55 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:22.442704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:22.449386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:22.449796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:22.450307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:22.472042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:22.608305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:22.632059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:22.717137 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3247/6487] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:23.254305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:23.263576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:23.716888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500569f-d353-4a03-923d-c5a435db7dc4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:23.735061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:23.735826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:23.736120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:23.736414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:23.743242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:24.000263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:24.002334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:24.054917 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3241/6488] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 15:11:23 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:32.678141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:34.030905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=48 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:36.703096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:36.706147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:36.960298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2a114-f652-4102-82fc-fffaf24ed215 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:36.975009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:36.976072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:36.976378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:36.976717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:36.979669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:37.014031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:37.018722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:37.055547 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3248/6489] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:47.031771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=32 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:53.921393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:53.922941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:54.256023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf996566-cd9d-4823-bc07-7366964c715a service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:54.272861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:54.273851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:54.274209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:54.274716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:54.277536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:54.342771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:54.345134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:54.384522 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3242/6490] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:55.340494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:55.352442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:55.355806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:55.382881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e256f8-19e7-440b-8dfc-83dc1457dabf service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:55.404153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15709a9-5cb6-45f4-af62-3cf9217940ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:55.405811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15709a9-5cb6-45f4-af62-3cf9217940ce service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:55.406358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15709a9-5cb6-45f4-af62-3cf9217940ce service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:55.406816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15709a9-5cb6-45f4-af62-3cf9217940ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:55.409494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c15709a9-5cb6-45f4-af62-3cf9217940ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:55.446501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15709a9-5cb6-45f4-af62-3cf9217940ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:55.448761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15709a9-5cb6-45f4-af62-3cf9217940ce service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:55.467443 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3249/6491] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:55.519143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0785377-9949-4649-b13d-1a5fade15d34 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:55.525559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:55.526997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:55.527591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:55.528117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] PATH_INFO: `/v3/users/3d09f924225c4abb90f04ed4859179b6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:55.529752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d09f924225c4abb90f04ed4859179b6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:55.532919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:55.605967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d09f924225c4abb90f04ed4859179b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:55.623995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d09f924225c4abb90f04ed4859179b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:55.626092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d09f924225c4abb90f04ed4859179b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:55.636138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d09f924225c4abb90f04ed4859179b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:55.637479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d09f924225c4abb90f04ed4859179b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:55.665277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:55.665634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:55.665859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:55.667378 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3243/6492] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:11:55 2022] DELETE /identity/v3/users/3d09f924225c4abb90f04ed4859179b6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:11:55.689137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:55.690704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:55.766621 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3250/6493] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:11:55.778258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:55.780394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:55.789555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:55.868340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92b976-ddf9-4834-9d16-0d3086adc8b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:55.872938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a170-9d57-4392-bba1-abfc0f45d19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:55.873996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a170-9d57-4392-bba1-abfc0f45d19f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:55.874521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a170-9d57-4392-bba1-abfc0f45d19f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:55.875688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a170-9d57-4392-bba1-abfc0f45d19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:55.890079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56a170-9d57-4392-bba1-abfc0f45d19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:55.892041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56a170-9d57-4392-bba1-abfc0f45d19f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:55.925423 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3244/6494] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:56.326049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:56.327632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:56.352106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8bef3-5b6f-4686-8cb2-2731df92e39c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:56.362887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:56.364022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:56.364229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:56.364472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] PATH_INFO: `/v3/projects/b671035050a44cd9ab78debecf203e2d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:56.365993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b671035050a44cd9ab78debecf203e2d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:56.368445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:56.471217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b671035050a44cd9ab78debecf203e2d', 'request_id': 'req-8dea4da2-7189-42b7-b04f-b426b5c7219e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:56.484297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b671035050a44cd9ab78debecf203e2d', 'request_id': 'req-8dea4da2-7189-42b7-b04f-b426b5c7219e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:56.500997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b671035050a44cd9ab78debecf203e2d', 'request_id': 'req-8dea4da2-7189-42b7-b04f-b426b5c7219e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:56.546674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] The token cache is being invalidate because project b671035050a44cd9ab78debecf203e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:11:56.547331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:56.548856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8dea4da2-7189-42b7-b04f-b426b5c7219e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:56.556061 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3251/6495] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:11:56 2022] DELETE /identity/v3/projects/b671035050a44cd9ab78debecf203e2d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:11:56.558409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34b9d-a833-4388-bfef-a8af849c5c97 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:56.558409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34b9d-a833-4388-bfef-a8af849c5c97 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:56.558964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34b9d-a833-4388-bfef-a8af849c5c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:56.603704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e5f34b9d-a833-4388-bfef-a8af849c5c97 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:56.606725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e5f34b9d-a833-4388-bfef-a8af849c5c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:56.739075 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3245/6496] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:11:56.752936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ec6d-400a-44bd-91b7-a84e7e5c080f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:56.754194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ec6d-400a-44bd-91b7-a84e7e5c080f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:56.754618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ec6d-400a-44bd-91b7-a84e7e5c080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:56.781493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2fc1ec6d-400a-44bd-91b7-a84e7e5c080f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:56.783120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fc1ec6d-400a-44bd-91b7-a84e7e5c080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:56.796845 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3252/6497] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:11:56.798075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f34b9d-a833-4388-bfef-a8af849c5c97 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:56.809823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f34b9d-a833-4388-bfef-a8af849c5c97 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:56.816078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:56.817188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:56.817676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:56.818390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:56.819611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:11:56.820068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:56.822017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:56.839319 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3246/6498] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:11:56.843754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1ec6d-400a-44bd-91b7-a84e7e5c080f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:56.862971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1ec6d-400a-44bd-91b7-a84e7e5c080f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:56.871466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:56.872528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:56.873006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:56.873849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:56.875635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:56.879409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:56.941479 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3253/6499] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:11:56 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:11:56.942648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:56.963049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320bb2-9c8d-4873-81f7-ca5848a00f93 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:57.064855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:57.066369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:57.066987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:57.067611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:57.069173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:57.073621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:57.126989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:57.127261 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3247/6500] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:11:56 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:11:57.150101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f390cee-96b7-4753-861a-e3c881e82a89 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:57.163529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:57.166549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:57.167659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:57.172924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:57.175377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:57.179178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:57.216097 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3254/6501] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:11:57.221672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:57.256533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ba4e-fa26-45ee-ab7e-3577b9fc0d7f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:57.283749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819773-755d-4f3f-96b0-351a51894405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:57.285545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819773-755d-4f3f-96b0-351a51894405 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:57.286844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819773-755d-4f3f-96b0-351a51894405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:57.288090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819773-755d-4f3f-96b0-351a51894405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:57.289998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819773-755d-4f3f-96b0-351a51894405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:57.294261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819773-755d-4f3f-96b0-351a51894405 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:57.320294 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3248/6502] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:11:57.325071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:57.346784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5cc0-0d07-4d37-8bbf-9c674a0598f4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:57.361286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:57.363222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:57.363989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:57.365184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] PATH_INFO: `/v3/projects/c4303c7232c84f5eb979fcc8f832fb10/users/f8ad274b9e7f4809a08713395244b384/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:57.402576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4303c7232c84f5eb979fcc8f832fb10, user_id=f8ad274b9e7f4809a08713395244b384, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:57.409985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:57.439343 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3255/6503] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:11:57 2022] PUT /identity/v3/projects/c4303c7232c84f5eb979fcc8f832fb10/users/f8ad274b9e7f4809a08713395244b384/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:11:57.457977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d658a-2a40-4604-9ed6-a7d2f8f8b20b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:57.458686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d658a-2a40-4604-9ed6-a7d2f8f8b20b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:57.459403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d658a-2a40-4604-9ed6-a7d2f8f8b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:57.503849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:57.513690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-684d658a-2a40-4604-9ed6-a7d2f8f8b20b None None] MFA Rules not processed for user `f8ad274b9e7f4809a08713395244b384`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:57.518701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-684d658a-2a40-4604-9ed6-a7d2f8f8b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:57.713396 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3249/6504] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:11:57.726712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:57.729450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:57.756283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:57.915950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bde95e-7432-4496-ba1b-5225586ae291 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:57.921007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0da16-a59d-4c49-9c30-6f0f1a041e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:57.922456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0da16-a59d-4c49-9c30-6f0f1a041e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:57.922827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0da16-a59d-4c49-9c30-6f0f1a041e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:57.923197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0da16-a59d-4c49-9c30-6f0f1a041e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:57.934181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0da16-a59d-4c49-9c30-6f0f1a041e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:57.936214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0da16-a59d-4c49-9c30-6f0f1a041e01 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:57.962205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3256/6505] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:11:57.968089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d658a-2a40-4604-9ed6-a7d2f8f8b20b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:58.201739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d658a-2a40-4604-9ed6-a7d2f8f8b20b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:58.212071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:58.213205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:58.214526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:58.215121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] PATH_INFO: `/v3/users/f8ad274b9e7f4809a08713395244b384` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:58.217864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ad274b9e7f4809a08713395244b384)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:58.226036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:58.340487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ad274b9e7f4809a08713395244b384'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:58.367008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ad274b9e7f4809a08713395244b384'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:58.368099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ad274b9e7f4809a08713395244b384'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:58.378547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ad274b9e7f4809a08713395244b384'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:58.379574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ad274b9e7f4809a08713395244b384'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:58.410600 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3250/6506] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:11:57 2022] DELETE /identity/v3/users/f8ad274b9e7f4809a08713395244b384 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:11:58.412358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:58.412860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:58.412994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:58.445505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:58.446779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:58.574473 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3257/6507] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:11:58.586414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:58.587959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:58.636259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:58.700990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d8813-a58b-4ea7-b0fe-d899bfe1d640 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:58.707674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d162154-3734-45da-87a4-1ba1f31a90bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:58.708868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d162154-3734-45da-87a4-1ba1f31a90bb service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:58.709586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d162154-3734-45da-87a4-1ba1f31a90bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:58.710316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d162154-3734-45da-87a4-1ba1f31a90bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:58.742432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d162154-3734-45da-87a4-1ba1f31a90bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:58.746935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d162154-3734-45da-87a4-1ba1f31a90bb service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:58.788936 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3251/6508] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:11:59.470251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:59.480944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:59.504646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4a89d-28f5-451c-9cf4-05e4c52974ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:59.524198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:59.527427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:59.528470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:59.529550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] PATH_INFO: `/v3/projects/c4303c7232c84f5eb979fcc8f832fb10` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:59.532937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4303c7232c84f5eb979fcc8f832fb10)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:59.535923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:59.615241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4303c7232c84f5eb979fcc8f832fb10', 'request_id': 'req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:59.623264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4303c7232c84f5eb979fcc8f832fb10', 'request_id': 'req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:59.632287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4303c7232c84f5eb979fcc8f832fb10', 'request_id': 'req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:59.657392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] The token cache is being invalidate because project c4303c7232c84f5eb979fcc8f832fb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:11:59.657695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:59.658550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c9bf92e9-c1d0-4aa7-a87b-9f08a9de5b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:11:59.665322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3258/6509] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:11:59 2022] DELETE /identity/v3/projects/c4303c7232c84f5eb979fcc8f832fb10 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:11:59.667451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5dd9-7cce-4e3c-be34-7d8b8b954c9c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:59.668065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5dd9-7cce-4e3c-be34-7d8b8b954c9c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:59.668660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5dd9-7cce-4e3c-be34-7d8b8b954c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:59.722788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fa8f5dd9-7cce-4e3c-be34-7d8b8b954c9c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:59.738473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa8f5dd9-7cce-4e3c-be34-7d8b8b954c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:59.888952 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3252/6510] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:11:59.897419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baefe3-e18a-4472-b68c-41558b9a0059 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:59.897840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baefe3-e18a-4472-b68c-41558b9a0059 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:59.898149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baefe3-e18a-4472-b68c-41558b9a0059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:59.925454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-49baefe3-e18a-4472-b68c-41558b9a0059 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:11:59.926806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-49baefe3-e18a-4472-b68c-41558b9a0059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:11:59.939831 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3259/6511] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:11:59.944573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5dd9-7cce-4e3c-be34-7d8b8b954c9c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:11:59.956347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5dd9-7cce-4e3c-be34-7d8b8b954c9c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:11:59.961833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:11:59.962547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:11:59.962918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:11:59.963212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:11:59.964074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:11:59.964387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:11:59.966068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:11:59.982770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3253/6512] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:11:59.989663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baefe3-e18a-4472-b68c-41558b9a0059 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:00.010546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baefe3-e18a-4472-b68c-41558b9a0059 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:00.021093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:00.022791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:00.023791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:00.024579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:00.026467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:00.033141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:00.112742 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3260/6513] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:11:59 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:00.114956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:00.130423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe17a-9a7f-44de-99a4-da98e63e12cf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:00.298542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:00.299848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:00.300331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:00.300806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:00.303394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:00.308647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:00.376559 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3254/6514] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:00 2022] POST /identity/v3/users => generated 279 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:00.380777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:00.391937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:00.397399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101bf7e-2f47-4f0a-a401-4f77ed2dd6df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:00.404359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:00.406718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:00.409980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:00.410403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:00.411823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:00.426678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:00.458516 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3261/6515] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:00.462643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:00.475389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b778e5-6f21-4142-bb2b-ec0ca29fb9ad admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:00.481428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb28a7f-1325-40ac-969c-3c8e63d90c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:00.482262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb28a7f-1325-40ac-969c-3c8e63d90c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:00.482593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb28a7f-1325-40ac-969c-3c8e63d90c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:00.482904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb28a7f-1325-40ac-969c-3c8e63d90c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:00.483986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb28a7f-1325-40ac-969c-3c8e63d90c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:00.485900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb28a7f-1325-40ac-969c-3c8e63d90c0a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:00.504002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:00.505102 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3255/6516] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:12:00.517464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343c57d-f599-4031-aae7-13969f021c63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:00.523199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:00.524101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:00.524681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:00.525127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] PATH_INFO: `/v3/projects/9329614d47d644dbb313dcda2b709044/users/0521d55808c4478a9c916c00796ecfb6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:00.552063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9329614d47d644dbb313dcda2b709044, user_id=0521d55808c4478a9c916c00796ecfb6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:00.555019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:00.573415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3262/6517] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:00 2022] PUT /identity/v3/projects/9329614d47d644dbb313dcda2b709044/users/0521d55808c4478a9c916c00796ecfb6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:00.586845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627da5a8-35ce-44fa-9ba5-130df6933f02 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:00.587416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627da5a8-35ce-44fa-9ba5-130df6933f02 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:00.588794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627da5a8-35ce-44fa-9ba5-130df6933f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:00.672162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-627da5a8-35ce-44fa-9ba5-130df6933f02 None None] MFA Rules not processed for user `0521d55808c4478a9c916c00796ecfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:00.676016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-627da5a8-35ce-44fa-9ba5-130df6933f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:00.725046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:00.851055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3256/6518] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:00 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:00.865024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:00.867768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:01.027412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2f3c-48c1-4945-9a9f-09f4d69bdeb2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:01.034895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:01.036272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:01.036858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:01.037364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:01.056582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:01.059445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:01.082445 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3263/6519] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:00 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:03.707154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d932-cefe-4c09-83a8-a044067022bc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:03.708059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d932-cefe-4c09-83a8-a044067022bc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:03.708225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d932-cefe-4c09-83a8-a044067022bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:03.749015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-81b2d932-cefe-4c09-83a8-a044067022bc None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:03.752119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81b2d932-cefe-4c09-83a8-a044067022bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:03.900346 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3257/6520] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:11.070213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:13.874622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=43 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:13.896264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:13.898692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:14.212640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259ef6-42b5-4809-8395-8d131dafe3c9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:14.223892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b8d3e-7abc-430f-8648-9bf1364f7a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:14.227801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b8d3e-7abc-430f-8648-9bf1364f7a09 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:14.228269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b8d3e-7abc-430f-8648-9bf1364f7a09 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:14.228572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b8d3e-7abc-430f-8648-9bf1364f7a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:14.231030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2d0b8d3e-7abc-430f-8648-9bf1364f7a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:14.285514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b8d3e-7abc-430f-8648-9bf1364f7a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:14.289732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b8d3e-7abc-430f-8648-9bf1364f7a09 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:14.361044 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3264/6521] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:12:24.310917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=34 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:27.565467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:27.566227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:27.568764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:27.640941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] MFA Rules not processed for user `ed79aa2ea715471bb970282c9e8dfd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:27.645768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:27.898182 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3258/6522] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:31.536085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:31.537558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:31.538250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:31.636502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:31.640246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:31.713791 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3265/6523] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:36.085755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:36.087710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:36.364198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fdb03-d488-48e1-9e79-5cf0e18c6f5a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:36.382644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:36.391537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:36.391925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:36.392221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:36.398204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:36.446339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:36.448182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:36.493771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3259/6524] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:37.536046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:37.551038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:37.583980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:37.586187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:37.771892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616ad2-e282-4643-960d-67c1f14b2d2c service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:37.784775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:37.786046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:37.786712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:37.787130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] PATH_INFO: `/v3/users/2a7848d78b8848ceab09a548efef5641` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:37.790596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7848d78b8848ceab09a548efef5641)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:37.802272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:37.881344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063133d-7f50-4f57-8a29-1625ee10c06a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:37.904110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:37.910996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:37.912476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:37.912770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:37.928569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] PATH_INFO: `/v3/users/9295895807c14be089de7f34ee87c06c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:37.933059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9295895807c14be089de7f34ee87c06c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:37.935113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:37.956242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7848d78b8848ceab09a548efef5641'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:37.996342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7848d78b8848ceab09a548efef5641'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:37.997296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7848d78b8848ceab09a548efef5641'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.038962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7848d78b8848ceab09a548efef5641'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.042551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc2466c-0014-4466-9b57-376a3eabe8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7848d78b8848ceab09a548efef5641'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.097641 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3260/6525] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:12:37 2022] DELETE /identity/v3/users/2a7848d78b8848ceab09a548efef5641 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:38.106242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:38.107103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:38.108114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:38.209650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:38.219090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9295895807c14be089de7f34ee87c06c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.225125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:38.274320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9295895807c14be089de7f34ee87c06c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.296156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9295895807c14be089de7f34ee87c06c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.298474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9295895807c14be089de7f34ee87c06c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.325405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9f912b2-0d89-443f-ac1a-3611a9510725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9295895807c14be089de7f34ee87c06c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:38.347201 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3266/6526] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:12:37 2022] DELETE /identity/v3/users/9295895807c14be089de7f34ee87c06c => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:38.352039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:38.352463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:38.353407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:38.398880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:38.400361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:38.579031 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3261/6527] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:38.593982 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3267/6528] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:38.636114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:38.638490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:38.735520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:38.737093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:38.771593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:38.890533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82765b-8898-4e49-8a3a-d87e50f9bad5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:39.026373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7df0-f67d-4359-9f5e-b236b94e494c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:39.072863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:39.073629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:39.073922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:39.074212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:39.141243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:39.145121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:39.203700 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3268/6529] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:39.262744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:39.264755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:39.306215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab94b2-d825-44d2-9f08-bd88c94bad4b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:39.328404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:39.332125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:39.347521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:39.352301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] PATH_INFO: `/v3/users/0521d55808c4478a9c916c00796ecfb6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:39.354806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0521d55808c4478a9c916c00796ecfb6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:39.363342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:39.543674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f314771-ed81-4db6-909b-8f6d95c7d04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:39.544368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f314771-ed81-4db6-909b-8f6d95c7d04e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:39.544655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f314771-ed81-4db6-909b-8f6d95c7d04e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:39.544935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f314771-ed81-4db6-909b-8f6d95c7d04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:39.576384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0521d55808c4478a9c916c00796ecfb6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:39.588689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f314771-ed81-4db6-909b-8f6d95c7d04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:39.594772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f314771-ed81-4db6-909b-8f6d95c7d04e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:39.618710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0521d55808c4478a9c916c00796ecfb6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:39.637056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0521d55808c4478a9c916c00796ecfb6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:39.637592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0521d55808c4478a9c916c00796ecfb6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:39.660218 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3262/6530] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1025 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:39.662873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0521d55808c4478a9c916c00796ecfb6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:39.680731 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3269/6531] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:12:39 2022] DELETE /identity/v3/users/0521d55808c4478a9c916c00796ecfb6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:12:39.686614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:39.686898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:39.687158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:39.749730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:39.757627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:39.789336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:40.010785 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3263/6532] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:40.059834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:40.062650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:40.296623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42faa4-32e6-412d-b2fd-b09813ccf39f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:40.322367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:40.323104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:40.323428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:40.323720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:40.380558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:40.383618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:40.453757 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3270/6533] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:40.461956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:40.464073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:40.685666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec366b-6879-403d-a29e-7fdd2eaf6fb0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:40.693244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:40.694283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:40.694938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:40.695391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:40.697909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:40.818555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:40.820429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:40.852408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3264/6534] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:12:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:12:41.475951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:41.478298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:41.496653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0d9a2-eb22-44fe-a6c6-8dd0b7589997 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:41.504784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:41.506219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:41.506770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:41.507322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] PATH_INFO: `/v3/projects/799e8d62c4e74aae9ff85abf31e89bd4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:41.509004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=799e8d62c4e74aae9ff85abf31e89bd4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:41.511855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:41.568918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:41.572393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:41.573038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:41.611529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799e8d62c4e74aae9ff85abf31e89bd4', 'request_id': 'req-c05acbe6-7207-4d45-b4a5-7655b862cbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:41.633214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799e8d62c4e74aae9ff85abf31e89bd4', 'request_id': 'req-c05acbe6-7207-4d45-b4a5-7655b862cbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:41.660372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359827c-87b7-4646-850b-b331d2d85256 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:41.662581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799e8d62c4e74aae9ff85abf31e89bd4', 'request_id': 'req-c05acbe6-7207-4d45-b4a5-7655b862cbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:41.693398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] The token cache is being invalidate because project 799e8d62c4e74aae9ff85abf31e89bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:12:41.694003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:41.695145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c05acbe6-7207-4d45-b4a5-7655b862cbfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:41.697466 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3271/6535] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:12:41 2022] DELETE /identity/v3/projects/799e8d62c4e74aae9ff85abf31e89bd4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:41.705926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dbc22-ec40-467e-ae25-351a469932c6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:41.708391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dbc22-ec40-467e-ae25-351a469932c6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:41.708772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dbc22-ec40-467e-ae25-351a469932c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:41.748552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c07dbc22-ec40-467e-ae25-351a469932c6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:41.749886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c07dbc22-ec40-467e-ae25-351a469932c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:41.812486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:41.845984 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3272/6536] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:41.862928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:41.864066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:41.866639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:41.897679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:41.898945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:41.899472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:41.899911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] PATH_INFO: `/v3/projects/6eb273ba209948f099b4431aa278dcf2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:41.901533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb273ba209948f099b4431aa278dcf2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:41.903738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:41.920328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:41.923977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:41.937977 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3273/6537] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:41.939146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:41.941358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:41.965039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5193-5636-499b-a0de-d85ec5bb7acc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:41.985260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:41.986394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:41.987293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:41.987293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] PATH_INFO: `/v3/projects/9329614d47d644dbb313dcda2b709044` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:41.989864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9329614d47d644dbb313dcda2b709044)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:42.007372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:42.024669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb273ba209948f099b4431aa278dcf2', 'request_id': 'req-887581e8-767b-4af2-b9ff-3cc00b44eba2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.047741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb273ba209948f099b4431aa278dcf2', 'request_id': 'req-887581e8-767b-4af2-b9ff-3cc00b44eba2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.055933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb273ba209948f099b4431aa278dcf2', 'request_id': 'req-887581e8-767b-4af2-b9ff-3cc00b44eba2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.081308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] The token cache is being invalidate because project 6eb273ba209948f099b4431aa278dcf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:12:42.081617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.083674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.101315 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3265/6538] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:12:41 2022] DELETE /identity/v3/projects/6eb273ba209948f099b4431aa278dcf2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:42.101315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:42.104214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9329614d47d644dbb313dcda2b709044', 'request_id': 'req-6fbe2261-fea8-4c2b-8004-ab618174f766'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.104395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:42.115202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9329614d47d644dbb313dcda2b709044', 'request_id': 'req-6fbe2261-fea8-4c2b-8004-ab618174f766'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.125654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9329614d47d644dbb313dcda2b709044', 'request_id': 'req-6fbe2261-fea8-4c2b-8004-ab618174f766'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.168878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] The token cache is being invalidate because project 9329614d47d644dbb313dcda2b709044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:12:42.169493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.170577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.173497 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3274/6539] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:12:41 2022] DELETE /identity/v3/projects/9329614d47d644dbb313dcda2b709044 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:42.175130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:42.177161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:42.251421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:42.267677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887581e8-767b-4af2-b9ff-3cc00b44eba2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:42.337500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2261-fea8-4c2b-8004-ab618174f766 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:42.357087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:42.358050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:42.358397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:42.358682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] PATH_INFO: `/v3/users/1ac00b1f2fff4165865eacfcbb2ce548` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:42.365885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac00b1f2fff4165865eacfcbb2ce548)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:42.365885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:42.468030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b86d-07c4-4416-94e1-a29adaf87a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:42.469183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b86d-07c4-4416-94e1-a29adaf87a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:42.469643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b86d-07c4-4416-94e1-a29adaf87a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:42.470160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b86d-07c4-4416-94e1-a29adaf87a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:42.471392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b86d-07c4-4416-94e1-a29adaf87a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:12:42.476375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b86d-07c4-4416-94e1-a29adaf87a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:42.478796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b86d-07c4-4416-94e1-a29adaf87a35 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:42.499926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac00b1f2fff4165865eacfcbb2ce548'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.534860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac00b1f2fff4165865eacfcbb2ce548'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.551021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3266/6540] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:12:42.553545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa655-53da-4d60-b3b6-e21cb8ab8aa6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:42.558110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac00b1f2fff4165865eacfcbb2ce548'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.558511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa655-53da-4d60-b3b6-e21cb8ab8aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:42.559042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac00b1f2fff4165865eacfcbb2ce548'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.559410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa655-53da-4d60-b3b6-e21cb8ab8aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:42.577729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac00b1f2fff4165865eacfcbb2ce548'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:42.596971 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3275/6541] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:12:42 2022] DELETE /identity/v3/users/1ac00b1f2fff4165865eacfcbb2ce548 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:42.598027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:42.614658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:42.616896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:42.627310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e3fa655-53da-4d60-b3b6-e21cb8ab8aa6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:42.629523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e3fa655-53da-4d60-b3b6-e21cb8ab8aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:42.835037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7312c0-764e-4572-ab13-8f1ebe4bcbe7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:42.858134 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3267/6542] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:42.858589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:42.858589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:42.858589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:42.858589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:42.858912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:42.859977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:42.861122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079962-27eb-4b5f-a6b8-0e5fccc603f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:42.861588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079962-27eb-4b5f-a6b8-0e5fccc603f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:42.862012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079962-27eb-4b5f-a6b8-0e5fccc603f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:42.923367 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3276/6543] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:12:42 2022] POST /identity/v3/projects => generated 365 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:42.924379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:42.969640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-28079962-27eb-4b5f-a6b8-0e5fccc603f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:42.975861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28079962-27eb-4b5f-a6b8-0e5fccc603f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:43.045872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:43.128632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bb57f-5663-4203-bd7f-0c3f90203967 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.152023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.155307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.159923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.160291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.167589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.178348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.193206 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3268/6544] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:43.199208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079962-27eb-4b5f-a6b8-0e5fccc603f4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.227469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079962-27eb-4b5f-a6b8-0e5fccc603f4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.258276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.259365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.259812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.262184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.263706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:12:43.264802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.271565 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3277/6545] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:42 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:43.275507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.290791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.324598 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3269/6546] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:12:43.332254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.336407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165982b-1fe7-4ae6-8fb5-26800e86e388 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.365022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb132ef-e525-4cd9-b909-4f7ab1540179 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.367696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.369709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.390634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.391935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.392385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.392848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.393590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.394082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.396637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.398240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.400088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.409756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.479344 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3278/6547] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:43.481457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.494404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3270/6548] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:12:43 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:43.502155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.590097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fd2b-3263-435d-9a31-1f8717bef39f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.688595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a3e48-abe9-448f-ba93-26868bfd051b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.709998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.717452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.720546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.720991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.721899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.727395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.757496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.759510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.759796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.762359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.770096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.770096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.793058 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3271/6549] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:43 2022] POST /identity/v3/users => generated 303 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:43.798740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.815389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:43.820389 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3279/6550] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:43.821627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.831172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235df57-9191-4978-ad1c-2a97965006a0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.847339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.848696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.849095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.849273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.850088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.850518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d54ee-7a28-42f8-827d-e4924ee45b14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.853475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.866277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17834fce-5bdd-4f8a-96b6-b331583515d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.867211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834fce-5bdd-4f8a-96b6-b331583515d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.867551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834fce-5bdd-4f8a-96b6-b331583515d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.867836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834fce-5bdd-4f8a-96b6-b331583515d3 admin admin] PATH_INFO: `/v3/projects/eed187286194420b88b541c46f412f3c/users/4fd14c354c5740aeba4b339b215043a7/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.874165 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3272/6551] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:12:43.886117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.911029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372cd1d-c7a4-4156-9e1e-45b6f7d51e7c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:43.913988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17834fce-5bdd-4f8a-96b6-b331583515d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed187286194420b88b541c46f412f3c, user_id=4fd14c354c5740aeba4b339b215043a7, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.916421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:43.917279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.917568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.917859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.918712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:43.924426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17834fce-5bdd-4f8a-96b6-b331583515d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.924709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:43.944537 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3273/6552] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:43.949157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:43.958548 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3280/6553] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:43 2022] PUT /identity/v3/projects/eed187286194420b88b541c46f412f3c/users/4fd14c354c5740aeba4b339b215043a7/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:43.970474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:43.970783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:43.971146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:43.984821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4aa03-00b2-4d63-98a5-d2641ca17e9a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:44.027715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] MFA Rules not processed for user `4fd14c354c5740aeba4b339b215043a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:44.030651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:44.197164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35775a-e4ba-4a19-b0b6-d2d176d80784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:44.198040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35775a-e4ba-4a19-b0b6-d2d176d80784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:44.198334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35775a-e4ba-4a19-b0b6-d2d176d80784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:44.198621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35775a-e4ba-4a19-b0b6-d2d176d80784 admin admin] PATH_INFO: `/v3/projects/a30fd4c7d3d349b4802196f8724fac3f/users/32e73a9aff6e441eb721f7999e42082b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:44.252760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35775a-e4ba-4a19-b0b6-d2d176d80784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30fd4c7d3d349b4802196f8724fac3f, user_id=32e73a9aff6e441eb721f7999e42082b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:44.256181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35775a-e4ba-4a19-b0b6-d2d176d80784 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:44.291751 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3281/6554] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:44.296111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3274/6555] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:43 2022] PUT /identity/v3/projects/a30fd4c7d3d349b4802196f8724fac3f/users/32e73a9aff6e441eb721f7999e42082b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:44.312156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:44.312156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:44.318106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:44.319077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:44.319763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:44.382039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:44.402718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] MFA Rules not processed for user `32e73a9aff6e441eb721f7999e42082b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:44.405789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:44.576731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf168a-76ac-41fe-8ce8-90ce9117779d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:44.673432 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3275/6556] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:44.675717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:44.678378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:44.716290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:44.722491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:44.723070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:44.725195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:44.823029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:44.881646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717347-608e-4c75-9e1a-129762fc468d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:44.897461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:44.898909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:44.899422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:44.899909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] PATH_INFO: `/v3/projects/b4ddd9e12f0c4e76906f2b1a415cf71b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:44.911607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ddd9e12f0c4e76906f2b1a415cf71b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:44.920616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:44.952499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:44.954063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:45.008801 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3282/6557] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:45.012444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:45.090242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ad6e3-a85d-45f3-9d5c-3b9ebb516498 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:45.125068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:45.126366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:45.128360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:45.130795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:45.132713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:45.143527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:45.184119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ddd9e12f0c4e76906f2b1a415cf71b', 'request_id': 'req-572173de-baa0-49ce-8003-54a5ae5a6bb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:45.300282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ddd9e12f0c4e76906f2b1a415cf71b', 'request_id': 'req-572173de-baa0-49ce-8003-54a5ae5a6bb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:45.359097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ddd9e12f0c4e76906f2b1a415cf71b', 'request_id': 'req-572173de-baa0-49ce-8003-54a5ae5a6bb3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:45.388734 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3283/6558] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:12:45 2022] POST /identity/v3/projects => generated 403 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:45.396690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:45.420591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] The token cache is being invalidate because project b4ddd9e12f0c4e76906f2b1a415cf71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:12:45.421027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:45.423700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-572173de-baa0-49ce-8003-54a5ae5a6bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:45.439034 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3276/6559] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:12:44 2022] DELETE /identity/v3/projects/b4ddd9e12f0c4e76906f2b1a415cf71b => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:45.441638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764427-2b79-4615-8f9a-6d1c04c6c0f2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:45.442090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764427-2b79-4615-8f9a-6d1c04c6c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:45.443320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764427-2b79-4615-8f9a-6d1c04c6c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:45.524466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a2764427-2b79-4615-8f9a-6d1c04c6c0f2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:45.531743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2764427-2b79-4615-8f9a-6d1c04c6c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:45.654268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530e93a-df7a-41de-8f7e-07d3e6528faa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:45.662862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:45.663904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:45.666511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:45.667015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:45.668160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:45.672631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:45.689422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:45.713113 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3284/6560] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:45 2022] POST /identity/v3/users => generated 308 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:12:45.744868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:45.756519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:45.807690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4f05-a949-4fe6-9b1e-c93a7098397a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:45.825486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:45.826323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:45.827364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:45.827851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:45.834341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:45.840911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:45.864659 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3277/6561] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:45.871872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe6949-04b2-468a-9d45-89a15b48c63b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:45.876337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe6949-04b2-468a-9d45-89a15b48c63b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:45.877358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe6949-04b2-468a-9d45-89a15b48c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:45.880552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3285/6562] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:45.894709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:45.952622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab695e3-6a96-40d5-ae5e-cef464060404 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:45.969847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-41fe6949-04b2-468a-9d45-89a15b48c63b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:45.971793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:45.972963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:45.973309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:45.973697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] PATH_INFO: `/v3/projects/7da408ba50a848c29157eab1c75b8452/users/e901b40ae3684b869758bb59aaa2c511/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:45.978012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-41fe6949-04b2-468a-9d45-89a15b48c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:46.021010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da408ba50a848c29157eab1c75b8452, user_id=e901b40ae3684b869758bb59aaa2c511, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.025329 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3278/6563] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:46.026571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.031718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe6949-04b2-468a-9d45-89a15b48c63b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.048391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe6949-04b2-468a-9d45-89a15b48c63b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.062693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.063591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.063888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.064259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.066389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:12:46.068934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.073837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.091308 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3286/6564] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:45 2022] PUT /identity/v3/projects/7da408ba50a848c29157eab1c75b8452/users/e901b40ae3684b869758bb59aaa2c511/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:46.111754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.124627 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3279/6565] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:12:46.130639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.169276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092111-3c1e-4234-ad0e-b2ac6d80cbd6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.369315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.370015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.370297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.370572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.371317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.376731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.386089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092d0a7-9a90-457f-8061-9e727562749e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.399169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:46.406114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.406836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.407125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.407427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.408191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.409875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.444087 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3280/6566] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:12:46 2022] POST /identity/v3/projects => generated 377 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:46.445722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.461928 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3287/6567] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:46.463684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.499099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003127-7e92-484b-8c50-e8525841c2c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.540364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4706-b703-498f-9119-720c4ebd77b3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.545847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.546709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.547501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.547788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.548661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.551067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.584978 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3281/6568] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:46 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:46.591752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.615046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b984c-0b13-4367-ba23-365cba888431 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.632879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.633586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.633873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.634160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.634918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.638098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.663955 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3282/6569] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:46.665021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.680789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b54c5-8220-4ea6-ad35-128ecf87a43e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.688043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.688883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.689112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.690288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c8fb1-f9bb-4c8c-8fff-136d3fab18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.690525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.691497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.693179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.693977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8fb1-f9bb-4c8c-8fff-136d3fab18be admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.694630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8fb1-f9bb-4c8c-8fff-136d3fab18be admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.703200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8fb1-f9bb-4c8c-8fff-136d3fab18be admin admin] PATH_INFO: `/v3/projects/7da408ba50a848c29157eab1c75b8452/users/e901b40ae3684b869758bb59aaa2c511/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.707587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c8fb1-f9bb-4c8c-8fff-136d3fab18be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da408ba50a848c29157eab1c75b8452, user_id=e901b40ae3684b869758bb59aaa2c511, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.709440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3283/6570] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:46.713996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:46.716979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c8fb1-f9bb-4c8c-8fff-136d3fab18be admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.728033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d226dc-2d4e-49c5-8710-1d4d4655b452 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:46.733894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b71d24-7818-42bb-a070-321d5e7a5566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:46.737425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71d24-7818-42bb-a070-321d5e7a5566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.738716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71d24-7818-42bb-a070-321d5e7a5566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.738716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71d24-7818-42bb-a070-321d5e7a5566 admin admin] PATH_INFO: `/v3/projects/26930a0cc799434cb0051011f97622a7/users/c5e7a13b89104b2e9286ae150ba064da/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.759205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3288/6571] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:46 2022] PUT /identity/v3/projects/7da408ba50a848c29157eab1c75b8452/users/e901b40ae3684b869758bb59aaa2c511/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:46.772012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b71d24-7818-42bb-a070-321d5e7a5566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26930a0cc799434cb0051011f97622a7, user_id=c5e7a13b89104b2e9286ae150ba064da, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:46.772012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b71d24-7818-42bb-a070-321d5e7a5566 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:46.776673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.777354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.777986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.804004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3284/6572] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:46 2022] PUT /identity/v3/projects/26930a0cc799434cb0051011f97622a7/users/c5e7a13b89104b2e9286ae150ba064da/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:46.805774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5339-fa6f-4b73-aefa-6939a6d15c4f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:46.806243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5339-fa6f-4b73-aefa-6939a6d15c4f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:46.806637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5339-fa6f-4b73-aefa-6939a6d15c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:46.852527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-824a5339-fa6f-4b73-aefa-6939a6d15c4f None None] MFA Rules not processed for user `c5e7a13b89104b2e9286ae150ba064da`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:46.856751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-824a5339-fa6f-4b73-aefa-6939a6d15c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:46.878253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] MFA Rules not processed for user `e901b40ae3684b869758bb59aaa2c511`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:46.880494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:47.055285 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3285/6573] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:47.056302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a5339-fa6f-4b73-aefa-6939a6d15c4f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:47.069358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:47.126893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:47.256924 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3289/6574] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:47.301889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:47.304075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:47.314364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a5339-fa6f-4b73-aefa-6939a6d15c4f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:47.337618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:47.338252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:47.338474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:47.338746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:47.339778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:47.348846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:47.541137 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3286/6575] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:12:47 2022] POST /identity/v3/projects => generated 375 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:47.542136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:47.801847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281d369-71a7-4e5e-ab2f-5943ae14f718 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:47.810106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:47.810819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:47.811247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:47.812045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:47.812792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:47.814978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:47.836673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b194876-1749-4e99-8670-70d7e7de8db8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:47.864838 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3287/6576] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:47 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:47.865870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:47.883302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993052e-7232-4317-9f36-dd92d6b1309f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:47.897401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:47.898123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:47.898406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:47.898748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:47.899534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:47.905129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:47.934522 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3288/6577] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:47.935706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:47.966464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceeae4-8cea-4992-9653-efd9f90ffbd2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:47.980010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:47.980952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:47.981420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:47.981711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] PATH_INFO: `/v3/projects/c42bf669cc7740dabe5b2b9528963508/users/4f0cb246f8c04c6fb2dd8a921ec6d1df/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:48.025292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42bf669cc7740dabe5b2b9528963508, user_id=4f0cb246f8c04c6fb2dd8a921ec6d1df, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:48.028467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:48.062762 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3289/6578] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:47 2022] PUT /identity/v3/projects/c42bf669cc7740dabe5b2b9528963508/users/4f0cb246f8c04c6fb2dd8a921ec6d1df/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:48.063829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:48.069651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a7172-59c4-4347-8d74-cd7ec87df5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:48.070954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7172-59c4-4347-8d74-cd7ec87df5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:48.071321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7172-59c4-4347-8d74-cd7ec87df5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:48.077681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7172-59c4-4347-8d74-cd7ec87df5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:48.209802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:48.229643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b46858-bbf9-4181-a5f4-1c186daa99fe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:48.257160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:48.257888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:48.258175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:48.258453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:48.260180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:48.262168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:48.298878 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3290/6579] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:48.300045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:48.318140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cb480-56fd-4b95-bbcc-86c788053577 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:48.340018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:48.341337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:48.341710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:48.342028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] PATH_INFO: `/v3/projects/c42bf669cc7740dabe5b2b9528963508/users/4f0cb246f8c04c6fb2dd8a921ec6d1df/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:48.348942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42bf669cc7740dabe5b2b9528963508, user_id=4f0cb246f8c04c6fb2dd8a921ec6d1df, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:48.351735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:48.359723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a7172-59c4-4347-8d74-cd7ec87df5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:48.360902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a7172-59c4-4347-8d74-cd7ec87df5d8 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:48.385799 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3290/6581] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 1085 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:12:48.392350 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3291/6581] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:48 2022] PUT /identity/v3/projects/c42bf669cc7740dabe5b2b9528963508/users/4f0cb246f8c04c6fb2dd8a921ec6d1df/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:48.393341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45ef4-6897-4057-84c1-0f830efc9f39 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:48.393642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45ef4-6897-4057-84c1-0f830efc9f39 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:48.393914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45ef4-6897-4057-84c1-0f830efc9f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:48.453533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-56e45ef4-6897-4057-84c1-0f830efc9f39 None None] MFA Rules not processed for user `4f0cb246f8c04c6fb2dd8a921ec6d1df`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:48.454768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56e45ef4-6897-4057-84c1-0f830efc9f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:48.496827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:48.715614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3291/6582] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:48.756946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:48.797031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e45ef4-6897-4057-84c1-0f830efc9f39 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:49.073620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e45ef4-6897-4057-84c1-0f830efc9f39 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:49.087621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd72c3-b97e-4e11-b0e5-74bcb313d17e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:49.090636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c93a0-a011-48c0-a483-4984b560b88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:49.100522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c93a0-a011-48c0-a483-4984b560b88e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:49.100846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c93a0-a011-48c0-a483-4984b560b88e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:49.103160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c93a0-a011-48c0-a483-4984b560b88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:49.133186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:49.134104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:49.134389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:49.134670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] PATH_INFO: `/v3/users/32e73a9aff6e441eb721f7999e42082b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:49.144858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e73a9aff6e441eb721f7999e42082b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:49.148361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:49.313766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e73a9aff6e441eb721f7999e42082b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:49.339791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c93a0-a011-48c0-a483-4984b560b88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:49.343798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c93a0-a011-48c0-a483-4984b560b88e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:49.347243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e73a9aff6e441eb721f7999e42082b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:49.350011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e73a9aff6e441eb721f7999e42082b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:49.365480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e73a9aff6e441eb721f7999e42082b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:49.366479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e73a9aff6e441eb721f7999e42082b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:49.368711 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3292/6583] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:12:49.385809 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3292/6584] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:12:48 2022] DELETE /identity/v3/users/32e73a9aff6e441eb721f7999e42082b => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:49.391489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:49.392296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:49.392704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:49.437395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:49.438879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:49.603714 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3293/6585] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:49.615917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:49.617115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:49.807190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664891b7-5118-420a-ba81-aae378fe7aa6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:49.817138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:49.818226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:49.818721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:49.819218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:49.840996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:49.843221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:49.853726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:49.871515 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3293/6586] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:50.889743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:50.891700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:50.929830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e3a39-3a52-4f6d-b0a4-ddef97a73d89 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:50.948733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:50.949966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:50.950539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:50.951029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] PATH_INFO: `/v3/projects/a30fd4c7d3d349b4802196f8724fac3f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:50.956014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30fd4c7d3d349b4802196f8724fac3f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:50.959582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:50.984218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:51.324485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30fd4c7d3d349b4802196f8724fac3f', 'request_id': 'req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.348043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30fd4c7d3d349b4802196f8724fac3f', 'request_id': 'req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.365374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30fd4c7d3d349b4802196f8724fac3f', 'request_id': 'req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.441885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] The token cache is being invalidate because project a30fd4c7d3d349b4802196f8724fac3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:12:51.442349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.443258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.452647 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3294/6587] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:12:50 2022] DELETE /identity/v3/projects/a30fd4c7d3d349b4802196f8724fac3f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:51.455065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:51.467755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc9e4-f9fe-4987-905d-316226e6d5b4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:51.711704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:51.712639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:51.712929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:51.722797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] PATH_INFO: `/v3/users/e901b40ae3684b869758bb59aaa2c511` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:51.729898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e901b40ae3684b869758bb59aaa2c511)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:51.741191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:51.863205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e901b40ae3684b869758bb59aaa2c511'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.914458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e901b40ae3684b869758bb59aaa2c511'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.917650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e901b40ae3684b869758bb59aaa2c511'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.939992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e901b40ae3684b869758bb59aaa2c511'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.941360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc479c3-e031-4137-bd18-31385ab11353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e901b40ae3684b869758bb59aaa2c511'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:51.969145 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3294/6588] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:12:51 2022] DELETE /identity/v3/users/e901b40ae3684b869758bb59aaa2c511 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:53.009173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:53.010685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:53.061394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a16ecf-f5cd-4477-9edc-521d6c5069ab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:53.251479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:53.253308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:53.253780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:53.254405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] PATH_INFO: `/v3/projects/7da408ba50a848c29157eab1c75b8452` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:53.265475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da408ba50a848c29157eab1c75b8452)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:53.273840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:53.452874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da408ba50a848c29157eab1c75b8452', 'request_id': 'req-8515fb10-45bc-480d-98b7-7ff35db0d5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:53.471831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da408ba50a848c29157eab1c75b8452', 'request_id': 'req-8515fb10-45bc-480d-98b7-7ff35db0d5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:53.500866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da408ba50a848c29157eab1c75b8452', 'request_id': 'req-8515fb10-45bc-480d-98b7-7ff35db0d5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:53.519965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] The token cache is being invalidate because project 7da408ba50a848c29157eab1c75b8452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:12:53.520207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:53.522649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8515fb10-45bc-480d-98b7-7ff35db0d5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:53.525055 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3295/6589] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:12:53 2022] DELETE /identity/v3/projects/7da408ba50a848c29157eab1c75b8452 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:53.530856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bf53-4a02-4de0-b8da-f70654ae88d7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:53.531550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bf53-4a02-4de0-b8da-f70654ae88d7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:53.531550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bf53-4a02-4de0-b8da-f70654ae88d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:53.571916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a947bf53-4a02-4de0-b8da-f70654ae88d7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:53.573583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a947bf53-4a02-4de0-b8da-f70654ae88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:53.748874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3295/6590] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:53.841721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfd50a-9206-4b71-853f-0fb2f9c0a779 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:53.842080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfd50a-9206-4b71-853f-0fb2f9c0a779 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:53.842862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfd50a-9206-4b71-853f-0fb2f9c0a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:53.909533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0fdfd50a-9206-4b71-853f-0fb2f9c0a779 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:53.909533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fdfd50a-9206-4b71-853f-0fb2f9c0a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:53.937406 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3296/6591] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:53.938994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bf53-4a02-4de0-b8da-f70654ae88d7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:54.007992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bf53-4a02-4de0-b8da-f70654ae88d7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:54.042816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:54.043847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:54.046890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:54.047495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:54.050059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:12:54.051740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:54.053584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:54.095728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfd50a-9206-4b71-853f-0fb2f9c0a779 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:54.108762 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3296/6592] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:12:54.110880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfd50a-9206-4b71-853f-0fb2f9c0a779 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:54.126212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:54.127093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:54.128203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:54.128661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:54.131661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:54.134021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:54.182138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:54.223908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:54.230173 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3297/6593] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:12:54 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:54.232741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:54.241421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e0d3-a5d9-45f4-8a3c-f654007480d4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:54.458360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:54.460598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:54.461037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:54.461350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:54.462180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:54.464825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:54.556911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:54.558358 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3297/6594] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:54 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:12:54.577021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2b6f1-1e5f-47c8-8c73-2eec04ba3f45 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:54.589031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:54.592490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:54.592881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:54.593243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:54.594091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:54.597243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:54.627897 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3298/6595] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:54.628506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:54.640123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf260d-900d-49ec-a870-07022d4a7840 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:54.654045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a3535-4375-4549-883e-b50e1efe2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:54.655014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3535-4375-4549-883e-b50e1efe2e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:54.657140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3535-4375-4549-883e-b50e1efe2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:54.657581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3535-4375-4549-883e-b50e1efe2e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:54.658489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a3535-4375-4549-883e-b50e1efe2e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:54.665460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a3535-4375-4549-883e-b50e1efe2e8c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:54.692001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3298/6596] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:12:54.697328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:54.734230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf256-2763-4b2f-8602-aad8085d49fb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:54.750718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:54.751564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:54.752213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:54.752600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] PATH_INFO: `/v3/projects/4b52ea6bd9744dc59b2dcc5cc163dedf/users/4511aa9ff56e413bb4f3bddc6bab8902/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:54.813897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b52ea6bd9744dc59b2dcc5cc163dedf, user_id=4511aa9ff56e413bb4f3bddc6bab8902, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:54.817133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:54.846667 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3299/6597] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:54 2022] PUT /identity/v3/projects/4b52ea6bd9744dc59b2dcc5cc163dedf/users/4511aa9ff56e413bb4f3bddc6bab8902/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:54.857283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcbbd6-c947-4d3a-a3d9-b170f99b5c99 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:54.858464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcbbd6-c947-4d3a-a3d9-b170f99b5c99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:54.858960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcbbd6-c947-4d3a-a3d9-b170f99b5c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:54.929314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6dbcbbd6-c947-4d3a-a3d9-b170f99b5c99 None None] MFA Rules not processed for user `4511aa9ff56e413bb4f3bddc6bab8902`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:54.930828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6dbcbbd6-c947-4d3a-a3d9-b170f99b5c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:55.141559 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3299/6598] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:55.146091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:55.419904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c853a54-4e58-45ae-8d34-b076155ed011 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:55.437521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:55.438631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:55.439103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:55.439539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:55.441226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:55.442797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:55.519604 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3300/6599] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:12:55 2022] POST /identity/v3/projects => generated 389 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:55.524197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcbbd6-c947-4d3a-a3d9-b170f99b5c99 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:55.572213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcbbd6-c947-4d3a-a3d9-b170f99b5c99 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:55.799699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:55.800788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:55.801288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:55.801909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:55.804866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:55.811378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:55.892574 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3300/6600] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:12:55 2022] POST /identity/v3/users => generated 301 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:12:55.896730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:55.910467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6801b-3bca-43f0-9f06-c11285ebb7a6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:55.932380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:55.936732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:55.938741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:55.939138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:55.941964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:55.946172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:55.982998 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3301/6601] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:55.984604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:55.991627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:56.003668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858a75-1cd6-4232-81d9-03ebe4826401 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:56.017218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:56.020092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:56.020961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:56.022553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] PATH_INFO: `/v3/projects/e1c327f048144c70bcf961c27826171a/users/c1d829f0c686479bb6d7c7637cf9c2c8/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:56.059231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c327f048144c70bcf961c27826171a, user_id=c1d829f0c686479bb6d7c7637cf9c2c8, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:56.064946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:56.095160 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3301/6602] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:55 2022] PUT /identity/v3/projects/e1c327f048144c70bcf961c27826171a/users/c1d829f0c686479bb6d7c7637cf9c2c8/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:56.101025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:56.117323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbed6f9-ee1a-41b4-9096-303c0c1a9ce3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:56.272928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca483-86a2-4075-93b1-f8434ae4fa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:56.276392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca483-86a2-4075-93b1-f8434ae4fa40 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:56.277238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca483-86a2-4075-93b1-f8434ae4fa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:56.277987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca483-86a2-4075-93b1-f8434ae4fa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:56.281105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ca483-86a2-4075-93b1-f8434ae4fa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:56.289610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ca483-86a2-4075-93b1-f8434ae4fa40 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:56.324098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3302/6603] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:12:56.329785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:56.365262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac899e55-25db-43b7-b7d7-f12eba9d0b8b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:56.411674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:56.419842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:56.421372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:56.421971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] PATH_INFO: `/v3/projects/e1c327f048144c70bcf961c27826171a/users/c1d829f0c686479bb6d7c7637cf9c2c8/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:56.428991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c327f048144c70bcf961c27826171a, user_id=c1d829f0c686479bb6d7c7637cf9c2c8, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:56.446900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:56.518243 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3302/6604] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:12:56 2022] PUT /identity/v3/projects/e1c327f048144c70bcf961c27826171a/users/c1d829f0c686479bb6d7c7637cf9c2c8/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:56.527812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f539-8ed8-4f90-b654-ee3b28f2d609 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:56.528166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f539-8ed8-4f90-b654-ee3b28f2d609 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:56.528521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f539-8ed8-4f90-b654-ee3b28f2d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:56.596960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5c05f539-8ed8-4f90-b654-ee3b28f2d609 None None] MFA Rules not processed for user `c1d829f0c686479bb6d7c7637cf9c2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:56.598242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c05f539-8ed8-4f90-b654-ee3b28f2d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:56.677059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:56.855458 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3303/6605] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:56.860994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:56.884171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:57.235098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57692-cbe9-44b7-b2cc-04712fd3f162 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:57.272609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f62e3-02b8-48e5-a6fc-558298314cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:57.289586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f62e3-02b8-48e5-a6fc-558298314cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:57.290203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f62e3-02b8-48e5-a6fc-558298314cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:57.290706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f62e3-02b8-48e5-a6fc-558298314cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:57.348809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f62e3-02b8-48e5-a6fc-558298314cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:57.350285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f62e3-02b8-48e5-a6fc-558298314cd1 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:57.391773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3303/6606] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:57.823481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05f539-8ed8-4f90-b654-ee3b28f2d609 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:57.968829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05f539-8ed8-4f90-b654-ee3b28f2d609 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:57.974026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:57.974940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:57.975232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:57.975544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] PATH_INFO: `/v3/users/4511aa9ff56e413bb4f3bddc6bab8902` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:57.976829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4511aa9ff56e413bb4f3bddc6bab8902)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:57.978826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:58.104688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4511aa9ff56e413bb4f3bddc6bab8902'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:58.134028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4511aa9ff56e413bb4f3bddc6bab8902'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:58.152611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4511aa9ff56e413bb4f3bddc6bab8902'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:58.153387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4511aa9ff56e413bb4f3bddc6bab8902'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:58.167382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4511aa9ff56e413bb4f3bddc6bab8902'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:12:58.192172 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3304/6607] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:12:57 2022] DELETE /identity/v3/users/4511aa9ff56e413bb4f3bddc6bab8902 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:12:58.194138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:58.194844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:58.194844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:58.230672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:12:58.232149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:58.372009 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3304/6608] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:12:58.381573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:58.383704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:58.473209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:58.528654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff69d-d412-4d73-8d03-bf72afff97a4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:58.536855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:58.537553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:58.537924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:58.538331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:58.566364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:58.567966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:12:58.590524 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3305/6609] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:12:59.747882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:12:59.750391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:12:59.794523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753dc7-82bf-4a70-984f-9918356cb89c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:12:59.817537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:12:59.820538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:12:59.831129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:12:59.831619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] PATH_INFO: `/v3/projects/4b52ea6bd9744dc59b2dcc5cc163dedf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:12:59.835969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b52ea6bd9744dc59b2dcc5cc163dedf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:12:59.840887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:00.019026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:00.020780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:00.059482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b52ea6bd9744dc59b2dcc5cc163dedf', 'request_id': 'req-91c75c2b-e2a3-4457-bb31-6280f758a1b3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.086245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b52ea6bd9744dc59b2dcc5cc163dedf', 'request_id': 'req-91c75c2b-e2a3-4457-bb31-6280f758a1b3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.129312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b52ea6bd9744dc59b2dcc5cc163dedf', 'request_id': 'req-91c75c2b-e2a3-4457-bb31-6280f758a1b3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.162159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:00.207651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] The token cache is being invalidate because project 4b52ea6bd9744dc59b2dcc5cc163dedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:13:00.211391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.215553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.220768 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3305/6610] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:12:59 2022] DELETE /identity/v3/projects/4b52ea6bd9744dc59b2dcc5cc163dedf => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:00.230903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:00.233813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:00.308384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a09e30-2880-4680-9022-ee92336c6741 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:00.524991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:00.527744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:00.528919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:00.530635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:00.540604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:00.581347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75c2b-e2a3-4457-bb31-6280f758a1b3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:00.594899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:00.596089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:00.596622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:00.596622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] PATH_INFO: `/v3/users/c1d829f0c686479bb6d7c7637cf9c2c8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:00.598461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d829f0c686479bb6d7c7637cf9c2c8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:00.602789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:00.768694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:00.786015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:00.850871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d829f0c686479bb6d7c7637cf9c2c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.875086 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3306/6611] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 856 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:00.927705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d829f0c686479bb6d7c7637cf9c2c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.928970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d829f0c686479bb6d7c7637cf9c2c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.988064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d829f0c686479bb6d7c7637cf9c2c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:00.991151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13380a82-4f21-45d4-96fa-b51f8ef1132a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d829f0c686479bb6d7c7637cf9c2c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:01.056224 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3306/6612] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:13:00 2022] DELETE /identity/v3/users/c1d829f0c686479bb6d7c7637cf9c2c8 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:01.767533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:01.837772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6305f10-9f46-4cfb-b38f-d012e831cc2f service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:02.016451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:02.063758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:02.066573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:02.078879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:02.078879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] PATH_INFO: `/v3/projects/e1c327f048144c70bcf961c27826171a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:02.083204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c327f048144c70bcf961c27826171a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:02.090886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:02.405414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c327f048144c70bcf961c27826171a', 'request_id': 'req-fe0ba192-8034-4734-8480-035c5570786a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:02.429165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c327f048144c70bcf961c27826171a', 'request_id': 'req-fe0ba192-8034-4734-8480-035c5570786a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:02.456626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c327f048144c70bcf961c27826171a', 'request_id': 'req-fe0ba192-8034-4734-8480-035c5570786a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:02.506186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] The token cache is being invalidate because project e1c327f048144c70bcf961c27826171a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:13:02.506513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:02.510592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe0ba192-8034-4734-8480-035c5570786a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:02.519640 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3307/6613] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:13:01 2022] DELETE /identity/v3/projects/e1c327f048144c70bcf961c27826171a => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:13:02.524787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26f61-6c9f-4f56-9dbd-cfb2771a52e1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:02.525863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26f61-6c9f-4f56-9dbd-cfb2771a52e1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:02.526302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26f61-6c9f-4f56-9dbd-cfb2771a52e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:02.567540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3da26f61-6c9f-4f56-9dbd-cfb2771a52e1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:02.569092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3da26f61-6c9f-4f56-9dbd-cfb2771a52e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:02.772052 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3307/6614] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:02.775351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f0305-469d-4ddc-9d5a-0489f48dad90 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:02.776339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f0305-469d-4ddc-9d5a-0489f48dad90 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:02.776956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f0305-469d-4ddc-9d5a-0489f48dad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:02.828351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d71f0305-469d-4ddc-9d5a-0489f48dad90 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:02.829623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d71f0305-469d-4ddc-9d5a-0489f48dad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:02.863679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3308/6615] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:13:02.868138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da26f61-6c9f-4f56-9dbd-cfb2771a52e1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:02.885478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da26f61-6c9f-4f56-9dbd-cfb2771a52e1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:02.907601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:02.908402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:02.908696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:02.909012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:02.909854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:13:02.910173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:02.911927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:02.932946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:02.947108 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3308/6616] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:13:02.951800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f0305-469d-4ddc-9d5a-0489f48dad90 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:02.963032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f0305-469d-4ddc-9d5a-0489f48dad90 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:02.982822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:02.983869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:02.984342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:02.984843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:02.985890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:02.988513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:03.050243 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3309/6617] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:13:02 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:13:03.056224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:03.099946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06ab6d-1bd0-46e2-b5fc-c9bcb818a5d2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:03.348059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:03.349248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:03.349748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:03.350237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:03.351214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:03.353574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:03.421939 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3309/6618] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:13:03 2022] POST /identity/v3/users => generated 285 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:13:03.423921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:03.439669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7037-3d03-42ed-ae75-7bec2217d353 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:03.478782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:03.480719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:03.495070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:03.496837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:03.497982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:03.500401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:03.530446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3310/6619] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:03.534431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:03.546924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd37687-09de-4219-8561-2132a943ba34 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:03.573546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97dfba-e3b7-4882-b442-27f891357da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:03.574572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97dfba-e3b7-4882-b442-27f891357da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:03.575079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97dfba-e3b7-4882-b442-27f891357da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:03.577372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97dfba-e3b7-4882-b442-27f891357da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:03.578552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97dfba-e3b7-4882-b442-27f891357da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:03.580703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97dfba-e3b7-4882-b442-27f891357da6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:03.625361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:03.647391 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3310/6620] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:03.650047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10fe7-baa2-4677-9511-3e3dd45f9483 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:03.672812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:03.673596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:03.674003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:03.674365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] PATH_INFO: `/v3/projects/cc957622784843ba912f59ce75aee2a7/users/ef0565f08c444052b98b007d344ea2ba/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:03.712272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc957622784843ba912f59ce75aee2a7, user_id=ef0565f08c444052b98b007d344ea2ba, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:03.726085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:03.767370 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3311/6621] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:13:03 2022] PUT /identity/v3/projects/cc957622784843ba912f59ce75aee2a7/users/ef0565f08c444052b98b007d344ea2ba/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:03.772471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af703bf-1250-4dca-aea1-36b34b88706c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:03.772771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af703bf-1250-4dca-aea1-36b34b88706c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:03.773058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af703bf-1250-4dca-aea1-36b34b88706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:03.800583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5af703bf-1250-4dca-aea1-36b34b88706c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:03.801869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5af703bf-1250-4dca-aea1-36b34b88706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:03.941803 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3311/6622] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:03.952175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:03.954839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:04.213004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88d17-55d1-4a93-9a81-8e1f4cadb7bc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:04.224285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:04.225290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:04.225771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:04.226162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:04.308405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:04.312878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:04.323110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:04.351711 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3312/6623] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:06.704007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45ac7-2a03-4811-93f5-038d93e6f5ed None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:06.705130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45ac7-2a03-4811-93f5-038d93e6f5ed None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:06.705522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45ac7-2a03-4811-93f5-038d93e6f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:07.008138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-32a45ac7-2a03-4811-93f5-038d93e6f5ed None None] MFA Rules not processed for user `ef0565f08c444052b98b007d344ea2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:07.009690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32a45ac7-2a03-4811-93f5-038d93e6f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:07.408004 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3312/6624] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 705 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:07.411550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:07.425112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a975-204a-44f4-bcc8-24436bcb1134 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:07.459850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:07.460556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:07.460940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:07.461232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:07.461972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:07.464047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:07.536911 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3313/6625] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:13:07 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:13:07.541179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45ac7-2a03-4811-93f5-038d93e6f5ed None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:07.562814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45ac7-2a03-4811-93f5-038d93e6f5ed None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:07.569884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:07.818484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:07.819924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:07.820363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:07.820826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:07.821702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:07.826926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:07.892487 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3313/6626] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:13:07 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:13:07.896575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:07.910934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1604-9aa3-4043-b23b-1aed805b9d94 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:07.932974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:07.938230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:07.940506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:07.940506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:07.944047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:07.951135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:07.978658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:07.995490 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3314/6627] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:08.008244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71134ffb-f62d-4610-8750-5aa5da430e8e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:08.035122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:08.036088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:08.036379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:08.036793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] PATH_INFO: `/v3/projects/38223cb92dab4a3a95ac3a448717acfa/users/7ea1e9fa9d664ac5b4ae91d9acbbc005/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:08.088113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38223cb92dab4a3a95ac3a448717acfa, user_id=7ea1e9fa9d664ac5b4ae91d9acbbc005, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:08.091574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:08.123755 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3314/6628] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:13:07 2022] PUT /identity/v3/projects/38223cb92dab4a3a95ac3a448717acfa/users/7ea1e9fa9d664ac5b4ae91d9acbbc005/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:13:08.127855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:08.150632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cef27-cfd0-404b-bca9-fab40cb96583 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:08.197880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:08.510844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50ab55-d1e3-4e89-98fa-58064342abd5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:08.520372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09165b-ee5d-4f16-b713-eb9e70d1bb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:08.521099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09165b-ee5d-4f16-b713-eb9e70d1bb3a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:08.521377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09165b-ee5d-4f16-b713-eb9e70d1bb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:08.521684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09165b-ee5d-4f16-b713-eb9e70d1bb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:08.528241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa09165b-ee5d-4f16-b713-eb9e70d1bb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:08.537205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:08.537999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:08.538186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:08.538441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:08.541199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:08.544219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:08.564835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09165b-ee5d-4f16-b713-eb9e70d1bb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:08.566622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09165b-ee5d-4f16-b713-eb9e70d1bb3a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:08.582379 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3315/6629] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:08.583821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:08.601128 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3315/6630] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:08.605715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1507-c819-4cc1-afd4-a7cc6c374862 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:08.620764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718f5b6-3fe6-475a-a865-397ab510d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:08.621866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f5b6-3fe6-475a-a865-397ab510d3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:08.622165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f5b6-3fe6-475a-a865-397ab510d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:08.622459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f5b6-3fe6-475a-a865-397ab510d3dc admin admin] PATH_INFO: `/v3/projects/38223cb92dab4a3a95ac3a448717acfa/users/7ea1e9fa9d664ac5b4ae91d9acbbc005/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:08.632262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f5b6-3fe6-475a-a865-397ab510d3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=38223cb92dab4a3a95ac3a448717acfa, user_id=7ea1e9fa9d664ac5b4ae91d9acbbc005, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:08.635793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f5b6-3fe6-475a-a865-397ab510d3dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:08.662723 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3316/6631] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:13:08 2022] PUT /identity/v3/projects/38223cb92dab4a3a95ac3a448717acfa/users/7ea1e9fa9d664ac5b4ae91d9acbbc005/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:11.714406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:11.715404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:11.715914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:11.787835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] MFA Rules not processed for user `7ea1e9fa9d664ac5b4ae91d9acbbc005`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:11.794515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:12.157737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:12.174555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3316/6632] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:12.184581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535aac-8899-44e7-aa24-10d216e7656e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:12.185139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535aac-8899-44e7-aa24-10d216e7656e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:12.185233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535aac-8899-44e7-aa24-10d216e7656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:12.243570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-07535aac-8899-44e7-aa24-10d216e7656e None None] MFA Rules not processed for user `ef0565f08c444052b98b007d344ea2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:12.244852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07535aac-8899-44e7-aa24-10d216e7656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:12.503913 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3317/6633] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:12.522142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:12.525662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:13.123351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bdfd4-27d9-40d2-b303-c3c8c28acb8f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:13.162487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:13.166733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:13.169511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:13.169867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:13.219127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:13.228211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:13.274543 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3317/6634] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:14.212426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d2ce-f494-4e03-b7bf-c4781dcd0004 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:14.213008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d2ce-f494-4e03-b7bf-c4781dcd0004 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:14.213371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d2ce-f494-4e03-b7bf-c4781dcd0004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:14.301282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ff82d2ce-f494-4e03-b7bf-c4781dcd0004 None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:14.303452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff82d2ce-f494-4e03-b7bf-c4781dcd0004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:14.433471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:14.468951 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3318/6635] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:19.352717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:19.357243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:19.613018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b16bd-4d63-45ec-9d5a-de96a24983e4 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:19.631892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:19.632687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:19.633512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:19.633512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:19.635901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:19.670482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:19.672177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:19.702691 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3318/6636] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:24.441928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:29.681602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=71 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:33.503896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d2ce-f494-4e03-b7bf-c4781dcd0004 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:33.552237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d2ce-f494-4e03-b7bf-c4781dcd0004 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:33.595997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:33.599479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:33.600922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:33.601207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:33.608840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:33.665982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:33.667849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:33.721997 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3319/6637] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:37.482611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:37.484887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:37.643392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b040d5e-6eb5-4454-9031-e205d7c6087f service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:37.657108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:37.663005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:37.663314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:37.663604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] PATH_INFO: `/v3/users/515dbc74a0544243bba03ae2974c218c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:37.708701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515dbc74a0544243bba03ae2974c218c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:37.715120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:37.933684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515dbc74a0544243bba03ae2974c218c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:37.992337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515dbc74a0544243bba03ae2974c218c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:37.993433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515dbc74a0544243bba03ae2974c218c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:38.024686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515dbc74a0544243bba03ae2974c218c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:38.027184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515dbc74a0544243bba03ae2974c218c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:38.119815 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3319/6638] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:13:37 2022] DELETE /identity/v3/users/515dbc74a0544243bba03ae2974c218c => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:38.642260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:38.666089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7ab2-86cf-41ac-a3e7-2e2d0cea8b5a service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:38.847313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:38.848301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:38.848592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:38.848880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] PATH_INFO: `/v3/projects/e83a2d7967344e64aac0c62b4e1f3d94` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:38.889065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83a2d7967344e64aac0c62b4e1f3d94)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:38.897886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:39.143663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83a2d7967344e64aac0c62b4e1f3d94', 'request_id': 'req-084dd1b8-4f59-4d1c-be98-49acf064ab4b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.176692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83a2d7967344e64aac0c62b4e1f3d94', 'request_id': 'req-084dd1b8-4f59-4d1c-be98-49acf064ab4b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.212113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83a2d7967344e64aac0c62b4e1f3d94', 'request_id': 'req-084dd1b8-4f59-4d1c-be98-49acf064ab4b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.254188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] The token cache is being invalidate because project e83a2d7967344e64aac0c62b4e1f3d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:13:39.254665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.258067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.271152 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3320/6639] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:13:38 2022] DELETE /identity/v3/projects/e83a2d7967344e64aac0c62b4e1f3d94 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:13:39.271916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:39.273940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:39.319604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ca972-73be-4038-ae0b-5623a73ef0b5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:39.492007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:39.493183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:39.493480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:39.493774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] PATH_INFO: `/v3/users/3116fb08842f484fa9490b20962917f8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:39.526190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:39.530722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3116fb08842f484fa9490b20962917f8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:39.532861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:39.670743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3116fb08842f484fa9490b20962917f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.786696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3116fb08842f484fa9490b20962917f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.787985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3116fb08842f484fa9490b20962917f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.832448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3116fb08842f484fa9490b20962917f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.840083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c75e646-53cc-4287-9e2d-f0268a134fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3116fb08842f484fa9490b20962917f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:39.897141 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3320/6640] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:13:39 2022] DELETE /identity/v3/users/3116fb08842f484fa9490b20962917f8 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:40.760379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:40.762649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:40.809086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd1b8-4f59-4d1c-be98-49acf064ab4b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:41.050110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:41.053482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:41.053777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:41.054068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] PATH_INFO: `/v3/projects/eb2fce848197475b8396271aed9a664b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:41.100161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2fce848197475b8396271aed9a664b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:41.104303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:41.110124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:41.284923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2fce848197475b8396271aed9a664b', 'request_id': 'req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:41.303484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2fce848197475b8396271aed9a664b', 'request_id': 'req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:41.359580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2fce848197475b8396271aed9a664b', 'request_id': 'req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:41.441805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] The token cache is being invalidate because project eb2fce848197475b8396271aed9a664b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:13:41.442770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:41.455895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c246b8e-8a56-465d-9e1b-4e2f4775b1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:41.458323 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3321/6641] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:13:40 2022] DELETE /identity/v3/projects/eb2fce848197475b8396271aed9a664b => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:41.463497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58a65-0606-4d63-8ea5-e78b55218ffc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:41.464443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58a65-0606-4d63-8ea5-e78b55218ffc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:41.464954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58a65-0606-4d63-8ea5-e78b55218ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:41.581474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-18a58a65-0606-4d63-8ea5-e78b55218ffc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:41.585598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18a58a65-0606-4d63-8ea5-e78b55218ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:41.777938 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3321/6642] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:13:41.786457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac38f-38de-4489-b4dc-2a85c283c597 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:41.787055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac38f-38de-4489-b4dc-2a85c283c597 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:41.787055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac38f-38de-4489-b4dc-2a85c283c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:41.832012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28eac38f-38de-4489-b4dc-2a85c283c597 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:41.834406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28eac38f-38de-4489-b4dc-2a85c283c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:41.854102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3322/6643] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:13:41.858970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58a65-0606-4d63-8ea5-e78b55218ffc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:41.878205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58a65-0606-4d63-8ea5-e78b55218ffc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:41.889877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:41.890694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:41.891063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:41.891564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:41.892615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:13:41.893004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:41.904248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:41.933164 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3322/6644] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:13:41.935688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eac38f-38de-4489-b4dc-2a85c283c597 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:41.956178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eac38f-38de-4489-b4dc-2a85c283c597 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:41.961760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:41.962794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:41.962794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:41.962998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:41.963810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:41.966427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:42.034873 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3323/6645] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:13:41 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:13:42.048023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:42.095875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dee4df-0fde-4198-8b8b-a9bc2731dfae admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:42.221259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:42.271099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:42.271990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:42.273626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:42.274140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:42.275115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:42.278704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:42.353241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:42.356312 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3323/6646] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:13:42 2022] POST /identity/v3/users => generated 300 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:13:42.371881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5158f8-8108-49d6-85f2-a3aa5d9758be admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:42.394184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:42.394900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:42.395194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:42.395522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:42.397243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:42.398947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:42.416803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3324/6647] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:42.418896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:42.437797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86d90d-ec8f-45bf-a347-78e570d96913 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:42.443718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8b159-26f4-4a0f-9a1c-a88b41b31ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:42.444541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b159-26f4-4a0f-9a1c-a88b41b31ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:42.444920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b159-26f4-4a0f-9a1c-a88b41b31ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:42.445297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b159-26f4-4a0f-9a1c-a88b41b31ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:42.446144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8b159-26f4-4a0f-9a1c-a88b41b31ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:42.447993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8b159-26f4-4a0f-9a1c-a88b41b31ebe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:42.466498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:42.475200 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3324/6648] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:42.486102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b97189-c6e5-4a94-93b1-70642a67c80b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:42.503010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:42.504735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:42.505126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:42.505498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] PATH_INFO: `/v3/projects/b0d773410b4f4f569ba3afa8661c17d8/users/94ce161302f9413e9ea56f41dc4ad728/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:42.596331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d773410b4f4f569ba3afa8661c17d8, user_id=94ce161302f9413e9ea56f41dc4ad728, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:42.617636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:42.665184 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3325/6649] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:13:42 2022] PUT /identity/v3/projects/b0d773410b4f4f569ba3afa8661c17d8/users/94ce161302f9413e9ea56f41dc4ad728/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:42.668189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:42.669820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:42.670551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:42.742387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:42.742387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:42.939392 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3325/6650] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:42.943935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:42.946341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:43.180539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738f1a-131a-4cd3-a89f-c3c45dc8cd4d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:43.205823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163df4bb-6ffc-4fd6-ac9c-15bae7bf5b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:43.207386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163df4bb-6ffc-4fd6-ac9c-15bae7bf5b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:43.207934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163df4bb-6ffc-4fd6-ac9c-15bae7bf5b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:43.208435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163df4bb-6ffc-4fd6-ac9c-15bae7bf5b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:43.235985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163df4bb-6ffc-4fd6-ac9c-15bae7bf5b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:43.240017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163df4bb-6ffc-4fd6-ac9c-15bae7bf5b57 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:43.242305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:43.245525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:43.274850 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3326/6651] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:43.295977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f10de-5da8-4719-ae32-32fd616a2b1d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:43.323660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:43.328153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:43.329452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:43.330481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] PATH_INFO: `/v3/users/4e25d7c41fc74859a6a0bed6e2fea16f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:43.336241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e25d7c41fc74859a6a0bed6e2fea16f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:43.338584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:43.454060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e25d7c41fc74859a6a0bed6e2fea16f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:43.487381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e25d7c41fc74859a6a0bed6e2fea16f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:43.489348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e25d7c41fc74859a6a0bed6e2fea16f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:43.500184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e25d7c41fc74859a6a0bed6e2fea16f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:43.501187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e25d7c41fc74859a6a0bed6e2fea16f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:43.531332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3326/6652] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:13:43 2022] DELETE /identity/v3/users/4e25d7c41fc74859a6a0bed6e2fea16f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:43.534722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:43.535616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:43.536052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:43.600072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:43.604890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:43.648991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:43.752668 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3327/6653] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:13:43.766648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:43.768319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:43.895651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:43.932531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78311fc2-66ce-464e-9456-9e8b59893756 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:43.945241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:43.945938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:43.946275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:43.946781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:43.974380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:43.975994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:44.008783 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3327/6654] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:44.461360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:44.465103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:44.720107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5d7ff-c990-4cf2-9800-93ce7cf6accf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:44.735014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9c0b3-12e1-4c52-9b28-b49ca2e7380a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:44.735762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c0b3-12e1-4c52-9b28-b49ca2e7380a service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:44.736053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c0b3-12e1-4c52-9b28-b49ca2e7380a service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:44.736334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c0b3-12e1-4c52-9b28-b49ca2e7380a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:44.756659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9c9c0b3-12e1-4c52-9b28-b49ca2e7380a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:44.998419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9c0b3-12e1-4c52-9b28-b49ca2e7380a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:45.008821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9c0b3-12e1-4c52-9b28-b49ca2e7380a service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:45.046550 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3328/6655] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:45.705942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:45.708075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:45.737607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5d38-e6b2-4dcf-99d3-aab8b76a7aa5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:45.758636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:45.759847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:45.760293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:45.760753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] PATH_INFO: `/v3/projects/311be4cdeacf4d23b29b2ec466b2836b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:45.765721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=311be4cdeacf4d23b29b2ec466b2836b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:45.768055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:45.974684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311be4cdeacf4d23b29b2ec466b2836b', 'request_id': 'req-dc842c55-4592-464a-ae12-265c46c65f29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:45.994196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311be4cdeacf4d23b29b2ec466b2836b', 'request_id': 'req-dc842c55-4592-464a-ae12-265c46c65f29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:46.015893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311be4cdeacf4d23b29b2ec466b2836b', 'request_id': 'req-dc842c55-4592-464a-ae12-265c46c65f29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:46.048125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] The token cache is being invalidate because project 311be4cdeacf4d23b29b2ec466b2836b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:13:46.048373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:46.053481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc842c55-4592-464a-ae12-265c46c65f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:46.062064 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3328/6656] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:13:45 2022] DELETE /identity/v3/projects/311be4cdeacf4d23b29b2ec466b2836b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:46.064734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2ede-b1c1-4e2d-b256-c538c978d22a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:46.065629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2ede-b1c1-4e2d-b256-c538c978d22a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:46.065943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2ede-b1c1-4e2d-b256-c538c978d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:46.172215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8cfb2ede-b1c1-4e2d-b256-c538c978d22a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:46.180835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cfb2ede-b1c1-4e2d-b256-c538c978d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:46.617259 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3329/6657] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:46.629632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fa1b-55ff-4478-9b46-29ccd97e6ecf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:46.630338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fa1b-55ff-4478-9b46-29ccd97e6ecf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:46.630906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fa1b-55ff-4478-9b46-29ccd97e6ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:46.676833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f356fa1b-55ff-4478-9b46-29ccd97e6ecf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:46.683581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f356fa1b-55ff-4478-9b46-29ccd97e6ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:46.723794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3329/6658] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:13:46.737374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2ede-b1c1-4e2d-b256-c538c978d22a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:46.788820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2ede-b1c1-4e2d-b256-c538c978d22a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:46.828103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:46.828853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:46.829149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:46.829437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:46.830208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:13:46.830540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:46.832233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:46.843541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:46.877347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3330/6659] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:13:46.881438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356fa1b-55ff-4478-9b46-29ccd97e6ecf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:46.900501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356fa1b-55ff-4478-9b46-29ccd97e6ecf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:46.921351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:46.922313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:46.922892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:46.923392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:46.924344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:46.933243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:47.029341 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3330/6660] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:13:46 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:13:47.035137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:47.051961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610d23a-7441-45da-900c-c399d3160df3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:47.265463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:47.268912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:47.269685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:47.271822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:47.274526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:47.279170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:47.357483 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3331/6661] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:13:47 2022] POST /identity/v3/users => generated 287 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:13:47.358393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:47.381050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a624f-a243-4d7d-b800-852e611aeee5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:47.412114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:47.412862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:47.413121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:47.418014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:47.419454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:47.421336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:47.463322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3331/6662] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:47.464112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:47.476942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd140-08db-4410-a2a7-57788c239f24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:47.496161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5c1b-f6e5-44c9-9f56-33960a771dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:47.497455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5c1b-f6e5-44c9-9f56-33960a771dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:47.497755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5c1b-f6e5-44c9-9f56-33960a771dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:47.498068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5c1b-f6e5-44c9-9f56-33960a771dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:47.498855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5c1b-f6e5-44c9-9f56-33960a771dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:47.500566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5c1b-f6e5-44c9-9f56-33960a771dbe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:47.558537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:47.563724 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3332/6663] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:47.582016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db5b5-4ff5-4d1c-889a-eff5603bed73 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:47.602946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:47.604350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:47.611930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:47.612463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] PATH_INFO: `/v3/projects/388e2ae9b45d44c5839b6bbf34cf352d/users/fb01ba25eba14005b6d1ba3e2ef44298/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:47.666055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388e2ae9b45d44c5839b6bbf34cf352d, user_id=fb01ba25eba14005b6d1ba3e2ef44298, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:47.671999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:47.730689 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3332/6664] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:13:47 2022] PUT /identity/v3/projects/388e2ae9b45d44c5839b6bbf34cf352d/users/fb01ba25eba14005b6d1ba3e2ef44298/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:47.735104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f59b5b-206d-40c7-b0b3-c9cf6684a70f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:47.735677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f59b5b-206d-40c7-b0b3-c9cf6684a70f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:47.736119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f59b5b-206d-40c7-b0b3-c9cf6684a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:47.810658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-64f59b5b-206d-40c7-b0b3-c9cf6684a70f None None] MFA Rules not processed for user `fb01ba25eba14005b6d1ba3e2ef44298`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:47.812393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64f59b5b-206d-40c7-b0b3-c9cf6684a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:48.066352 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3333/6665] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:48.396942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:48.399150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:48.574403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446daf4-9382-460a-927b-f61e9fcb7bb2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:48.583021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44172c9b-02d0-451d-bc38-223445c69588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:48.584089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172c9b-02d0-451d-bc38-223445c69588 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:48.584586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172c9b-02d0-451d-bc38-223445c69588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:48.585021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172c9b-02d0-451d-bc38-223445c69588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:48.610819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172c9b-02d0-451d-bc38-223445c69588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:48.612507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172c9b-02d0-451d-bc38-223445c69588 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:48.636770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3333/6666] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:48.697897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f59b5b-206d-40c7-b0b3-c9cf6684a70f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:48.835719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f59b5b-206d-40c7-b0b3-c9cf6684a70f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:48.852868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:48.853802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:48.855763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:48.855763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] PATH_INFO: `/v3/users/fb01ba25eba14005b6d1ba3e2ef44298` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:48.868974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb01ba25eba14005b6d1ba3e2ef44298)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:48.871176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:48.878520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:48.990208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb01ba25eba14005b6d1ba3e2ef44298'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:49.056544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb01ba25eba14005b6d1ba3e2ef44298'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:49.089544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb01ba25eba14005b6d1ba3e2ef44298'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:49.091638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb01ba25eba14005b6d1ba3e2ef44298'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:49.177123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc93cdd4-e446-4778-b07a-c45de68d0c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb01ba25eba14005b6d1ba3e2ef44298'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:49.260605 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3334/6667] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:13:48 2022] DELETE /identity/v3/users/fb01ba25eba14005b6d1ba3e2ef44298 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:49.275916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:49.280900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:49.281417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:49.306008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:49.348318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:49.349819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:49.350291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:49.395706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:49.399352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:49.552268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] MFA Rules not processed for user `0110507279914488aca33cec9a2fc9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:49.569322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:49.689639 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3334/6668] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:49.716410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:49.726070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:49.859313 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3335/6669] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:50.164018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04976-4740-4a8a-9b63-0a9b7f1eeb4c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:50.227617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ec32-0e25-4698-8abb-386f7878208a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:50.228811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ec32-0e25-4698-8abb-386f7878208a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:50.229290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ec32-0e25-4698-8abb-386f7878208a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:50.229766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ec32-0e25-4698-8abb-386f7878208a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:50.317158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0ec32-0e25-4698-8abb-386f7878208a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:50.327103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0ec32-0e25-4698-8abb-386f7878208a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:50.412727 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3335/6670] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:13:53.145019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:53.148701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:53.216365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fcd63-d4ee-4e63-bb49-a9b64f24e504 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:53.239121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:53.240092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:53.240412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:53.240931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] PATH_INFO: `/v3/projects/388e2ae9b45d44c5839b6bbf34cf352d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:53.244463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=388e2ae9b45d44c5839b6bbf34cf352d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:53.256438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:53.412230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388e2ae9b45d44c5839b6bbf34cf352d', 'request_id': 'req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:53.421420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388e2ae9b45d44c5839b6bbf34cf352d', 'request_id': 'req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:53.430830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388e2ae9b45d44c5839b6bbf34cf352d', 'request_id': 'req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:53.491424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] The token cache is being invalidate because project 388e2ae9b45d44c5839b6bbf34cf352d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:13:53.491857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:53.495242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-587bc4ca-ee11-416b-b5c3-1f541e7b4a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:13:53.503704 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3336/6671] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:13:53 2022] DELETE /identity/v3/projects/388e2ae9b45d44c5839b6bbf34cf352d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:53.511505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9a7e5-3a42-4c19-8987-fc6b7d8307e9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:53.513361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9a7e5-3a42-4c19-8987-fc6b7d8307e9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:53.514123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9a7e5-3a42-4c19-8987-fc6b7d8307e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:53.607131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-35c9a7e5-3a42-4c19-8987-fc6b7d8307e9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:53.609409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-35c9a7e5-3a42-4c19-8987-fc6b7d8307e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:53.907345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3336/6672] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:53.918428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a1a0-a721-4e77-a8c1-c6a984e6e24d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:53.918924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a1a0-a721-4e77-a8c1-c6a984e6e24d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:53.919258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a1a0-a721-4e77-a8c1-c6a984e6e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:53.998060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a131a1a0-a721-4e77-a8c1-c6a984e6e24d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:54.002427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a131a1a0-a721-4e77-a8c1-c6a984e6e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:54.039090 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3337/6673] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:13:54.045474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9a7e5-3a42-4c19-8987-fc6b7d8307e9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:54.063324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9a7e5-3a42-4c19-8987-fc6b7d8307e9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:54.080281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:54.081005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:54.090436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:54.091459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:54.092201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:13:54.092520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:54.094228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:54.151511 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3337/6674] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:13:54.168338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131a1a0-a721-4e77-a8c1-c6a984e6e24d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:54.174564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:54.187531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131a1a0-a721-4e77-a8c1-c6a984e6e24d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:54.205157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:54.205921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:54.206239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:54.206560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:54.210225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:54.216693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:54.349472 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3338/6675] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:13:54 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:13:54.350587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:54.371533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbad056-d9c6-4cba-90c8-76a5d329c23c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:54.501489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:54.592267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:54.593637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:54.593637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:54.593637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:54.594383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:54.596545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:54.643365 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3338/6676] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:13:54 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:13:54.648063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:54.667196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66cea-1e1f-428a-b633-01e2798aa6c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:54.708635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:54.713645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:54.715388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:54.729263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:54.737810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:54.768412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:54.845888 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3339/6677] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:54.872410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:54.962507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998bda5-b690-463c-a0b8-efcbdd0c27ca admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:55.019712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f4ba2-d17f-4426-a986-b45ac0c061de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:55.020943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f4ba2-d17f-4426-a986-b45ac0c061de admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:55.021471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f4ba2-d17f-4426-a986-b45ac0c061de admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:55.027923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f4ba2-d17f-4426-a986-b45ac0c061de admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:55.031620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f4ba2-d17f-4426-a986-b45ac0c061de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:55.036966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f4ba2-d17f-4426-a986-b45ac0c061de admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:55.057335 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3339/6678] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:13:55.063151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:55.116572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2df1ca-c8e1-468e-a61a-f633a3fb00d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:55.182857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:55.185626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:55.186058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:55.186478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] PATH_INFO: `/v3/projects/406107b53d424678a716867f11bebae2/users/df8c67406d8f4722a1234aad34c75194/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:55.270980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=406107b53d424678a716867f11bebae2, user_id=df8c67406d8f4722a1234aad34c75194, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:55.276276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:55.333252 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3340/6679] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:13:55 2022] PUT /identity/v3/projects/406107b53d424678a716867f11bebae2/users/df8c67406d8f4722a1234aad34c75194/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:13:55.334641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e2f33-28b3-4057-b274-9b118189abac None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:55.335012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e2f33-28b3-4057-b274-9b118189abac None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:55.335469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e2f33-28b3-4057-b274-9b118189abac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:55.418435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e03e2f33-28b3-4057-b274-9b118189abac None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:13:55.423550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e03e2f33-28b3-4057-b274-9b118189abac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:55.803524 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3340/6680] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:13:55.812901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:13:55.817248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:13:56.067456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2686d9-5795-457b-9374-b1f43a14a14a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:13:56.083695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:13:56.085638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:13:56.086406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:13:56.087296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:13:56.136811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:13:56.140031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:13:56.191923 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3341/6681] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:01.766538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7bc1-c97b-457d-9056-e956c327b301 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:01.767182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7bc1-c97b-457d-9056-e956c327b301 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:01.767182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7bc1-c97b-457d-9056-e956c327b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:01.849774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-235f7bc1-c97b-457d-9056-e956c327b301 None None] MFA Rules not processed for user `df8c67406d8f4722a1234aad34c75194`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:01.851045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-235f7bc1-c97b-457d-9056-e956c327b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:02.197872 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3341/6682] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:14:02.216724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:02.220928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:02.413582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba9522-b18a-4148-bc73-ccb44fbc8b74 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:02.426453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc2e08-90ac-4966-a1c1-35654b5059d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:02.431700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2e08-90ac-4966-a1c1-35654b5059d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:02.432775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2e08-90ac-4966-a1c1-35654b5059d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:02.433344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2e08-90ac-4966-a1c1-35654b5059d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:02.464495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc2e08-90ac-4966-a1c1-35654b5059d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:02.470643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc2e08-90ac-4966-a1c1-35654b5059d4 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:02.540530 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3342/6683] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:04.359193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:04.361265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:04.361548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:04.492208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] MFA Rules not processed for user `94ce161302f9413e9ea56f41dc4ad728`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:04.495557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:04.608467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:04.739721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:04.740538 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3342/6684] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:04.741324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:04.743631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:04.928197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] MFA Rules not processed for user `94ce161302f9413e9ea56f41dc4ad728`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:04.930197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:05.003798 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3343/6685] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:05.315081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:05.319900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:05.786381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c708ce-91d0-4026-bb43-67c4026ec1d8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:05.805621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60390bd-3dae-4803-85e4-33bc53c97ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:05.806773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60390bd-3dae-4803-85e4-33bc53c97ca5 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:05.816338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60390bd-3dae-4803-85e4-33bc53c97ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:05.822527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60390bd-3dae-4803-85e4-33bc53c97ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:05.890382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60390bd-3dae-4803-85e4-33bc53c97ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:05.895317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60390bd-3dae-4803-85e4-33bc53c97ca5 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:05.970846 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3343/6686] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:07.700877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:07.702648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:07.813900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961f13b-8430-4b22-8ea1-a94f75aaf73c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:07.858260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:07.861918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:07.864924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:07.866881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] PATH_INFO: `/v3/users/c5e7a13b89104b2e9286ae150ba064da` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:07.877786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e7a13b89104b2e9286ae150ba064da)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:07.893767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:08.050275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:08.063073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e7a13b89104b2e9286ae150ba064da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:08.095971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e7a13b89104b2e9286ae150ba064da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:08.113680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e7a13b89104b2e9286ae150ba064da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:08.115755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e7a13b89104b2e9286ae150ba064da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:08.130799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e7a13b89104b2e9286ae150ba064da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:08.157014 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3344/6687] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:14:07 2022] DELETE /identity/v3/users/c5e7a13b89104b2e9286ae150ba064da => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:08.161458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:08.162246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:08.162246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:08.241041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:08.242443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:08.625503 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3344/6688] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:08.637075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:08.639658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:09.069027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d95b8-ca67-43f9-9d39-47b45fbc3ea6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:09.086174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:09.108334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:09.109110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:09.109642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:09.161282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:09.177882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:09.298389 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3345/6689] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:10.777521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:10.779155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:10.820811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162a36-6883-445c-aa0b-67a57b6220bf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:10.852287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:10.853197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:10.853476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:10.860899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] PATH_INFO: `/v3/projects/26930a0cc799434cb0051011f97622a7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:10.867226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26930a0cc799434cb0051011f97622a7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:10.881236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:11.095530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:11.115964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26930a0cc799434cb0051011f97622a7', 'request_id': 'req-222a4ceb-02d2-4761-83dc-a8514659f998'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.131690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26930a0cc799434cb0051011f97622a7', 'request_id': 'req-222a4ceb-02d2-4761-83dc-a8514659f998'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.153700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26930a0cc799434cb0051011f97622a7', 'request_id': 'req-222a4ceb-02d2-4761-83dc-a8514659f998'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.201194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] The token cache is being invalidate because project 26930a0cc799434cb0051011f97622a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:14:11.208952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.210333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.215959 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3345/6690] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:14:10 2022] DELETE /identity/v3/projects/26930a0cc799434cb0051011f97622a7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:11.220943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:11.265153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b4d1-fef4-4f1a-b1c9-154ec24b987f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:11.505557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:11.506499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:11.506794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:11.507083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] PATH_INFO: `/v3/users/4f0cb246f8c04c6fb2dd8a921ec6d1df` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:11.518247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0cb246f8c04c6fb2dd8a921ec6d1df)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:11.526095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:11.716740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0cb246f8c04c6fb2dd8a921ec6d1df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.768077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:11.772701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0cb246f8c04c6fb2dd8a921ec6d1df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.792873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0cb246f8c04c6fb2dd8a921ec6d1df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.796049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0cb246f8c04c6fb2dd8a921ec6d1df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.824183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dd74c21-d33f-4863-bb38-bb6015d7d3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0cb246f8c04c6fb2dd8a921ec6d1df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:11.853934 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3346/6691] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:14:11 2022] DELETE /identity/v3/users/4f0cb246f8c04c6fb2dd8a921ec6d1df => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:14.518562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:14.521753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:14.555063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a4ceb-02d2-4761-83dc-a8514659f998 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:14.914548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:14.918331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:14.918835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:14.919659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] PATH_INFO: `/v3/projects/c42bf669cc7740dabe5b2b9528963508` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:14.924907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42bf669cc7740dabe5b2b9528963508)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:14.931879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:15.172734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42bf669cc7740dabe5b2b9528963508', 'request_id': 'req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:15.213440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42bf669cc7740dabe5b2b9528963508', 'request_id': 'req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:15.332850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42bf669cc7740dabe5b2b9528963508', 'request_id': 'req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:15.392825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] The token cache is being invalidate because project c42bf669cc7740dabe5b2b9528963508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:14:15.393246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:15.397022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5820f758-2a7d-4cbf-a9db-e62c20d1ce3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:15.436656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3346/6692] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:14:14 2022] DELETE /identity/v3/projects/c42bf669cc7740dabe5b2b9528963508 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:15.439083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a10f3-403e-4ca7-9521-7e30910b1bd5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:15.439584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a10f3-403e-4ca7-9521-7e30910b1bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:15.439925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a10f3-403e-4ca7-9521-7e30910b1bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:15.507244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-929a10f3-403e-4ca7-9521-7e30910b1bd5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:15.514971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-929a10f3-403e-4ca7-9521-7e30910b1bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:15.802463 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3347/6693] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:15.803775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d8770-d791-47f4-beaa-12b4fb7614da None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:15.804473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d8770-d791-47f4-beaa-12b4fb7614da None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:15.804866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d8770-d791-47f4-beaa-12b4fb7614da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:15.881507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d68d8770-d791-47f4-beaa-12b4fb7614da None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:15.885463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d68d8770-d791-47f4-beaa-12b4fb7614da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:15.917992 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3347/6694] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:15.918139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a10f3-403e-4ca7-9521-7e30910b1bd5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:15.928086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a10f3-403e-4ca7-9521-7e30910b1bd5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:15.961251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:15.967871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:15.968653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:15.969681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:15.974253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:14:15.975124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:15.981717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:16.046948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3348/6695] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:14:16.051518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d8770-d791-47f4-beaa-12b4fb7614da None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:16.074059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d8770-d791-47f4-beaa-12b4fb7614da None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:16.092542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:16.093440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:16.093841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:16.094261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:16.095227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:16.097411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:16.206925 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3348/6696] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:14:16 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:16.211393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:16.230625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ee3c4-d782-45c6-968b-72b8c548a735 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:16.451021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:16.453014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:16.453426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:16.459830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:16.460758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:16.462980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:16.513172 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3349/6697] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:14:16 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:16.515345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:16.536608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8fc99-eb2a-4737-9bdc-5a6648c0f906 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:16.566925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:16.568009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:16.568301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:16.568633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:16.569422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:16.571249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:16.607490 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3349/6698] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:16.610997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:16.627957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b579-068a-4202-96df-20155c4f3e23 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:16.641008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35318ef5-a5c0-456c-967a-3aea1fbc4379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:16.641779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318ef5-a5c0-456c-967a-3aea1fbc4379 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:16.642073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318ef5-a5c0-456c-967a-3aea1fbc4379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:16.642373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318ef5-a5c0-456c-967a-3aea1fbc4379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:16.643203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35318ef5-a5c0-456c-967a-3aea1fbc4379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:16.644972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35318ef5-a5c0-456c-967a-3aea1fbc4379 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:16.681321 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3350/6699] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:16.686169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:16.704953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6d964-7cf7-4d96-aa92-a14e9834cb1d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:16.724155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:16.725133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:16.725425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:16.725705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] PATH_INFO: `/v3/projects/9ea581be9f364dbdb831774ca567fe33/users/038b18e0bcf94f22abcd2afba8744673/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:16.770790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea581be9f364dbdb831774ca567fe33, user_id=038b18e0bcf94f22abcd2afba8744673, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:16.771467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:16.811468 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3350/6700] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:14:16 2022] PUT /identity/v3/projects/9ea581be9f364dbdb831774ca567fe33/users/038b18e0bcf94f22abcd2afba8744673/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:16.813326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bdda-aa0b-41c6-a8fb-c09265e878a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:16.813682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bdda-aa0b-41c6-a8fb-c09265e878a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:16.814049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bdda-aa0b-41c6-a8fb-c09265e878a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:16.885498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-27d5bdda-aa0b-41c6-a8fb-c09265e878a2 None None] MFA Rules not processed for user `038b18e0bcf94f22abcd2afba8744673`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:16.887080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-27d5bdda-aa0b-41c6-a8fb-c09265e878a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:16.975040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:17.116723 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3351/6701] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:14:17.118024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:17.123536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:17.392861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fef33f-0eb8-412d-9c93-fb8741b46991 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:17.428941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:17.429663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:17.429986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:17.430272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:17.430983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:17.433165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:17.515987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3351/6702] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:14:17 2022] POST /identity/v3/projects => generated 377 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:17.519995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5bdda-aa0b-41c6-a8fb-c09265e878a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:17.541418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5bdda-aa0b-41c6-a8fb-c09265e878a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:17.699476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:17.700317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:17.700610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:17.700900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:17.701609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:17.707587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:17.779795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3352/6703] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:14:17 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:17.783626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:17.800247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261292f9-3702-4cf8-8a37-4832d718bc28 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:17.813827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:17.814786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:17.815516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:17.815763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:17.816597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:17.818710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:17.850588 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3352/6704] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:17.854831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:17.868493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a1232-7b4b-4b7c-9279-b0e0d506388c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:17.885548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:17.886595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:17.887438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:17.887730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] PATH_INFO: `/v3/projects/a92c5832f14445cdbe820c947f5bc2a2/users/1ed6cbbd72f4489fbe43f214ed2388be/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:17.933462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92c5832f14445cdbe820c947f5bc2a2, user_id=1ed6cbbd72f4489fbe43f214ed2388be, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:17.939632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:17.996494 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3353/6705] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:14:17 2022] PUT /identity/v3/projects/a92c5832f14445cdbe820c947f5bc2a2/users/1ed6cbbd72f4489fbe43f214ed2388be/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:18.000603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:18.033744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa86bdb-b0fb-4c44-8d60-cfb5449a18d0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:18.322813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268854-8ae3-492a-b059-94539b10229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:18.327294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268854-8ae3-492a-b059-94539b10229a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:18.327294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268854-8ae3-492a-b059-94539b10229a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:18.338607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268854-8ae3-492a-b059-94539b10229a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:18.343494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd268854-8ae3-492a-b059-94539b10229a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:18.354718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd268854-8ae3-492a-b059-94539b10229a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:18.410791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3353/6706] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:18.411709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:18.470302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98494aee-497f-4faa-8612-14bb1426805f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:18.492394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:18.498432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:18.498966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:18.499514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] PATH_INFO: `/v3/projects/a92c5832f14445cdbe820c947f5bc2a2/users/1ed6cbbd72f4489fbe43f214ed2388be/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:18.513137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92c5832f14445cdbe820c947f5bc2a2, user_id=1ed6cbbd72f4489fbe43f214ed2388be, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:18.516355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:18.564577 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3354/6707] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:14:18 2022] PUT /identity/v3/projects/a92c5832f14445cdbe820c947f5bc2a2/users/1ed6cbbd72f4489fbe43f214ed2388be/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:14:18.578041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c76e-6c29-475f-89e3-080bf93a085e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:18.578357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c76e-6c29-475f-89e3-080bf93a085e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:18.578575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c76e-6c29-475f-89e3-080bf93a085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:18.716206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-95f8c76e-6c29-475f-89e3-080bf93a085e None None] MFA Rules not processed for user `1ed6cbbd72f4489fbe43f214ed2388be`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:18.717454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-95f8c76e-6c29-475f-89e3-080bf93a085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:18.887441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:18.911625 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3354/6708] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:18.992847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:18.994622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:19.296681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c8a8a-d31d-47eb-908a-971959f8f300 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:19.316790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:19.317494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:19.317784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:19.318068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:19.473260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:19.515909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:19.517769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:19.537075 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3355/6709] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:22.896381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8c76e-6c29-475f-89e3-080bf93a085e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:22.912082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8c76e-6c29-475f-89e3-080bf93a085e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:22.934044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d56736-4644-4206-ad35-11448a04f832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:22.939096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d56736-4644-4206-ad35-11448a04f832 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:22.939427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d56736-4644-4206-ad35-11448a04f832 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:22.943996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d56736-4644-4206-ad35-11448a04f832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:22.977613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d56736-4644-4206-ad35-11448a04f832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:22.980470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d56736-4644-4206-ad35-11448a04f832 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:23.016635 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3355/6710] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:29.525044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:32.993251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:44.547765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:44.833329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471cb96-e634-44f4-b7a4-eb271212a7a2 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:44.859936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:44.862731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:44.863082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:44.864352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] PATH_INFO: `/v3/users/038b18e0bcf94f22abcd2afba8744673` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:44.873499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038b18e0bcf94f22abcd2afba8744673)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:44.878036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:45.063836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038b18e0bcf94f22abcd2afba8744673'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:45.095205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038b18e0bcf94f22abcd2afba8744673'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:45.123199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038b18e0bcf94f22abcd2afba8744673'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:45.123972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038b18e0bcf94f22abcd2afba8744673'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:45.137686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038b18e0bcf94f22abcd2afba8744673'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:45.149495 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3356/6711] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:14:44 2022] DELETE /identity/v3/users/038b18e0bcf94f22abcd2afba8744673 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:45.154963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:45.155795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:45.155795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:45.250050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:45.251338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:45.444017 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3356/6712] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:45.457124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:45.458707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:45.667908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35bad0-3b19-4601-a850-89673ccd1494 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:45.681755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:45.682459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:45.682753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:45.683669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:45.726301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:45.727837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:45.778546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3357/6713] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:45.938333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:45.940108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:45.963377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1241-e7d8-4a5b-b342-709057d6e495 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:45.980410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:45.981315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:45.981740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:45.982004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] PATH_INFO: `/v3/users/94ce161302f9413e9ea56f41dc4ad728` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:45.983480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ce161302f9413e9ea56f41dc4ad728)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:46.002911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:46.160807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ce161302f9413e9ea56f41dc4ad728'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:46.215335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ce161302f9413e9ea56f41dc4ad728'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:46.216527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ce161302f9413e9ea56f41dc4ad728'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:46.273695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ce161302f9413e9ea56f41dc4ad728'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:46.276207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ce161302f9413e9ea56f41dc4ad728'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:46.328359 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3357/6714] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:14:45 2022] DELETE /identity/v3/users/94ce161302f9413e9ea56f41dc4ad728 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:46.843075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:46.845124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:46.885575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924ddb-b3b3-41af-accf-6353cb0ba425 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:46.951144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:47.022670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:47.027244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:47.174016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:47.174864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:47.175152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:47.175464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] PATH_INFO: `/v3/projects/9ea581be9f364dbdb831774ca567fe33` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:47.192539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea581be9f364dbdb831774ca567fe33)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:47.194506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:47.361968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ea70-8929-44bd-813f-c517e47fd59f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:47.376241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea581be9f364dbdb831774ca567fe33', 'request_id': 'req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.398025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea581be9f364dbdb831774ca567fe33', 'request_id': 'req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.410594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:47.424205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea581be9f364dbdb831774ca567fe33', 'request_id': 'req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.483307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] The token cache is being invalidate because project 9ea581be9f364dbdb831774ca567fe33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:14:47.483602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.484337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.489570 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3358/6715] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:14:46 2022] DELETE /identity/v3/projects/9ea581be9f364dbdb831774ca567fe33 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:47.496343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:47.499865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:47.517229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:47.520477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:47.520939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:47.522515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] PATH_INFO: `/v3/projects/b0d773410b4f4f569ba3afa8661c17d8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:47.526174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d773410b4f4f569ba3afa8661c17d8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:47.534187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:47.681341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d773410b4f4f569ba3afa8661c17d8', 'request_id': 'req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.683247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130fc5-f6cc-4416-89b4-1318b6e6c35a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:47.708027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d773410b4f4f569ba3afa8661c17d8', 'request_id': 'req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.720582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d773410b4f4f569ba3afa8661c17d8', 'request_id': 'req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.738969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] The token cache is being invalidate because project b0d773410b4f4f569ba3afa8661c17d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:14:47.739394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.740357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6c92a91e-a4a3-47cb-a51b-97d1f941fd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:47.742149 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3358/6716] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:14:47 2022] DELETE /identity/v3/projects/b0d773410b4f4f569ba3afa8661c17d8 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:47.749794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17764-a91d-478b-8a1f-acfb669eeb09 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:47.750233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17764-a91d-478b-8a1f-acfb669eeb09 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:47.750629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17764-a91d-478b-8a1f-acfb669eeb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:47.893495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f3f17764-a91d-478b-8a1f-acfb669eeb09 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:47.895499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f3f17764-a91d-478b-8a1f-acfb669eeb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:47.899210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:47.900423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:47.900858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:47.901258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] PATH_INFO: `/v3/users/1ed6cbbd72f4489fbe43f214ed2388be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:47.903022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed6cbbd72f4489fbe43f214ed2388be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:47.906432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:47.908694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:47.921459 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3359/6717] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:47.935301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc3456-602a-470e-9b42-ab6dd702c14c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:47.935540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc3456-602a-470e-9b42-ab6dd702c14c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:47.935970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc3456-602a-470e-9b42-ab6dd702c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:48.016713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-20cc3456-602a-470e-9b42-ab6dd702c14c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:48.025963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20cc3456-602a-470e-9b42-ab6dd702c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:48.057226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed6cbbd72f4489fbe43f214ed2388be'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:48.068465 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3360/6718] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:48.070130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc3456-602a-470e-9b42-ab6dd702c14c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:48.122815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc3456-602a-470e-9b42-ab6dd702c14c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:48.128663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed6cbbd72f4489fbe43f214ed2388be'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:48.144922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:48.146803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:48.147873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:48.149061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:48.150399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:14:48.150935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:48.154060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed6cbbd72f4489fbe43f214ed2388be'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:48.154959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed6cbbd72f4489fbe43f214ed2388be'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:48.164387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:48.180789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed6cbbd72f4489fbe43f214ed2388be'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:48.211216 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3359/6719] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:14:47 2022] DELETE /identity/v3/users/1ed6cbbd72f4489fbe43f214ed2388be => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:48.211622 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3361/6720] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:14:48.213697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:48.215516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:48.339062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97cec-9531-4035-8c66-731a553addc9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:48.348498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:48.349368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:48.349767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:48.350193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:48.351056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:48.353633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:48.515210 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3360/6721] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:14:48 2022] POST /identity/v3/projects => generated 375 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:48.516110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:48.532302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbc119-3583-46ba-b4ce-452786b6ecdd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:48.720159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:48.720814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:48.721067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:48.721348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:48.722043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:48.724539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:48.781067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:48.817057 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3362/6722] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:14:48 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:48.818557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:48.852963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:48.854887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de85da-d39f-48ec-9e45-71f93336c772 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:48.856172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:48.877297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:48.878285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:48.878805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:48.879728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:48.880791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:48.882909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:48.890898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0970-203d-484b-ab0a-f5a24c1d74e2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:48.915000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:48.915965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:48.916258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:48.916675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] PATH_INFO: `/v3/projects/a92c5832f14445cdbe820c947f5bc2a2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:48.921978 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3361/6723] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:48.922526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92c5832f14445cdbe820c947f5bc2a2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:48.924164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:48.942414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:48.971375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fab9f-5540-4790-aaff-d5c3eb016576 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:48.993207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:48.994305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:48.994946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:48.995600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:48.996652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:49.000466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:49.048480 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3362/6724] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:49.050465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:49.083216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cff24-2fd1-41d2-88cd-7568d7a5fdbd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:49.095358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92c5832f14445cdbe820c947f5bc2a2', 'request_id': 'req-05978090-3807-4941-aea4-9839a5de3db8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:49.137704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92c5832f14445cdbe820c947f5bc2a2', 'request_id': 'req-05978090-3807-4941-aea4-9839a5de3db8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:49.149037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92c5832f14445cdbe820c947f5bc2a2', 'request_id': 'req-05978090-3807-4941-aea4-9839a5de3db8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:49.178640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] The token cache is being invalidate because project a92c5832f14445cdbe820c947f5bc2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:14:49.179041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:49.180099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05978090-3807-4941-aea4-9839a5de3db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:14:49.187096 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3363/6725] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:14:48 2022] DELETE /identity/v3/projects/a92c5832f14445cdbe820c947f5bc2a2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:14:49.192872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129519fb-5bad-4360-b18e-82ca33b3f83e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:49.193194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129519fb-5bad-4360-b18e-82ca33b3f83e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:49.193510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129519fb-5bad-4360-b18e-82ca33b3f83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:49.221461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-129519fb-5bad-4360-b18e-82ca33b3f83e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:49.222667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-129519fb-5bad-4360-b18e-82ca33b3f83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:49.270291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:49.334094 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3364/6726] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:14:49.345566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc70efd-327a-45af-8a37-6c0897e9894a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:49.349174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc70efd-327a-45af-8a37-6c0897e9894a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:49.350436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc70efd-327a-45af-8a37-6c0897e9894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:49.356716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:49.362191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:49.362559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:49.362869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] PATH_INFO: `/v3/projects/105c133485b84b21a9b029141b5053ad/users/83513b7f5185436b8ea320c025f673af/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:49.397104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7bc70efd-327a-45af-8a37-6c0897e9894a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:49.398266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7bc70efd-327a-45af-8a37-6c0897e9894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:49.404014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=105c133485b84b21a9b029141b5053ad, user_id=83513b7f5185436b8ea320c025f673af, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:49.407323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:49.438288 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3363/6727] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:14:49 2022] PUT /identity/v3/projects/105c133485b84b21a9b029141b5053ad/users/83513b7f5185436b8ea320c025f673af/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:49.438490 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3365/6728] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:49.438591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:49.441602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:49.450479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:49.451591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:49.522776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:49.530120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:49.623565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589a4ec-c74f-4bfc-ba74-172bd5de0ffd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:49.647211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:49.647965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:49.648255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:49.648541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:49.654924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:14:49.655411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:49.664765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:49.701316 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3364/6729] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:14:49.706267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:49.728678 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3366/6730] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:49.742021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6feb0-a623-4f09-b23d-5f2843f70ce8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:49.742660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:49.744307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:49.759972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:49.761837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:49.763578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:49.764147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:49.765387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:49.771036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:49.783921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:49.898395 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3365/6731] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:14:49 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:49.899015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904074-4703-49e9-a317-ff84fb333b43 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:49.902059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:50.194375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:50.196526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:50.198634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:50.198634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:50.220485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142261ef-2e08-4696-afdd-6e1e32cf9e7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:50.231234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:50.232109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:50.233811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:50.234147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:50.237971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:50.253027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:50.274185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:50.277129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:50.340639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3366/6732] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:14:49 2022] POST /identity/v3/users => generated 296 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:50.341822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:50.351703 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3367/6733] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:14:50.382457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48f7d6-e26e-4a90-b966-2030b431969a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:50.392533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:50.397497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:50.400164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:50.400727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:50.404130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:50.407364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:50.455230 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3367/6734] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:50.461114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:50.477076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860f90-28d9-4faf-ba1c-9ccdb1743e85 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:50.501462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a231-2040-48f4-9571-d89c6e6dad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:50.505626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a231-2040-48f4-9571-d89c6e6dad16 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:50.512735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a231-2040-48f4-9571-d89c6e6dad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:50.513609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a231-2040-48f4-9571-d89c6e6dad16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:50.514458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343a231-2040-48f4-9571-d89c6e6dad16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:50.522363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343a231-2040-48f4-9571-d89c6e6dad16 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:50.588023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:50.591050 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3368/6735] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:50.606473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a997412-375a-48f3-ad08-c92e8d63dac3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:50.617482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:50.623142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:50.623541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:50.623770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] PATH_INFO: `/v3/projects/e6ff4a0651ab4286b50f807ec047d843/users/2d1a73f8d40747f9810900bf292fa26c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:50.656930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:50.664204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ff4a0651ab4286b50f807ec047d843, user_id=2d1a73f8d40747f9810900bf292fa26c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:50.670718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:50.695568 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3368/6736] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:14:50 2022] PUT /identity/v3/projects/e6ff4a0651ab4286b50f807ec047d843/users/2d1a73f8d40747f9810900bf292fa26c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:14:50.723361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bfdd5-b255-483a-9208-1b7fb16d5d58 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:50.723875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bfdd5-b255-483a-9208-1b7fb16d5d58 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:50.728096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bfdd5-b255-483a-9208-1b7fb16d5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:50.889208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-299bfdd5-b255-483a-9208-1b7fb16d5d58 None None] MFA Rules not processed for user `2d1a73f8d40747f9810900bf292fa26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:50.898171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-299bfdd5-b255-483a-9208-1b7fb16d5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:51.374422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:51.451089 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3369/6737] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 730 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:14:51.459229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bfdd5-b255-483a-9208-1b7fb16d5d58 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:51.779410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ef3cd-bf4a-4f28-bb0b-18b9eaed8fd0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:51.838704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:51.845487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:51.850983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:51.856659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:51.860102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:51.884167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:51.888477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bfdd5-b255-483a-9208-1b7fb16d5d58 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:51.931517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:51.933469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:51.934019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:51.934494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:51.935921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:51.960980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:52.118228 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3370/6738] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:14:51 2022] POST /identity/v3/projects => generated 393 bytes in 660 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:52.125017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:52.408210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:52.429393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:52.472240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20af6-9688-4eac-8e66-3e82514c081a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:52.490160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:52.491890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:52.492169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:52.492452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:52.493481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:52.498099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:52.547510 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3369/6739] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 15:14:51 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3234 bytes in 1174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:14:52.717651 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3371/6740] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:14:52 2022] POST /identity/v3/users => generated 303 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:14:52.730469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:52.780424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f7dac-3c6a-4ba6-8dfe-051d3731be87 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:52.811793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:52.812512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:52.812802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:52.813083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:52.813856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:52.823350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:52.876096 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3370/6741] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:52.882696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:52.931242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131258c4-573b-43ac-9bda-c5b679654e31 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:52.974886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:52.991469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:52.991946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:52.992455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] PATH_INFO: `/v3/projects/edff9050e905409a843eeeb9c9eaf7b9/users/12e1798a23314d81ba58b04d133025b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:53.122444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] RBAC: Authorizing `identity:create_grant(project_id=edff9050e905409a843eeeb9c9eaf7b9, user_id=12e1798a23314d81ba58b04d133025b1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:53.136760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:53.225887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3372/6742] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:14:52 2022] PUT /identity/v3/projects/edff9050e905409a843eeeb9c9eaf7b9/users/12e1798a23314d81ba58b04d133025b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:53.230313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:53.317554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5dc3-ff70-4a46-aeb1-c93538363508 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:53.685503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e4bc5-b7af-4757-9069-142318250363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:53.686631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4bc5-b7af-4757-9069-142318250363 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:53.692142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4bc5-b7af-4757-9069-142318250363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:53.702314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4bc5-b7af-4757-9069-142318250363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:53.704207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e4bc5-b7af-4757-9069-142318250363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:53.707318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e4bc5-b7af-4757-9069-142318250363 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:53.776457 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3371/6743] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:14:53.782140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:53.858949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea7c92-b8d4-455d-9ada-b3500518652c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:53.881074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:53.888266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:53.889126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:53.889293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] PATH_INFO: `/v3/projects/edff9050e905409a843eeeb9c9eaf7b9/users/12e1798a23314d81ba58b04d133025b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:53.914680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edff9050e905409a843eeeb9c9eaf7b9, user_id=12e1798a23314d81ba58b04d133025b1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:53.936018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:53.991451 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3373/6744] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:14:53 2022] PUT /identity/v3/projects/edff9050e905409a843eeeb9c9eaf7b9/users/12e1798a23314d81ba58b04d133025b1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:14:53.993905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0f05-00d1-42b7-98bc-505dbb292341 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:53.994387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0f05-00d1-42b7-98bc-505dbb292341 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:53.994885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0f05-00d1-42b7-98bc-505dbb292341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:54.202689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a9ea0f05-00d1-42b7-98bc-505dbb292341 None None] MFA Rules not processed for user `12e1798a23314d81ba58b04d133025b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:14:54.204038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9ea0f05-00d1-42b7-98bc-505dbb292341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:54.382659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:54.704874 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3372/6745] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:14:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 713 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:14:54.719587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:54.721884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:54.948352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120dc9c-a423-4792-8048-2b7dd3cd8d49 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:54.992969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:54.993582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:54.993886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:54.994154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:55.037824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:55.039344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:55.098090 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3374/6746] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:55.207676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0f05-00d1-42b7-98bc-505dbb292341 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:55.258844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0f05-00d1-42b7-98bc-505dbb292341 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:55.285658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:55.290279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:55.294228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:55.295124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:55.520632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:55.522572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:55.535420 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3373/6747] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:14:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:14:57.072259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:14:57.074739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:57.171611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:57.271599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ef5f-2a08-4654-a1b2-d78a4b82af64 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:14:57.301244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60fca-e255-437f-878a-a72ea0d43297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:14:57.301949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60fca-e255-437f-878a-a72ea0d43297 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:14:57.302245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60fca-e255-437f-878a-a72ea0d43297 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:14:57.302536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60fca-e255-437f-878a-a72ea0d43297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:14:57.304664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a0e60fca-e255-437f-878a-a72ea0d43297 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:14:57.449360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e60fca-e255-437f-878a-a72ea0d43297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:14:57.454569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e60fca-e255-437f-878a-a72ea0d43297 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:14:57.486605 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3375/6748] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:14:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:05.529848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=48 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:06.330101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:06.332404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:06.603366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8034-e442-4a86-b51f-432c31a286e8 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:06.610540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b7dfa-f4c1-411f-b2e6-bb6715d7e659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:06.612137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7dfa-f4c1-411f-b2e6-bb6715d7e659 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:06.615953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7dfa-f4c1-411f-b2e6-bb6715d7e659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:06.616694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7dfa-f4c1-411f-b2e6-bb6715d7e659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:06.621718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb9b7dfa-f4c1-411f-b2e6-bb6715d7e659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:06.931413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b7dfa-f4c1-411f-b2e6-bb6715d7e659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:06.933306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b7dfa-f4c1-411f-b2e6-bb6715d7e659 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:06.968154 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3374/6749] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:07.466524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=39 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:10.988285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:10.988848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:10.989287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:11.130092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] MFA Rules not processed for user `83513b7f5185436b8ea320c025f673af`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:11.132109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:11.491770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3376/6750] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:11.501652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8e1f-df4c-4396-af75-e7c260f0c822 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:11.502410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8e1f-df4c-4396-af75-e7c260f0c822 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:11.502569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8e1f-df4c-4396-af75-e7c260f0c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:11.604194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3fce8e1f-df4c-4396-af75-e7c260f0c822 None None] MFA Rules not processed for user `83513b7f5185436b8ea320c025f673af`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:11.613322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3fce8e1f-df4c-4396-af75-e7c260f0c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:11.677252 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3375/6751] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:15:11.688323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:11.694372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:12.157765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eeb46-58b5-4c25-b200-33a872e96974 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:12.188305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62746e-a2e2-4be8-a03f-a1c543761d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:12.189480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62746e-a2e2-4be8-a03f-a1c543761d4a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:12.190240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62746e-a2e2-4be8-a03f-a1c543761d4a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:12.190723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62746e-a2e2-4be8-a03f-a1c543761d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:12.273161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62746e-a2e2-4be8-a03f-a1c543761d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:12.287552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62746e-a2e2-4be8-a03f-a1c543761d4a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:12.355023 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3377/6752] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:13.404006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce8e1f-df4c-4396-af75-e7c260f0c822 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:13.481932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce8e1f-df4c-4396-af75-e7c260f0c822 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:13.532980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:13.533886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:13.534181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:13.534464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] PATH_INFO: `/v3/users/2d1a73f8d40747f9810900bf292fa26c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:13.557989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1a73f8d40747f9810900bf292fa26c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:13.560115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:13.720176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1a73f8d40747f9810900bf292fa26c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:13.811884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1a73f8d40747f9810900bf292fa26c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:13.894440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1a73f8d40747f9810900bf292fa26c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:13.905207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1a73f8d40747f9810900bf292fa26c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:13.939239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1a73f8d40747f9810900bf292fa26c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:13.987122 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3376/6753] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:13 2022] DELETE /identity/v3/users/2d1a73f8d40747f9810900bf292fa26c => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:13.991900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:13.992766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:13.992766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:14.086140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:14.088090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:14.468195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:14.470754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:14.477767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3378/6754] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:14.491383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:14.501209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:14.532714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:14.562957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:14.762302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db84a-881a-4dde-a1d5-9fb753a09483 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:14.781467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:14.785426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:14.786908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:14.787215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:14.795582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:14.820748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b9d46-7260-40e7-bd10-91aeb190d480 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:14.834408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:14.841813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:14.842348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:14.843366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:14.845209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:14.851709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:14.909314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:14.923659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:14.939158 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3377/6755] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:14.958919 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3379/6756] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:17.866839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:17.868352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:17.929659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e28f6-8f3f-4b2d-9c18-7d119455f69f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:17.950447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:17.953692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:17.958988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:17.959574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] PATH_INFO: `/v3/projects/e6ff4a0651ab4286b50f807ec047d843` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:17.968448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ff4a0651ab4286b50f807ec047d843)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:17.974414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:18.289536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ff4a0651ab4286b50f807ec047d843', 'request_id': 'req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:18.314440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ff4a0651ab4286b50f807ec047d843', 'request_id': 'req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:18.343108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ff4a0651ab4286b50f807ec047d843', 'request_id': 'req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:18.370232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] The token cache is being invalidate because project e6ff4a0651ab4286b50f807ec047d843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:18.370662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:18.377000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:18.379632 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3378/6757] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:17 2022] DELETE /identity/v3/projects/e6ff4a0651ab4286b50f807ec047d843 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:18.386074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:18.426213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90420a-c1fd-422f-99e7-df645806678b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:18.784271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:18.786193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:18.796916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:18.797544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] PATH_INFO: `/v3/users/12e1798a23314d81ba58b04d133025b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:18.799844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e1798a23314d81ba58b04d133025b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:18.802904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:19.012756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e1798a23314d81ba58b04d133025b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:19.065521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e1798a23314d81ba58b04d133025b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:19.067534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e1798a23314d81ba58b04d133025b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:19.098119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e1798a23314d81ba58b04d133025b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:19.101911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84d27b8f-497a-4151-90bf-912b53571038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e1798a23314d81ba58b04d133025b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:19.162335 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3380/6758] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:18 2022] DELETE /identity/v3/users/12e1798a23314d81ba58b04d133025b1 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:22.161301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:22.162794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:22.191418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350e38-9b6c-4d4b-8a28-f2f0f1a250ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:22.379235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:22.386306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:22.391482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:22.392075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] PATH_INFO: `/v3/projects/edff9050e905409a843eeeb9c9eaf7b9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:22.402206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edff9050e905409a843eeeb9c9eaf7b9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:22.417366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:22.620373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:22.654643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edff9050e905409a843eeeb9c9eaf7b9', 'request_id': 'req-9117f7d6-35e0-4f98-8859-a96015c2d977'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:22.688602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edff9050e905409a843eeeb9c9eaf7b9', 'request_id': 'req-9117f7d6-35e0-4f98-8859-a96015c2d977'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:22.723880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edff9050e905409a843eeeb9c9eaf7b9', 'request_id': 'req-9117f7d6-35e0-4f98-8859-a96015c2d977'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:22.764872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] The token cache is being invalidate because project edff9050e905409a843eeeb9c9eaf7b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:22.769155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:22.783988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9117f7d6-35e0-4f98-8859-a96015c2d977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:22.794408 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3379/6759] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:22 2022] DELETE /identity/v3/projects/edff9050e905409a843eeeb9c9eaf7b9 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:22.803110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2eae0-03d0-4607-b0a4-c4d91dc76dbc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:22.803702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2eae0-03d0-4607-b0a4-c4d91dc76dbc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:22.803787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2eae0-03d0-4607-b0a4-c4d91dc76dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:22.894284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-23e2eae0-03d0-4607-b0a4-c4d91dc76dbc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:22.901728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-23e2eae0-03d0-4607-b0a4-c4d91dc76dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:22.980312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:23.101044 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3381/6760] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:23.113242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408409b0-8688-488b-a27f-823192f60c63 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:23.113781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408409b0-8688-488b-a27f-823192f60c63 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:23.114216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408409b0-8688-488b-a27f-823192f60c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:23.185819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-408409b0-8688-488b-a27f-823192f60c63 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:23.195112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-408409b0-8688-488b-a27f-823192f60c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:23.252556 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3380/6761] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:15:23.258780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2eae0-03d0-4607-b0a4-c4d91dc76dbc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:23.284059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2eae0-03d0-4607-b0a4-c4d91dc76dbc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:23.311110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:23.312018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:23.314148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:23.315177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:23.319173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:23.323725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:23.328730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:23.357763 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3382/6762] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:23.364451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408409b0-8688-488b-a27f-823192f60c63 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:23.375633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408409b0-8688-488b-a27f-823192f60c63 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:23.403459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:23.404647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:23.405367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:23.405984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:23.406851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:23.414416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:23.538963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:23.543478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:23.580300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023d9d-c57f-4664-94dc-d16a07007094 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:23.594088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:23.595015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:23.610225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:23.610638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] PATH_INFO: `/v3/users/ef0565f08c444052b98b007d344ea2ba` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:23.612342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0565f08c444052b98b007d344ea2ba)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:23.620983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:23.627344 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3381/6763] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:23 2022] POST /identity/v3/projects => generated 401 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:15:23.629010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:23.801021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0565f08c444052b98b007d344ea2ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:23.862561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0565f08c444052b98b007d344ea2ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:23.867796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0565f08c444052b98b007d344ea2ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:23.903930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0565f08c444052b98b007d344ea2ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:23.905289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0565f08c444052b98b007d344ea2ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:23.913791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744184-d56f-4c7f-b681-82f0341d69c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:23.949217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:23.957699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:23.957699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:23.957699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:23.964287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:23.972514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:24.012835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3383/6764] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:23 2022] DELETE /identity/v3/users/ef0565f08c444052b98b007d344ea2ba => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:24.043836 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3382/6765] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:23 2022] POST /identity/v3/users => generated 301 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:24.049320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:24.050906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:24.221444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ac39-6ebe-4dd0-b5c6-03c05eff8679 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:24.231532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:24.232795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:24.233299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:24.234066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:24.235661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:24.251806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:24.325601 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3384/6766] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:24.329820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:24.346983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495218-1bef-466b-ba2c-6390d1306d00 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:24.359463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206964f-a4a1-4bfe-b04d-68117e802f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:24.361221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206964f-a4a1-4bfe-b04d-68117e802f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:24.361964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206964f-a4a1-4bfe-b04d-68117e802f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:24.363824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206964f-a4a1-4bfe-b04d-68117e802f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:24.367184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206964f-a4a1-4bfe-b04d-68117e802f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:24.371679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206964f-a4a1-4bfe-b04d-68117e802f0a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:24.403924 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3383/6767] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:24.408059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:24.434774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632546-44b3-4604-8c6c-231d8a147baf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:24.457804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:24.460294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:24.464416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:24.465277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] PATH_INFO: `/v3/projects/a694fd255f9d47ad9ff5444965f0a7c4/users/546172617b5b4d38a413be3c823e445f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:24.541930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a694fd255f9d47ad9ff5444965f0a7c4, user_id=546172617b5b4d38a413be3c823e445f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:24.565911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:24.596898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:24.604745 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3385/6768] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:24 2022] PUT /identity/v3/projects/a694fd255f9d47ad9ff5444965f0a7c4/users/546172617b5b4d38a413be3c823e445f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:24.616635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d349-8e9d-43bf-8a0a-862238095add None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:24.616935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d349-8e9d-43bf-8a0a-862238095add None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:24.617462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102d349-8e9d-43bf-8a0a-862238095add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:24.722705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d102d349-8e9d-43bf-8a0a-862238095add None None] MFA Rules not processed for user `546172617b5b4d38a413be3c823e445f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:24.724128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d102d349-8e9d-43bf-8a0a-862238095add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:24.873728 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3384/6769] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:15:24.874998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:25.060810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34ddb8-84e9-45d5-b4b5-fe8b484d81a2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:25.076571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:25.077494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:25.077873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:25.078394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:25.079360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:25.081583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:25.131913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3386/6770] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:24 2022] POST /identity/v3/projects => generated 401 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:25.136225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d349-8e9d-43bf-8a0a-862238095add None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:25.145104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:25.161546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102d349-8e9d-43bf-8a0a-862238095add None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:25.415125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:25.418414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:25.418973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:25.421208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:25.422441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:25.428711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:25.522857 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3385/6771] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:25 2022] POST /identity/v3/users => generated 307 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:25.524664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:25.543771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd9bf-ffa0-4249-afe8-04a2059f104f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:25.560607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:25.561353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:25.561649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:25.564306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:25.567435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:25.569372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:25.610682 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3387/6772] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:25.614521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:25.631048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32daf5d3-2bc3-4901-9219-567c64c0dae1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:25.638224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:25.639704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:25.640187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:25.640646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] PATH_INFO: `/v3/projects/2307e08b5455446d8a8a664e95682b73/users/47f3d5e056b04555a6f1bd20c3806f83/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:25.695697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:25.697578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:25.712108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2307e08b5455446d8a8a664e95682b73, user_id=47f3d5e056b04555a6f1bd20c3806f83, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:25.720961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:25.725159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad87ef-44f4-4afe-8a54-37839291e5d9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:25.746198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:25.750939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:25.751328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:25.754355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] PATH_INFO: `/v3/projects/cc957622784843ba912f59ce75aee2a7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:25.758220 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3386/6773] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:25 2022] PUT /identity/v3/projects/2307e08b5455446d8a8a664e95682b73/users/47f3d5e056b04555a6f1bd20c3806f83/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:25.763200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:25.763362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc957622784843ba912f59ce75aee2a7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:25.774817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:25.892906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc957622784843ba912f59ce75aee2a7', 'request_id': 'req-d02ee963-2450-4224-890e-f92abc036fc8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:25.916097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc957622784843ba912f59ce75aee2a7', 'request_id': 'req-d02ee963-2450-4224-890e-f92abc036fc8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:25.952822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc957622784843ba912f59ce75aee2a7', 'request_id': 'req-d02ee963-2450-4224-890e-f92abc036fc8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:25.967174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ce785-4ac4-4770-9734-ff5edfd3b902 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:25.974094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] The token cache is being invalidate because project cc957622784843ba912f59ce75aee2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:25.976770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:25.980199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:25.987115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3388/6774] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:25 2022] DELETE /identity/v3/projects/cc957622784843ba912f59ce75aee2a7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:25.990072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:25.995528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:26.158042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:26.160130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:26.160671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:26.161162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:26.162067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:26.166316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:26.209395 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3387/6775] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:15:26.210983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:26.217434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:26.225739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:26.252478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ee963-2450-4224-890e-f92abc036fc8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:26.265698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:26.266853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:26.267316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a9ae-a14b-49bc-8d4c-fd47ca8db150 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:26.267752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:26.268862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] PATH_INFO: `/v3/users/7ea1e9fa9d664ac5b4ae91d9acbbc005` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:26.272150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea1e9fa9d664ac5b4ae91d9acbbc005)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:26.276593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:26.282096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aec5d-56fb-43c0-97a6-105c62b3b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:26.284989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aec5d-56fb-43c0-97a6-105c62b3b558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:26.285679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aec5d-56fb-43c0-97a6-105c62b3b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:26.287035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aec5d-56fb-43c0-97a6-105c62b3b558 admin admin] PATH_INFO: `/v3/projects/2307e08b5455446d8a8a664e95682b73/users/47f3d5e056b04555a6f1bd20c3806f83/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:26.293656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aec5d-56fb-43c0-97a6-105c62b3b558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2307e08b5455446d8a8a664e95682b73, user_id=47f3d5e056b04555a6f1bd20c3806f83, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:26.301021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aec5d-56fb-43c0-97a6-105c62b3b558 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:26.315471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:26.334109 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3388/6776] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:26 2022] PUT /identity/v3/projects/2307e08b5455446d8a8a664e95682b73/users/47f3d5e056b04555a6f1bd20c3806f83/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:26.357097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:26.357811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:26.358379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:26.504452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea1e9fa9d664ac5b4ae91d9acbbc005'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:26.605976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] MFA Rules not processed for user `47f3d5e056b04555a6f1bd20c3806f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:26.620991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:26.626111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea1e9fa9d664ac5b4ae91d9acbbc005'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:26.630444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea1e9fa9d664ac5b4ae91d9acbbc005'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:26.671569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea1e9fa9d664ac5b4ae91d9acbbc005'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:26.672390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea1e9fa9d664ac5b4ae91d9acbbc005'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:26.702221 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3389/6777] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:25 2022] DELETE /identity/v3/users/7ea1e9fa9d664ac5b4ae91d9acbbc005 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:26.958335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3389/6778] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 603 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:15:26.973484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:26.988878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:27.091825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:27.093519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:27.269370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086b1c-c216-4222-8b2d-c8420e1ced42 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:27.284178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:27.285165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:27.285600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:27.286398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:27.333615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944d0e9-b2cf-41fe-aba4-6dc6c27bb077 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:27.567624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:27.569109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:27.569680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:27.570440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] PATH_INFO: `/v3/projects/38223cb92dab4a3a95ac3a448717acfa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:27.578668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38223cb92dab4a3a95ac3a448717acfa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:27.594166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:27.597619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:27.603473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:27.666401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3390/6779] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:27.690584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:27.692952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:27.749795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55fd5-d264-40b3-b73e-1d960ebfe999 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:27.793797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:27.805291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:27.809210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:27.812216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] PATH_INFO: `/v3/users/ed79aa2ea715471bb970282c9e8dfd7d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:27.820767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed79aa2ea715471bb970282c9e8dfd7d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:27.823560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:27.828101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:27.922569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38223cb92dab4a3a95ac3a448717acfa', 'request_id': 'req-123a9f8e-4724-4b14-bb0b-083e4fd59b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:27.954932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38223cb92dab4a3a95ac3a448717acfa', 'request_id': 'req-123a9f8e-4724-4b14-bb0b-083e4fd59b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:27.976992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:27.987108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38223cb92dab4a3a95ac3a448717acfa', 'request_id': 'req-123a9f8e-4724-4b14-bb0b-083e4fd59b13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.051130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] The token cache is being invalidate because project 38223cb92dab4a3a95ac3a448717acfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:28.051905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.053725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.058967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3390/6780] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:27 2022] DELETE /identity/v3/projects/38223cb92dab4a3a95ac3a448717acfa => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:28.060366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:28.065924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:28.090881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed79aa2ea715471bb970282c9e8dfd7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.136766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed79aa2ea715471bb970282c9e8dfd7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.140022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed79aa2ea715471bb970282c9e8dfd7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.187042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed79aa2ea715471bb970282c9e8dfd7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.189153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3b3ef7d1-9213-420e-9ed1-44c13d094445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed79aa2ea715471bb970282c9e8dfd7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:28.246708 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3391/6781] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:27 2022] DELETE /identity/v3/users/ed79aa2ea715471bb970282c9e8dfd7d => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:28.279498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:28.280019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:28.280526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:28.399716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:28.408362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:28.462657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9f8e-4724-4b14-bb0b-083e4fd59b13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:28.751216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8275ea-b194-4092-94c5-4885c72f4fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:28.752886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8275ea-b194-4092-94c5-4885c72f4fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:28.753255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8275ea-b194-4092-94c5-4885c72f4fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:28.753569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8275ea-b194-4092-94c5-4885c72f4fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:28.764324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb8275ea-b194-4092-94c5-4885c72f4fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:28.847705 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3392/6782] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 601 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:28.849169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:28.858339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:28.984853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8275ea-b194-4092-94c5-4885c72f4fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:28.993478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8275ea-b194-4092-94c5-4885c72f4fd5 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:29.056609 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3391/6783] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 997 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:29.071354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:29.075027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:29.075820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:29.161095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:29.165272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:29.176906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808a3c-9fcf-4617-9214-3e08219e7fe4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:29.202246 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3392/6784] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:29.205161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:29.219454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:29.226093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd88ff1-b174-470e-b98b-8b0a50bc1f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:29.226997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd88ff1-b174-470e-b98b-8b0a50bc1f1f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:29.227325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd88ff1-b174-470e-b98b-8b0a50bc1f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:29.227654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd88ff1-b174-470e-b98b-8b0a50bc1f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:29.248991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dfd88ff1-b174-470e-b98b-8b0a50bc1f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:29.286853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec996d9-4393-4fb8-ac3c-58d36b7f875c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:29.305146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:29.306103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:29.306435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:29.306681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] PATH_INFO: `/v3/projects/a800489ef5a24105b8f9eaee334937c1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:29.309311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a800489ef5a24105b8f9eaee334937c1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:29.319177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:29.403772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:29.472557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:29.540780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a800489ef5a24105b8f9eaee334937c1', 'request_id': 'req-37525d09-c18b-4420-84bd-c7eae2afccf0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:29.562591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a800489ef5a24105b8f9eaee334937c1', 'request_id': 'req-37525d09-c18b-4420-84bd-c7eae2afccf0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:29.586232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd88ff1-b174-470e-b98b-8b0a50bc1f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:29.587635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a800489ef5a24105b8f9eaee334937c1', 'request_id': 'req-37525d09-c18b-4420-84bd-c7eae2afccf0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:29.590073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd88ff1-b174-470e-b98b-8b0a50bc1f1f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:29.637029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] The token cache is being invalidate because project a800489ef5a24105b8f9eaee334937c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:29.657039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:29.663863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:29.673431 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3393/6785] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:29 2022] DELETE /identity/v3/projects/a800489ef5a24105b8f9eaee334937c1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:29.676326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:29.678834 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3393/6786] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 830 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:29.680628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f2fb-3335-4ab4-89d0-2489b5e7e4a4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:29.682928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:29.685393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f2fb-3335-4ab4-89d0-2489b5e7e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:29.687505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f2fb-3335-4ab4-89d0-2489b5e7e4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:29.781748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5057f2fb-3335-4ab4-89d0-2489b5e7e4a4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:29.783090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5057f2fb-3335-4ab4-89d0-2489b5e7e4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:29.876109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525d09-c18b-4420-84bd-c7eae2afccf0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:29.893229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:29.894276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:29.895119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:29.895620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:29.896615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:29.900037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:29.902268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:29.941013 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3394/6787] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:29.945563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:29.973021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac3ac-b405-40a7-ba2a-737b7351ad3c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:29.978694 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3394/6788] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:29.987614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91101995-1705-454b-9495-40b19cded314 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:29.987912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91101995-1705-454b-9495-40b19cded314 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:29.988216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:29.988922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91101995-1705-454b-9495-40b19cded314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:29.989188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:29.989602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:29.990088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:29.991104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:30.002762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:30.073777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-91101995-1705-454b-9495-40b19cded314 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:30.075264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-91101995-1705-454b-9495-40b19cded314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:30.111997 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3395/6789] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:29 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:15:30.113276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:30.141244 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3395/6790] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:30.145312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91101995-1705-454b-9495-40b19cded314 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:30.182664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91101995-1705-454b-9495-40b19cded314 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:30.445012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:30.445999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:30.446484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:30.446933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:30.450380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:30.451525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:30.453500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:30.494315 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3396/6791] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:30.500924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:30.518882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be36ad-8af4-4a9a-925c-83c88ec50fa4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:30.532095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:30.533098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:30.533516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:30.533909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:30.534821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:30.537064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:30.616124 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3397/6792] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:30 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:30.617362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:30.623136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89963d-22dc-4069-a9ae-359434aa5f6a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:30.748332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:30.858250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:30.893002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:30.893924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:30.894345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:30.894746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:30.895641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:30.897836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:30.936335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d48c98-93a9-4fb8-a306-7a07303790f5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:30.958523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:30.959912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:30.960440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:30.960956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:30.962337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:30.974727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:30.981612 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3396/6793] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:30 2022] POST /identity/v3/users => generated 289 bytes in 869 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:30.987364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.013075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa818d4-7c22-44b3-aa67-614e2274bbd7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:31.028136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:31.029179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.029582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.029940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.033710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:31.037273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:31.068486 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3397/6794] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:15:31.073409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3398/6795] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:30 2022] POST /identity/v3/users => generated 295 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:31.074774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.085072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.102672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d95a6-3cb3-4b6e-8216-41228e870c5e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:31.128377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:31.129539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.130393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.131188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.138551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:31.140677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:31.163552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004bfd-3c75-4d38-9241-39a004208595 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:31.200708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:31.201434 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3398/6796] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:31.201963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.202528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.203001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.203295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.204587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:31.229022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:31.242180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d0ff-501d-4804-8974-1864c0363fe5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:31.265768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cbdcd-dc9f-46c4-8ccc-098444d847b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:31.267024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cbdcd-dc9f-46c4-8ccc-098444d847b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.267420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cbdcd-dc9f-46c4-8ccc-098444d847b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.267779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cbdcd-dc9f-46c4-8ccc-098444d847b8 admin admin] PATH_INFO: `/v3/projects/146bd89a1d554414837d4f9a6903cc7a/users/8f7149cc14e94b27ac5dafa78458ab12/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.310918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cbdcd-dc9f-46c4-8ccc-098444d847b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146bd89a1d554414837d4f9a6903cc7a, user_id=8f7149cc14e94b27ac5dafa78458ab12, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:31.312805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cbdcd-dc9f-46c4-8ccc-098444d847b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:31.321913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3399/6797] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:31.333067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.355589 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3399/6798] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:31 2022] PUT /identity/v3/projects/146bd89a1d554414837d4f9a6903cc7a/users/8f7149cc14e94b27ac5dafa78458ab12/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:31.365743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.366046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.366496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.375431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c13b84-1005-4582-b789-493a4c60f9d0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:31.426514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] MFA Rules not processed for user `8f7149cc14e94b27ac5dafa78458ab12`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:31.429478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:31.657987 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3400/6799] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:15:31.663209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:31.664452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.664941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.665415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.667298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:31.671950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.674491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:31.693554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:31.752888 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3400/6800] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:31.754501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.810687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4048cf-f381-4a65-af06-1bb9a57e3c83 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:31.831704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38e280-fd92-4ec7-82fd-5179730e05c8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:31.840201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc828e-6576-4b94-8470-e5f8d58a6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:31.841649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc828e-6576-4b94-8470-e5f8d58a6474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.842078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc828e-6576-4b94-8470-e5f8d58a6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.842500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc828e-6576-4b94-8470-e5f8d58a6474 admin admin] PATH_INFO: `/v3/projects/4600d4f1b07743c1a1c1234b6e83439c/users/e068bf2146964aee8918f0ab3036626d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.843779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:31.844976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.845863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.846398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:31.874358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:31.879055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:31.901704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc828e-6576-4b94-8470-e5f8d58a6474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4600d4f1b07743c1a1c1234b6e83439c, user_id=e068bf2146964aee8918f0ab3036626d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:31.907935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc828e-6576-4b94-8470-e5f8d58a6474 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:31.926377 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3401/6801] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:31.927390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:31.931365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:31.951866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:31.957444 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3401/6802] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:31 2022] PUT /identity/v3/projects/4600d4f1b07743c1a1c1234b6e83439c/users/e068bf2146964aee8918f0ab3036626d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:31.968976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47b802-05da-4fef-aeed-e31f7db07ea4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:31.969938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47b802-05da-4fef-aeed-e31f7db07ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:31.970679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47b802-05da-4fef-aeed-e31f7db07ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:32.065788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0e47b802-05da-4fef-aeed-e31f7db07ea4 None None] MFA Rules not processed for user `e068bf2146964aee8918f0ab3036626d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:32.067857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0e47b802-05da-4fef-aeed-e31f7db07ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:32.169112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec090d4b-7935-46c0-b6d3-ed0a9e677fac service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:32.384477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:32.386008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:32.386219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:32.386684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:32.398145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:32.439336 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3402/6803] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:32.441311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47b802-05da-4fef-aeed-e31f7db07ea4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:32.565019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:32.751823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47b802-05da-4fef-aeed-e31f7db07ea4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:32.774467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:32.779235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:32.779888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:32.780408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:32.786285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:32.824638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:32.907469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:32.915395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:32.954417 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3403/6804] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:32 2022] POST /identity/v3/projects => generated 391 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:32.959086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:33.004215 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3402/6805] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 1077 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:33.113243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e647e-7222-4e30-af9c-fc65d2a39abd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:33.129421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:33.130156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:33.130450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:33.130743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:33.131509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:33.135731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:33.193702 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3404/6806] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:32 2022] POST /identity/v3/users => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:33.199037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:33.219019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250d8a2-d045-4b3b-a787-b5bee5b84f51 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:33.279069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:33.285547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:33.285979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:33.286166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:33.287074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:33.290472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:33.318540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3403/6807] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:33.322998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:33.344762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a9aa8-1989-4588-b404-45aef16c11be admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:33.365262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:33.366198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:33.366495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:33.366781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] PATH_INFO: `/v3/projects/f9dc0e26d82c4aa98de8eaaf265908fc/users/239460848c6644bab6389047c64910de/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:33.426845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dc0e26d82c4aa98de8eaaf265908fc, user_id=239460848c6644bab6389047c64910de, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:33.442840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:33.479042 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3405/6808] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:33 2022] PUT /identity/v3/projects/f9dc0e26d82c4aa98de8eaaf265908fc/users/239460848c6644bab6389047c64910de/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:33.484481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:33.501846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04e4be-5d9e-4c1a-be29-3a866c0f50fa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:33.670726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:33.703138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb478ec-66aa-449c-b467-acd475edda6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:33.704005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb478ec-66aa-449c-b467-acd475edda6c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:33.704367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb478ec-66aa-449c-b467-acd475edda6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:33.704730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb478ec-66aa-449c-b467-acd475edda6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:33.705563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb478ec-66aa-449c-b467-acd475edda6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:33.707366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb478ec-66aa-449c-b467-acd475edda6c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:33.737572 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3404/6809] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:33.741420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:33.764469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8395-8555-4337-87b2-3f5809ee7298 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:33.769891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:33.771522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:33.771994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:33.773100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] PATH_INFO: `/v3/projects/f9dc0e26d82c4aa98de8eaaf265908fc/users/239460848c6644bab6389047c64910de/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:33.778424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dc0e26d82c4aa98de8eaaf265908fc, user_id=239460848c6644bab6389047c64910de, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:33.788536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:33.830525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3406/6810] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:33 2022] PUT /identity/v3/projects/f9dc0e26d82c4aa98de8eaaf265908fc/users/239460848c6644bab6389047c64910de/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:33.834335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a611-8127-40f4-96bd-d8d7f345c18e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:33.840501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a611-8127-40f4-96bd-d8d7f345c18e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:33.840501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a611-8127-40f4-96bd-d8d7f345c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:33.908538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5ac8a611-8127-40f4-96bd-d8d7f345c18e None None] MFA Rules not processed for user `239460848c6644bab6389047c64910de`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:33.909939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ac8a611-8127-40f4-96bd-d8d7f345c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:34.126656 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3405/6811] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:34.131547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:34.163380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff331f-3114-43d1-af8a-e48f964af95d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:34.200682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:34.201996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:34.202856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:34.203413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:34.204409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:34.213310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:34.284018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8a611-8127-40f4-96bd-d8d7f345c18e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:34.288803 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3407/6812] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:15:34 2022] POST /identity/v3/domains => generated 277 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:34.296337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8a611-8127-40f4-96bd-d8d7f345c18e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:34.558869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:34.559860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:34.561812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:34.564804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:34.567062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:34.571247 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:34.571247 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:34.571247 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:34.576319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:34.759590 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3406/6813] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:15:34 2022] PUT /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config => generated 138 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:34.761070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:34.784737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8d84f-b4e0-4b77-8414-68e3dc1ea93e tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:34.819707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:34.833812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:34.834384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:34.834797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:34.843133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29, group=identity)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:34.848273 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:34.848273 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:34.848273 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:34.872625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:34.957398 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3408/6814] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:15:34 2022] GET /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/identity => generated 45 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 14 15:15:34.962128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:35.086086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9de73-2212-4046-93db-3697bb76cbc0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:35.109487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:35.115181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:35.116861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:35.117891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/identity/driver` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:35.125246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29, group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:35.126161 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:35.126161 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:35.126161 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:35.127103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:35.135873 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3407/6815] 10.222.0.98 () {58 vars in 1295 bytes} [Thu Jul 14 15:15:34 2022] GET /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/identity/driver => generated 31 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:35.139790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:35.165855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080767fb-4090-42df-b50e-24cf3a53d9f1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:35.183825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:35.184973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:35.185244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:35.185533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/ldap` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:35.190267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29, group=ldap)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:35.192682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:35.219259 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3409/6816] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:15:35 2022] GET /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/ldap => generated 106 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:35.224063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:35.248443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd2f0-1fc1-4522-b86b-633f6396925b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:35.264255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:35.265453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:35.265918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:35.266374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/ldap/url` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:35.269097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29, group=ldap, option=url)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:35.271938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:35.292653 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3408/6817] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:15:35 2022] GET /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/ldap/url => generated 46 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:35.296863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:35.321918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065a41c-aba2-4fb3-8a6e-4681a412938b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:35.339032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:35.340233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:35.340688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:35.341158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/ldap/user_tree_dn` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:35.353146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29, group=ldap, option=user_tree_dn)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:35.375608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:35.400957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:35.401655 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3410/6818] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:15:35 2022] GET /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config/ldap/user_tree_dn => generated 63 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:35.416295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3c85-05ff-43b9-a6ae-883841ce9366 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:35.445498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:35.446605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:35.447172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:35.449406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:35.456047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:35.469080 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:35.469080 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:35.469080 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:35.471035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:35.501253 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3409/6819] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 15:15:35 2022] DELETE /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29/config => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:35.505484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:35.535222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff21bd6-b71e-4ec9-b029-d46d95170ed4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:35.574698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:35.575648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:35.575946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:35.576236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:35.580578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:35.595378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:35.698494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:35.707249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:35.712629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:35.809334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:35.811120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:35.829219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:35.831525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3411/6820] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:15:35 2022] PATCH /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29 => generated 278 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:15:35.831950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:35.882477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019d1e0-a6f5-4d67-86ed-c61cfbd2dce7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:35.929188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:36.085267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:36.086582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:36.087082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:36.087575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:36.122749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=71dcb11cd9b3454ea7b0b6538eff9d29)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:36.125123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:36.208080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.212797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.406800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29', 'request_id': 'req-a00bf4a4-98db-43d4-b46e-9f682796411b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.434032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29', 'request_id': 'req-a00bf4a4-98db-43d4-b46e-9f682796411b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.465248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29', 'request_id': 'req-a00bf4a4-98db-43d4-b46e-9f682796411b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.520822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] The token cache is being invalidate because project 71dcb11cd9b3454ea7b0b6538eff9d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:36.521499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.527744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.591670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29', 'request_id': 'req-a00bf4a4-98db-43d4-b46e-9f682796411b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.625759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29', 'request_id': 'req-a00bf4a4-98db-43d4-b46e-9f682796411b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.632091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '71dcb11cd9b3454ea7b0b6538eff9d29', 'request_id': 'req-a00bf4a4-98db-43d4-b46e-9f682796411b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:36.678677 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3410/6821] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:15:35 2022] DELETE /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:36.689174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:36.742419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498f3d3-b200-4e6a-9660-99c4102c815c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:36.957762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:36.961772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:37.185703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:37.195053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:37.199380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:37.204314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:37.212675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:37.231762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:37.285414 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3412/6822] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:15:36 2022] POST /identity/v3/domains => generated 277 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:37.292191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:37.294413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:37.361039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:37.457162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf4a4-98db-43d4-b46e-9f682796411b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:37.574515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ceb2-0cfe-4e28-882f-4d0bdce203f3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:37.607931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:37.608988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:37.609424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:37.612920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:37.620717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:37.621983 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:37.621983 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:37.621983 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:37.623574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:37.773921 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3413/6823] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:15:37 2022] PUT /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config => generated 138 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:37.775497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:37.781496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:37.798773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:37.803502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:37.804489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:37.811503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] PATH_INFO: `/v3/users/4fd14c354c5740aeba4b339b215043a7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:37.820554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d889a4b-3de0-43d8-af89-ae326ef90532 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:37.825126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd14c354c5740aeba4b339b215043a7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:37.833198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:37.834205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:37.835248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:37.835768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:37.836195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] PATH_INFO: `/v3/users/0110507279914488aca33cec9a2fc9f0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:37.838923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0110507279914488aca33cec9a2fc9f0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:37.841199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:37.927593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:37.940106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0110507279914488aca33cec9a2fc9f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:37.972887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0110507279914488aca33cec9a2fc9f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:37.974056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0110507279914488aca33cec9a2fc9f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:37.995346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0110507279914488aca33cec9a2fc9f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:37.996029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0110507279914488aca33cec9a2fc9f0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:38.023777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd14c354c5740aeba4b339b215043a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:38.048887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3414/6824] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:37 2022] DELETE /identity/v3/users/0110507279914488aca33cec9a2fc9f0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:38.053759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:38.064272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:38.091573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd14c354c5740aeba4b339b215043a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:38.125049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd14c354c5740aeba4b339b215043a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:38.125992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd14c354c5740aeba4b339b215043a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:38.151872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-79da37e7-badc-491b-ac0c-0b67cc3e9313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd14c354c5740aeba4b339b215043a7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:38.168178 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3411/6825] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:36 2022] DELETE /identity/v3/users/4fd14c354c5740aeba4b339b215043a7 => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:38.174507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:38.175104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:38.175580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:38.214346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:38.215948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:38.237924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfdacd-aa0e-406c-8392-ba21325b83ea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:38.383559 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3412/6826] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:38.402920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:38.404508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:38.405478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:38.406896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:38.407691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:38.408214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:38.412329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:38.413847 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:38.413847 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:38.413847 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:38.415828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:38.449104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:38.485403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3415/6827] 10.222.0.98 () {60 vars in 1270 bytes} [Thu Jul 14 15:15:38 2022] PATCH /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config => generated 141 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:38.490252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:38.507632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:38.544107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d6888-474c-4068-9881-a023b05bda51 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:38.549026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0730-1c98-4b04-976c-d3310e5c7507 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:38.560518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:38.561363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:38.561661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:38.561950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:38.564204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:38.565737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:38.567647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:38.568347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:38.579164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:38.580691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:38.580840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:38.582776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:38.605308 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3416/6828] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:15:38 2022] GET /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config => generated 141 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:38.609760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:38.611563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3413/6829] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:38.644941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76100c5-3fd7-49ac-ad06-6b61780a8926 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:38.669886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:38.671246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:38.671852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:38.672365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:38.673511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:38.674919 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:38.674919 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:38.674919 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:38.683617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:38.761219 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3417/6830] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 15:15:38 2022] DELETE /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:38.765639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:38.791726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b21c97-0002-45a5-9db8-dba20d2fa71c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:38.820224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:38.821331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:38.821745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:38.822061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:38.824074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:38.826099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Could not find any options in domain configuration for domain 4e42bd4ecea44eefadb84ecda0669dea.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 4e42bd4ecea44eefadb84ecda0669dea. Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:38.884330 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 4e42bd4ecea44eefadb84ecda0669dea. Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:38.889865 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3414/6831] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:15:38 2022] GET /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config => generated 151 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:15:38.897069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:38.954383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bf3f-7bbb-4a9e-b008-7d904f853c95 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:38.988689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:38.990049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:38.990502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:38.990917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:38.991992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:39.006256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:39.042040 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3418/6832] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 15:15:38 2022] DELETE /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea/config => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:39.046626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:39.079216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a1fd-09a7-4ee7-a663-42e024d5f213 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:39.100714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:39.102559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:39.107181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:39.107970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:39.114275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:39.121762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:39.241776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:39.245001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:39.245430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:39.251515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:39.320983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724fdc-d165-48f7-a51b-84f1df8e36c8 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:39.345355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:39.349698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:39.362282 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3415/6833] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:15:39 2022] PATCH /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea => generated 278 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:39.372223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:39.375865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:39.392312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:39.699391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1257cc6-3d18-45bf-bc66-57f1794c44c5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:39.728936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:39.730513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:39.731020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:39.731533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:39.777797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4e42bd4ecea44eefadb84ecda0669dea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:39.782093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:39.814899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:39.816490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:39.816993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:39.817500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] PATH_INFO: `/v3/projects/2e413ee06c0848c3bbdad2e46c394e69` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:39.833502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e413ee06c0848c3bbdad2e46c394e69)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:39.837294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:39.843145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:39.855389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:39.984459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:40.018275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea', 'request_id': 'req-2dc6fba2-c628-4176-8a77-12cf57af00d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.036918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea', 'request_id': 'req-2dc6fba2-c628-4176-8a77-12cf57af00d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.050419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea', 'request_id': 'req-2dc6fba2-c628-4176-8a77-12cf57af00d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.085148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] The token cache is being invalidate because project 4e42bd4ecea44eefadb84ecda0669dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:40.085549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.086492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.097427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e413ee06c0848c3bbdad2e46c394e69', 'request_id': 'req-07c4531e-71aa-420b-9830-478ef22cb1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.119859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea', 'request_id': 'req-2dc6fba2-c628-4176-8a77-12cf57af00d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.123824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e413ee06c0848c3bbdad2e46c394e69', 'request_id': 'req-07c4531e-71aa-420b-9830-478ef22cb1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.129098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea', 'request_id': 'req-2dc6fba2-c628-4176-8a77-12cf57af00d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.130482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4e42bd4ecea44eefadb84ecda0669dea', 'request_id': 'req-2dc6fba2-c628-4176-8a77-12cf57af00d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.145722 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3416/6834] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:15:39 2022] DELETE /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:40.146011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e413ee06c0848c3bbdad2e46c394e69', 'request_id': 'req-07c4531e-71aa-420b-9830-478ef22cb1f2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.146958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:40.148906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:40.182335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] The token cache is being invalidate because project 2e413ee06c0848c3bbdad2e46c394e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:40.182859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.192001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.195050 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3419/6835] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:39 2022] DELETE /identity/v3/projects/2e413ee06c0848c3bbdad2e46c394e69 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:40.196262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:40.198601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:40.312678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6fba2-c628-4176-8a77-12cf57af00d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:40.474364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:40.475968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:40.480075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:40.482013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] PATH_INFO: `/v3/projects/eed187286194420b88b541c46f412f3c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:40.488697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed187286194420b88b541c46f412f3c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:40.501303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:40.510613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4531e-71aa-420b-9830-478ef22cb1f2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:40.526214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bbec5-a41e-4804-bb76-9301b5aad9ef tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:40.528786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bbec5-a41e-4804-bb76-9301b5aad9ef tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:40.529336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bbec5-a41e-4804-bb76-9301b5aad9ef tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:40.529850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bbec5-a41e-4804-bb76-9301b5aad9ef tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:40.531383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bbec5-a41e-4804-bb76-9301b5aad9ef tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:40.542349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bbec5-a41e-4804-bb76-9301b5aad9ef tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:40.639958 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3420/6836] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:15:40 2022] POST /identity/v3/domains => generated 276 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:40.645469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe4f0-fca4-4dc8-b96a-5beee16f136e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:40.645954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe4f0-fca4-4dc8-b96a-5beee16f136e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:40.646446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe4f0-fca4-4dc8-b96a-5beee16f136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:40.738934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed187286194420b88b541c46f412f3c', 'request_id': 'req-174c0a7b-6792-4b7c-bc0a-8226c748fc83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.749123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5b3fe4f0-fca4-4dc8-b96a-5beee16f136e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:40.751406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b3fe4f0-fca4-4dc8-b96a-5beee16f136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:40.768322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:40.776830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed187286194420b88b541c46f412f3c', 'request_id': 'req-174c0a7b-6792-4b7c-bc0a-8226c748fc83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.816575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed187286194420b88b541c46f412f3c', 'request_id': 'req-174c0a7b-6792-4b7c-bc0a-8226c748fc83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.861721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] The token cache is being invalidate because project eed187286194420b88b541c46f412f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:40.864238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.870398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:40.880787 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3417/6837] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:40 2022] DELETE /identity/v3/projects/eed187286194420b88b541c46f412f3c => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:40.882696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:40.888035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:40.921453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:40.990708 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3421/6838] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:40.993755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034da76-7129-402d-b850-9089e5a2340a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:40.994690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034da76-7129-402d-b850-9089e5a2340a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:40.995491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034da76-7129-402d-b850-9089e5a2340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.077269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7034da76-7129-402d-b850-9089e5a2340a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:41.079329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7034da76-7129-402d-b850-9089e5a2340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:41.104497 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3422/6839] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:41.107021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759797-448b-499e-87e4-f915e5ecf0b6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.111191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759797-448b-499e-87e4-f915e5ecf0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.111724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759797-448b-499e-87e4-f915e5ecf0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.185549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-56759797-448b-499e-87e4-f915e5ecf0b6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:41.187842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-56759797-448b-499e-87e4-f915e5ecf0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:41.201812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0a7b-6792-4b7c-bc0a-8226c748fc83 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:41.216011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:41.218166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.219140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.221101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.226613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:41.235857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:41.236165 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3423/6840] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:41.245042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061cd9-8457-4997-9d3b-139e1e12b4e9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.245578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061cd9-8457-4997-9d3b-139e1e12b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.246070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061cd9-8457-4997-9d3b-139e1e12b4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.346460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ac061cd9-8457-4997-9d3b-139e1e12b4e9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:41.351344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ac061cd9-8457-4997-9d3b-139e1e12b4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:41.360049 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3418/6841] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:15:40 2022] PUT /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config => generated 138 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:41.364416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:41.386450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7f286-1e4d-4d54-9314-2e173b57c103 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:41.387743 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3424/6842] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:41.389431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061cd9-8457-4997-9d3b-139e1e12b4e9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:41.404088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:41.405061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.407723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.408222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.409182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:41.409663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:41.414172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:41.434353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061cd9-8457-4997-9d3b-139e1e12b4e9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:41.461177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3419/6843] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:41.463700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:41.487997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15fadb-f841-4208-9066-0539352fbeb0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:41.496693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:41.498720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.504960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:41.505678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.506021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.506257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.507026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:41.507387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:41.511873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.512766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:41.513821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.515483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2, group=identity)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:41.526959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:41.557948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3420/6844] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:41.558966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:41.581782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f270c5-4ea4-4d0d-a031-45850bebff89 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:41.591905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:41.592605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.593034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.593326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.594043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:41.600147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:41.672362 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3425/6845] 10.222.0.98 () {60 vars in 1296 bytes} [Thu Jul 14 15:15:41 2022] PATCH /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity => generated 177 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:41.675555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3421/6846] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:41 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:41.678422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:41.683518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:41.764821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b237-1589-44a9-aee9-0ce373645bed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:41.990715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:41.991589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:41.991886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:41.992348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:41.993955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:41.996951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.021149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5593-4682-4212-bc30-af1d0dc9e866 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.033875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.035496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.036085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.036708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity/driver` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.037980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2, group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.042300 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:42.042300 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:42.042300 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:42.045020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.061339 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3426/6847] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:41 2022] POST /identity/v3/projects => generated 391 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:42.065837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.080134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:42.119512 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3422/6848] 10.222.0.98 () {60 vars in 1317 bytes} [Thu Jul 14 15:15:41 2022] PATCH /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity/driver => generated 177 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:42.126034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.151831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f912e9-d97d-47ab-8224-b813dc568c30 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.295637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253ca8d-0bf8-4eee-97a6-eb99cc677e2c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.319905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.321444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.321623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.322158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.323569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.327846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.348178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.350589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.351439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.352154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.354233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.358813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.364161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:42.380372 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3427/6849] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:42 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:42.382040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.476418 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3423/6850] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:42 2022] POST /identity/v3/users => generated 296 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:42.476418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.503408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202ce4-4591-4751-98c0-bf58606f4918 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.518511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.528785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.529478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.529994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.531018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.532991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.565645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3424/6851] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:42.575219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.580141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633a76-9365-4668-bd09-7db6bb78f67f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.588875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.590596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.591095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.591727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity/driver` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.593057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2, group=identity, option=driver)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.596735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.605307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef6b89-7b07-4294-a126-a4b0ad6bae5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.623963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.625106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.625626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.626175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.627397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.629604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.635914 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3428/6852] 10.222.0.98 () {58 vars in 1298 bytes} [Thu Jul 14 15:15:42 2022] DELETE /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity/driver => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:42.635914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.661740 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3425/6853] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:42.662775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.683404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa4f35-13e2-4e2d-9291-39de9f3aabed tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.708830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.709989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.710524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.710971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.712603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.719054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.723114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9423c0-5372-4efc-9b74-374326156ab6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.753656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.756321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.756321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.756321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity/driver` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.756919 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3429/6854] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:42.758147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.767898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2, group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.776181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.815719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2b12-d21b-4142-9722-f7d96f4e03eb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Could not find option driver in group identity in domain configuration for domain ad9175badc7947d2ad635d3c0dbd8dc2.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain ad9175badc7947d2ad635d3c0dbd8dc2. Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:42.827109 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain ad9175badc7947d2ad635d3c0dbd8dc2. Jul 14 15:15:42.828301 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:42.834446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3426/6855] 10.222.0.98 () {58 vars in 1295 bytes} [Thu Jul 14 15:15:42 2022] GET /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity/driver => generated 171 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:15:42.834446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.839342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.841011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.841507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.841787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.842869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.844685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.870115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec893-9c07-42d6-b93c-0c173f87d3c6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.872003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3430/6856] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:42.873309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:42.898497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fc998-6b5e-4b86-89a2-36d5a8b8dc83 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:42.904290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.908091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.908558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.908936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] PATH_INFO: `/v3/projects/15c99dd003de49b0b2de54ef8f9e18ff/users/a641b40ffe66407e98d7c0cc31ff51dd/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.924280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:42.925204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:42.925655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:42.925953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:42.938174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2, group=identity)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.942010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c99dd003de49b0b2de54ef8f9e18ff, user_id=a641b40ffe66407e98d7c0cc31ff51dd, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:42.942286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:42.953012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:43.002447 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3427/6858] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:42 2022] PUT /identity/v3/projects/15c99dd003de49b0b2de54ef8f9e18ff/users/a641b40ffe66407e98d7c0cc31ff51dd/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:43.002932 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3431/6858] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 15:15:42 2022] DELETE /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:43.003018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:43.003103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:43.012725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0ef60-ae9f-4605-8ea6-d75eeeb89e40 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:43.117481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad95b45-9ca9-4023-9ad8-e6e7bade3ad4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:43.117737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cf610-23df-405f-b984-eccd1cfc58d3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:43.118572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad95b45-9ca9-4023-9ad8-e6e7bade3ad4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:43.118702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad95b45-9ca9-4023-9ad8-e6e7bade3ad4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:43.119672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad95b45-9ca9-4023-9ad8-e6e7bade3ad4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:43.120899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad95b45-9ca9-4023-9ad8-e6e7bade3ad4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2, group=identity)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:43.122891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad95b45-9ca9-4023-9ad8-e6e7bade3ad4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:43.131770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:43.133107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:43.133930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:43.134493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] PATH_INFO: `/v3/projects/e488efe5120f4e81a4065caaf1e87dfc/users/5d44cb537ec94c96a9506fc15c98d1ef/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7ad95b45-9ca9-4023-9ad8-e6e7bade3ad4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Could not find group identity in domain configuration for domain ad9175badc7947d2ad635d3c0dbd8dc2.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain ad9175badc7947d2ad635d3c0dbd8dc2. Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:43.149292 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain ad9175badc7947d2ad635d3c0dbd8dc2. Jul 14 15:15:43.150225 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:15:43.154354 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3432/6859] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:15:42 2022] GET /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config/identity => generated 154 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:15:43.156258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b665f52-3340-48bd-a034-d49beecf3339 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:43.156440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b665f52-3340-48bd-a034-d49beecf3339 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:43.156679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b665f52-3340-48bd-a034-d49beecf3339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:43.160576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e488efe5120f4e81a4065caaf1e87dfc, user_id=5d44cb537ec94c96a9506fc15c98d1ef, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:43.164212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:43.185938 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3428/6860] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:42 2022] PUT /identity/v3/projects/e488efe5120f4e81a4065caaf1e87dfc/users/5d44cb537ec94c96a9506fc15c98d1ef/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:43.187045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:43.201094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=2,keystone:INSERT=6,keystone:SELECT=92 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:43.272702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4b665f52-3340-48bd-a034-d49beecf3339 None None] MFA Rules not processed for user `a641b40ffe66407e98d7c0cc31ff51dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:43.274700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b665f52-3340-48bd-a034-d49beecf3339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:43.407800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:43.420409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9c30d-eedd-4803-a030-c668e3fa58dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:43.474855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96808a4b-770b-40ca-a5c4-db073d931d33 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:43.475423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96808a4b-770b-40ca-a5c4-db073d931d33 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:43.475724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96808a4b-770b-40ca-a5c4-db073d931d33 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:43.476689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96808a4b-770b-40ca-a5c4-db073d931d33 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:43.478279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96808a4b-770b-40ca-a5c4-db073d931d33 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:43.483524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96808a4b-770b-40ca-a5c4-db073d931d33 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:43.508243 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3429/6861] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 15:15:43 2022] DELETE /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2/config => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:43.509776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:43.510089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:43.510375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:43.523001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3433/6862] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:43.533092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b665f52-3340-48bd-a034-d49beecf3339 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:43.555838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b665f52-3340-48bd-a034-d49beecf3339 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:43.562402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:43.563362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:43.563861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:43.564040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:43.565690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:43.569119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:43.596421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] MFA Rules not processed for user `5d44cb537ec94c96a9506fc15c98d1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:43.596961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:43.597821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:43.598205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:43.659107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:43.661967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:43.674847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3434/6863] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:15:43 2022] PATCH /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2 => generated 277 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:43.675795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:43.677527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:43.801098 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3430/6864] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:43.801990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:43.812836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:43.840003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9cb70-ef01-4121-88b1-0ab5366e42a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:43.852831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:43.854884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:43.855423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:43.856078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:43.859646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:43.864570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:43.929119 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3435/6865] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:43 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:43.930757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:43.934460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:44.024468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68db20-62c2-43ce-997a-4186df0e02b3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:44.108007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08de5c-eea3-4cdf-8b39-7674ff9ff268 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:44.124785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:44.132633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:44.133083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:44.133238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:44.184837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:44.224622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:44.230621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:44.233374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:44.234769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:44.244901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:44.274225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ad9175badc7947d2ad635d3c0dbd8dc2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:44.276524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:44.330048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.342919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.356041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:44.358594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:44.382577 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3436/6866] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:44.383845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:44.457224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2', 'request_id': 'req-d0953d83-625e-4f25-801c-194a439841f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.471192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2', 'request_id': 'req-d0953d83-625e-4f25-801c-194a439841f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.489371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2', 'request_id': 'req-d0953d83-625e-4f25-801c-194a439841f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.518038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] The token cache is being invalidate because project ad9175badc7947d2ad635d3c0dbd8dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:44.518880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.520530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.541332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2', 'request_id': 'req-d0953d83-625e-4f25-801c-194a439841f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.550293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2', 'request_id': 'req-d0953d83-625e-4f25-801c-194a439841f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.552122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ad9175badc7947d2ad635d3c0dbd8dc2', 'request_id': 'req-d0953d83-625e-4f25-801c-194a439841f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:44.566388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1edca-c99a-45ff-9889-9c2d04c5a630 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:44.568739 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3431/6867] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:15:43 2022] DELETE /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:44.576497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:44.581007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:44.772746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:44.773523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0953d83-625e-4f25-801c-194a439841f9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:44.773964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:44.774484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:44.774985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:44.787685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:44.792345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:44.803689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:44.810583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:44.811169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:44.811775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:44.813047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:44.815252 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:44.815252 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:44.815252 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:44.821025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:44.847753 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3432/6868] 10.222.0.98 () {58 vars in 1172 bytes} [Thu Jul 14 15:15:44 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:44.849920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:44.859877 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3437/6869] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:44 2022] POST /identity/v3/users => generated 295 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:44.863310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:44.884970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:44.899441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3237c4-a545-4404-b5f6-648900fdb357 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:44.910986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac181ec2-e33d-4a85-8383-d576a2943850 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:44.918866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:44.919996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:44.920172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:44.920624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:44.921077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:44.921213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:44.921831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:44.922210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:44.922550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:44.924244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:44.927431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:44.933866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:44.941529 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3433/6870] 10.222.0.98 () {58 vars in 1199 bytes} [Thu Jul 14 15:15:44 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:44.942841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:44.958466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b82fe-02b3-48c7-a0eb-dfa8ad0741d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:44.969404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3438/6871] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:44.975257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:44.979611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:44.981976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:44.984251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:44.984781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:44.985681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:44.992240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:44.998897 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3434/6872] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:15:44 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:44.999531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460c52-850a-411d-b565-d0252b00aa4c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.000648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.014090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:45.015115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.015521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.015873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] PATH_INFO: `/v3/projects/5a59287c78c84159b57e6e5bf995cb16/users/b420b56aff72402680813789f0ba264c/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.030290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55201a04-5519-40cf-b69b-52860bad8871 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.048152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:45.049138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.049739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.049995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a59287c78c84159b57e6e5bf995cb16, user_id=b420b56aff72402680813789f0ba264c, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:45.050247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.053135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:45.053341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:45.055081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:45.056438 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3435/6873] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:44 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 14 15:15:45.065226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.085140 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3439/6874] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:44 2022] PUT /identity/v3/projects/5a59287c78c84159b57e6e5bf995cb16/users/b420b56aff72402680813789f0ba264c/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:45.090266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.104318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32c82a-b45a-479a-9840-5258222a45fd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.117777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:45.194142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:45.260244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4817-6aeb-46f8-a178-192bc2d3d3df admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.277256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:45.277967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.278253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.278538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.279348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:45.281065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:45.306585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3440/6875] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:15:45.310339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.336369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:45.338426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3019ad-2a80-4bde-8a9b-208d23258f85 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.339000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.339359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.339657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.342666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:45.345583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:45.356405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee19f03-1b9d-446f-84af-f29c1df376d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:45.356980 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3436/6876] 10.222.0.98 () {58 vars in 1187 bytes} [Thu Jul 14 15:15:45 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:45.357503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee19f03-1b9d-446f-84af-f29c1df376d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.357796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee19f03-1b9d-446f-84af-f29c1df376d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.358077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee19f03-1b9d-446f-84af-f29c1df376d9 admin admin] PATH_INFO: `/v3/projects/5a59287c78c84159b57e6e5bf995cb16/users/b420b56aff72402680813789f0ba264c/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.361509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.367501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee19f03-1b9d-446f-84af-f29c1df376d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a59287c78c84159b57e6e5bf995cb16, user_id=b420b56aff72402680813789f0ba264c, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:45.369155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee19f03-1b9d-446f-84af-f29c1df376d9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:45.394069 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3441/6877] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:45 2022] PUT /identity/v3/projects/5a59287c78c84159b57e6e5bf995cb16/users/b420b56aff72402680813789f0ba264c/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:45.408033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.408419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.408600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.419912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadec10f-846d-4069-9bf7-35c64ffdb1e5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.475534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] MFA Rules not processed for user `b420b56aff72402680813789f0ba264c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:45.480068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:45.666707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:45.667692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.668449 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3442/6878] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:15:45.669462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.673482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.673922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.674671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:45.677384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:45.684896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:45.686211 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3437/6879] 10.222.0.98 () {58 vars in 1199 bytes} [Thu Jul 14 15:15:45 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:45.700935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.778172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f16a2f-2eb5-4f2a-ad3a-8dd12193b286 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.819204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:45.819930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:45.820224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:45.820511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:45.821278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:45.822924 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:45.822924 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:45.822924 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:45.840911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:45.942669 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3438/6880] 10.222.0.98 () {60 vars in 1184 bytes} [Thu Jul 14 15:15:45 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:45.945727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:45.987712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5786ae-449a-43d4-896c-575cf350a538 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.996604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b579b-3a7e-4633-b89f-cb75a1a5cc8c tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:45.997881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.001153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.001861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.002481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] PATH_INFO: `/v3/users/546172617b5b4d38a413be3c823e445f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.004311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546172617b5b4d38a413be3c823e445f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.007031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.023614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.023614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.023614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.023954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.023954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.024401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.026189 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3439/6881] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 15:15:45 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:46.032385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.059889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4191966-8769-40bc-ba65-5208cfb6a79f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.065546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.066448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.066746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.068067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/45ec4187ec1a4b2bba8d7d4e97c0c74d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.068442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=45ec4187ec1a4b2bba8d7d4e97c0c74d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.069516 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:46.069516 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:46.069516 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:46.070458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.105552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3440/6882] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/OS-OAUTH1/consumers/45ec4187ec1a4b2bba8d7d4e97c0c74d => generated 220 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:46.114079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.129506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:46.140355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546172617b5b4d38a413be3c823e445f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.159050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8136c3-dc01-4c5d-989c-b412f5d4c0df tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.173835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.175026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.175462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546172617b5b4d38a413be3c823e445f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.175759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.176206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.176956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546172617b5b4d38a413be3c823e445f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.177427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.180344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.182712 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3441/6883] 10.222.0.98 () {58 vars in 1208 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:46.184342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.210910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762bf1-76bf-404f-a598-8895be88baa1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.218509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.223246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.223804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.225514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/45ec4187ec1a4b2bba8d7d4e97c0c74d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.226272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=45ec4187ec1a4b2bba8d7d4e97c0c74d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.239054 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:46.239054 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:46.239054 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:46.245349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.246511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invalidating token cache because consumer 45ec4187ec1a4b2bba8d7d4e97c0c74d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:46.247478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.247647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546172617b5b4d38a413be3c823e445f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.249740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.258434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546172617b5b4d38a413be3c823e445f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.302010 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3443/6884] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:45 2022] DELETE /identity/v3/users/546172617b5b4d38a413be3c823e445f => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:46.306352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.308145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:46.310586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afbbfcbc-d11f-428b-8c40-45772f8a4e58 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '45ec4187ec1a4b2bba8d7d4e97c0c74d', 'request_id': 'req-afbbfcbc-d11f-428b-8c40-45772f8a4e58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.403348 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3442/6885] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:15:46 2022] DELETE /identity/v3/OS-OAUTH1/consumers/45ec4187ec1a4b2bba8d7d4e97c0c74d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:46.408611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3baab-80bc-4b50-823d-849ccb8bc636 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.411945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3baab-80bc-4b50-823d-849ccb8bc636 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.412490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3baab-80bc-4b50-823d-849ccb8bc636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.483744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-63e3baab-80bc-4b50-823d-849ccb8bc636 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:46.487826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63e3baab-80bc-4b50-823d-849ccb8bc636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:46.497361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d145a-fbb2-43d6-b28b-0d30d8799332 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.510307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.513484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.515547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.516503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.519214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.521977 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:46.521977 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:46.521977 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:46.523547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.529521 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3444/6886] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:46.530851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.537976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:46.630278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:46.674358 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3443/6887] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:46.681510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3baab-80bc-4b50-823d-849ccb8bc636 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.689281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7660d5-6627-4d50-9e4f-bcfa922e6348 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.695992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.696862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.697377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.698226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.699095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.701086 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:46.701086 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:46.701086 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:46.703002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.717517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3baab-80bc-4b50-823d-849ccb8bc636 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.732227 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3445/6888] 10.222.0.98 () {60 vars in 1184 bytes} [Thu Jul 14 15:15:46 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:46.732747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.733363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.735681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.736565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:46.738130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.738909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.741318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.748080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.751843 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3444/6889] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:46.753814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.781638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ae103-8cd1-4116-bbe1-a65ac8fc86e6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.795228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.797164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.797971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.798753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.802612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2753dac098aa4f91ace51b402090845c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.807647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.821783 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3445/6890] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c => generated 220 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:46.824822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.854727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def45ef0-ce42-48e7-8e11-7ea05e0a5ec2 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.865833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.868248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.869914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.871199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.872806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.886606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.892837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3446/6891] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:46.892837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.906183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b162a-9e49-4d20-b7a8-cbebe4fb9d8d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.911819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.912940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.913361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.913730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.919844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ee69-0f2a-4ee2-9af1-6b42856bc11c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:46.929646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:46.930978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:46.931612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:46.932156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:46.933630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2753dac098aa4f91ace51b402090845c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.935805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:46.937186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.937699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invalidating token cache because consumer 2753dac098aa4f91ace51b402090845c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:46.938294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.939710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.940424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:46.954249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:46.958618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2753dac098aa4f91ace51b402090845c', 'request_id': 'req-520b2bc1-6630-41ec-bfe3-8340974e88e4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:46.982145 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3446/6892] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:46.984608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:46.993762 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3447/6893] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:15:46 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:46.999532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.002176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:47.013856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982d232-0550-4161-ae6a-36a3936833d5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.034205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b2bc1-6630-41ec-bfe3-8340974e88e4 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.050438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.051350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.051652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.054760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.055635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2753dac098aa4f91ace51b402090845c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.060537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.061609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.063545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.070603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.070603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.070603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.078378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.081137 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3447/6894] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.094055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.096270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 14 15:15:47.126585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:47.129021 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3448/6895] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:15:46 2022] GET /identity/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c => generated 74 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:15:47.133306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.162401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a5347-94b2-484b-9078-e17274561d6a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.175895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a98b-a49d-4762-9976-924f7ecabe36 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.184644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.185605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.185987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.186293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.188125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.192110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.194156 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3448/6896] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.199499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.211342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.211342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.211342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.212123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.212123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2753dac098aa4f91ace51b402090845c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.227021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.227021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invalidating token cache because consumer 2753dac098aa4f91ace51b402090845c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:47.227021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:47.227021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:47.249281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc607f-1ead-4055-951e-f3ff87ec51fe tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.261967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.264463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.275927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.277162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.278143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.282732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.284897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3449/6897] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.310875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.321000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 14 15:15:47.350501 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 14 15:15:47.353585 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:47.360707 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3449/6898] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:15:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2753dac098aa4f91ace51b402090845c => generated 74 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:15:47.367495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4683a1-acee-4cd9-bee2-c68959334c1a tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.368603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.376518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:47.389795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.391164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.391686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.394000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.395709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.403349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.408277 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3450/6899] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.422289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.468978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4255-2ca0-444f-b901-c7c340da409f tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.482741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac52d8-f450-4caf-a399-e18e536fdb16 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.491860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.494840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.495536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.497435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.500635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.509324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.513022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.515179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.515762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.520861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.522209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.531696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.534338 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3451/6900] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.538260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.561719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8d54d-cc4c-44d9-965f-7c07f9bef25c tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.574969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.576239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.577780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.578883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.580725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.587544 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3450/6901] 10.222.0.98 () {60 vars in 1184 bytes} [Thu Jul 14 15:15:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:47.589187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.589645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.597928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3452/6902] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 14 15:15:47.600160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.624495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d65b-a55f-4b79-94c7-d73dbbf4104a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.631725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996cb07-8f82-4365-9da1-28e56c4cb725 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.638110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.639562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.640567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.640982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.641916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.643995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.646458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.649450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.649865 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3453/6903] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.651644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.655116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.655116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.661595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.664475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.668400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45981c-173a-4793-ab51-8586425ab7ff tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.675939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.679934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.680945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.681444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.684145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.692488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.701536 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3454/6904] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.703053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.704551 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3451/6905] 10.222.0.98 () {60 vars in 1184 bytes} [Thu Jul 14 15:15:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:47.708727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.722276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c342459-bcdb-4314-9801-eb44cdefaf93 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.728803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.729836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.730475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.730891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.732645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.734921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.738662 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3455/6906] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.742944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.752153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14825159-1c75-4d6b-95df-45bdd7d84a1d tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.760757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349759c-832e-4ca0-bf65-5bf6efd2c9c0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.763589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.765078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.765700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.766344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.768239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.769895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.770708 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:47.770708 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:15:47.770708 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:15:47.771515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.772444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.772588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.773265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.774429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.779797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.788247 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3456/6907] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.789014 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3452/6908] 10.222.0.98 () {58 vars in 1163 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:47.790627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.794616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.834089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a81a3-e3cc-46a6-913c-fe667481e7db tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.842488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.845110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.845861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.846431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.848172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.848961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bc08e-a492-4e67-ae99-bdd6440ae511 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.850620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.860714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.862055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.862735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.863039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/54ffa3c041d24c1f821ba51f2d765850` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.866169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=54ffa3c041d24c1f821ba51f2d765850)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.868278 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:47.868278 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:47.868278 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:47.869476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.869956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invalidating token cache because consumer 54ffa3c041d24c1f821ba51f2d765850 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:47.870444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:47.871709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:47.875909 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3453/6909] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.880911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.883920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:47.940396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce03f4e-aaef-4f5e-8198-072f90f4ca08 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.948728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.949962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.950505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.951030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.951987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.954156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.961352 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3454/6910] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:47.963869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:47.968115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '54ffa3c041d24c1f821ba51f2d765850', 'request_id': 'req-c20ac396-95e2-40e2-9074-2d86f5acd9dd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:47.980430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54d3d3-9410-45cb-8639-80caea3b1d46 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:47.988675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:47.990089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:47.990650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:47.991635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:47.992726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:47.996982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:47.999196 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3455/6911] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:15:47 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.003816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.022496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ed00-9f28-4194-a9da-3951e6035302 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.030102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.032130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.032862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.033497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.034450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.036978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.045554 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3456/6912] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 15:15:48 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.047684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.057121 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3457/6913] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:15:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/54ffa3c041d24c1f821ba51f2d765850 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:48.060286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.065933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:48.067980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c3cfb-19ef-4c7b-a715-fdbdfc5f3e8d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.077429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.078851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.079433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.080139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.081636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.083783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.088822 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3457/6914] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 15:15:48 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.090096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.114005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2dde-b8eb-4dde-8a48-248560e3b1ce tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.122676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.123755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.124161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.124558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.125390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.127316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.133274 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3458/6915] 10.222.0.98 () {58 vars in 1289 bytes} [Thu Jul 14 15:15:48 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.135610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.165701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4135c-f2f2-43af-9e88-0f91cf9ed151 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.198614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.201058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.202295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.202721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.206267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.210026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.212146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac396-95e2-40e2-9074-2d86f5acd9dd tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.217398 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3459/6916] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 15:15:48 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.219512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.252376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d172f2-63e4-4e43-9a7f-ca56412af802 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.258516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.259527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.260458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.260823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.268703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.270239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.270770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.271327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a6be7b649ac2493abc52707b4c89254a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.272734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.274418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.276736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a6be7b649ac2493abc52707b4c89254a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.279700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.280213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invalidating token cache because consumer a6be7b649ac2493abc52707b4c89254a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:48.280746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.282560 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3460/6917] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:15:48 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.283572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.286628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.290332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:48.343613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a6be7b649ac2493abc52707b4c89254a', 'request_id': 'req-dd9b960a-89bb-423b-a33b-53f4efbb1167'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.363691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706eca-bbd7-4aa9-89fc-f9f12c8c7cf0 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.377356 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3458/6918] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:15:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a6be7b649ac2493abc52707b4c89254a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:48.378337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.380403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:48.398281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b960a-89bb-423b-a33b-53f4efbb1167 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.405140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.406193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.406494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.406794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] PATH_INFO: `/v3/projects/a694fd255f9d47ad9ff5444965f0a7c4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.408180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a694fd255f9d47ad9ff5444965f0a7c4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.411196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.423234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.433008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.433508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.434763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.439335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.445499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.455403 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3461/6919] 10.222.0.98 () {58 vars in 1307 bytes} [Thu Jul 14 15:15:48 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.455403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.458982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:48.514192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a36b7-63be-4752-bc40-931e93adcd39 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.534933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.535761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.536129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.536489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.537408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.539341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.581228 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3462/6920] 10.222.0.98 () {60 vars in 1184 bytes} [Thu Jul 14 15:15:48 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:48.582591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.610675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da9908-fe36-4ac9-ab24-249e7ae5f803 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:48.620769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a694fd255f9d47ad9ff5444965f0a7c4', 'request_id': 'req-6493b411-fb73-413b-8f5d-496ada5e0dc8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.638687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a694fd255f9d47ad9ff5444965f0a7c4', 'request_id': 'req-6493b411-fb73-413b-8f5d-496ada5e0dc8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.664338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a694fd255f9d47ad9ff5444965f0a7c4', 'request_id': 'req-6493b411-fb73-413b-8f5d-496ada5e0dc8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.719521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] The token cache is being invalidate because project a694fd255f9d47ad9ff5444965f0a7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:48.720101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.724169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:48.728109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3459/6921] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:48 2022] DELETE /identity/v3/projects/a694fd255f9d47ad9ff5444965f0a7c4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:48.731449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.733629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:48.803915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:48.804889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:48.805260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:48.805536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:48.806262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:48.808251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:48.812814 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3463/6922] 10.222.0.98 () {58 vars in 1289 bytes} [Thu Jul 14 15:15:48 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:48.814076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:48.822759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:48.860849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:48.912164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:49.009938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493b411-fb73-413b-8f5d-496ada5e0dc8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.036215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.037286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.037590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.037881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c127342063854121a06b6c724c7f7b5a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.038653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=c127342063854121a06b6c724c7f7b5a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.040116 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:49.040116 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:49.040116 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:49.041641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.052255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4b60a-3eb8-4405-8bc7-4a1bb8e3a9d3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.072978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.073903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.074195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.074504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] PATH_INFO: `/v3/users/47f3d5e056b04555a6f1bd20c3806f83` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.077657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f3d5e056b04555a6f1bd20c3806f83)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.079694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.091963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3460/6923] 10.222.0.98 () {60 vars in 1284 bytes} [Thu Jul 14 15:15:48 2022] PATCH /identity/v3/OS-OAUTH1/consumers/c127342063854121a06b6c724c7f7b5a => generated 221 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:49.094042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.108461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:49.133524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aeaf65-1973-40b8-9f9e-f55dca4017c9 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.142580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.143670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.143869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.144119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.144863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.146741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.151933 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3461/6924] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:49.151933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.183899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8965-b9d3-40e3-92ff-8c99741391da tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.205980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.206911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.207253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.207764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c127342063854121a06b6c724c7f7b5a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.208347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c127342063854121a06b6c724c7f7b5a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.209552 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:15:49.209552 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:15:49.209552 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:15:49.210499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.224536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f3d5e056b04555a6f1bd20c3806f83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.227727 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3462/6925] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/OS-OAUTH1/consumers/c127342063854121a06b6c724c7f7b5a => generated 221 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:49.229711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.250121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc56a4d-c174-417f-8773-d917a5ba45f3 tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.263043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.268464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.269665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.270128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.270532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f3d5e056b04555a6f1bd20c3806f83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.271223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.273700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.279746 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3463/6926] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:49.280847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.287931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f3d5e056b04555a6f1bd20c3806f83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.288648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f3d5e056b04555a6f1bd20c3806f83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.302108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f3d5e056b04555a6f1bd20c3806f83'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.316931 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3464/6927] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:48 2022] DELETE /identity/v3/users/47f3d5e056b04555a6f1bd20c3806f83 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:49.349584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.357995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefea9d-28cd-4dfe-a582-25319071544f tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.365180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:49.521838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b420b56aff72402680813789f0ba264c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a59287c78c84159b57e6e5bf995cb16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.526501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.526819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.527106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c127342063854121a06b6c724c7f7b5a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.537559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c127342063854121a06b6c724c7f7b5a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.538078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.538429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invalidating token cache because consumer c127342063854121a06b6c724c7f7b5a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:49.538776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.544310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.581805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c127342063854121a06b6c724c7f7b5a', 'request_id': 'req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:49.615130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bb3d7-2936-43ae-aa3f-0723ce6c8a7a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.631887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3464/6928] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:15:49 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c127342063854121a06b6c724c7f7b5a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:49.633364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.637833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.641349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.642592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:49.643242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.645042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.648056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.652441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.659413 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3465/6929] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:49.660447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.662532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:49.708187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31c2f-4477-481d-ac83-6781ddb5e7e3 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.722376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.723337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.723634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.723976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.729240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.739072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.747540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3466/6930] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:49.751897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.787388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca52b0-3cf9-41e7-b186-4c5df4aab536 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.826140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.834794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.835536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.836148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.852457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.855461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.857979 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3467/6931] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:49.864659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.888137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ff4c9-3997-42f3-9bd9-7ef9bc89f49a tempest-OAUTHConsumersV3Test-1429965015 tempest-OAUTHConsumersV3Test-1429965015-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.909344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.910140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.910451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.910726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] PATH_INFO: `/v3/users/a641b40ffe66407e98d7c0cc31ff51dd` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.917152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a641b40ffe66407e98d7c0cc31ff51dd)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.917971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a9516-a432-4fa7-9cba-826a0a0312b5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:49.920313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.942643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:49.945153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:49.948678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:49.949788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:49.951689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:49.954379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:49.960944 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3468/6932] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:49.962596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:49.997026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8758b-3e9d-46b6-b4f1-cbdc4d39226b tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:50.006688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:50.008497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:50.010233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:50.011379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:50.014186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:50.018562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:50.024407 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3469/6933] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 15:15:49 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:50.030583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:50.054853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:50.082668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a641b40ffe66407e98d7c0cc31ff51dd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.102667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af65d-0c73-43d5-abd1-19a90eb966d6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:50.112752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a641b40ffe66407e98d7c0cc31ff51dd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.115741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a641b40ffe66407e98d7c0cc31ff51dd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.139417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a641b40ffe66407e98d7c0cc31ff51dd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.140552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fe2797c-13a4-4ddc-b499-b60b7776f494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a641b40ffe66407e98d7c0cc31ff51dd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.142595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:50.145006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:50.145506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:50.146273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:50.147663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:50.156044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:50.162690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3470/6934] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 15:15:50 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:50.168366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:50.170393 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3465/6935] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:49 2022] DELETE /identity/v3/users/a641b40ffe66407e98d7c0cc31ff51dd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:50.175109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:50.175686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:50.176242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:50.177496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:50.212319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:50.214740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:50.237609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:50.258327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702314b-e7a0-4194-89f7-c4d1d7a32bc7 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:50.503345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3466/6936] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:50.503345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:50.504199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:50.537730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:50.539132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:50.539522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:50.555306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a62f-e331-4b2e-8fdd-7477e89ab91d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:50.556701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:50.557590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:50.562516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:50.571974 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3471/6937] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 15:15:50 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:50.573198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:50.583242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:50.583545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:50.584312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:50.584624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:50.584923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] PATH_INFO: `/v3/projects/2307e08b5455446d8a8a664e95682b73` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:50.592273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2307e08b5455446d8a8a664e95682b73)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:50.594309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:50.776573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2307e08b5455446d8a8a664e95682b73', 'request_id': 'req-6594b3d6-bbf2-410b-b23b-8fff93f448ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.788276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2307e08b5455446d8a8a664e95682b73', 'request_id': 'req-6594b3d6-bbf2-410b-b23b-8fff93f448ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.804052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2307e08b5455446d8a8a664e95682b73', 'request_id': 'req-6594b3d6-bbf2-410b-b23b-8fff93f448ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.819563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] The token cache is being invalidate because project 2307e08b5455446d8a8a664e95682b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:50.819870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.829176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:50.842117 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3467/6938] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:50 2022] DELETE /identity/v3/projects/2307e08b5455446d8a8a664e95682b73 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:50.842117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:50.848228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:50.872659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c4cb-8bb3-4531-9490-28faf2f296d1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:50.972740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:51.023796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594b3d6-bbf2-410b-b23b-8fff93f448ba admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.026131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.028650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.028650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.029001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.035563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:51.063805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b04c3-e533-4037-9f3f-3cd4d39e78dd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.070888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b04c3-e533-4037-9f3f-3cd4d39e78dd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.070888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b04c3-e533-4037-9f3f-3cd4d39e78dd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.070888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b04c3-e533-4037-9f3f-3cd4d39e78dd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.070888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b04c3-e533-4037-9f3f-3cd4d39e78dd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.071513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b04c3-e533-4037-9f3f-3cd4d39e78dd tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.076378 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3468/6939] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:15:50 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:51.084818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae029-7d42-4e01-a062-25a02ce01801 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.085610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae029-7d42-4e01-a062-25a02ce01801 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.086557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae029-7d42-4e01-a062-25a02ce01801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.177495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0b8ae029-7d42-4e01-a062-25a02ce01801 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:51.191047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b8ae029-7d42-4e01-a062-25a02ce01801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:51.288796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.290673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.311021 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3472/6940] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:51.312413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.363774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b038-5bca-45a3-84a4-166a67e68192 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.387600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.388440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.388726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.389013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.389693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.403870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.411992 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3473/6941] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:51 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:51.423328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.444919 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3469/6942] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:51.450644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ea4e-fbe9-4549-b397-3bcf5855bdb0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.450940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ea4e-fbe9-4549-b397-3bcf5855bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.451222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ea4e-fbe9-4549-b397-3bcf5855bdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.498586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49f70-373c-47a7-b100-7968f58bc758 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.546267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.547470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.550277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.550655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.563201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.570113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-acb4ea4e-fbe9-4549-b397-3bcf5855bdb0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:51.571649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-acb4ea4e-fbe9-4549-b397-3bcf5855bdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:51.576574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.586591 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3474/6943] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:15:51 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:51.592721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.658610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:51.673634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d83e-f38a-4da5-a80e-2f9c0c230165 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.694499 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3470/6944] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:51.696546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ea4e-fbe9-4549-b397-3bcf5855bdb0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.698462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.699309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.699604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.699891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.700577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.703002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.712187 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3475/6945] 10.222.0.98 () {58 vars in 1211 bytes} [Thu Jul 14 15:15:51 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:51.713335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.759522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ea4e-fbe9-4549-b397-3bcf5855bdb0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.788228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.788934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.789168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.789440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.789741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c104-9c4f-49d1-bbf3-af14e18e6865 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.790498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:51.791503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.801371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.827184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.827184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.827184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.835001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3471/6946] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:51.840254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.841053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.842646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.842814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.844088 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3476/6947] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:15:51 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:51.860009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.892737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea4b3c-5650-4359-be07-4e3773742db1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.903172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956aa91-6c74-4766-8d6c-acb0a79652ab tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:51.911876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.912694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.917949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.919002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.919432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.922595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.931874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:51.932759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:51.933052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:51.933342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:51.934036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:51.935776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:51.937283 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3477/6948] 10.222.0.98 () {58 vars in 1214 bytes} [Thu Jul 14 15:15:51 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:51.948637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:51.981597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c7cdc-7a53-47ca-9907-151b7fb5b27d tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.012776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.016119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.016623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.017311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.017456 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3472/6949] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:51 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:15:52.018496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.018731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.020737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.022428 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3478/6950] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 15:15:51 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:52.030606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.050847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a96a47-5491-4063-9332-141366f858c4 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.224997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.225858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.226152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.226501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.227176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.228861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.230197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3479/6951] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:52 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:52.230886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.233669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db782ed-4bc8-4e15-8f25-9a548c7cb735 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.245452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:52.249832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.250552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.250840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.251137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.251857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.253842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.288157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe946-d999-4189-af5c-aaf3b1d4b696 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.302906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.303841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.304136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.304653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] PATH_INFO: `/v3/projects/15c99dd003de49b0b2de54ef8f9e18ff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.305567 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3473/6952] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:52 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:52.306532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c99dd003de49b0b2de54ef8f9e18ff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.310633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.312695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.337001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08424-6daa-465d-b35d-a81ff9f1c73d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.346441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.348541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.349271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.349698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.350841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.352992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.355372 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3474/6953] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:52 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:52.356905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.372058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db6e6-c3b4-4b45-ac4d-1dba1c430ac5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.379118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.380275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.380671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.381187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.382469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.385738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.406760 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3475/6954] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:52.407866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.432333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c99dd003de49b0b2de54ef8f9e18ff', 'request_id': 'req-d798ca8c-9479-4e19-8757-13353632394b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.443742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c99dd003de49b0b2de54ef8f9e18ff', 'request_id': 'req-d798ca8c-9479-4e19-8757-13353632394b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.456962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c99dd003de49b0b2de54ef8f9e18ff', 'request_id': 'req-d798ca8c-9479-4e19-8757-13353632394b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.459230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d404a1c-7f1a-4312-afe3-8f4f9eac63a7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.477744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] The token cache is being invalidate because project 15c99dd003de49b0b2de54ef8f9e18ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:52.478026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.479260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.481267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3480/6955] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:52 2022] DELETE /identity/v3/projects/15c99dd003de49b0b2de54ef8f9e18ff => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:52.482936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.484630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:52.494474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:52.571103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.572670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.573075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.573466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.574301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.576224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.581656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3476/6956] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 15:15:52 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:52.585194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.589421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798ca8c-9479-4e19-8757-13353632394b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.591127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:52.613857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.614605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.614889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.615404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.616547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.618356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.629671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a526-3d69-4adb-8b27-1af18e4944e9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.640940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.642618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.643853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.644775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] PATH_INFO: `/v3/users/b420b56aff72402680813789f0ba264c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.648303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b420b56aff72402680813789f0ba264c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.651296 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3481/6957] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:52.652422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.653753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.658028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:52.703029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98c37d-4a36-48ae-bbc6-722ca736b1fd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.720731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.721701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.722069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.722381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.724955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.726880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.731995 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3482/6958] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:15:52 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:52.732925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.740531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:52.759325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22ab7-19d7-4883-a69f-36d31e0053cf tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:52.773970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:52.776047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.776691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.777182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] PATH_INFO: `/v3/projects/e7b296d581614e6fb284c01b1a968251/users/854d603cfcf94ffabdd95c46dc60525f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:52.823090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b296d581614e6fb284c01b1a968251, user_id=854d603cfcf94ffabdd95c46dc60525f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:52.829273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:52.874018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b420b56aff72402680813789f0ba264c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.875282 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3483/6959] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:52 2022] PUT /identity/v3/projects/e7b296d581614e6fb284c01b1a968251/users/854d603cfcf94ffabdd95c46dc60525f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:52.877054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:52.909026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b420b56aff72402680813789f0ba264c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.913741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b420b56aff72402680813789f0ba264c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.932554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b420b56aff72402680813789f0ba264c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.942156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-727adee9-6f01-4f38-9eb3-e337d38e9a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b420b56aff72402680813789f0ba264c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:52.967193 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3477/6960] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:52 2022] DELETE /identity/v3/users/b420b56aff72402680813789f0ba264c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:52.977518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:52.978066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:52.979132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.043936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] MFA Rules not processed for user `854d603cfcf94ffabdd95c46dc60525f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:53.050181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:53.152814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5c9a5-27cc-47fa-9029-76ed70841e35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.268674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3478/6961] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:53.276824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.281322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:53.374384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.375235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.375552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.375846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.376539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:53.378260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:53.384109 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3484/6962] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:15:52 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:53.385139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.391767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:53.393505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:53.409379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7765-701b-4f93-86e8-69587d7708b1 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.415343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.416773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.417859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.418346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.423047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:53.425115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:53.426383 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3485/6963] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:53 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 14 15:15:53.432672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.458038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e746392-8ed7-4aa6-9b6d-42c78e2da7a9 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.470103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.471044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.471369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.471657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.472420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:53.474185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:53.484001 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3486/6964] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 15:15:53 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 14 15:15:53.485988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.510864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023942d2-f5fb-4015-9488-01657bf19238 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.534977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.535962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.536283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.536871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.548229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ae9f1-8bf4-485e-b94d-7b3b5307e39e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.549355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:15:53.569969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.570678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.570973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Could not find domain: ad9175badc7947d2ad635d3c0dbd8dc2.: keystone.exception.DomainNotFound: Could not find domain: ad9175badc7947d2ad635d3c0dbd8dc2. Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ad9175badc7947d2ad635d3c0dbd8dc2. Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:53.571081 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:15:53.572344 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:15:53.573673 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ad9175badc7947d2ad635d3c0dbd8dc2. Jul 14 15:15:53.574900 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.574987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.574987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:53.574987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:53.577325 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3487/6965] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:15:53 2022] PATCH /identity/v3/domains/ad9175badc7947d2ad635d3c0dbd8dc2 => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:15:53.579883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.605853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184779-a5f4-48c6-9a27-77a3ac3e55f5 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.632542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.635213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.635531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.635815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/4e42bd4ecea44eefadb84ecda0669dea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.654202 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3479/6966] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:53 2022] POST /identity/v3/projects => generated 387 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:53.662920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:15:53.672198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Could not find domain: 4e42bd4ecea44eefadb84ecda0669dea.: keystone.exception.DomainNotFound: Could not find domain: 4e42bd4ecea44eefadb84ecda0669dea. Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4e42bd4ecea44eefadb84ecda0669dea. Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:53.708355 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:15:53.709522 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:15:53.710482 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4e42bd4ecea44eefadb84ecda0669dea. Jul 14 15:15:53.711540 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.720615 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3488/6967] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:15:53 2022] PATCH /identity/v3/domains/4e42bd4ecea44eefadb84ecda0669dea => generated 112 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:15:53.721956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.754107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea16f3-4fb1-426e-83bf-3210314149a6 tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.850201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '239460848c6644bab6389047c64910de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.850476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7889-4fcb-4da3-ad07-8ea5a3ef92d7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.850582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.850924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.856711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.857669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.858120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.858582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.859539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:53.861246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] PATH_INFO: `/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.861973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:53.885329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:15:53.893494 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3480/6968] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:53 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:15:53.894628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.899297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Could not find domain: 71dcb11cd9b3454ea7b0b6538eff9d29.: keystone.exception.DomainNotFound: Could not find domain: 71dcb11cd9b3454ea7b0b6538eff9d29. Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 71dcb11cd9b3454ea7b0b6538eff9d29. Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:15:53.903242 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:15:53.904809 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:15:53.905856 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 71dcb11cd9b3454ea7b0b6538eff9d29. Jul 14 15:15:53.907103 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:15:53.907103 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3489/6969] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:15:53 2022] PATCH /identity/v3/domains/71dcb11cd9b3454ea7b0b6538eff9d29 => generated 112 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:15:53.907103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:53.922153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:53.933051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740cc9-a862-4b58-adac-246ea4cb98f3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.940748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abcdcb-b6c4-44b0-b048-d66a989c61af tempest-DomainConfigurationTestJSON-1439933636 tempest-DomainConfigurationTestJSON-1439933636-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:53.950634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.950922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:53.951518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.951765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:53.951879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.952116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:53.952221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.952374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] PATH_INFO: `/v3/projects/5a59287c78c84159b57e6e5bf995cb16` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:53.952824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:53.954852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:53.955205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a59287c78c84159b57e6e5bf995cb16)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:53.960944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:53.997204 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3490/6970] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:54.004062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:54.012016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:54.058444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc01abd-c6eb-400b-bc56-437bb516f510 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:54.088109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a59287c78c84159b57e6e5bf995cb16', 'request_id': 'req-61127d16-821e-467b-bb7f-e87dc76ce5ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.103866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a59287c78c84159b57e6e5bf995cb16', 'request_id': 'req-61127d16-821e-467b-bb7f-e87dc76ce5ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.129114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a59287c78c84159b57e6e5bf995cb16', 'request_id': 'req-61127d16-821e-467b-bb7f-e87dc76ce5ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.153654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] The token cache is being invalidate because project 5a59287c78c84159b57e6e5bf995cb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:54.153973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.154973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.157034 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3481/6971] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:53 2022] DELETE /identity/v3/projects/5a59287c78c84159b57e6e5bf995cb16 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:54.161051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:54.163041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:54.223003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:54.240825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:54.241848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:54.242140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:54.242426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] PATH_INFO: `/v3/users/e068bf2146964aee8918f0ab3036626d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:54.249329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e068bf2146964aee8918f0ab3036626d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:54.256781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:54.381718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61127d16-821e-467b-bb7f-e87dc76ce5ee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:54.406539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541103-f627-4170-8938-48c6c438a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:54.406766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e068bf2146964aee8918f0ab3036626d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.408205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541103-f627-4170-8938-48c6c438a8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:54.408871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541103-f627-4170-8938-48c6c438a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:54.409541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541103-f627-4170-8938-48c6c438a8bf admin admin] PATH_INFO: `/v3/projects/eb7b74fd63ab473da3c4d3a9c6d86a3d/users/5277bfe9054c4e5aaa491a59c87ef186/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:54.432264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e068bf2146964aee8918f0ab3036626d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.449144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e068bf2146964aee8918f0ab3036626d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.449789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e068bf2146964aee8918f0ab3036626d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.458592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7541103-f627-4170-8938-48c6c438a8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7b74fd63ab473da3c4d3a9c6d86a3d, user_id=5277bfe9054c4e5aaa491a59c87ef186, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:54.462450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c57c3ab-97a2-4538-9165-a73b3bb60bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e068bf2146964aee8918f0ab3036626d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:54.467808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7541103-f627-4170-8938-48c6c438a8bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:54.480896 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3491/6972] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:53 2022] DELETE /identity/v3/users/e068bf2146964aee8918f0ab3036626d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:54.482608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:54.482909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:54.483201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:54.517448 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3482/6973] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:54 2022] PUT /identity/v3/projects/eb7b74fd63ab473da3c4d3a9c6d86a3d/users/5277bfe9054c4e5aaa491a59c87ef186/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:54.519167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2f820-9675-4edb-9091-c21cc409cdfd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:54.519523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2f820-9675-4edb-9091-c21cc409cdfd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:54.519857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2f820-9675-4edb-9091-c21cc409cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:54.523162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:54.524361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:54.544751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-57b2f820-9675-4edb-9091-c21cc409cdfd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:54.546003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-57b2f820-9675-4edb-9091-c21cc409cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:54.687466 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3492/6974] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:54.693747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:54.696201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:54.708942 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3483/6975] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:54.713104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852013-0967-431f-aafe-de220e621f33 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:54.713438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852013-0967-431f-aafe-de220e621f33 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:54.715262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852013-0967-431f-aafe-de220e621f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:54.717336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d241b-b8f8-4820-8da2-c02679b30d40 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:54.736255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:54.737338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:54.738025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:54.738559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:54.739863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:54.742632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:54.754595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fb852013-0967-431f-aafe-de220e621f33 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:54.758960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb852013-0967-431f-aafe-de220e621f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:54.766145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:54.786895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3493/6976] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:54.788079 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3484/6977] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:54.789002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb852013-0967-431f-aafe-de220e621f33 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:54.791603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:54.796307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:54.803115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb852013-0967-431f-aafe-de220e621f33 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:54.817620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:54.819737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:54.820027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:54.820308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] PATH_INFO: `/v3/projects/eb7b74fd63ab473da3c4d3a9c6d86a3d/users/5277bfe9054c4e5aaa491a59c87ef186/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:54.825838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7b74fd63ab473da3c4d3a9c6d86a3d, user_id=5277bfe9054c4e5aaa491a59c87ef186, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:54.829570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:54.858847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3485/6978] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:54 2022] PUT /identity/v3/projects/eb7b74fd63ab473da3c4d3a9c6d86a3d/users/5277bfe9054c4e5aaa491a59c87ef186/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:54.869683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:54.961486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687556c7-a46b-43c2-b850-dc3ad2e017b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.068294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408b2a4-67da-4647-8291-8ce41f96028f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.068983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408b2a4-67da-4647-8291-8ce41f96028f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.069277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408b2a4-67da-4647-8291-8ce41f96028f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.069564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408b2a4-67da-4647-8291-8ce41f96028f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.080688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408b2a4-67da-4647-8291-8ce41f96028f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:55.082407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408b2a4-67da-4647-8291-8ce41f96028f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:55.091597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666d8c8-5276-436b-81b0-cbe2d72b75d0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.106830 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3494/6979] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:55.109124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.109826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.110110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.110394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.111168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:55.111508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:55.113203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:55.119974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.120288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.120536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.184475 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3486/6980] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:55.192911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:55.215559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32f68c-6ac8-4917-aad3-0adc1d63ce9e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.216023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] MFA Rules not processed for user `5277bfe9054c4e5aaa491a59c87ef186`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:55.217333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:55.237577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.240757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.241256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.242259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.274756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:55.306973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:55.375533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:55.384995 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3495/6981] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:55.396603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:55.398400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:55.407415 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3487/6982] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:55 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:55.413326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:55.486549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:55.504455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae5714-0c96-46a0-9289-90a9d518d217 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.590702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.591566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.592302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.592674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.613018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5028320-d0ca-4b08-b4ce-7410e751bdd7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.623945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.624675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.625389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.625389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.625962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:55.628051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:55.677955 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3488/6983] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:55 2022] POST /identity/v3/users => generated 284 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:55.678952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:55.706118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0add8d-9531-4d31-982f-056f81f735b8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.721755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.722627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.723024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.723199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.724752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:55.726101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:55.763567 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3489/6984] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:55.764595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:55.772943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:55.776810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:55.795024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f4b7c-91ec-4dec-9826-c54ec660c178 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.802819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012da86-c53d-4a87-a5a5-4386e9aa9bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.803655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012da86-c53d-4a87-a5a5-4386e9aa9bed admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.804235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012da86-c53d-4a87-a5a5-4386e9aa9bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.804542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012da86-c53d-4a87-a5a5-4386e9aa9bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:55.805335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012da86-c53d-4a87-a5a5-4386e9aa9bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:55.807896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012da86-c53d-4a87-a5a5-4386e9aa9bed admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:55.843414 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3496/6985] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:15:55.858181 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3490/6986] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:55.862430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:55.922766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a845d-35a2-468e-808c-ab60adca6657 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:55.943006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:55.953581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:55.955475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:55.957117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] PATH_INFO: `/v3/projects/396848c4219d412ab46486519c9599da/users/c87d3fadd3c94469837d07d8f989db74/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:56.032435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=396848c4219d412ab46486519c9599da, user_id=c87d3fadd3c94469837d07d8f989db74, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:56.049340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:56.159803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3497/6987] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:55 2022] PUT /identity/v3/projects/396848c4219d412ab46486519c9599da/users/c87d3fadd3c94469837d07d8f989db74/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:56.173359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba87683-fd2f-4e37-881f-1755713b5b7d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:56.174079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba87683-fd2f-4e37-881f-1755713b5b7d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:56.175701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba87683-fd2f-4e37-881f-1755713b5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:56.223137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:56.225934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:56.302538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2ba87683-fd2f-4e37-881f-1755713b5b7d None None] MFA Rules not processed for user `c87d3fadd3c94469837d07d8f989db74`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:56.304315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ba87683-fd2f-4e37-881f-1755713b5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:56.365880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05558a-deef-4e91-929a-18600a3a43dc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:56.379664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:56.380537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:56.380928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:56.381189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] PATH_INFO: `/v3/projects/4600d4f1b07743c1a1c1234b6e83439c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:56.388629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4600d4f1b07743c1a1c1234b6e83439c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:56.391168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:56.526511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:56.548831 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3491/6988] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:56.554367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba87683-fd2f-4e37-881f-1755713b5b7d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:56.601783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4600d4f1b07743c1a1c1234b6e83439c', 'request_id': 'req-46684eaf-fa05-4587-8706-297990a6f4d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.620342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4600d4f1b07743c1a1c1234b6e83439c', 'request_id': 'req-46684eaf-fa05-4587-8706-297990a6f4d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.639938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba87683-fd2f-4e37-881f-1755713b5b7d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:56.651146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4600d4f1b07743c1a1c1234b6e83439c', 'request_id': 'req-46684eaf-fa05-4587-8706-297990a6f4d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.673292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] The token cache is being invalidate because project 4600d4f1b07743c1a1c1234b6e83439c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:56.673292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.674404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.679484 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3498/6989] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:56 2022] DELETE /identity/v3/projects/4600d4f1b07743c1a1c1234b6e83439c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:56.680558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:56.683886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:56.787521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:56.803822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46684eaf-fa05-4587-8706-297990a6f4d7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:56.808433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:56.809132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:56.809445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:56.809733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:56.810479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:56.811720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:56.812878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:56.813411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:56.813838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] PATH_INFO: `/v3/users/239460848c6644bab6389047c64910de` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:56.815826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=239460848c6644bab6389047c64910de)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:56.816069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:56.818950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:56.891602 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3492/6990] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:56 2022] POST /identity/v3/projects => generated 365 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:56.892553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:56.895666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '239460848c6644bab6389047c64910de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.904490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:56.915406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '239460848c6644bab6389047c64910de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.926953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '239460848c6644bab6389047c64910de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.927849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '239460848c6644bab6389047c64910de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.939578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '239460848c6644bab6389047c64910de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:56.948784 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3499/6991] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:56 2022] DELETE /identity/v3/users/239460848c6644bab6389047c64910de => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:57.072075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0a5b1-7a82-4f50-a7ec-52cc59236d22 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:57.237883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:57.238584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:57.238870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:57.239785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:57.240506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:57.242646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:57.314103 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3493/6992] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:56 2022] POST /identity/v3/users => generated 289 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:57.319760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:57.325347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:57.359618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ffb6-488c-4f01-9733-0a386498f10e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:57.377759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:57.378982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:57.379509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:57.380019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:57.381370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:57.385450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:57.405034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:57.409527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:57.433461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3500/6993] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:15:57.435393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:57.443542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435bcd8-56cb-4b4e-8e3f-209fc370f364 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:57.451130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:57.452201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:57.452503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:57.452789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] PATH_INFO: `/v3/users/854d603cfcf94ffabdd95c46dc60525f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:57.454203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854d603cfcf94ffabdd95c46dc60525f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:57.458664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:57.480358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04915231-f3ca-434f-a2cd-d4574af64de1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:57.491106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:57.492524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:57.492999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:57.493289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] PATH_INFO: `/v3/projects/6dc5a1a041664f3a92c7507b35e906a6/users/94825e9c2ecc481796e12e5baac9a80e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:57.540359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc5a1a041664f3a92c7507b35e906a6, user_id=94825e9c2ecc481796e12e5baac9a80e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:57.550119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:57.565552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854d603cfcf94ffabdd95c46dc60525f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:57.569721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:57.582179 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3501/6994] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:57 2022] PUT /identity/v3/projects/6dc5a1a041664f3a92c7507b35e906a6/users/94825e9c2ecc481796e12e5baac9a80e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:57.588594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:57.605662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854d603cfcf94ffabdd95c46dc60525f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:57.607844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854d603cfcf94ffabdd95c46dc60525f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:57.621963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:57.629649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854d603cfcf94ffabdd95c46dc60525f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:57.632816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa2d11c-26aa-4061-9a28-da053f38ad16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854d603cfcf94ffabdd95c46dc60525f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:57.714364 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3494/6995] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:15:57 2022] DELETE /identity/v3/users/854d603cfcf94ffabdd95c46dc60525f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:15:57.725353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:57.725658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:57.725953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:57.833546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:57.839985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:57.866118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d0fbc-4e76-4b40-8125-886cb3f2f885 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:57.992266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:57.992730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:57.992906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:57.993238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:57.994451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:57.996160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:58.009290 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3502/6996] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:15:58.011581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:58.013195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:58.029589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e80ec5-180c-4ccc-a35e-cd5c3c38ea6f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:58.036525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:58.037570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:58.037970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:58.038484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] PATH_INFO: `/v3/projects/f9dc0e26d82c4aa98de8eaaf265908fc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:58.040257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9dc0e26d82c4aa98de8eaaf265908fc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:58.042948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:58.101619 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3495/6997] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:58.109009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:58.111957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:58.114245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'request_id': 'req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:58.123959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'request_id': 'req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:58.132592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dc0e26d82c4aa98de8eaaf265908fc', 'request_id': 'req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:58.140430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cef9d-8c3c-4eed-9f5d-ba4fbd3a7ce0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:58.154821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] The token cache is being invalidate because project f9dc0e26d82c4aa98de8eaaf265908fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:15:58.157647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:58.159449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:15:58.162281 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3503/6998] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:58 2022] DELETE /identity/v3/projects/f9dc0e26d82c4aa98de8eaaf265908fc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:58.164106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:58.171311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:58.252764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:58.345057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5415f6-2182-49ec-ae00-cabf6ff69d9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:58.349092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881351b5-7fca-4605-932f-bc75a52437b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:58.350052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881351b5-7fca-4605-932f-bc75a52437b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:58.350338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881351b5-7fca-4605-932f-bc75a52437b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:58.350621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881351b5-7fca-4605-932f-bc75a52437b8 admin admin] PATH_INFO: `/v3/projects/6dc5a1a041664f3a92c7507b35e906a6/users/94825e9c2ecc481796e12e5baac9a80e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:58.354339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881351b5-7fca-4605-932f-bc75a52437b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc5a1a041664f3a92c7507b35e906a6, user_id=94825e9c2ecc481796e12e5baac9a80e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:58.358874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881351b5-7fca-4605-932f-bc75a52437b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:58.365037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c2fc0-aa14-411e-bf60-51a24f65e988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:58.370691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2fc0-aa14-411e-bf60-51a24f65e988 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:58.370945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2fc0-aa14-411e-bf60-51a24f65e988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:58.371308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2fc0-aa14-411e-bf60-51a24f65e988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:58.376795 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3496/6999] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:15:58 2022] PUT /identity/v3/projects/6dc5a1a041664f3a92c7507b35e906a6/users/94825e9c2ecc481796e12e5baac9a80e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:15:58.378229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a0c2fc0-aa14-411e-bf60-51a24f65e988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:58.378564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cb682-452f-4e4d-abd6-5bf420eded82 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:58.379028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cb682-452f-4e4d-abd6-5bf420eded82 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:58.379340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cb682-452f-4e4d-abd6-5bf420eded82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:58.408413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ea9cb682-452f-4e4d-abd6-5bf420eded82 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:58.410031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ea9cb682-452f-4e4d-abd6-5bf420eded82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:58.412584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c2fc0-aa14-411e-bf60-51a24f65e988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:58.414494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c2fc0-aa14-411e-bf60-51a24f65e988 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:58.442604 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3504/7000] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:15:58.543162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5648f1c-783b-4e12-a672-fe86d8d7b1b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:58.543680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5648f1c-783b-4e12-a672-fe86d8d7b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:58.543843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5648f1c-783b-4e12-a672-fe86d8d7b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:58.592267 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3497/7001] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:58.601277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74780709-7832-466d-bcbd-daa9083bd1f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:58.601452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74780709-7832-466d-bcbd-daa9083bd1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:58.601937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74780709-7832-466d-bcbd-daa9083bd1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:58.607548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d5648f1c-783b-4e12-a672-fe86d8d7b1b8 None None] MFA Rules not processed for user `94825e9c2ecc481796e12e5baac9a80e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:58.611070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5648f1c-783b-4e12-a672-fe86d8d7b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:58.657034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-74780709-7832-466d-bcbd-daa9083bd1f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:15:58.659087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74780709-7832-466d-bcbd-daa9083bd1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:58.697987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3498/7002] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:15:58.724889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74780709-7832-466d-bcbd-daa9083bd1f4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:58.768831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74780709-7832-466d-bcbd-daa9083bd1f4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:58.790103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:58.791457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:58.807776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:58.808350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:58.809913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:15:58.810302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:58.813458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:58.891369 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3499/7003] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:58.910256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:58.946255 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3505/7004] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:15:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:15:58.955427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5648f1c-783b-4e12-a672-fe86d8d7b1b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:58.965533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:58.981578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363b1b-a00d-45a3-a116-29bf10789008 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:58.990157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5648f1c-783b-4e12-a672-fe86d8d7b1b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:59.001747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:59.002850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:59.004446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:59.005006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:59.006275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:59.010048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:59.015644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:59.016754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:59.017257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:59.017752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:59.019048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:59.022423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:59.146560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3500/7005] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:58 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:59.154577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:59.155612 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3506/7006] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:15:58 2022] POST /identity/v3/projects => generated 358 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:15:59.157760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:59.448177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51efb-a58f-4bc0-8f22-d0bbfad3673a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:59.460570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854557-820a-4334-ba48-1f361a243357 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:59.470030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:59.473075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:59.476377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:59.477088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:59.485376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:59.493352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:59.602489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3501/7007] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:59 2022] POST /identity/v3/users => generated 369 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:59.605234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:59.611250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:15:59.646541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:59.731182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:59.732249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:59.732640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:59.733023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:59.733854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:59.736245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:59.781587 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3507/7008] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:15:59 2022] POST /identity/v3/users => generated 283 bytes in 625 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:15:59.783585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:59.822787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149d1f-8929-406f-b663-d1cfa74f87ff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:59.827039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a270f-54a3-430a-bbe8-1f9e0622332e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:59.834594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:59.836223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:59.837018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:59.837506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/a5a48a5f13f0463891b312e96ef1577f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:59.841437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:59.843532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:59.844084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:59.844472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] PATH_INFO: `/v3/projects/e7b296d581614e6fb284c01b1a968251` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:59.848082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b296d581614e6fb284c01b1a968251)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:59.854997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:59.888435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:get_user(user_id=a5a48a5f13f0463891b312e96ef1577f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:59.888435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:59.888435 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3508/7009] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:15:59 2022] GET /identity/v3/users/a5a48a5f13f0463891b312e96ef1577f => generated 369 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:15:59.888435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:15:59.928905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e074f8-248e-42cf-bb92-4958288e63e8 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:15:59.945589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:15:59.948463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:15:59.950954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:15:59.952531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:15:59.972444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:15:59.977110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:15:59.979489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b296d581614e6fb284c01b1a968251', 'request_id': 'req-0837f812-1651-4a97-b13a-c004fa3478fa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.010675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b296d581614e6fb284c01b1a968251', 'request_id': 'req-0837f812-1651-4a97-b13a-c004fa3478fa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.017331 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3509/7010] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:00.024667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:00.030767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b296d581614e6fb284c01b1a968251', 'request_id': 'req-0837f812-1651-4a97-b13a-c004fa3478fa'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.048684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:00.061089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] The token cache is being invalidate because project e7b296d581614e6fb284c01b1a968251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:00.062306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.064792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.065298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cb44-74af-4b6c-8bab-4424e67fd864 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:00.069346 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3502/7011] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:15:59 2022] DELETE /identity/v3/projects/e7b296d581614e6fb284c01b1a968251 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:00.077251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:00.080599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:00.236375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:00.237318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:00.237616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:00.237917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/a5a48a5f13f0463891b312e96ef1577f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:00.240162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a5a48a5f13f0463891b312e96ef1577f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:00.242849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:00.368778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a48a5f13f0463891b312e96ef1577f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.409575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a48a5f13f0463891b312e96ef1577f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.442734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f812-1651-4a97-b13a-c004fa3478fa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:00.448525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a48a5f13f0463891b312e96ef1577f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.456133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a48a5f13f0463891b312e96ef1577f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.463047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:00.467461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:00.468196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:00.468729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:00.479095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:00.488900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:00.492207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a48a5f13f0463891b312e96ef1577f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.512415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3510/7012] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:00 2022] DELETE /identity/v3/users/a5a48a5f13f0463891b312e96ef1577f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:00.513612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:00.522505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:00.564712 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3503/7013] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:00.569296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:00.573021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:00.641790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5346-445f-42b4-bba5-9687c55a0ca7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:00.651093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:00.753116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eebfe9-85b2-4462-939a-6d74e294939d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:00.768356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:00.769447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:00.771665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:00.772121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] PATH_INFO: `/v3/users/5277bfe9054c4e5aaa491a59c87ef186` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:00.776515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5277bfe9054c4e5aaa491a59c87ef186)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:00.783393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:00.785849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:00.790104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:00.794796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:00.797090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/e8e1aa595d494e97814f98787749d2e6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:00.801872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e8e1aa595d494e97814f98787749d2e6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:00.808947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:00.920669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5277bfe9054c4e5aaa491a59c87ef186'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.952092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e1aa595d494e97814f98787749d2e6', 'request_id': 'req-7dde9ac6-ac9b-4387-8737-e92f81100c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.957285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5277bfe9054c4e5aaa491a59c87ef186'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.975420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e1aa595d494e97814f98787749d2e6', 'request_id': 'req-7dde9ac6-ac9b-4387-8737-e92f81100c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.987152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5277bfe9054c4e5aaa491a59c87ef186'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.992559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e1aa595d494e97814f98787749d2e6', 'request_id': 'req-7dde9ac6-ac9b-4387-8737-e92f81100c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:00.999991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5277bfe9054c4e5aaa491a59c87ef186'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:01.035519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] The token cache is being invalidate because project e8e1aa595d494e97814f98787749d2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:01.035913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:01.036778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:01.040044 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3504/7014] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:00 2022] DELETE /identity/v3/projects/e8e1aa595d494e97814f98787749d2e6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:01.041327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:01.046274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:01.124662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5277bfe9054c4e5aaa491a59c87ef186'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:01.175884 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3511/7015] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:00 2022] DELETE /identity/v3/users/5277bfe9054c4e5aaa491a59c87ef186 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:01.189799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:01.202969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:01.311310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:01.535697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5b93-a9ab-45eb-99b7-2cd1d6f24306 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:01.559429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7919a-83b9-4ea7-a0c6-84e765ba3e18 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:01.560170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7919a-83b9-4ea7-a0c6-84e765ba3e18 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:01.560477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7919a-83b9-4ea7-a0c6-84e765ba3e18 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:01.560764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7919a-83b9-4ea7-a0c6-84e765ba3e18 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:01.560965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9ac6-ac9b-4387-8737-e92f81100c8d tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:01.561497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7919a-83b9-4ea7-a0c6-84e765ba3e18 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:01.565668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7919a-83b9-4ea7-a0c6-84e765ba3e18 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:01.662811 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3512/7016] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:01 2022] POST /identity/v3/projects => generated 360 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:01.666239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57eb17-2fba-4b8c-8042-38db95c5328c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:01.666538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57eb17-2fba-4b8c-8042-38db95c5328c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:01.666830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57eb17-2fba-4b8c-8042-38db95c5328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:01.727533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6b57eb17-2fba-4b8c-8042-38db95c5328c None None] MFA Rules not processed for user `83513b7f5185436b8ea320c025f673af`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:01.739397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b57eb17-2fba-4b8c-8042-38db95c5328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:01.780701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:01.781647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:01.781945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:01.782236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] PATH_INFO: `/v3/projects/d5926250de6e4c55862663c631daea97/users/3bdf8aee69724f45a08e87c4920b453e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:01.807477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5926250de6e4c55862663c631daea97, user_id=3bdf8aee69724f45a08e87c4920b453e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:01.810544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:01.821629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:01.847849 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3505/7017] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:01 2022] PUT /identity/v3/projects/d5926250de6e4c55862663c631daea97/users/3bdf8aee69724f45a08e87c4920b453e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:01.848981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:01.966488 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3513/7018] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:01.968215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa47be-a4c8-4d6d-99d9-927882bcc7a4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:01.974112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa47be-a4c8-4d6d-99d9-927882bcc7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:01.978781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa47be-a4c8-4d6d-99d9-927882bcc7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:02.062795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a5aa47be-a4c8-4d6d-99d9-927882bcc7a4 None None] MFA Rules not processed for user `3bdf8aee69724f45a08e87c4920b453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:02.065944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5aa47be-a4c8-4d6d-99d9-927882bcc7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:02.160256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6739d0-3366-4c2e-9707-40fd9695b36d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:02.191605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:02.192561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:02.193015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:02.193779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:02.202738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:02.209614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:02.362281 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3506/7019] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:01 2022] POST /identity/v3/users => generated 414 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:02.368532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:02.375600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:02.397307 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3514/7020] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:02.398226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa47be-a4c8-4d6d-99d9-927882bcc7a4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:02.455868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa47be-a4c8-4d6d-99d9-927882bcc7a4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:02.480660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:02.481397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:02.481698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:02.481992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:02.487557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:02.489651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:02.554082 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3515/7021] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:02 2022] POST /identity/v3/roles => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:02.558838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:02.565014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:02.700645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:02.753118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8a29a-f101-48ad-86da-4f3566dc4493 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:02.768682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:02.769598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:02.769882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:02.770519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] PATH_INFO: `/v3/projects/eb7b74fd63ab473da3c4d3a9c6d86a3d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:02.785329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7b74fd63ab473da3c4d3a9c6d86a3d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:02.787718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:02.811349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c86a6-f6b8-4e50-ba59-43709645d37b tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:02.824665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:02.825762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:02.825762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:02.826069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:02.826960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:02.830068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:02.903789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7b74fd63ab473da3c4d3a9c6d86a3d', 'request_id': 'req-93239d4a-c9e2-4998-9947-9de4570dd8bc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:02.910115 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3516/7022] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:02 2022] POST /identity/v3/projects => generated 365 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:02.912910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:02.916603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7b74fd63ab473da3c4d3a9c6d86a3d', 'request_id': 'req-93239d4a-c9e2-4998-9947-9de4570dd8bc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:02.944295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7b74fd63ab473da3c4d3a9c6d86a3d', 'request_id': 'req-93239d4a-c9e2-4998-9947-9de4570dd8bc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:02.985716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] The token cache is being invalidate because project eb7b74fd63ab473da3c4d3a9c6d86a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:02.986028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:02.986971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:02.992764 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3507/7023] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:02 2022] DELETE /identity/v3/projects/eb7b74fd63ab473da3c4d3a9c6d86a3d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:02.994495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.000344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:03.074735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:03.147191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239d4a-c9e2-4998-9947-9de4570dd8bc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:03.168199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4bbd-71ea-44d9-bfe8-a13f5a05e1b4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:03.190305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:03.191460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.191764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.192132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/548d69721fce4578b0c733a712dec70d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.236426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:get_user(user_id=548d69721fce4578b0c733a712dec70d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:03.249568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:03.254690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3517/7024] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:16:02 2022] GET /identity/v3/users/548d69721fce4578b0c733a712dec70d => generated 414 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:03.255666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.269910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:03.318425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f401f91-0e42-4f00-aa3b-c206c76ea5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:03.319837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f401f91-0e42-4f00-aa3b-c206c76ea5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.320258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f401f91-0e42-4f00-aa3b-c206c76ea5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.320410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f401f91-0e42-4f00-aa3b-c206c76ea5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.336652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f401f91-0e42-4f00-aa3b-c206c76ea5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:03.363380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f401f91-0e42-4f00-aa3b-c206c76ea5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:03.364887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f401f91-0e42-4f00-aa3b-c206c76ea5f3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:03.390582 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3508/7025] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:03.392301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.392603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.392891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.435049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:03.436286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:03.438464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9672024-133c-4fa9-bc40-8ab80df1efbe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:03.457815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:03.458526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.458831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.459123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.464997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:03.467157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:03.476239 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3509/7026] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:03.476556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.485263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:03.523053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a038db-347a-4171-8721-5ed3c288f454 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:03.534731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530e12a-1910-4e8d-93dc-1ceef3de4f38 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:03.535925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530e12a-1910-4e8d-93dc-1ceef3de4f38 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.536383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530e12a-1910-4e8d-93dc-1ceef3de4f38 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.536862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530e12a-1910-4e8d-93dc-1ceef3de4f38 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/roles/48f1a10333204f94ae5625e815d9975b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.539604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530e12a-1910-4e8d-93dc-1ceef3de4f38 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:get_role(role_id=48f1a10333204f94ae5625e815d9975b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:03.541639 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-a530e12a-1910-4e8d-93dc-1ceef3de4f38 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:03.541639 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:03.541639 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:03.542968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530e12a-1910-4e8d-93dc-1ceef3de4f38 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:03.548194 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3510/7027] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:16:03 2022] GET /identity/v3/roles/48f1a10333204f94ae5625e815d9975b => generated 240 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:03.549721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eec5c-12d3-4b7f-9aeb-b239135f37a3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.550025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eec5c-12d3-4b7f-9aeb-b239135f37a3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.550310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eec5c-12d3-4b7f-9aeb-b239135f37a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.552859 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3518/7028] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:03 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:03.557334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.599532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843d9b-8be3-410b-913b-1175c97a226f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:03.600078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8b4eec5c-12d3-4b7f-9aeb-b239135f37a3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:03.603723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b4eec5c-12d3-4b7f-9aeb-b239135f37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:03.620423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:03.622028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.622602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.623159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.628990 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3511/7029] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:03.628990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4eec5c-12d3-4b7f-9aeb-b239135f37a3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.629261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:03.638561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:03.658249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4eec5c-12d3-4b7f-9aeb-b239135f37a3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:03.666326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:03.667044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.667371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.667667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.668378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:03.670317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:03.692629 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3519/7030] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:03 2022] GET /identity/v3/roles => generated 1651 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:03.692629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.778685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91752dd0-bb49-42a0-b3b2-814bf201115f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:03.786108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:03.796927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:03.797718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:03.798011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:03.798293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:03.799125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:03.799482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:03.810771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:03.836472 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3512/7031] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:03 2022] POST /identity/v3/projects => generated 360 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:03.844789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.862187 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3520/7032] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:03.864099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:03.904944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384917-7db6-4fae-8dbf-5cfaa0cb1720 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:04.037089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318ddb8-63cb-473e-a708-25cfc6c88203 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:04.055153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:04.056674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:04.057131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:04.057295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] PATH_INFO: `/v3/projects/8443577a582b439b81f049c06889bccf/users/b5927d55b39b43d7800381bcc6486353/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:04.082930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:04.083873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:04.084166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:04.084452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/4a0a6dd0062a4301a067280f309de8e4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:04.089479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:get_project(project_id=4a0a6dd0062a4301a067280f309de8e4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:04.091661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:04.120452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8443577a582b439b81f049c06889bccf, user_id=b5927d55b39b43d7800381bcc6486353, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:04.123143 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3521/7033] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:16:03 2022] GET /identity/v3/projects/4a0a6dd0062a4301a067280f309de8e4 => generated 360 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:04.124151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:04.125843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:04.154640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15c162-af0e-4087-89ae-618945bcec3f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:04.184392 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3513/7034] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:03 2022] PUT /identity/v3/projects/8443577a582b439b81f049c06889bccf/users/b5927d55b39b43d7800381bcc6486353/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:04.189551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:04.238049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:04.308856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:04.309788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:04.310199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:04.313295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:04.314496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:04.316672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:04.381670 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3522/7035] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:04 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:04.382714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:04.396143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd4f93-be92-4d3f-91ea-e3ad73f7d550 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:04.567315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f21f1c-dfdf-4638-a53a-0550959086e3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:04.581194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:04.581987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:04.582411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:04.582795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:04.583829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:04.586396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:04.601327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3523/7036] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:04 2022] GET /identity/v3/roles => generated 1651 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:04.602937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:04.621724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe25b-8408-4886-b37c-d0cd52217880 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:04.628722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:04.630167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:04.630827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:04.631320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/4a0a6dd0062a4301a067280f309de8e4/users/548d69721fce4578b0c733a712dec70d/roles/48f1a10333204f94ae5625e815d9975b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:04.636373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4a0a6dd0062a4301a067280f309de8e4, user_id=548d69721fce4578b0c733a712dec70d, role_id=48f1a10333204f94ae5625e815d9975b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:04.646339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:04.646915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:04.647326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:04.647586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:04.647707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:04.648323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:04.659743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:04.703349 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3514/7037] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:04 2022] PUT /identity/v3/projects/4a0a6dd0062a4301a067280f309de8e4/users/548d69721fce4578b0c733a712dec70d/roles/48f1a10333204f94ae5625e815d9975b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:04.707320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:04.742972 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3524/7038] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:04 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:04.745738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:04.817252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12c7f-8905-43ad-b9d7-42249d10cf72 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:04.923390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:04.939006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:04.940181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:04.940589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:04.941240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:04.942326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:04.945195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:05.059295 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3525/7039] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:04 2022] POST /identity/v3/projects => generated 359 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:05.059295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:05.108775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff6631-4d06-4e06-820d-c696c31c8b7a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.147257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:05.255822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:05.259724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.260020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.260300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] PATH_INFO: `/v3/projects/8443577a582b439b81f049c06889bccf/users/b5927d55b39b43d7800381bcc6486353/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:05.264249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8443577a582b439b81f049c06889bccf, user_id=b5927d55b39b43d7800381bcc6486353, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:05.267383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:05.276327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1519-68c9-4aa2-9b76-c1db331ab17e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.288217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce95039-e8bd-4a7c-b13f-00c23178df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:05.289311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce95039-e8bd-4a7c-b13f-00c23178df73 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.289800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce95039-e8bd-4a7c-b13f-00c23178df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.290275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce95039-e8bd-4a7c-b13f-00c23178df73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:05.291826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce95039-e8bd-4a7c-b13f-00c23178df73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:05.294273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce95039-e8bd-4a7c-b13f-00c23178df73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:05.298513 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3515/7040] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:04 2022] PUT /identity/v3/projects/8443577a582b439b81f049c06889bccf/users/b5927d55b39b43d7800381bcc6486353/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:05.300959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:05.320391 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3526/7041] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:05 2022] GET /identity/v3/roles => generated 1651 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:05.323543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d696-165d-4a9a-a454-41b020ee1a47 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.324148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d696-165d-4a9a-a454-41b020ee1a47 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.324592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d696-165d-4a9a-a454-41b020ee1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:05.397559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4631d696-165d-4a9a-a454-41b020ee1a47 None None] MFA Rules not processed for user `b5927d55b39b43d7800381bcc6486353`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:05.400603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4631d696-165d-4a9a-a454-41b020ee1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:05.486519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb7990-801e-43a3-a458-5f62616651c5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.494407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:05.495384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.495637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.496065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/32fc73162a5040c9a396dff1549878b0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:05.497695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:get_project(project_id=32fc73162a5040c9a396dff1549878b0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:05.501082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:05.507555 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3516/7042] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:16:05 2022] GET /identity/v3/projects/32fc73162a5040c9a396dff1549878b0 => generated 359 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:05.510895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:05.541701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3527/7043] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:05.543371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d696-165d-4a9a-a454-41b020ee1a47 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:05.590310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d696-165d-4a9a-a454-41b020ee1a47 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.595433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:05.596341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.596639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.596928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/32fc73162a5040c9a396dff1549878b0/users/548d69721fce4578b0c733a712dec70d/roles/48f1a10333204f94ae5625e815d9975b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:05.599500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32fc73162a5040c9a396dff1549878b0, user_id=548d69721fce4578b0c733a712dec70d, role_id=48f1a10333204f94ae5625e815d9975b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:05.602297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:05.626485 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3528/7044] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:05 2022] PUT /identity/v3/projects/32fc73162a5040c9a396dff1549878b0/users/548d69721fce4578b0c733a712dec70d/roles/48f1a10333204f94ae5625e815d9975b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:05.628329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:05.678700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fde26-baf6-437c-9ec5-80cc3295e228 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.694734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:05.776855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df863f39-3d3a-4835-a082-f4e872ba885e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.785817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:05.786879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.787174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.787510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:05.788381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:05.795881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:05.818197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:05.819673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.819896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.824389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:05.826441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:05.829986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:05.835847 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3529/7045] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:16:05 2022] POST /identity/v3/domains => generated 274 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:05.836856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:05.870065 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3517/7046] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:05 2022] GET /identity/v3/roles => generated 1651 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:05.871117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:05.904438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5093-21bd-47fe-9958-0d605f287500 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.920782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:05.979612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75e55-029a-4448-b139-149d6f540cfb tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:05.986717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:05.988280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:05.988280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:05.988547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/548d69721fce4578b0c733a712dec70d/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:06.001783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=548d69721fce4578b0c733a712dec70d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:06.004195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:06.058006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3530/7047] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:16:05 2022] GET /identity/v3/users/548d69721fce4578b0c733a712dec70d/projects => generated 843 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:06.059561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:06.080702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:06.081472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:06.081785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:06.082137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:06.085057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:06.089700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:06.202861 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3518/7048] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:05 2022] POST /identity/v3/users => generated 347 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:06.204100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:06.254197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef73f-bce7-4b24-a526-34a0d8dc24e6 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:06.256550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b8931-a6b6-445e-b227-a30d90763e9e tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:06.270892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:06.271888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:06.272499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:06.272871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:06.273285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/32fc73162a5040c9a396dff1549878b0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:06.274024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:06.274445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:06.274865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] PATH_INFO: `/v3/projects/178964408b17444d8a2c38c9b3e64359/users/450b7ea9a4e44d149bd7ea40eaf0d31d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:06.275859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32fc73162a5040c9a396dff1549878b0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:06.278680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:06.311319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178964408b17444d8a2c38c9b3e64359, user_id=450b7ea9a4e44d149bd7ea40eaf0d31d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:06.315209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:06.342362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3531/7049] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:06 2022] PUT /identity/v3/projects/178964408b17444d8a2c38c9b3e64359/users/450b7ea9a4e44d149bd7ea40eaf0d31d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:06.344027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:06.405243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fc73162a5040c9a396dff1549878b0', 'request_id': 'req-9c07a540-e472-42f8-b564-6f38b847b101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:06.425720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fc73162a5040c9a396dff1549878b0', 'request_id': 'req-9c07a540-e472-42f8-b564-6f38b847b101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:06.438545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fc73162a5040c9a396dff1549878b0', 'request_id': 'req-9c07a540-e472-42f8-b564-6f38b847b101'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:06.491084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] The token cache is being invalidate because project 32fc73162a5040c9a396dff1549878b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:06.491415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:06.497325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c07a540-e472-42f8-b564-6f38b847b101 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:06.504076 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3519/7050] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:06 2022] DELETE /identity/v3/projects/32fc73162a5040c9a396dff1549878b0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:06.519301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:06.521970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:06.525797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:06.580298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5629dcc-fc55-41f9-af5a-c725db530334 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:06.596688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:06.599707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:06.615200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:06.629218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:06.777657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:06.778397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:06.783061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:06.783491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:06.784281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:06.786245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:06.845895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3532/7051] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:06 2022] POST /identity/v3/users => generated 322 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:06.846844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:06.854289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:06.906245 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3520/7052] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:06.906245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:06.906245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:07.057421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c84e3-8882-497d-a41b-e98d32f0da7c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:07.076739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:07.078157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:07.078679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:07.079476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users/6e161fafff9148d2bf0a15cb215ef1ef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:07.138055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:get_user(user_id=6e161fafff9148d2bf0a15cb215ef1ef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:07.163100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833ca48-c89c-42a3-bdd9-ea940ae432c3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:07.164280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:07.166319 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3521/7053] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:16:06 2022] GET /identity/v3/users/6e161fafff9148d2bf0a15cb215ef1ef => generated 347 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:07.175457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:07.183492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:07.199572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:07.200871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:07.201293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:07.201703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/4a0a6dd0062a4301a067280f309de8e4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:07.203649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a0a6dd0062a4301a067280f309de8e4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:07.206997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:07.420364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0a6dd0062a4301a067280f309de8e4', 'request_id': 'req-75c8c381-eeb7-4934-861a-923ff8c5706e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:07.433912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdc860-7727-4428-8555-5529febd40d7 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:07.444079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0a6dd0062a4301a067280f309de8e4', 'request_id': 'req-75c8c381-eeb7-4934-861a-923ff8c5706e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:07.456371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0a6dd0062a4301a067280f309de8e4', 'request_id': 'req-75c8c381-eeb7-4934-861a-923ff8c5706e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:07.517361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] The token cache is being invalidate because project 4a0a6dd0062a4301a067280f309de8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:07.517740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:07.524484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:07.538744 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3533/7054] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:06 2022] DELETE /identity/v3/projects/4a0a6dd0062a4301a067280f309de8e4 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:07.540006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:07.544974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:07.704400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:07.710339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:07.712910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:07.714009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:07.722665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:07.727350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:07.808596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c381-eeb7-4934-861a-923ff8c5706e tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:07.832938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:07.833658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:07.833957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:07.834428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:07.835296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Adding query filter params (domain_id=e374ef3852314d6fae8a615248f1affc) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:07.835650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:07.837857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:07.940416 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3534/7055] 10.222.0.98 () {58 vars in 1206 bytes} [Thu Jul 14 15:16:07 2022] GET /identity/v3/users?domain_id=e374ef3852314d6fae8a615248f1affc => generated 484 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:07.945133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:07.960050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:08.070020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.071982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.089726 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3522/7056] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 916 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:08.091665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:08.100922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:08.117003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784064a0-1c34-46de-8489-d3ef9ad4f571 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:08.139984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:08.140688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:08.140975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:08.141441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:08.142453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.144572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.192763 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3523/7057] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:08 2022] GET /identity/v3/users => generated 9258 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:08.194825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:08.197265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:08.212126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec0030-330a-438e-a607-294c01186aa2 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:08.233255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:08.234644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:08.235057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:08.235518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/roles/48f1a10333204f94ae5625e815d9975b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:08.249244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_role(role_id=48f1a10333204f94ae5625e815d9975b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.251876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.334971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5e716-1dc0-4749-b2a8-28a2b3eea7e4 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:08.340017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:08.340976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:08.341424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:08.341880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:08.345813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invalidating the token cache because role 48f1a10333204f94ae5625e815d9975b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:08.346119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:08.347018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:08.352768 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3535/7058] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:07 2022] DELETE /identity/v3/roles/48f1a10333204f94ae5625e815d9975b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:08.352768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:08.352768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:08.359731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:08.548482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4eee8-5c83-43d9-a609-384eac5d0bef tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:08.554516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:08.556228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:08.556687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:08.557171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:08.558200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1278718998) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:08.558411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.558907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.559978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.562029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.586321 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3524/7059] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:08.587165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:08.633264 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3536/7060] 10.222.0.98 () {58 vars in 1188 bytes} [Thu Jul 14 15:16:08 2022] GET /identity/v3/users?name=tempest-test_user-1278718998 => generated 475 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:08.647610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:08.659023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9422a2-31db-414e-b5dc-2c241b4aaf53 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:08.684308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387813a-6a54-4adc-89a2-9e9be0ee1cf3 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:08.700101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:08.700832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:08.701132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:08.701425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:08.703409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:08.703736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.710272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.808303 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3537/7061] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 15:16:08 2022] GET /identity/v3/users?enabled=False => generated 835 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:08.813384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:08.827437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:08.830183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:08.830465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:08.830752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/548d69721fce4578b0c733a712dec70d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:08.838449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_user(user_id=548d69721fce4578b0c733a712dec70d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.840525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.861039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5ebf-aafc-4927-84be-cdaffa88e45a tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:08.879651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:08.886574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:08.886574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:08.888391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users/912e68bd7d5d4b0ebd8dde177c01a0ed` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:08.936468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:delete_user(user_id=912e68bd7d5d4b0ebd8dde177c01a0ed)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:08.946035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:08.995405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:09.071309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548d69721fce4578b0c733a712dec70d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.074435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:09.168784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548d69721fce4578b0c733a712dec70d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.171854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548d69721fce4578b0c733a712dec70d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.186409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912e68bd7d5d4b0ebd8dde177c01a0ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.192493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548d69721fce4578b0c733a712dec70d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.201410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548d69721fce4578b0c733a712dec70d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.223439 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3525/7062] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:08 2022] DELETE /identity/v3/users/548d69721fce4578b0c733a712dec70d => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:09.224863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:09.228046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:09.288041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912e68bd7d5d4b0ebd8dde177c01a0ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.302952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912e68bd7d5d4b0ebd8dde177c01a0ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.303621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912e68bd7d5d4b0ebd8dde177c01a0ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.350232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51b2d-8fec-4c49-9a97-02bbaef39831 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:09.358042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912e68bd7d5d4b0ebd8dde177c01a0ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:09.364273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:09.365154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:09.365557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:09.365955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:09.376006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:09.405428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:09.407124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:09.447415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3538/7063] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:08 2022] DELETE /identity/v3/users/912e68bd7d5d4b0ebd8dde177c01a0ed => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:09.448436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:09.451612 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3526/7064] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:09.456256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:09.460201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:09.470520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:09.806583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51b67-6e2d-4a1b-a38a-1f8fb0752102 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:09.862824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f7122-a084-45b6-b3df-e05b54b30021 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:09.879456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:09.880744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:09.881154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:09.881945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/6ed70a14b00e486a9882264fd60a8fea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:09.884710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6ed70a14b00e486a9882264fd60a8fea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:09.893665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:10.045191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed70a14b00e486a9882264fd60a8fea', 'request_id': 'req-455e2f41-88fe-4f15-adb5-32e2d0a83c25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.088210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed70a14b00e486a9882264fd60a8fea', 'request_id': 'req-455e2f41-88fe-4f15-adb5-32e2d0a83c25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.103928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed70a14b00e486a9882264fd60a8fea', 'request_id': 'req-455e2f41-88fe-4f15-adb5-32e2d0a83c25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.130212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:10.148486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:10.149011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:10.149500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/users/6e161fafff9148d2bf0a15cb215ef1ef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:10.154125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] The token cache is being invalidate because project 6ed70a14b00e486a9882264fd60a8fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:10.155641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.160697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6e161fafff9148d2bf0a15cb215ef1ef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:10.162684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-455e2f41-88fe-4f15-adb5-32e2d0a83c25 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.165469 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3539/7065] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:09 2022] DELETE /identity/v3/projects/6ed70a14b00e486a9882264fd60a8fea => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:10.167556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:10.167556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:10.169885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:10.183397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:10.254410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] MFA Rules not processed for user `450b7ea9a4e44d149bd7ea40eaf0d31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:10.256166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:10.267844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:10.278942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:10.388907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e161fafff9148d2bf0a15cb215ef1ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.415573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3540/7066] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:10.415573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:10.415573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:10.450489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e161fafff9148d2bf0a15cb215ef1ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.451632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e161fafff9148d2bf0a15cb215ef1ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.469090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e161fafff9148d2bf0a15cb215ef1ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.473034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e161fafff9148d2bf0a15cb215ef1ef'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.513744 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3527/7067] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:09 2022] DELETE /identity/v3/users/6e161fafff9148d2bf0a15cb215ef1ef => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:10.517809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:10.521059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:10.579159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ad558-ba4f-4c35-8d74-a1b11d26d5c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:10.636519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071eeed-969d-4332-9c6b-d1966c0a8ffc tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:10.641419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:10.642279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:10.642729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:10.643641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:10.646266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:10.776984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:10.778670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:10.779036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:10.779445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/c87d3fadd3c94469837d07d8f989db74` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:10.781228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:update_user(user_id=c87d3fadd3c94469837d07d8f989db74)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:10.783998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:10.847677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:10.848772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:10.873631 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3528/7068] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:10.874949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:10.876756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:10.893341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.934330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invalidating the token cache because user c87d3fadd3c94469837d07d8f989db74 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:10.935199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.936876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1a6ea5b-f268-4504-92ad-36a23a661623 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:10.945357 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3541/7069] 10.222.0.98 () {60 vars in 1242 bytes} [Thu Jul 14 15:16:10 2022] PATCH /identity/v3/users/c87d3fadd3c94469837d07d8f989db74 => generated 297 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:10.951121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:10.951678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:10.952327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:11.065475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:11.072082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] MFA Rules not processed for user `c87d3fadd3c94469837d07d8f989db74`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:11.080302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:11.083722 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3542/7070] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:10 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:16:11.088345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:11.090646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:11.120320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15217381-4259-4e33-a3dd-d9a3c0f17ac3 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:11.121508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e34825-ab57-4462-904e-f19063c470bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:11.129556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:11.131093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:11.135441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:11.136122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/c87d3fadd3c94469837d07d8f989db74` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:11.142055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:update_user(user_id=c87d3fadd3c94469837d07d8f989db74)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:11.142647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:11.143636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:11.143929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:11.144216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/domains/e374ef3852314d6fae8a615248f1affc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:11.145673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e374ef3852314d6fae8a615248f1affc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:11.145961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:11.147407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:11.210295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:11.211415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e374ef3852314d6fae8a615248f1affc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.217234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e374ef3852314d6fae8a615248f1affc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.268635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.293143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invalidating the token cache because user c87d3fadd3c94469837d07d8f989db74 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:11.293931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.294997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.298871 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3543/7071] 10.222.0.98 () {60 vars in 1242 bytes} [Thu Jul 14 15:16:11 2022] PATCH /identity/v3/users/c87d3fadd3c94469837d07d8f989db74 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:11.302805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:11.304919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:11.309806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e374ef3852314d6fae8a615248f1affc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.312218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e374ef3852314d6fae8a615248f1affc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.331890 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3529/7072] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:16:10 2022] PATCH /identity/v3/domains/e374ef3852314d6fae8a615248f1affc => generated 275 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:11.335780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:11.341647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:11.349161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177b969-4bdc-4277-bd03-e722dc89c01f tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:11.589413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef133fcb-1624-4a1c-a159-09f5c1475815 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:11.602724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5927d55b39b43d7800381bcc6486353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8443577a582b439b81f049c06889bccf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:11.607908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:11.608261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:11.608556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] PATH_INFO: `/v3/domains/e374ef3852314d6fae8a615248f1affc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:11.619790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:11.620900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:11.621312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:11.621715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/c87d3fadd3c94469837d07d8f989db74` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:11.642118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e374ef3852314d6fae8a615248f1affc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:11.644023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:11.694978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:update_user(user_id=c87d3fadd3c94469837d07d8f989db74)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:11.697959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:11.747109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e374ef3852314d6fae8a615248f1affc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.761050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e374ef3852314d6fae8a615248f1affc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.841293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.861007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invalidating the token cache because user c87d3fadd3c94469837d07d8f989db74 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:11.862541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.866553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d14f531-2baf-41a2-8a2f-b3047e25a893 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.879762 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3544/7073] 10.222.0.98 () {60 vars in 1242 bytes} [Thu Jul 14 15:16:11 2022] PATCH /identity/v3/users/c87d3fadd3c94469837d07d8f989db74 => generated 297 bytes in 578 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:11.888077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:11.890666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:11.891135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:11.902868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e374ef3852314d6fae8a615248f1affc', 'request_id': 'req-b1706e26-7947-42a7-9119-b24f9a9624d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.940428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e374ef3852314d6fae8a615248f1affc', 'request_id': 'req-b1706e26-7947-42a7-9119-b24f9a9624d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:11.970743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e374ef3852314d6fae8a615248f1affc', 'request_id': 'req-b1706e26-7947-42a7-9119-b24f9a9624d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.028647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] The token cache is being invalidate because project e374ef3852314d6fae8a615248f1affc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:12.028969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.029653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.052683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:12.060382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e374ef3852314d6fae8a615248f1affc', 'request_id': 'req-b1706e26-7947-42a7-9119-b24f9a9624d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.076444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e374ef3852314d6fae8a615248f1affc', 'request_id': 'req-b1706e26-7947-42a7-9119-b24f9a9624d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.077252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e374ef3852314d6fae8a615248f1affc', 'request_id': 'req-b1706e26-7947-42a7-9119-b24f9a9624d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.089527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] MFA Rules not processed for user `c87d3fadd3c94469837d07d8f989db74`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:12.093871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:12.101749 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3530/7074] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:16:11 2022] DELETE /identity/v3/domains/e374ef3852314d6fae8a615248f1affc => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:12.104385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:12.107409 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3545/7075] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:11 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:16:12.110689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:12.113894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:12.119858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:12.309858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b3c30-bbbb-41fd-9eb4-17934057dff9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:12.322936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:12.323555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:12.323850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:12.324137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/c87d3fadd3c94469837d07d8f989db74` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:12.334565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1706e26-7947-42a7-9119-b24f9a9624d5 tempest-UsersV3TestJSON-555319880 tempest-UsersV3TestJSON-555319880-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:12.344299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:update_user(user_id=c87d3fadd3c94469837d07d8f989db74)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:12.346538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:12.346758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:12.347741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:12.348032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:12.348320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] PATH_INFO: `/v3/users/3bdf8aee69724f45a08e87c4920b453e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:12.353873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdf8aee69724f45a08e87c4920b453e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:12.355499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:12.438079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.459226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invalidating the token cache because user c87d3fadd3c94469837d07d8f989db74 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:12.459557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.460602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.468867 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3546/7076] 10.222.0.98 () {60 vars in 1242 bytes} [Thu Jul 14 15:16:12 2022] PATCH /identity/v3/users/c87d3fadd3c94469837d07d8f989db74 => generated 297 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:12.470182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:12.472910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:12.479349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdf8aee69724f45a08e87c4920b453e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.490117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=5,keystone:UPDATE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:12.498991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4510c-3467-4fb2-b3b5-83f86652d646 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:12.517834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:12.519449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:12.519961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:12.520424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:12.524831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:12.530422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:12.535439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdf8aee69724f45a08e87c4920b453e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.537002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdf8aee69724f45a08e87c4920b453e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.556159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdf8aee69724f45a08e87c4920b453e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.557273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e508bbd9-61db-4ed1-8ef9-c40a771ce65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdf8aee69724f45a08e87c4920b453e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:12.645352 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3531/7077] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:12 2022] DELETE /identity/v3/users/3bdf8aee69724f45a08e87c4920b453e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:12.648376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:12.648666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:12.648952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:12.691063 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3547/7078] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:12 2022] POST /identity/v3/users => generated 264 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:12.695653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:12.701933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:12.722255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:12.724497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:12.729891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0db899-be46-4c64-9aea-bcf6e9370c71 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:12.922976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502d2dd-ca35-4d2e-9a01-54f6f9ac8627 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:12.924254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d2dd-ca35-4d2e-9a01-54f6f9ac8627 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:12.924833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d2dd-ca35-4d2e-9a01-54f6f9ac8627 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:12.925651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d2dd-ca35-4d2e-9a01-54f6f9ac8627 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/477852759060485d8ef7bf6ce3a0470a/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:12.981372 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3532/7079] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:12.989007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:12.991551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:13.027493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:13.139397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7502d2dd-ca35-4d2e-9a01-54f6f9ac8627 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '477852759060485d8ef7bf6ce3a0470a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:13.191593 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3548/7080] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:16:12 2022] POST /identity/v3/users/477852759060485d8ef7bf6ce3a0470a/password => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:13.281165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d891e-e46d-48ae-a395-a7e0a7e426a0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:13.286275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:13.287176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:13.287665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:13.288019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:13.326844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:13.328774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:13.356454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3533/7081] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:14.205639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323cea9-d13f-49ac-a87a-2b69db9b840d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:14.207209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323cea9-d13f-49ac-a87a-2b69db9b840d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:14.211861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323cea9-d13f-49ac-a87a-2b69db9b840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:14.241820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:14.245030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:14.311620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c323cea9-d13f-49ac-a87a-2b69db9b840d None None] MFA Rules not processed for user `477852759060485d8ef7bf6ce3a0470a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:14.313311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c323cea9-d13f-49ac-a87a-2b69db9b840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:14.326379 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3549/7082] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:14 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:16:14.330961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323cea9-d13f-49ac-a87a-2b69db9b840d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:14.373057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323cea9-d13f-49ac-a87a-2b69db9b840d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:14.374139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71920415-9064-4ea2-9315-7bc4e335dfcb service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:14.388227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:14.389278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:14.389648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:14.390008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] PATH_INFO: `/v3/projects/d5926250de6e4c55862663c631daea97` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:14.396334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5926250de6e4c55862663c631daea97)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:14.396775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:14.397514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:14.397868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:14.398211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:14.404968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:14.432309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:14.434933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:14.474078 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3550/7083] 10.222.0.98 () {56 vars in 1262 bytes} [Thu Jul 14 15:16:14 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:14.475398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:14.504805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee446f-26ff-45d1-b287-1a7cf83c48e7 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:14.521637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:14.522941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:14.523535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:14.524113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/477852759060485d8ef7bf6ce3a0470a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:14.526429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_user(user_id=477852759060485d8ef7bf6ce3a0470a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:14.530635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:14.666852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5926250de6e4c55862663c631daea97', 'request_id': 'req-634b03db-922d-4267-8866-be0468bd87a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.673232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477852759060485d8ef7bf6ce3a0470a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.683003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5926250de6e4c55862663c631daea97', 'request_id': 'req-634b03db-922d-4267-8866-be0468bd87a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.699302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5926250de6e4c55862663c631daea97', 'request_id': 'req-634b03db-922d-4267-8866-be0468bd87a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.703116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477852759060485d8ef7bf6ce3a0470a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.720899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477852759060485d8ef7bf6ce3a0470a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.721863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477852759060485d8ef7bf6ce3a0470a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.728402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] The token cache is being invalidate because project d5926250de6e4c55862663c631daea97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:14.728732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.730316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.731770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:14.737245 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3534/7084] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:14 2022] DELETE /identity/v3/projects/d5926250de6e4c55862663c631daea97 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:14.737484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477852759060485d8ef7bf6ce3a0470a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:14.739343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:14.741079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:14.753694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3551/7085] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:14 2022] DELETE /identity/v3/users/477852759060485d8ef7bf6ce3a0470a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:14.758587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:14.762394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:14.981758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b03db-922d-4267-8866-be0468bd87a7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:15.002016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa098-0ce5-4fe8-9577-212e2357defe tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:15.016530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:15.016530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:15.016530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:15.016819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:15.016819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:15.016819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:15.068846 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3552/7086] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:14 2022] POST /identity/v3/users => generated 364 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:15.071958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:15.074373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:15.105928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dfd4d-dbb0-4136-8a2d-1f124344ace2 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:15.126256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:15.126433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:15.126632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:15.126891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:15.134517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:15.137015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:15.138086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:15.139423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:15.140319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:15.142153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] PATH_INFO: `/v3/users/b5927d55b39b43d7800381bcc6486353` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:15.146753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5927d55b39b43d7800381bcc6486353)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:15.151691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:15.205376 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3553/7087] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:15 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:15.206566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:15.306234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5927d55b39b43d7800381bcc6486353'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:15.347064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5927d55b39b43d7800381bcc6486353'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:15.349117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5927d55b39b43d7800381bcc6486353'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:15.357710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72cc4c-88a3-46a6-994f-5e786be74f6a tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:15.374029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5927d55b39b43d7800381bcc6486353'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:15.378616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9193cd68-702b-46d6-bf85-cbe418c16f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5927d55b39b43d7800381bcc6486353'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:15.404476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:15.411178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:15.411558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:15.411878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/7e888c8950834ecf8b5198b134452f3b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:15.433773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3535/7088] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:14 2022] DELETE /identity/v3/users/b5927d55b39b43d7800381bcc6486353 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:15.471831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:update_user(user_id=7e888c8950834ecf8b5198b134452f3b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:15.481996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:15.521257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b33e8-e83e-4740-af7a-c63bc063ea03 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:15.521781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b33e8-e83e-4740-af7a-c63bc063ea03 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:15.522253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b33e8-e83e-4740-af7a-c63bc063ea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:15.543102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-248b33e8-e83e-4740-af7a-c63bc063ea03 None None] MFA Rules not processed for user `450b7ea9a4e44d149bd7ea40eaf0d31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:15.544785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-248b33e8-e83e-4740-af7a-c63bc063ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:15.559705 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3554/7089] 10.222.0.98 () {60 vars in 1243 bytes} [Thu Jul 14 15:16:15 2022] PATCH /identity/v3/users/7e888c8950834ecf8b5198b134452f3b => generated 524 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:15.564683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:15.567687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:15.598536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e0328-8fe7-4beb-9d77-ce4061538c68 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:15.645443 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3536/7090] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:15.703575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:15.765406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:15.766912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:15.767367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:15.767764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/7e888c8950834ecf8b5198b134452f3b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:15.835862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:get_user(user_id=7e888c8950834ecf8b5198b134452f3b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:15.838725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:15.848444 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3555/7091] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:16:15 2022] GET /identity/v3/users/7e888c8950834ecf8b5198b134452f3b => generated 390 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:15.851828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b33e8-e83e-4740-af7a-c63bc063ea03 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:15.878859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b33e8-e83e-4740-af7a-c63bc063ea03 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:15.917215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:15.918655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:15.926710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:15.927207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/projects/422d6d928abd419aa2061c80136ab9b9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:15.930230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_project(project_id=422d6d928abd419aa2061c80136ab9b9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:15.940127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:16.098863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422d6d928abd419aa2061c80136ab9b9', 'request_id': 'req-9869cc4b-8658-4ed8-9c22-17f78091a948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.115132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422d6d928abd419aa2061c80136ab9b9', 'request_id': 'req-9869cc4b-8658-4ed8-9c22-17f78091a948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.170534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422d6d928abd419aa2061c80136ab9b9', 'request_id': 'req-9869cc4b-8658-4ed8-9c22-17f78091a948'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.186030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:16.219853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] The token cache is being invalidate because project 422d6d928abd419aa2061c80136ab9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:16.219853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.222641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.225019 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3537/7092] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:15 2022] DELETE /identity/v3/projects/422d6d928abd419aa2061c80136ab9b9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:16.229901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:16.233082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:16.284289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260eb7-abb3-4be1-8d32-9ee07a9917bd tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:16.462992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94825e9c2ecc481796e12e5baac9a80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6dc5a1a041664f3a92c7507b35e906a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:16.463964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:16.464260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:16.464553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] PATH_INFO: `/v3/users/7e888c8950834ecf8b5198b134452f3b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:16.475716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7e888c8950834ecf8b5198b134452f3b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:16.478377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:16.625264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e888c8950834ecf8b5198b134452f3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.658811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e888c8950834ecf8b5198b134452f3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.672188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e888c8950834ecf8b5198b134452f3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.672971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e888c8950834ecf8b5198b134452f3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.687817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e888c8950834ecf8b5198b134452f3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:16.701400 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3556/7093] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:16 2022] DELETE /identity/v3/users/7e888c8950834ecf8b5198b134452f3b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:16.702858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:16.705043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:16.898483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869cc4b-8658-4ed8-9c22-17f78091a948 tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:16.933278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:16.936793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:17.074775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:17.119909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:17.123536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:17.123956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:17.124616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] PATH_INFO: `/v3/users/c87d3fadd3c94469837d07d8f989db74` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:17.161454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406c03a-7588-43c3-a9a8-7fd6473ad3ae tempest-UsersV3TestJSON-566948016 tempest-UsersV3TestJSON-566948016-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:17.197262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:17.198498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:17.198922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:17.200199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] PATH_INFO: `/v3/projects/8443577a582b439b81f049c06889bccf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:17.203210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8443577a582b439b81f049c06889bccf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:17.207810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87d3fadd3c94469837d07d8f989db74)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:17.213625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:17.217808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:17.385262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.390881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8443577a582b439b81f049c06889bccf', 'request_id': 'req-c2e24950-73d2-4572-bf32-ae95d52f4006'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.414368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8443577a582b439b81f049c06889bccf', 'request_id': 'req-c2e24950-73d2-4572-bf32-ae95d52f4006'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.427257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.428125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.437706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8443577a582b439b81f049c06889bccf', 'request_id': 'req-c2e24950-73d2-4572-bf32-ae95d52f4006'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.452263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.453137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cdc0cb40-c7bb-4f6d-92e3-b56f245a0fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87d3fadd3c94469837d07d8f989db74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.466840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] The token cache is being invalidate because project 8443577a582b439b81f049c06889bccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:17.467171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.469997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e24950-73d2-4572-bf32-ae95d52f4006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:17.480371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3557/7094] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:16 2022] DELETE /identity/v3/projects/8443577a582b439b81f049c06889bccf => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:17.483548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1347-779d-4295-a526-179522bb5390 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:17.483738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1347-779d-4295-a526-179522bb5390 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:17.484002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1347-779d-4295-a526-179522bb5390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:17.492604 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3538/7095] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:16 2022] DELETE /identity/v3/users/c87d3fadd3c94469837d07d8f989db74 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:17.494681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:17.495027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:17.495293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:17.525851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:17.529871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-848f1347-779d-4295-a526-179522bb5390 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:17.534554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-848f1347-779d-4295-a526-179522bb5390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:17.545921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:17.547193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:17.832178 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3558/7096] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:17.840366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462aea0-7318-4d74-b1b0-51dd2582296a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:17.843075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462aea0-7318-4d74-b1b0-51dd2582296a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:17.843618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462aea0-7318-4d74-b1b0-51dd2582296a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:17.863309 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3539/7097] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:17.876366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:17.881850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:17.908525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9462aea0-7318-4d74-b1b0-51dd2582296a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:17.910894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9462aea0-7318-4d74-b1b0-51dd2582296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:17.939642 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3559/7098] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:16:17.940882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462aea0-7318-4d74-b1b0-51dd2582296a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:17.960299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462aea0-7318-4d74-b1b0-51dd2582296a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:17.976911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:17.978677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:17.980566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:17.980783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:17.981844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:17.982361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:17.985610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:18.010654 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3560/7099] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:18.012381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:18.030182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3aad3-b55b-4a42-8204-01abe0f653bd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:18.044254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:18.045099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:18.045451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:18.045807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:18.046641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:18.050598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:18.077263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d03ab-2c64-47b7-b426-e531877b9190 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:18.083110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:18.084226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:18.085291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:18.086060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:18.101299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:18.105582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:18.157203 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3561/7100] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:18 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:18.161557 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3540/7101] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:16:18.167589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:18.185109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b0c7f-d3aa-4152-b1bd-25282acc03cb service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:18.397726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:18.398475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:18.398834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:18.403033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:18.404396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:18.411185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:18.555584 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3541/7102] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:18 2022] POST /identity/v3/users => generated 284 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:18.557913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:18.576013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eaed5-62b4-45d8-8298-42263fc25860 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:18.592913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:18.593884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:18.594346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:18.594795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:18.595754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:18.597892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:18.657912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3562/7103] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:16:18.662500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:18.703687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca9e0-fca3-45ca-a88a-b421bb6f0e85 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:18.751703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:18.752716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:18.753162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:18.753736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:18.763066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:18.772443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:18.823897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3542/7104] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:18.825358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:18.854489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb4e6-0174-4030-b317-313070272660 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:18.873306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836071e9-331a-470c-8b07-4906b00a7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:18.877553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836071e9-331a-470c-8b07-4906b00a7c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:18.879424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836071e9-331a-470c-8b07-4906b00a7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:18.880141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836071e9-331a-470c-8b07-4906b00a7c4b admin admin] PATH_INFO: `/v3/projects/cf448acd3d074f098c10181f4801d473/users/1fe58db9d87e4485b2233cd6def39f18/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:18.923848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836071e9-331a-470c-8b07-4906b00a7c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf448acd3d074f098c10181f4801d473, user_id=1fe58db9d87e4485b2233cd6def39f18, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:18.988459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836071e9-331a-470c-8b07-4906b00a7c4b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:19.029039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:19.068662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:19.070792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:19.095327 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3563/7105] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:18 2022] PUT /identity/v3/projects/cf448acd3d074f098c10181f4801d473/users/1fe58db9d87e4485b2233cd6def39f18/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:19.106501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d38b1-71be-47f3-8f6b-d9a3a9226725 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:19.106798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f977-1bcc-437d-9bf0-3f59db175237 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:19.111995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f977-1bcc-437d-9bf0-3f59db175237 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:19.112790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f977-1bcc-437d-9bf0-3f59db175237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:19.170836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:19.272674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:19.277985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f44f977-1bcc-437d-9bf0-3f59db175237 None None] MFA Rules not processed for user `1fe58db9d87e4485b2233cd6def39f18`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:19.278575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:19.279026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:19.279262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f44f977-1bcc-437d-9bf0-3f59db175237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:19.279666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] PATH_INFO: `/v3/projects/396848c4219d412ab46486519c9599da` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:19.281907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396848c4219d412ab46486519c9599da)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:19.302977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:19.491637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3564/7106] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:16:19.497429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44f977-1bcc-437d-9bf0-3f59db175237 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:19.536485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44f977-1bcc-437d-9bf0-3f59db175237 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:19.589016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396848c4219d412ab46486519c9599da', 'request_id': 'req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:19.643698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396848c4219d412ab46486519c9599da', 'request_id': 'req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:19.652145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:19.653441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:19.653986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:19.654448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:19.655520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:19.658389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:19.677421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396848c4219d412ab46486519c9599da', 'request_id': 'req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:19.706866 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3565/7107] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:19 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:19.711303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:19.716302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] The token cache is being invalidate because project 396848c4219d412ab46486519c9599da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:19.716600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:19.728677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:19.734844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3543/7108] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:19 2022] DELETE /identity/v3/projects/396848c4219d412ab46486519c9599da => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:19.736857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:19.738914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:19.767288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b6bb9-abf0-43a2-9f7c-6591aef2ed43 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:19.863956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:19.864999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:19.865304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:19.865588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] PATH_INFO: `/v3/users/94825e9c2ecc481796e12e5baac9a80e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:19.867126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=94825e9c2ecc481796e12e5baac9a80e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:19.869343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:19.967125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff4503-329f-4c93-8b51-5d25cd64d711 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:19.982726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:19.983812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:19.985342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:19.985830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:19.988156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:19.990958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94825e9c2ecc481796e12e5baac9a80e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:20.001234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:20.016612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:20.020310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94825e9c2ecc481796e12e5baac9a80e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:20.021503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94825e9c2ecc481796e12e5baac9a80e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:20.041817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94825e9c2ecc481796e12e5baac9a80e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:20.043211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94825e9c2ecc481796e12e5baac9a80e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:20.066830 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3566/7109] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:19 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:20.068809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:20.072706 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3544/7110] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:19 2022] DELETE /identity/v3/users/94825e9c2ecc481796e12e5baac9a80e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:20.078379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:20.092197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:20.102564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1f123-270d-4485-b55e-5107c1c6d458 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:20.226641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:20.229498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:20.229883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:20.230251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:20.232733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:20.236090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:20.288042 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3567/7111] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:16:20.292300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:20.312250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b725f-027d-40e8-9ce8-8f1e2442cddf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:20.362612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:20.370803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:20.371370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:20.371519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] PATH_INFO: `/v3/projects/ebde116aeda047c8a0adf53a726edcc7/users/7dbdb543aa5247b8ba8fa1e83fb15e1a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:20.468392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebde116aeda047c8a0adf53a726edcc7, user_id=7dbdb543aa5247b8ba8fa1e83fb15e1a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:20.481553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:20.528133 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3545/7112] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:20 2022] PUT /identity/v3/projects/ebde116aeda047c8a0adf53a726edcc7/users/7dbdb543aa5247b8ba8fa1e83fb15e1a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:20.528372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:20.543504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8be9-64cb-49a1-8d89-94d25e57fa20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:20.750250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23efe5-9125-4320-85ab-48b945c4b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:20.751024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23efe5-9125-4320-85ab-48b945c4b604 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:20.751257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23efe5-9125-4320-85ab-48b945c4b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:20.751585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23efe5-9125-4320-85ab-48b945c4b604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:20.755610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23efe5-9125-4320-85ab-48b945c4b604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:20.757356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23efe5-9125-4320-85ab-48b945c4b604 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:20.783153 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3568/7113] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:20.787194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:20.803719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dec5c-9679-4f73-a991-a27a950654d3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:20.819232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:20.820356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:20.820638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:20.820918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] PATH_INFO: `/v3/projects/ebde116aeda047c8a0adf53a726edcc7/users/7dbdb543aa5247b8ba8fa1e83fb15e1a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:20.829246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebde116aeda047c8a0adf53a726edcc7, user_id=7dbdb543aa5247b8ba8fa1e83fb15e1a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:20.833048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:20.858812 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3546/7114] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:20 2022] PUT /identity/v3/projects/ebde116aeda047c8a0adf53a726edcc7/users/7dbdb543aa5247b8ba8fa1e83fb15e1a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:20.869638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb834-7784-492c-927e-0849422e4534 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:20.870677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb834-7784-492c-927e-0849422e4534 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:20.871080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb834-7784-492c-927e-0849422e4534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:20.959112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ba0eb834-7784-492c-927e-0849422e4534 None None] MFA Rules not processed for user `7dbdb543aa5247b8ba8fa1e83fb15e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:20.960828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba0eb834-7784-492c-927e-0849422e4534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:21.287611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:21.291360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:21.422027 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3569/7115] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:16:21.427717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb834-7784-492c-927e-0849422e4534 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:21.474386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb834-7784-492c-927e-0849422e4534 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:21.506477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:21.510431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:21.513030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:21.516532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:21.526661 n-d-768852-23 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 14 15:16:21.534369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:21.544561 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:21.544561 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:21.544561 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:21.550036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:21.644208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7078-bffc-4ed8-9d03-4f79537929a2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:21.668843 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3570/7116] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:21 2022] POST /identity/v3/policies => generated 228 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:21.670934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:21.671889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:21.672181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:21.672466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] PATH_INFO: `/v3/projects/6dc5a1a041664f3a92c7507b35e906a6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:21.673025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:21.681478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc5a1a041664f3a92c7507b35e906a6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:21.685101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:21.742241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e21c4-305c-4d65-abbf-25a14007a8ab tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:21.777167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:21.785745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:21.786175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:21.788557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies/50149357bb1a45f8922166412754c433` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:21.789719 n-d-768852-23 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 14 15:16:21.790384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=50149357bb1a45f8922166412754c433)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:21.797340 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:21.797340 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:21.797340 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:21.803944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:21.815434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:21.864362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc5a1a041664f3a92c7507b35e906a6', 'request_id': 'req-9b61cb39-a52c-419b-98a5-73d1010ac129'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:21.891554 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3571/7117] 10.222.0.98 () {60 vars in 1251 bytes} [Thu Jul 14 15:16:21 2022] PATCH /identity/v3/policies/50149357bb1a45f8922166412754c433 => generated 235 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:21.895948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:21.910906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc5a1a041664f3a92c7507b35e906a6', 'request_id': 'req-9b61cb39-a52c-419b-98a5-73d1010ac129'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:21.933491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc5a1a041664f3a92c7507b35e906a6', 'request_id': 'req-9b61cb39-a52c-419b-98a5-73d1010ac129'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:21.958055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] The token cache is being invalidate because project 6dc5a1a041664f3a92c7507b35e906a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:21.958644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:21.959631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9b61cb39-a52c-419b-98a5-73d1010ac129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:21.961308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbcfec-f66e-438b-a068-ef28eb6c10eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:21.963226 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3547/7118] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:21 2022] DELETE /identity/v3/projects/6dc5a1a041664f3a92c7507b35e906a6 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:21.972573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8199c2c-99f0-4ab0-aab3-ab7205ae9ab7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:21.973077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8199c2c-99f0-4ab0-aab3-ab7205ae9ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:21.973554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8199c2c-99f0-4ab0-aab3-ab7205ae9ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.019875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a8199c2c-99f0-4ab0-aab3-ab7205ae9ab7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:22.021399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a8199c2c-99f0-4ab0-aab3-ab7205ae9ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:22.139548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.140573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.140879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.141281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies/50149357bb1a45f8922166412754c433` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.142031 n-d-768852-23 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 14 15:16:22.143605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:22.148123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=50149357bb1a45f8922166412754c433)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:22.150321 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:22.150321 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:22.150321 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:22.151398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:22.195029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3572/7119] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:16:21 2022] GET /identity/v3/policies/50149357bb1a45f8922166412754c433 => generated 235 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:22.207448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.221320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:22.288173 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3548/7120] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:22.294242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246c35-02b8-4637-810c-9073659ab2d2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.300232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03329b-1e29-4779-9d15-6bdbb0ae0bb9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.300536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03329b-1e29-4779-9d15-6bdbb0ae0bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.300827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03329b-1e29-4779-9d15-6bdbb0ae0bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.308197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.309390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.309827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.310257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies/50149357bb1a45f8922166412754c433` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.311213 n-d-768852-23 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 14 15:16:22.312038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=50149357bb1a45f8922166412754c433)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:22.315706 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:22.315706 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:22.315706 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:22.318404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:22.368511 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3573/7121] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:22 2022] DELETE /identity/v3/policies/50149357bb1a45f8922166412754c433 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:22.370419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bc03329b-1e29-4779-9d15-6bdbb0ae0bb9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:22.372528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bc03329b-1e29-4779-9d15-6bdbb0ae0bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:22.378206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.405186 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3549/7122] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:22.417219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03329b-1e29-4779-9d15-6bdbb0ae0bb9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.442492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3d950-42ba-4535-ba1e-043aff9d6be2 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.446128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03329b-1e29-4779-9d15-6bdbb0ae0bb9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.456018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.456732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.457028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.457318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.458540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:22.465340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:22.472967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.473674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.474395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.474395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.474981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:22.481601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:22.483634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:22.502316 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3574/7123] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:22 2022] POST /identity/v3/policies => generated 229 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:22.505433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.531021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3550/7124] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:22.532119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.537095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9e615-e944-408e-8059-05305db97555 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.562766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049cf20-3b3e-408e-97bd-4c717ed06843 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.570773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.580505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.581743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.582337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.582856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.584978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:22.588801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:22.599023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.599427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.599749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.604950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:22.613376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:22.663587 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3575/7125] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:22 2022] POST /identity/v3/policies => generated 228 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:22.666173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.707608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752a00a-ee7b-434d-baf8-51e70c5a19eb tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.714752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3551/7126] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:22 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:22.720266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.848454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.849969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.850515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.850984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.854086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:22.856961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:22.898649 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3576/7127] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:22 2022] POST /identity/v3/policies => generated 229 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:22.901074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:22.929490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10085fc2-033e-40c0-8a10-99be9a8c74cc tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.971923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:22.987737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:22.988039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64f7d5-937b-4164-a5ec-e482599ca529 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:22.988703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:22.989356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:22.991149 n-d-768852-23 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 14 15:16:22.994401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.000241 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:23.000241 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:23.000241 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:23.005994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.007762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.008561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.009494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.009962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.010925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.013423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.060558 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3577/7128] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:16:22 2022] GET /identity/v3/policies => generated 762 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:23.068491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.086120 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3552/7129] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:22 2022] POST /identity/v3/users => generated 296 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:23.093186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.097638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ace0c0-1575-4a45-9b63-f016db9f7906 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.117061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.128515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.129463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.134465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies/3d757893d1404329aec866bdfcc485dd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.136157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3d757893d1404329aec866bdfcc485dd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.138403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.185406 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3578/7130] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:23 2022] DELETE /identity/v3/policies/3d757893d1404329aec866bdfcc485dd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:23.185811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b833e35-158c-4df0-ae41-6006d6b3b197 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.192549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.219726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.220500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.220695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.220960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.231039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.233744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.240269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31eb5-5734-4323-90ae-5b4a165a7730 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.256406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.258379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.258379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.258379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies/b2b3561570d646c39da5afbdcc3cad49` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.259234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b2b3561570d646c39da5afbdcc3cad49)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.261301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.277656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3553/7131] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:23.280989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.294930 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3579/7132] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:23 2022] DELETE /identity/v3/policies/b2b3561570d646c39da5afbdcc3cad49 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:23.304531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c33b-ddcf-4664-b10d-e426985af111 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.305115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.311955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:23.321123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.322849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.322849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.323413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a66ac4-6084-4080-b1c5-21ccb80e50f8 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.323669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] PATH_INFO: `/v3/projects/597562258e934ccaa5bdfb57eb497057/users/45028093d9a14a4dbffd0cd348834c5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.347114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbdb543aa5247b8ba8fa1e83fb15e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebde116aeda047c8a0adf53a726edcc7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.347922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.348832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.348832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] PATH_INFO: `/v3/policies/ca34f992af714884b7dc4208d9a7e17b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.349633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ca34f992af714884b7dc4208d9a7e17b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.351782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.379163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=597562258e934ccaa5bdfb57eb497057, user_id=45028093d9a14a4dbffd0cd348834c5e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.379163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.401679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3580/7133] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:23 2022] DELETE /identity/v3/policies/ca34f992af714884b7dc4208d9a7e17b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:23.411068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.421696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:23.422981 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3554/7134] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:23 2022] PUT /identity/v3/projects/597562258e934ccaa5bdfb57eb497057/users/45028093d9a14a4dbffd0cd348834c5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:23.427143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.461593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f633ac-fae7-4860-9a1e-92124c4238c6 tempest-PoliciesTestJSON-497753485 tempest-PoliciesTestJSON-497753485-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.616717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:23.687302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ae26c-f42d-4a45-829c-4401ca63b86a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.699792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.701180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.701599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.702013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] PATH_INFO: `/v3/users/1fe58db9d87e4485b2233cd6def39f18` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.703604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.707310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.708052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.708721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe58db9d87e4485b2233cd6def39f18)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.709437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.715926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.719126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.727009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.766363 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3555/7135] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:16:23.768172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:23.797914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ca9d-c360-47cd-9ab4-af4d2b7cd61d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:23.833019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd95cb-adac-41ab-a249-06d07d01c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:23.835158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd95cb-adac-41ab-a249-06d07d01c79e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.835729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd95cb-adac-41ab-a249-06d07d01c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.836286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd95cb-adac-41ab-a249-06d07d01c79e admin admin] PATH_INFO: `/v3/projects/597562258e934ccaa5bdfb57eb497057/users/45028093d9a14a4dbffd0cd348834c5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.839333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd95cb-adac-41ab-a249-06d07d01c79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=597562258e934ccaa5bdfb57eb497057, user_id=45028093d9a14a4dbffd0cd348834c5e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:23.842411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd95cb-adac-41ab-a249-06d07d01c79e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:23.865112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe58db9d87e4485b2233cd6def39f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:23.879638 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3556/7136] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:23 2022] PUT /identity/v3/projects/597562258e934ccaa5bdfb57eb497057/users/45028093d9a14a4dbffd0cd348834c5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:23.889453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.889821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.890028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.903372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe58db9d87e4485b2233cd6def39f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:23.926274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe58db9d87e4485b2233cd6def39f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:23.927110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe58db9d87e4485b2233cd6def39f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:23.946698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bb056aa-cf1f-43fa-a277-b98cde469c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe58db9d87e4485b2233cd6def39f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:23.968613 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3581/7137] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:23 2022] DELETE /identity/v3/users/1fe58db9d87e4485b2233cd6def39f18 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:23.973377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:23.974514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:23.974954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:23.978177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] MFA Rules not processed for user `45028093d9a14a4dbffd0cd348834c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:23.980453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:24.016527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:24.017785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:24.136086 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3557/7138] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:24.138566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:24.140417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:24.265439 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3582/7139] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:24.281520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:24.289041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:24.309090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed393f8-23f4-41a4-b7b1-18bf09adbb6a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:24.323494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:24.324228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:24.324529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:24.324808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:24.325621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:24.326490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:24.331709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:24.392384 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3558/7140] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:24 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:16:24.393197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:24.514016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:24.577616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc513ea-5e19-4988-b923-99f2821ef6c2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:24.602340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd200-2bb1-47b9-b9eb-7bef0f8798f3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:24.617228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:24.617919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:24.618376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:24.618740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:24.619375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:24.621399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:24.701045 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3559/7141] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:24 2022] POST /identity/v3/users => generated 291 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:24.702543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:24.707536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:24.799357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:24.800542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:24.800998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:24.801449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:24.821694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:24.826106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:24.906197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3583/7142] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:24.908466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:24.933474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c848469-72b1-42dc-9ac5-66832dcba9d1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:24.947205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:24.948497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:24.949999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:24.952784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:24.954067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:24.956031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:24.962816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e5549-a710-4384-851c-0aa9a7e235f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:24.991557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:24.991557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:24.991557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:24.991557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:24.995639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3584/7143] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:25.000787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:25.005986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:25.008451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:25.067516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:25.068999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:25.080148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7623-1535-47aa-9090-27a1a5bd4c66 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:25.106357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:25.110100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:25.111686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:25.115305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] PATH_INFO: `/v3/users/5d44cb537ec94c96a9506fc15c98d1ef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:25.132017 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3560/7144] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:25.133023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:25.134671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d44cb537ec94c96a9506fc15c98d1ef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:25.177034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c248ace-9cbe-404b-afff-5830e3e7e34f service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:25.183319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:25.200278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:25.205252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:25.206662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:25.206662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:25.212087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:25.214033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:25.251434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3561/7145] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:25.262261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:25.340554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732b8d-2e6a-40a6-8aad-ed5fc01b3489 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:25.360487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8b40c-67ad-47bf-a0b4-73a4098cccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:25.362104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8b40c-67ad-47bf-a0b4-73a4098cccd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:25.362645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8b40c-67ad-47bf-a0b4-73a4098cccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:25.363138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8b40c-67ad-47bf-a0b4-73a4098cccd9 admin admin] PATH_INFO: `/v3/projects/11c9c009c76548caad4fe90384d511e6/users/04de43ca47474bfa8c765d3630fafb9a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:25.391926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d44cb537ec94c96a9506fc15c98d1ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:25.423366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8b40c-67ad-47bf-a0b4-73a4098cccd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c9c009c76548caad4fe90384d511e6, user_id=04de43ca47474bfa8c765d3630fafb9a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:25.441413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8b40c-67ad-47bf-a0b4-73a4098cccd9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:25.449200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d44cb537ec94c96a9506fc15c98d1ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:25.471018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d44cb537ec94c96a9506fc15c98d1ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:25.475096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d44cb537ec94c96a9506fc15c98d1ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:25.511420 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3562/7146] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:25 2022] PUT /identity/v3/projects/11c9c009c76548caad4fe90384d511e6/users/04de43ca47474bfa8c765d3630fafb9a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:25.524086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:25.525494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:25.526031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:25.551359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-430a1058-5d5c-406e-a7a9-d8bd9053875e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d44cb537ec94c96a9506fc15c98d1ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:25.628010 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3585/7147] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:24 2022] DELETE /identity/v3/users/5d44cb537ec94c96a9506fc15c98d1ef => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:25.637228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:25.641770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:25.644119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:25.691614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] MFA Rules not processed for user `04de43ca47474bfa8c765d3630fafb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:25.691614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:25.730246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:25.739495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:25.830447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:25.939432 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3586/7148] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:25.987677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:25.989365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:26.068117 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3563/7149] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:16:26.089062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:26.091637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:26.168058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69f6aa-db2c-4296-8388-c52175e818ac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:26.177862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:26.182501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:26.183607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:26.183906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:26.199001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:26.225286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:26.227030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:26.284603 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3587/7150] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:16:26.390118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c390ff4-a6b1-4fea-baf0-65b458ddc0ce None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:26.408828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:26.409623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:26.409915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:26.410198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:26.423315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:26.614089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:26.620709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:26.648350 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3564/7151] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:16:27.565588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:27.567026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:27.600790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd93a-645b-440f-a764-616d36f78014 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:27.628812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:27.629815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:27.630294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:27.630739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] PATH_INFO: `/v3/projects/cf448acd3d074f098c10181f4801d473` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:27.635246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf448acd3d074f098c10181f4801d473)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:27.638572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:27.837930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf448acd3d074f098c10181f4801d473', 'request_id': 'req-f7b6add1-b22c-4e49-9006-4192befe9e96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:27.862319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf448acd3d074f098c10181f4801d473', 'request_id': 'req-f7b6add1-b22c-4e49-9006-4192befe9e96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:27.881292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf448acd3d074f098c10181f4801d473', 'request_id': 'req-f7b6add1-b22c-4e49-9006-4192befe9e96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:27.908710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] The token cache is being invalidate because project cf448acd3d074f098c10181f4801d473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:27.909015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:27.911699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:27.919365 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3588/7152] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:27 2022] DELETE /identity/v3/projects/cf448acd3d074f098c10181f4801d473 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:27.923062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:27.935490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:27.937841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:27.983939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9affd41-d15b-4e36-a07a-22ebc003d4b2 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:28.128551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:28.154146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6add1-b22c-4e49-9006-4192befe9e96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:28.166285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:28.167199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:28.167507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:28.169371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] PATH_INFO: `/v3/users/45028093d9a14a4dbffd0cd348834c5e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:28.172009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45028093d9a14a4dbffd0cd348834c5e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:28.176170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:28.235594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:28.236530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:28.241529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:28.242056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] PATH_INFO: `/v3/users/7dbdb543aa5247b8ba8fa1e83fb15e1a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:28.261643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbdb543aa5247b8ba8fa1e83fb15e1a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:28.265651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:28.357891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45028093d9a14a4dbffd0cd348834c5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.405738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45028093d9a14a4dbffd0cd348834c5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.432525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45028093d9a14a4dbffd0cd348834c5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.438118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45028093d9a14a4dbffd0cd348834c5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.473255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbdb543aa5247b8ba8fa1e83fb15e1a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.477207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45028093d9a14a4dbffd0cd348834c5e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.493044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbdb543aa5247b8ba8fa1e83fb15e1a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.497029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbdb543aa5247b8ba8fa1e83fb15e1a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.508226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbdb543aa5247b8ba8fa1e83fb15e1a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.509066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b00c24e6-fff6-4e67-afda-e7e950348809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbdb543aa5247b8ba8fa1e83fb15e1a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:28.512619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:28.524959 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3589/7153] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:27 2022] DELETE /identity/v3/users/45028093d9a14a4dbffd0cd348834c5e => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:28.526176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:28.528197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:28.570301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3565/7154] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:27 2022] DELETE /identity/v3/users/7dbdb543aa5247b8ba8fa1e83fb15e1a => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:28.576496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:28.578577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:28.579057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:28.644719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:28.646280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:28.801355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbe5ed-0231-4088-905d-5245a8621c96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:28.947002 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3566/7155] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:28.976087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:28.977620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:29.086839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:29.087755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:29.088052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:29.088460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] PATH_INFO: `/v3/projects/e488efe5120f4e81a4065caaf1e87dfc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:29.091957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e488efe5120f4e81a4065caaf1e87dfc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:29.094080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:29.130056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5882d-3f70-461a-959e-92c007a356a7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:29.152130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a7a7-f537-46b7-a7f4-04b2e44f4d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:29.152838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a7a7-f537-46b7-a7f4-04b2e44f4d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:29.153126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a7a7-f537-46b7-a7f4-04b2e44f4d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:29.153516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a7a7-f537-46b7-a7f4-04b2e44f4d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:29.173392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a7a7-f537-46b7-a7f4-04b2e44f4d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:29.175119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a7a7-f537-46b7-a7f4-04b2e44f4d5c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:29.188001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3567/7156] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:16:29.225208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:29.312863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e488efe5120f4e81a4065caaf1e87dfc', 'request_id': 'req-0117df59-2c20-44a6-96a8-f3126b366a63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:29.343960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e488efe5120f4e81a4065caaf1e87dfc', 'request_id': 'req-0117df59-2c20-44a6-96a8-f3126b366a63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:29.381832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e488efe5120f4e81a4065caaf1e87dfc', 'request_id': 'req-0117df59-2c20-44a6-96a8-f3126b366a63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:29.433430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] The token cache is being invalidate because project e488efe5120f4e81a4065caaf1e87dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:29.433823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:29.436305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0117df59-2c20-44a6-96a8-f3126b366a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:29.442294 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3590/7157] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:28 2022] DELETE /identity/v3/projects/e488efe5120f4e81a4065caaf1e87dfc => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:29.450881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac07f9-0eac-40eb-850f-d44245456d99 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:29.451810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac07f9-0eac-40eb-850f-d44245456d99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:29.452120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac07f9-0eac-40eb-850f-d44245456d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:29.505045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d2ac07f9-0eac-40eb-850f-d44245456d99 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:29.506352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2ac07f9-0eac-40eb-850f-d44245456d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:29.716109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3568/7158] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:29.725256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1ed98-24d0-4dcc-978e-3b305248cd1f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:29.726247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1ed98-24d0-4dcc-978e-3b305248cd1f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:29.726744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1ed98-24d0-4dcc-978e-3b305248cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:29.767972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97b1ed98-24d0-4dcc-978e-3b305248cd1f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:29.773922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97b1ed98-24d0-4dcc-978e-3b305248cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:29.798659 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3591/7159] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:29.804811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac07f9-0eac-40eb-850f-d44245456d99 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:29.818391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac07f9-0eac-40eb-850f-d44245456d99 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:29.825190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:29.826386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:29.827018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:29.827560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:29.828863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:29.829444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:29.831612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:29.869627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1ed98-24d0-4dcc-978e-3b305248cd1f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:29.879455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1ed98-24d0-4dcc-978e-3b305248cd1f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:29.883766 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3569/7160] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:29.895056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:29.895793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:29.896082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:29.896375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:29.897103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:29.899118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:29.971725 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3592/7161] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:29 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:16:29.975810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:29.991034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c4fde-2e4e-4734-9075-30ae130075e8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:30.020133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:30.090156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:30.091639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.092186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.092671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.093746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:30.097338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:30.151435 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3570/7162] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:29 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:30.151945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:30.154990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:30.159883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:30.184403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20273280-53ee-4e19-a67c-e52a7c29c424 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:30.201025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:30.203392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.205791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.206716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.209213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:30.214316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:30.225113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01887d-2b51-4d8b-ba03-35d78864ab73 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:30.241828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3571/7163] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:16:30.244056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:30.246445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:30.246766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:30.251349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.253267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.256130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] PATH_INFO: `/v3/projects/597562258e934ccaa5bdfb57eb497057` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.257822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597562258e934ccaa5bdfb57eb497057)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:30.265402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:30.272367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd25bb-7f77-47c9-9634-290fe0a42e33 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:30.278924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:30.280125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.280798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.281198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] PATH_INFO: `/v3/projects/ebde116aeda047c8a0adf53a726edcc7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.282672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebde116aeda047c8a0adf53a726edcc7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:30.285006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:30.434222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebde116aeda047c8a0adf53a726edcc7', 'request_id': 'req-684b8497-4737-4d29-8270-40aafa25ad8c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.448103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597562258e934ccaa5bdfb57eb497057', 'request_id': 'req-77446823-76bf-46eb-877a-0f1a99cf1391'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.458458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebde116aeda047c8a0adf53a726edcc7', 'request_id': 'req-684b8497-4737-4d29-8270-40aafa25ad8c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.465629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597562258e934ccaa5bdfb57eb497057', 'request_id': 'req-77446823-76bf-46eb-877a-0f1a99cf1391'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.472476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebde116aeda047c8a0adf53a726edcc7', 'request_id': 'req-684b8497-4737-4d29-8270-40aafa25ad8c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.486583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597562258e934ccaa5bdfb57eb497057', 'request_id': 'req-77446823-76bf-46eb-877a-0f1a99cf1391'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.487436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] The token cache is being invalidate because project ebde116aeda047c8a0adf53a726edcc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:30.487739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.488734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.490583 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3572/7164] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:30 2022] DELETE /identity/v3/projects/ebde116aeda047c8a0adf53a726edcc7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:30.496243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:30.498169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:30.535491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] The token cache is being invalidate because project 597562258e934ccaa5bdfb57eb497057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:30.535905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.537516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77446823-76bf-46eb-877a-0f1a99cf1391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.544269 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3593/7165] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:30 2022] DELETE /identity/v3/projects/597562258e934ccaa5bdfb57eb497057 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:30.546313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.546662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.547466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.574754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:30.579033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:30.654820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b8497-4737-4d29-8270-40aafa25ad8c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:30.680800 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3594/7166] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:30.681963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:30.707414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:30.717039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7dfba-655e-4d0f-ad12-7acf4cd7e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:30.719413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dfba-655e-4d0f-ad12-7acf4cd7e8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.719669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dfba-655e-4d0f-ad12-7acf4cd7e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.719934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dfba-655e-4d0f-ad12-7acf4cd7e8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.720723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dfba-655e-4d0f-ad12-7acf4cd7e8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:30.722431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dfba-655e-4d0f-ad12-7acf4cd7e8ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:30.725599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:30.735609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf5919-a552-4995-bf5f-8248e626ae46 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:30.761713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:30.766341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.766679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.766968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] PATH_INFO: `/v3/users/04de43ca47474bfa8c765d3630fafb9a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.779897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3573/7167] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:30.781360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.781655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.781940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.784082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04de43ca47474bfa8c765d3630fafb9a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:30.786123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:30.861586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:30.867367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:30.911206 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3574/7168] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:30.911659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:30.913269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:30.946053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c341eb-fecf-4c88-a87f-e7a30b43e688 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:30.950450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04de43ca47474bfa8c765d3630fafb9a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:30.967399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65ec32-eb0c-4fd3-9e81-40fcb1798b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:30.968417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ec32-eb0c-4fd3-9e81-40fcb1798b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:30.968682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ec32-eb0c-4fd3-9e81-40fcb1798b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:30.968973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ec32-eb0c-4fd3-9e81-40fcb1798b3f admin admin] PATH_INFO: `/v3/projects/f3becca3bc96409891c05f7bd47f1601/users/a5636dbc7f0745bf845d714249f88de2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:30.981364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04de43ca47474bfa8c765d3630fafb9a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:31.018147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:31.024926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04de43ca47474bfa8c765d3630fafb9a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:31.025907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04de43ca47474bfa8c765d3630fafb9a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:31.035333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65ec32-eb0c-4fd3-9e81-40fcb1798b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3becca3bc96409891c05f7bd47f1601, user_id=a5636dbc7f0745bf845d714249f88de2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:31.043935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65ec32-eb0c-4fd3-9e81-40fcb1798b3f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:31.047148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04de43ca47474bfa8c765d3630fafb9a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:31.089173 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3595/7169] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:30 2022] DELETE /identity/v3/users/04de43ca47474bfa8c765d3630fafb9a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:31.091827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:31.094655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:31.096238 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3575/7170] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:30 2022] PUT /identity/v3/projects/f3becca3bc96409891c05f7bd47f1601/users/a5636dbc7f0745bf845d714249f88de2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:31.102041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:31.103175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:31.103549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:31.229655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:31.235017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:31.454121 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3576/7171] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:31.462875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc71dd3-3309-4c98-9812-2424c7b7012f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:31.472933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:31.475602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:31.496037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:31.497311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:31.497824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:31.498387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:31.501159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:31.501643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:31.513051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:31.557794 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3596/7172] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:31.562705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:31.582147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4671d-f535-46a3-b5a3-a77f18c2120d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:31.594803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:31.595823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:31.596345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:31.596813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:31.597909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:31.601138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:31.663508 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3597/7173] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:31 2022] POST /identity/v3/projects => generated 395 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:31.668143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:31.691355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c93d3-516c-4612-be4b-2119b47968d3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:31.797468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:31.817543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:31.818410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:31.822732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:31.823605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:31.844790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6004-94d3-4466-a43a-8212c75adea8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:31.851513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:31.856115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:31.864327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:31.865237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:31.865776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:31.866121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:31.867555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:31.873791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:31.889504 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3577/7174] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:31.922837 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3598/7175] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:31 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:16:31.924520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:31.940828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4e83-bbf7-4f67-bc86-f5b943b919e5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:31.966728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:31.968522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:31.970029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:31.970318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:31.972793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:31.977049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:32.021047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:32.022057 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3578/7176] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:32.032645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:32.042333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913dc19-e0c8-4663-837a-74fcebe25e59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:32.045641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:32.066120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:32.069025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:32.069329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:32.069613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:32.084852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:32.092733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:32.114496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011b8ef-5a05-4cdd-9def-1ca7fe5b2f50 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:32.133279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:32.137462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:32.137853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:32.138140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] PATH_INFO: `/v3/projects/11c9c009c76548caad4fe90384d511e6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:32.144853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c9c009c76548caad4fe90384d511e6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:32.145040 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3599/7177] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:32.147308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:32.152572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:32.183084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ba6de-9251-4c22-8347-873edf015915 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:32.206034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ba10-4fdd-4259-ae07-4e1fa76de2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:32.208281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ba10-4fdd-4259-ae07-4e1fa76de2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:32.208281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ba10-4fdd-4259-ae07-4e1fa76de2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:32.208434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ba10-4fdd-4259-ae07-4e1fa76de2f6 admin admin] PATH_INFO: `/v3/projects/0028e0a6147143988785719fef30d5db/users/3cba2ed3bafd44caa1edbaf7667e3a69/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:32.265408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ba10-4fdd-4259-ae07-4e1fa76de2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0028e0a6147143988785719fef30d5db, user_id=3cba2ed3bafd44caa1edbaf7667e3a69, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:32.269880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ba10-4fdd-4259-ae07-4e1fa76de2f6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:32.278240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:32.307855 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3600/7178] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:32 2022] PUT /identity/v3/projects/0028e0a6147143988785719fef30d5db/users/3cba2ed3bafd44caa1edbaf7667e3a69/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:32.440830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:32.441850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:32.442718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:32.451865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c9c009c76548caad4fe90384d511e6', 'request_id': 'req-3d7f1154-a51d-495e-9294-5314ac8981ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:32.485238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c9c009c76548caad4fe90384d511e6', 'request_id': 'req-3d7f1154-a51d-495e-9294-5314ac8981ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:32.533518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c9c009c76548caad4fe90384d511e6', 'request_id': 'req-3d7f1154-a51d-495e-9294-5314ac8981ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:32.579255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] MFA Rules not processed for user `3cba2ed3bafd44caa1edbaf7667e3a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:32.580763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:32.588948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] The token cache is being invalidate because project 11c9c009c76548caad4fe90384d511e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:32.589424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:32.590178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3d7f1154-a51d-495e-9294-5314ac8981ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:32.599963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3579/7179] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:32 2022] DELETE /identity/v3/projects/11c9c009c76548caad4fe90384d511e6 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:32.602960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b642b-4075-4969-b1b6-0c338ee0ca8d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:32.607297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b642b-4075-4969-b1b6-0c338ee0ca8d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:32.607770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b642b-4075-4969-b1b6-0c338ee0ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:32.683948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7f2b642b-4075-4969-b1b6-0c338ee0ca8d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:32.692655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7f2b642b-4075-4969-b1b6-0c338ee0ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:32.834003 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3601/7180] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:32.839086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:32.843427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:32.975235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3580/7181] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:32.985500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ede6a-26a8-47e3-83d5-e47912d8e27a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:32.986135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ede6a-26a8-47e3-83d5-e47912d8e27a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:32.988746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ede6a-26a8-47e3-83d5-e47912d8e27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.045556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7a0ede6a-26a8-47e3-83d5-e47912d8e27a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:33.047952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7a0ede6a-26a8-47e3-83d5-e47912d8e27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:33.068232 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3581/7182] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:33.070216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1c1b-9eac-40c0-9c77-2e2c11c28c4b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:33.072427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ede6a-26a8-47e3-83d5-e47912d8e27a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:33.085379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:33.088090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:33.088493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:33.089966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.091759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:33.097613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ede6a-26a8-47e3-83d5-e47912d8e27a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:33.098423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:33.112168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:33.113065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:33.113418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:33.113805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.117468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:33.117468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:33.121335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:33.148063 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3582/7183] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:33.155832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:33.169885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3602/7184] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:32 2022] POST /identity/v3/projects => generated 395 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:33.172398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:33.201654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638089b-ddef-46b0-b206-7dae9ea32360 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:33.247998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:33.381569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5063bc5-92c2-4a9d-8a9e-cee295198a5e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:33.393816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:33.396578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:33.396984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:33.397468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.398615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:33.405418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:33.460447 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3603/7185] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:33 2022] POST /identity/v3/users => generated 304 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:33.466329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:33.482209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f301f-d681-47a7-b03a-254e25311113 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:33.488756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:33.489604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:33.490006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:33.490401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.491336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:33.493263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:33.506147 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3604/7186] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:33.511492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:33.528814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7a13-3b3e-4102-bcf1-0268a020051b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:33.535802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:33.536562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:33.536848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:33.539066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:33.541782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:33.542677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:33.543519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] PATH_INFO: `/v3/projects/8468de67aa554f7a82a95ba1fc962e1c/users/a789641e54ed43e49cc40ccf30e44b54/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.551762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.556098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:33.566045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:33.602930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8468de67aa554f7a82a95ba1fc962e1c, user_id=a789641e54ed43e49cc40ccf30e44b54, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:33.609113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:33.658491 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3583/7187] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:33 2022] POST /identity/v3/projects => generated 369 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:33.664662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:33.680567 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3605/7188] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:33 2022] PUT /identity/v3/projects/8468de67aa554f7a82a95ba1fc962e1c/users/a789641e54ed43e49cc40ccf30e44b54/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:33.688506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:33.768816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:33.879794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f9e4-6b62-4816-8e9a-9c7589fda5e4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:33.898949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:33.900375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:33.900597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:33.900803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:33.901524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:33.909350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:33.973498 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3584/7189] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:33 2022] POST /identity/v3/users => generated 285 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:33.978839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:34.009838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b97570-0d3a-44bb-9f7d-eb5fca92df4d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:34.020656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:34.021463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:34.021839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:34.022108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:34.023057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:34.026979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:34.043708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080be0e-5fa0-4712-89e0-f7d241483de0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:34.061219 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3585/7190] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:34.062237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:34.066082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:34.072028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:34.072651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:34.075858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:34.080891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:34.090474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:34.090718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034d79c-ad13-4117-91d6-f32a8b1b7f1f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:34.111399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:34.112036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:34.112330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:34.112618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:34.113374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:34.115067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:34.161918 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3606/7191] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:34.162940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3586/7192] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:34.169171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:34.176473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:34.229658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89662-345f-4cc3-9174-c72db10e948c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:34.244231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbfeff-00a9-4953-9420-8ccac50042ee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:34.250060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c82b88-c170-4670-b816-9d7ca5c1b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:34.252960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82b88-c170-4670-b816-9d7ca5c1b67f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:34.253706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82b88-c170-4670-b816-9d7ca5c1b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:34.254273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82b88-c170-4670-b816-9d7ca5c1b67f admin admin] PATH_INFO: `/v3/projects/a3da7e6cd5474133a96a05e44a3fd445/users/c2799f8be87741fe899900267ea6d1ff/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:34.286463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a85b46-47f9-4945-9ce5-0933a4f04255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:34.287921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a85b46-47f9-4945-9ce5-0933a4f04255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:34.288216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a85b46-47f9-4945-9ce5-0933a4f04255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:34.288506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a85b46-47f9-4945-9ce5-0933a4f04255 admin admin] PATH_INFO: `/v3/projects/8468de67aa554f7a82a95ba1fc962e1c/users/a789641e54ed43e49cc40ccf30e44b54/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:34.302387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a85b46-47f9-4945-9ce5-0933a4f04255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8468de67aa554f7a82a95ba1fc962e1c, user_id=a789641e54ed43e49cc40ccf30e44b54, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:34.317324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c82b88-c170-4670-b816-9d7ca5c1b67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3da7e6cd5474133a96a05e44a3fd445, user_id=c2799f8be87741fe899900267ea6d1ff, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:34.326711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c82b88-c170-4670-b816-9d7ca5c1b67f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:34.328017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a85b46-47f9-4945-9ce5-0933a4f04255 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:34.366027 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3587/7193] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:34 2022] PUT /identity/v3/projects/a3da7e6cd5474133a96a05e44a3fd445/users/c2799f8be87741fe899900267ea6d1ff/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:34.394748 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3607/7194] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:34 2022] PUT /identity/v3/projects/8468de67aa554f7a82a95ba1fc962e1c/users/a789641e54ed43e49cc40ccf30e44b54/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:34.395036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1daf49-96a2-4279-b4f6-c0a240a179f6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:34.397194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52159-4c49-4831-bde0-faa0427626ca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:34.397364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1daf49-96a2-4279-b4f6-c0a240a179f6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:34.397616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52159-4c49-4831-bde0-faa0427626ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:34.398011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52159-4c49-4831-bde0-faa0427626ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:34.403955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1daf49-96a2-4279-b4f6-c0a240a179f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:34.537565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97a52159-4c49-4831-bde0-faa0427626ca None None] MFA Rules not processed for user `a789641e54ed43e49cc40ccf30e44b54`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:34.538828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97a52159-4c49-4831-bde0-faa0427626ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:34.604657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3e1daf49-96a2-4279-b4f6-c0a240a179f6 None None] MFA Rules not processed for user `c2799f8be87741fe899900267ea6d1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:34.611092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e1daf49-96a2-4279-b4f6-c0a240a179f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:34.682007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:34.757498 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3608/7195] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:34.759214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52159-4c49-4831-bde0-faa0427626ca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.025114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a52159-4c49-4831-bde0-faa0427626ca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:35.030544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cba2ed3bafd44caa1edbaf7667e3a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0028e0a6147143988785719fef30d5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:35.031573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:35.032150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:35.032761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:35.033796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:35.060455 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3588/7196] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 673 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 14 15:16:35.067464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 14 15:16:35.069098 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.073244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3609/7197] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:34 2022] POST /identity/v3/projects => generated 136 bytes in 314 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:16:35.077623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1daf49-96a2-4279-b4f6-c0a240a179f6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.078864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.098126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ab0d-0a57-4ab0-bf65-45d429f1685f tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:35.116021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a789641e54ed43e49cc40ccf30e44b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8468de67aa554f7a82a95ba1fc962e1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:35.119819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:35.120737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:35.121966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:35.129928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:35.136226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Invalid input for field 'name': '' is too short Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: On instance['name']: Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: On instance['name']: Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: '' Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise error Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application '' Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.163402 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:16:35.166085 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application '' Jul 14 15:16:35.167167 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.177990 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3610/7198] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:35 2022] POST /identity/v3/projects => generated 283 bytes in 101 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:16:35.183027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.208279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd370e-b629-46b8-9517-2b47b54a11ba tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:35.215331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a789641e54ed43e49cc40ccf30e44b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8468de67aa554f7a82a95ba1fc962e1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:35.216671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:35.217104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:35.217833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:35.219108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:35.220730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: On instance['name']: Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: On instance['name']: Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise error Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:16:35.228537 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:35.233428 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['name']: Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.241874 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3611/7199] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:35 2022] POST /identity/v3/projects => generated 412 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:16:35.243491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.259726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4ec5a-f959-4ca8-b3d7-91d8e10f1d0f tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:35.270572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a789641e54ed43e49cc40ccf30e44b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8468de67aa554f7a82a95ba1fc962e1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:35.272761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:35.273379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:35.274027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] PATH_INFO: `/v3/projects/c9043ec84efe4274aea0acd0620a39ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:35.293543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c9043ec84efe4274aea0acd0620a39ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:35.296014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Could not find project: c9043ec84efe4274aea0acd0620a39ba.: keystone.exception.ProjectNotFound: Could not find project: c9043ec84efe4274aea0acd0620a39ba. Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 14 15:16:35.348938 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c9043ec84efe4274aea0acd0620a39ba. Jul 14 15:16:35.350106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.373942 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3612/7200] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:35 2022] DELETE /identity/v3/projects/c9043ec84efe4274aea0acd0620a39ba => generated 113 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:16:35.380993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1daf49-96a2-4279-b4f6-c0a240a179f6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:35.382388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.402457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:35.403328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:35.410509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:35.411125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:35.411983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:35.429144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:35.430012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e58a-6b71-41e6-ad32-6e4f67869644 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:35.447965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:35.448175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cba2ed3bafd44caa1edbaf7667e3a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0028e0a6147143988785719fef30d5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:35.448549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:35.449307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:35.449674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:35.450521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 14 15:16:35.490117 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._list_projects() Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 14 15:16:35.491464 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:35.512637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3613/7201] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:16:35 2022] GET /identity/v3/projects => generated 135 bytes in 120 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:16:35.516081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.577644 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3589/7202] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:35 2022] POST /identity/v3/projects => generated 365 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:35.578675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:35.590203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e821b41-cbbb-428c-a59c-0580c669b0c8 tempest-ProjectsNegativeStaticTestJSON-932470016 tempest-ProjectsNegativeStaticTestJSON-932470016-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:35.800103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a789641e54ed43e49cc40ccf30e44b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8468de67aa554f7a82a95ba1fc962e1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:35.800103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:35.800103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:35.801056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:35.801056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:35.802846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:35.868073 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3614/7203] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:35 2022] POST /identity/v3/projects => generated 358 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:35.873137 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:36.025560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:36.040273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc505f2-fc22-4003-87d9-3b5797449467 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:36.063825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c992366-1d1d-46a1-8278-d993b83cc8d3 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:36.088454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a789641e54ed43e49cc40ccf30e44b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8468de67aa554f7a82a95ba1fc962e1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:36.089177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:36.089473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:36.089800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:36.090522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:36.092687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:36.140242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.sql.core [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2022069724' for key 'project.ixu_project_name_domain_id'") Jul 14 15:16:36.140242 n-d-768852-23 devstack@keystone.service[80581]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:16:36.140242 n-d-768852-23 devstack@keystone.service[80581]: [parameters: {'id': 'a16c3e0c035c4acfae481e3808a41927', 'name': 'tempest-project-dup-2022069724', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:16:36.140242 n-d-768852-23 devstack@keystone.service[80581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2022069724, project id a16c3e0c035c4acfae481e3808a41927.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2022069724, project id a16c3e0c035c4acfae481e3808a41927. Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:16:36.159531 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-2022069724' for key 'project.ixu_project_name_domain_id'") Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:16:36.160388 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:16:36.161580 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:16:36.162937 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:16:36.164359 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:16:36.166042 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2022069724' for key 'project.ixu_project_name_domain_id'") Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [parameters: {'id': 'a16c3e0c035c4acfae481e3808a41927', 'name': 'tempest-project-dup-2022069724', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:36.167641 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-2022069724 at domain ID default. Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:36.168947 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2022069724, project id a16c3e0c035c4acfae481e3808a41927. Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3615/7204] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:16:35 2022] POST /identity/v3/projects => generated 285 bytes in 295 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:16:36.170289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:36.205928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143d684-3683-4d8f-b042-e8db798ab198 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:36.213547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a789641e54ed43e49cc40ccf30e44b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8468de67aa554f7a82a95ba1fc962e1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:36.214465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:36.214761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:36.215054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] PATH_INFO: `/v3/projects/b9c9775559e04cfe81cf1232bb06fb88` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:36.216515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9c9775559e04cfe81cf1232bb06fb88)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:36.219162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:36.323506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c9775559e04cfe81cf1232bb06fb88', 'request_id': 'req-183666a5-d4f4-41e3-b194-4fd6335cdbe2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.333239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c9775559e04cfe81cf1232bb06fb88', 'request_id': 'req-183666a5-d4f4-41e3-b194-4fd6335cdbe2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.350722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c9775559e04cfe81cf1232bb06fb88', 'request_id': 'req-183666a5-d4f4-41e3-b194-4fd6335cdbe2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.361401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:36.362691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:36.363177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:36.363810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:36.366319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:36.370047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:36.389761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] The token cache is being invalidate because project b9c9775559e04cfe81cf1232bb06fb88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:36.390024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.400688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.411007 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3616/7205] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:36 2022] DELETE /identity/v3/projects/b9c9775559e04cfe81cf1232bb06fb88 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:36.425645 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3590/7206] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:35 2022] POST /identity/v3/users => generated 289 bytes in 847 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:36.429598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:36.429958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:36.434347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:36.434711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:36.483675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774a092-5d9b-47ee-9e51-c06bfcbde45c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:36.567593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183666a5-d4f4-41e3-b194-4fd6335cdbe2 tempest-ProjectsNegativeStaticTestJSON-935813255 tempest-ProjectsNegativeStaticTestJSON-935813255-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:36.594465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:36.595919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:36.596321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:36.597202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] PATH_INFO: `/v3/users/3cba2ed3bafd44caa1edbaf7667e3a69` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:36.603043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cba2ed3bafd44caa1edbaf7667e3a69)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:36.606416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:36.672613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:36.673545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:36.673900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:36.674239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:36.675186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:36.677148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:36.750372 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3591/7207] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:36.760652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:36.828309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b5aa8-7a96-439c-b42d-6dfd6a85b811 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:36.861361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cba2ed3bafd44caa1edbaf7667e3a69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.867819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:36.871952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:36.872531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:36.874796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] PATH_INFO: `/v3/projects/34b54b822f9a48c0a6fd9ec6861760c7/users/830efec2903242cf94886f6bef322e13/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:36.907328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:36.915607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cba2ed3bafd44caa1edbaf7667e3a69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.951680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cba2ed3bafd44caa1edbaf7667e3a69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.957874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cba2ed3bafd44caa1edbaf7667e3a69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:36.989241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b54b822f9a48c0a6fd9ec6861760c7, user_id=830efec2903242cf94886f6bef322e13, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:37.000261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f68e740-84f7-4b0b-901d-8fe7061f3f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cba2ed3bafd44caa1edbaf7667e3a69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:37.010863 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3617/7208] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:36 2022] DELETE /identity/v3/users/3cba2ed3bafd44caa1edbaf7667e3a69 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:37.015035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:37.015989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:37.020867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:37.021221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:37.039180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:37.059866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3592/7209] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:36 2022] PUT /identity/v3/projects/34b54b822f9a48c0a6fd9ec6861760c7/users/830efec2903242cf94886f6bef322e13/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:37.061505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:37.062375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:37.063734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:37.063907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:37.319686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3618/7210] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:37.327804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6744-c06f-4e9b-9579-952ce2079352 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:37.334692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:37.337211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:37.350663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:37.351866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:37.353869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:37.354484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:37.356597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:37.364412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:37.393525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3593/7211] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:37.398416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:37.427058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8299844-d99a-421a-b595-d5b159788443 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:37.440969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9c316-af96-4eaf-8109-ec611496fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:37.442576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9c316-af96-4eaf-8109-ec611496fe52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:37.443017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9c316-af96-4eaf-8109-ec611496fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:37.443499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9c316-af96-4eaf-8109-ec611496fe52 admin admin] PATH_INFO: `/v3/projects/34b54b822f9a48c0a6fd9ec6861760c7/users/830efec2903242cf94886f6bef322e13/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:37.447787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9c316-af96-4eaf-8109-ec611496fe52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b54b822f9a48c0a6fd9ec6861760c7, user_id=830efec2903242cf94886f6bef322e13, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:37.462621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9c316-af96-4eaf-8109-ec611496fe52 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:37.523775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3594/7212] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:37 2022] PUT /identity/v3/projects/34b54b822f9a48c0a6fd9ec6861760c7/users/830efec2903242cf94886f6bef322e13/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:37.533314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb26f9-265a-4e7e-bbd1-43f4f8ab6b74 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:37.533609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb26f9-265a-4e7e-bbd1-43f4f8ab6b74 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:37.533858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb26f9-265a-4e7e-bbd1-43f4f8ab6b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:37.540861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e9d4-2b56-4c99-bff3-e86c8eb53986 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:37.700135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2ffb26f9-265a-4e7e-bbd1-43f4f8ab6b74 None None] MFA Rules not processed for user `830efec2903242cf94886f6bef322e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:37.707168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ffb26f9-265a-4e7e-bbd1-43f4f8ab6b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:37.720718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:37.724788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:37.725149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:37.725477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:37.903330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:37.957277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:37.964426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:38.019449 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3619/7213] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:16:38.028708 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3595/7214] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:38.093565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:38.135671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf3608-9d5c-413b-b366-b5571b47d904 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:38.169410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:38.171212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:38.172149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:38.172556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:38.230128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:38.234557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:38.263983 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3620/7215] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:40.059451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099a9eb-1391-4ae9-9d55-24390ef87a5b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:40.060002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099a9eb-1391-4ae9-9d55-24390ef87a5b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:40.060101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099a9eb-1391-4ae9-9d55-24390ef87a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:40.151643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d099a9eb-1391-4ae9-9d55-24390ef87a5b None None] MFA Rules not processed for user `df8c67406d8f4722a1234aad34c75194`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:40.153873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d099a9eb-1391-4ae9-9d55-24390ef87a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:40.347598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:40.350144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:40.377026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d0993-4e48-494a-b29e-a9ad7728b3fe service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:40.396642 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3596/7216] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:40.403717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:40.404653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:40.404958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:40.405243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] PATH_INFO: `/v3/projects/0028e0a6147143988785719fef30d5db` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:40.406577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0028e0a6147143988785719fef30d5db)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:40.411682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:40.570282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0028e0a6147143988785719fef30d5db', 'request_id': 'req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:40.588742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0028e0a6147143988785719fef30d5db', 'request_id': 'req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:40.597982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0028e0a6147143988785719fef30d5db', 'request_id': 'req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:40.636004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] The token cache is being invalidate because project 0028e0a6147143988785719fef30d5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:40.636765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:40.638114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:40.641912 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3621/7217] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:40 2022] DELETE /identity/v3/projects/0028e0a6147143988785719fef30d5db => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:40.650776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099a9eb-1391-4ae9-9d55-24390ef87a5b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:40.681346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099a9eb-1391-4ae9-9d55-24390ef87a5b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:40.694627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:40.877800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:40.879209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:40.879787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:40.880322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] PATH_INFO: `/v3/users/a789641e54ed43e49cc40ccf30e44b54` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:40.883126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a789641e54ed43e49cc40ccf30e44b54)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:40.887694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:41.074427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a789641e54ed43e49cc40ccf30e44b54'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:41.152141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a789641e54ed43e49cc40ccf30e44b54'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:41.153849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a789641e54ed43e49cc40ccf30e44b54'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:41.180958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a789641e54ed43e49cc40ccf30e44b54'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:41.182417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a789641e54ed43e49cc40ccf30e44b54'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:41.212408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3597/7218] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:40 2022] DELETE /identity/v3/users/a789641e54ed43e49cc40ccf30e44b54 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:41.476409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:41.479975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:41.624671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258de2e-be11-41d4-b6a0-cd9e1f4f1e88 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:41.739004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:41.741228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:41.742512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:41.745122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:41.750742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:41.803460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:41.808229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:41.848012 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3622/7219] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:42.663875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:42.665989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:43.031432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711908fe-8f9d-4967-8383-930ed207d578 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:43.060051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:43.063406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:43.064487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:43.065036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] PATH_INFO: `/v3/projects/8468de67aa554f7a82a95ba1fc962e1c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:43.081935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8468de67aa554f7a82a95ba1fc962e1c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:43.086502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:43.290576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:43.365037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8468de67aa554f7a82a95ba1fc962e1c', 'request_id': 'req-652934a1-938c-4c2a-b4ba-56fcf9cd021b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:43.368364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:43.370691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:43.411791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8468de67aa554f7a82a95ba1fc962e1c', 'request_id': 'req-652934a1-938c-4c2a-b4ba-56fcf9cd021b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:43.454501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:43.455389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8468de67aa554f7a82a95ba1fc962e1c', 'request_id': 'req-652934a1-938c-4c2a-b4ba-56fcf9cd021b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:43.562048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] The token cache is being invalidate because project 8468de67aa554f7a82a95ba1fc962e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:43.565123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:43.573020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-652934a1-938c-4c2a-b4ba-56fcf9cd021b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:43.589656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3598/7220] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:42 2022] DELETE /identity/v3/projects/8468de67aa554f7a82a95ba1fc962e1c => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:43.603060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd133ac-5867-45f9-970f-bfc277ddcd19 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:43.603855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd133ac-5867-45f9-970f-bfc277ddcd19 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:43.608609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd133ac-5867-45f9-970f-bfc277ddcd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:43.743534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6dd133ac-5867-45f9-970f-bfc277ddcd19 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:43.748354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6dd133ac-5867-45f9-970f-bfc277ddcd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:43.886130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a4364-78be-4986-92b0-d5ee2475082c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:44.072585 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3599/7221] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:44.078976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819f7a-ca95-46b5-936d-05e5dbb19b91 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:44.079716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819f7a-ca95-46b5-936d-05e5dbb19b91 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:44.080244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819f7a-ca95-46b5-936d-05e5dbb19b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:44.153239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d7819f7a-ca95-46b5-936d-05e5dbb19b91 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:44.156317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d7819f7a-ca95-46b5-936d-05e5dbb19b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:44.174383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:44.180494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:44.181815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:44.183626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:44.191898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:44.201332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3600/7222] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:44.210831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7819f7a-ca95-46b5-936d-05e5dbb19b91 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:44.263175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7819f7a-ca95-46b5-936d-05e5dbb19b91 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:44.264382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:44.275165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:44.293131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:44.296510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:44.298029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:44.299756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:44.306299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:44.306620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:44.332059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:44.341191 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3623/7223] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 973 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:16:44.379658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:44.383529 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3601/7224] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:44.403026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e44b2-bf31-49ed-a0af-b2fc83a0fe39 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:44.431307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:44.433660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:44.440412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:44.441042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:44.444826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:44.456190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:44.584729 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3624/7225] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:44 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:16:44.585121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:44.606834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44090492-5a71-4833-803b-65ba294b72d4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:44.782149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:44.783768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:44.784255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:44.784727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:44.785700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:44.788361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:44.819667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3602/7226] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:44 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:44.824361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:44.847650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe85c-9eda-415a-a9ef-5409cecc69ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:44.877044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:44.878017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:44.878499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:44.878962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:44.880122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:44.882024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:44.925471 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3625/7227] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:16:44.932405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:44.967759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70779a8e-db7b-4a24-96fd-8631c585183a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:44.990145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f1db-ac74-4854-a7a8-a866794e95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:44.991055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f1db-ac74-4854-a7a8-a866794e95ea admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:44.994546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f1db-ac74-4854-a7a8-a866794e95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:44.995389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f1db-ac74-4854-a7a8-a866794e95ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:44.997175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7f1db-ac74-4854-a7a8-a866794e95ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:45.000213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7f1db-ac74-4854-a7a8-a866794e95ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:45.037785 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3603/7228] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:45.037995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:45.055053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c0b3-6c22-49c5-a51d-0432bfc228dc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:45.076029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:45.076965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:45.077628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:45.078007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] PATH_INFO: `/v3/projects/2459905bde664a5798b275453827ab11/users/77ffc8f16876405fb6307d1bcd50512e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:45.118670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2459905bde664a5798b275453827ab11, user_id=77ffc8f16876405fb6307d1bcd50512e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:45.127636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:45.170411 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3626/7229] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:45 2022] PUT /identity/v3/projects/2459905bde664a5798b275453827ab11/users/77ffc8f16876405fb6307d1bcd50512e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:45.175694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdb132-63ed-40cf-8f47-cabdc467d229 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:45.175979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdb132-63ed-40cf-8f47-cabdc467d229 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:45.176465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdb132-63ed-40cf-8f47-cabdc467d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:45.261534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0ebdb132-63ed-40cf-8f47-cabdc467d229 None None] MFA Rules not processed for user `77ffc8f16876405fb6307d1bcd50512e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:45.272783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ebdb132-63ed-40cf-8f47-cabdc467d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:45.303172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:45.511649 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3604/7230] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:45.517636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:45.644825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:45.669478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd9c3-aa1c-4ae8-bf98-31cf93c2d352 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:45.681942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:45.684079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:45.684961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:45.688023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:45.689509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:45.697036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:45.777954 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3627/7231] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:45 2022] POST /identity/v3/projects => generated 367 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:45.780547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdb132-63ed-40cf-8f47-cabdc467d229 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:45.822220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdb132-63ed-40cf-8f47-cabdc467d229 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:46.040602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:46.041460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:46.041748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:46.042025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:46.042952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:46.045098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:46.109881 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3605/7232] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:45 2022] POST /identity/v3/users => generated 290 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:16:46.117340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:46.141449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36457d-a956-4cea-9e5e-4596167ef24d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:46.166723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:46.169867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:46.170311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:46.178658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:46.180442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:46.182317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:46.247482 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3628/7233] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:46.248038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:46.264176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fd6e7-438e-4a8b-ab0a-322df495cd37 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:46.279061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:46.280015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:46.280462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:46.280750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] PATH_INFO: `/v3/projects/f6e09abcec6448dea4cdcb29db24fcbe/users/a070af80e1c7486b873d946f9774369a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:46.381299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e09abcec6448dea4cdcb29db24fcbe, user_id=a070af80e1c7486b873d946f9774369a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:46.385374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:46.450293 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3606/7234] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:46 2022] PUT /identity/v3/projects/f6e09abcec6448dea4cdcb29db24fcbe/users/a070af80e1c7486b873d946f9774369a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:46.455055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:46.516573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c283bbd-cca5-4a2d-a0fa-6ee7ed0100eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:46.787895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71c847-4464-49fb-aad4-2058da4786ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:46.790451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c847-4464-49fb-aad4-2058da4786ba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:46.792509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c847-4464-49fb-aad4-2058da4786ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:46.793651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c847-4464-49fb-aad4-2058da4786ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:46.795671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71c847-4464-49fb-aad4-2058da4786ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:46.799493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71c847-4464-49fb-aad4-2058da4786ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:46.829401 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3629/7235] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:46.835207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:46.872585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45350d-1635-4620-ad77-c95040c486a4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:46.895033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:46.902489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:46.903395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:46.906674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] PATH_INFO: `/v3/projects/f6e09abcec6448dea4cdcb29db24fcbe/users/a070af80e1c7486b873d946f9774369a/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:46.918382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e09abcec6448dea4cdcb29db24fcbe, user_id=a070af80e1c7486b873d946f9774369a, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:46.928296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:46.987906 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3607/7236] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:46 2022] PUT /identity/v3/projects/f6e09abcec6448dea4cdcb29db24fcbe/users/a070af80e1c7486b873d946f9774369a/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:47.000545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a30b1-29bb-48ca-bb5a-f0c6dda8d4b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:47.001813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a30b1-29bb-48ca-bb5a-f0c6dda8d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:47.004178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a30b1-29bb-48ca-bb5a-f0c6dda8d4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:47.083711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e99a30b1-29bb-48ca-bb5a-f0c6dda8d4b1 None None] MFA Rules not processed for user `a070af80e1c7486b873d946f9774369a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:47.086961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e99a30b1-29bb-48ca-bb5a-f0c6dda8d4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:47.374287 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3630/7237] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:16:47.379397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:47.448503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed05d-eb55-4407-af02-5c1a615fcb8b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:47.474163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:47.476578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:47.478164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:47.480629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:47.483325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:47.485345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:47.529418 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3608/7238] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:47 2022] POST /identity/v3/roles => generated 234 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:47.533721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a30b1-29bb-48ca-bb5a-f0c6dda8d4b1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:47.562516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a30b1-29bb-48ca-bb5a-f0c6dda8d4b1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:47.577034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:47.578086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:47.578392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:47.578691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:47.579529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:47.582243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:47.629065 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3631/7239] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:47 2022] POST /identity/v3/roles => generated 234 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:47.630520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:47.656993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587c09-b514-436c-90c6-4b22a6c5c979 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:47.671942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:47.673103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:47.673623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:47.674132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:47.675466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:47.678659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:47.748366 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3609/7240] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:47 2022] POST /identity/v3/roles => generated 234 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:47.750747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:47.790773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1fcf1-f3b2-4da5-b8a2-f05801503e85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:47.825859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:47.826582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:47.827283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:47.827283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:47.833369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:47.842133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:47.885871 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3632/7241] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:16:47 2022] POST /identity/v3/domains => generated 276 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:47.889480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:47.913077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204f62-20f2-4eda-8a59-694fd91560d8 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:48.010012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:48.026894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:48.028670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:48.094290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:48.123095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:48.124309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:48.128494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:48.130467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:48.131606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:48.135465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:48.234474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99564f5-7689-42fb-9396-e7e294d625d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:48.247590 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3610/7242] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:47 2022] POST /identity/v3/projects => generated 400 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:48.250781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:48.463750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:48.471101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:48.478607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:48.479825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] PATH_INFO: `/v3/users/8f7149cc14e94b27ac5dafa78458ab12` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:48.493235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7149cc14e94b27ac5dafa78458ab12)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:48.507134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58502-7301-4934-9461-5300fd03713b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:48.508704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:48.540964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aefb4-6e2d-45e5-9ca3-56c21a1681cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:48.545818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aefb4-6e2d-45e5-9ca3-56c21a1681cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:48.547256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aefb4-6e2d-45e5-9ca3-56c21a1681cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:48.549765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aefb4-6e2d-45e5-9ca3-56c21a1681cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/groups` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:48.549765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aefb4-6e2d-45e5-9ca3-56c21a1681cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:48.557216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aefb4-6e2d-45e5-9ca3-56c21a1681cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:48.612124 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3611/7243] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:16:48 2022] POST /identity/v3/groups => generated 299 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:16:48.618794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a1627-21f2-4b30-8e59-f714f2b7c61b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:48.623444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a1627-21f2-4b30-8e59-f714f2b7c61b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:48.623988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a1627-21f2-4b30-8e59-f714f2b7c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:48.690601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7149cc14e94b27ac5dafa78458ab12'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:48.715458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8d5a1627-21f2-4b30-8e59-f714f2b7c61b None None] MFA Rules not processed for user `a5636dbc7f0745bf845d714249f88de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:48.720318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8d5a1627-21f2-4b30-8e59-f714f2b7c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:48.739615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7149cc14e94b27ac5dafa78458ab12'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:48.766823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7149cc14e94b27ac5dafa78458ab12'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:48.769606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7149cc14e94b27ac5dafa78458ab12'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:48.796131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7149cc14e94b27ac5dafa78458ab12'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:48.805681 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3633/7244] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:48 2022] DELETE /identity/v3/users/8f7149cc14e94b27ac5dafa78458ab12 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:48.807524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:48.809578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:48.900631 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3612/7245] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:48.902206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4793e4-feae-4b19-9d66-fed0d4395284 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:48.902509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4793e4-feae-4b19-9d66-fed0d4395284 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:48.902794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4793e4-feae-4b19-9d66-fed0d4395284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:48.911327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:48.961214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ab4793e4-feae-4b19-9d66-fed0d4395284 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:48.961546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac82470-6e6b-4379-828e-5d91b4d797e7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:48.962955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ab4793e4-feae-4b19-9d66-fed0d4395284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:48.981385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:48.982202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:48.982554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:48.982956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:48.984228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:48.986446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:49.022159 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3634/7246] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:48 2022] POST /identity/v3/roles => generated 234 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:49.022159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.025096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:49.033524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:49.199500 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3613/7247] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:49.206459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4793e4-feae-4b19-9d66-fed0d4395284 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.227470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4793e4-feae-4b19-9d66-fed0d4395284 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:49.233579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:49.234353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:49.234648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:49.234937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:49.235783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:49.238158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:49.268942 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3614/7248] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:49 2022] POST /identity/v3/users => generated 442 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:49.269958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.272484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048554a8-259f-4c07-9d36-2b4f3b5d8737 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:49.277028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:49.284884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:49.290049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:49.290378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:49.290650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:49.292651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:49.297003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:49.372127 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3635/7249] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:49 2022] POST /identity/v3/projects => generated 373 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:49.372127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.447588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930fec-81e1-4b45-89b0-7e3381ba3e6e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:49.548843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bbca8-213d-4f78-92b3-cb6c0918d5fb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:49.568692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:49.569456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:49.569958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:49.571236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:49.572265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:49.573343 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:49.573343 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:49.573343 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:49.574267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:49.595145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:49.595867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:49.596274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:49.596564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:49.625239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3636/7250] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:49 2022] POST /identity/v3/roles => generated 270 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:49.626758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.777861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf717-6243-450e-bcbc-a8168b6ada3b tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:49.782487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:49.787049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:49.789142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:49.801488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:49.804649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:49.805392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:49.805910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:49.806943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:49.812233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:49.823253 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3615/7251] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:16:49.825611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.851731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf954-2dd7-45b9-a060-7e0037eb6d67 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:49.864090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:49.865058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:49.865339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:49.865849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/627f6025b9ce49518354f91dd119ecbb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:49.887482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=627f6025b9ce49518354f91dd119ecbb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:49.891151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:49.913033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:49.922345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3616/7252] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:49 2022] PUT /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/627f6025b9ce49518354f91dd119ecbb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:49.930337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.933831 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3637/7253] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:49 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:49.941370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:49.980069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0e0ef-e01c-4786-ab0d-0dab4a55da79 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:50.187786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3e43-1f86-4f76-a435-9d402ccfd682 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:50.193155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:50.194555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:50.197083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:50.198793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:50.203748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:50.209884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:50.212162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:50.212763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:50.215861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:50.216129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:50.218237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Adding query filter params (scope.project.id=9fd105db988943569f2415957a5af184, user.id=92ec18c6a0be4d51ab865152b4a0cabb) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:50.218574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:50.225057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:50.272117 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3638/7254] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:49 2022] GET /identity/v3/roles => generated 2320 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:50.273239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:50.303931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b738d89-68b8-4590-bd7f-9cc083282997 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:50.310099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:50.311467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:50.311864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:50.312974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] PATH_INFO: `/v3/projects/79c87518b0d44e5aac946893f1d0c0a3/users/9d308a61b80a441fa7a891d3b0f4dd6e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:50.355762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c87518b0d44e5aac946893f1d0c0a3, user_id=9d308a61b80a441fa7a891d3b0f4dd6e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:50.359512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:50.380862 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3617/7255] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 15:16:49 2022] GET /identity/v3/role_assignments?scope.project.id=9fd105db988943569f2415957a5af184&user.id=92ec18c6a0be4d51ab865152b4a0cabb&effective => generated 228 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:50.387417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:50.389174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3639/7256] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:50 2022] PUT /identity/v3/projects/79c87518b0d44e5aac946893f1d0c0a3/users/9d308a61b80a441fa7a891d3b0f4dd6e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:50.393205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:50.432994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4c7d0-1839-4c4a-9c41-991ce580d70c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:50.627147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09666e0-2ef1-4d98-a1a9-304d429bbbe7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:50.641232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:50.645325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:50.649251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:50.649545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:50.652841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:50.656394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:50.665460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:50.666400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:50.666710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:50.666991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/627f6025b9ce49518354f91dd119ecbb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:50.674348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=627f6025b9ce49518354f91dd119ecbb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:50.677239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:50.705455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role 627f6025b9ce49518354f91dd119ecbb was removed from user 92ec18c6a0be4d51ab865152b4a0cabb on project 9fd105db988943569f2415957a5af184. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:50.706016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:50.707625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:50.736547 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3640/7257] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:50 2022] GET /identity/v3/roles => generated 2320 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:16:50.739982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:50.743686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:50.760217 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3618/7258] 10.222.0.98 () {58 vars in 1466 bytes} [Thu Jul 14 15:16:50 2022] DELETE /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/627f6025b9ce49518354f91dd119ecbb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:50.766902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:50.768442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:50.770335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fcd0e-137d-449d-993c-b42290e082ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:50.913289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:50.957075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9352-bf96-45f3-acf6-874eb71d2a31 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:50.965932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:50.966908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:50.967204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:50.972523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/627f6025b9ce49518354f91dd119ecbb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:50.974320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=627f6025b9ce49518354f91dd119ecbb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:50.975443 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:50.975443 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:50.975443 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:50.976389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:51.044971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:51.062421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role 627f6025b9ce49518354f91dd119ecbb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:51.062759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:51.062919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:51.063895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:51.064130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:51.064288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:51.064720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] PATH_INFO: `/v3/projects/79c87518b0d44e5aac946893f1d0c0a3/users/9d308a61b80a441fa7a891d3b0f4dd6e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:51.067672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c87518b0d44e5aac946893f1d0c0a3, user_id=9d308a61b80a441fa7a891d3b0f4dd6e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:51.074801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3619/7259] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:50 2022] DELETE /identity/v3/roles/627f6025b9ce49518354f91dd119ecbb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:51.075114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:51.076326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:51.077977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:51.092530 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3641/7260] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:50 2022] PUT /identity/v3/projects/79c87518b0d44e5aac946893f1d0c0a3/users/9d308a61b80a441fa7a891d3b0f4dd6e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:51.237762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b63bb-40a2-4e53-b89d-2888da26fa05 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:51.397704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:51.399403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:51.399702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:51.399996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/b09fafaf38d249ce8ef7f29337958f65` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:51.405078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=b09fafaf38d249ce8ef7f29337958f65)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:51.408015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:51.455900 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3620/7261] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:51 2022] PUT /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/b09fafaf38d249ce8ef7f29337958f65 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:51.462448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:51.492872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c775c7-7668-45e7-afb9-ff7a9fb47a37 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:51.661852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:51.667803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:51.669728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:51.670565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:51.675382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:51.679068 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:51.679068 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:51.679068 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:51.682999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:51.812816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3642/7262] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:16:51 2022] PUT /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 519 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:51.814403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:51.830085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94d83f-8ec2-4ea2-8441-65d2e5df5f50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:51.949216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:51.968292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:51.968913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:51.969290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:51.969679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:51.970490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Adding query filter params (scope.project.id=9fd105db988943569f2415957a5af184, user.id=92ec18c6a0be4d51ab865152b4a0cabb) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:51.973391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:51.976046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:52.233325 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3621/7263] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 15:16:51 2022] GET /identity/v3/role_assignments?scope.project.id=9fd105db988943569f2415957a5af184&user.id=92ec18c6a0be4d51ab865152b4a0cabb&effective => generated 1061 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:16:52.239689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:52.261247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3bc2-adaf-42c1-b4fa-e9e947b36644 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:52.291333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:52.291949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:52.292248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:52.292535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:52.298180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:52.299197 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:52.299197 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:52.299197 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:52.305754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:52.348611 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3643/7264] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:16:52 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:52.356872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:52.374948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:52.378047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:52.401932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032a57-06f0-44f7-a2b4-cfc663bb7420 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:52.668814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01bfa-7eb2-43b9-ba10-af989e0145c2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:52.688340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:52.690265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:52.691546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:52.693117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] PATH_INFO: `/v3/projects/146bd89a1d554414837d4f9a6903cc7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:52.698334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=146bd89a1d554414837d4f9a6903cc7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:52.707646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:52.728232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712f639-9379-407c-b606-718c70e3ff60 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:52.729644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712f639-9379-407c-b606-718c70e3ff60 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:52.730137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712f639-9379-407c-b606-718c70e3ff60 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:52.730609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712f639-9379-407c-b606-718c70e3ff60 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:52.732189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712f639-9379-407c-b606-718c70e3ff60 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Adding query filter params (scope.project.id=9fd105db988943569f2415957a5af184, user.id=92ec18c6a0be4d51ab865152b4a0cabb) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:52.732699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712f639-9379-407c-b606-718c70e3ff60 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:52.742574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712f639-9379-407c-b606-718c70e3ff60 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:52.912599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146bd89a1d554414837d4f9a6903cc7a', 'request_id': 'req-b7e80422-7d4f-4d14-944e-3282780ac1fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:52.936530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146bd89a1d554414837d4f9a6903cc7a', 'request_id': 'req-b7e80422-7d4f-4d14-944e-3282780ac1fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:52.945239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:52.969365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146bd89a1d554414837d4f9a6903cc7a', 'request_id': 'req-b7e80422-7d4f-4d14-944e-3282780ac1fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:52.984174 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3622/7265] 10.222.0.98 () {58 vars in 1355 bytes} [Thu Jul 14 15:16:52 2022] GET /identity/v3/role_assignments?scope.project.id=9fd105db988943569f2415957a5af184&user.id=92ec18c6a0be4d51ab865152b4a0cabb&effective => generated 577 bytes in 629 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:52.995349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e59b-20d7-46da-b020-39e182b083e7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:52.996134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e59b-20d7-46da-b020-39e182b083e7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:52.996854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e59b-20d7-46da-b020-39e182b083e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.018380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] The token cache is being invalidate because project 146bd89a1d554414837d4f9a6903cc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:53.018380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:53.020964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:53.030363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3644/7266] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:16:52 2022] DELETE /identity/v3/projects/146bd89a1d554414837d4f9a6903cc7a => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:53.032425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:53.037976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:53.094072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a513e59b-20d7-46da-b020-39e182b083e7 None None] MFA Rules not processed for user `450b7ea9a4e44d149bd7ea40eaf0d31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:53.100795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a513e59b-20d7-46da-b020-39e182b083e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:53.171812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80422-7d4f-4d14-944e-3282780ac1fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:53.180044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae063c-6344-4ce9-9f4f-e3dd2c30c0cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:53.182167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae063c-6344-4ce9-9f4f-e3dd2c30c0cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.182677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae063c-6344-4ce9-9f4f-e3dd2c30c0cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.183033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae063c-6344-4ce9-9f4f-e3dd2c30c0cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.185856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae063c-6344-4ce9-9f4f-e3dd2c30c0cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:53.188835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae063c-6344-4ce9-9f4f-e3dd2c30c0cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bcae063c-6344-4ce9-9f4f-e3dd2c30c0cc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417.: keystone.exception.ImpliedRoleNotFound: b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417. Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = query.one() Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._iter().one() Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._only_one_row( Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:53.221775 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 14 15:16:53.223055 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 14 15:16:53.224147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 14 15:16:53.224147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 14 15:16:53.224147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 14 15:16:53.224147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417. Jul 14 15:16:53.224147 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:16:53.224492 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3645/7267] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:16:53 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 137 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:16:53.226639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3345-1df2-4a52-9f66-80a72f89bc4a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.227144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3345-1df2-4a52-9f66-80a72f89bc4a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.227668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3345-1df2-4a52-9f66-80a72f89bc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.279504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-17ef3345-1df2-4a52-9f66-80a72f89bc4a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:53.281023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17ef3345-1df2-4a52-9f66-80a72f89bc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:53.343109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3623/7268] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:53.343109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e59b-20d7-46da-b020-39e182b083e7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:53.372643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e59b-20d7-46da-b020-39e182b083e7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:53.393413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:53.395664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.396142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.396632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/b09fafaf38d249ce8ef7f29337958f65` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.405626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=b09fafaf38d249ce8ef7f29337958f65)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:53.413586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:53.437492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role b09fafaf38d249ce8ef7f29337958f65 was removed from user 92ec18c6a0be4d51ab865152b4a0cabb on project 9fd105db988943569f2415957a5af184. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:53.438358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:53.439928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:53.450757 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3646/7269] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:53.452672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbda0e-1b09-40bf-ae83-08b196a65464 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.452971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbda0e-1b09-40bf-ae83-08b196a65464 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.453304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbda0e-1b09-40bf-ae83-08b196a65464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.467040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:53.510566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a1fbda0e-1b09-40bf-ae83-08b196a65464 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:53.511859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1fbda0e-1b09-40bf-ae83-08b196a65464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:53.525977 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3624/7270] 10.222.0.98 () {58 vars in 1466 bytes} [Thu Jul 14 15:16:53 2022] DELETE /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/b09fafaf38d249ce8ef7f29337958f65 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:53.538637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:53.541708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:53.708724 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3647/7271] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:16:53.711437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbda0e-1b09-40bf-ae83-08b196a65464 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:53.755900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbda0e-1b09-40bf-ae83-08b196a65464 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:53.773714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ea36b-c040-4be2-be4b-07a90c462bfa tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:53.779361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:53.780410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.781905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.782931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.783717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:53.784293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:53.788627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:53.797966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:53.799038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.799570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.800071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.801542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:53.805952 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:53.805952 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:53.805952 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:53.812918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:53.841980 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3648/7272] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:53.847016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:53.886018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3625/7273] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:53 2022] POST /identity/v3/roles => generated 272 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:53.887805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:53.912358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e87fe8-5ffb-4a9c-a4ba-f41e800ae074 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:53.927977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0617fb0-3ba0-410b-be71-20b54a389914 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:53.937440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:53.939171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:53.940745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.940949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:53.941063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.941167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:53.941341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.941565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:53.942666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Adding query filter params (domain_id=2ce5935f95bb44cda39a899eb1ac7be2) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:53.943028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:53.943185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:53.950518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:53.950758 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:53.950758 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:53.950758 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:53.955625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:53.991997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:54.002995 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3626/7274] 10.222.0.98 () {58 vars in 1206 bytes} [Thu Jul 14 15:16:53 2022] GET /identity/v3/roles?domain_id=2ce5935f95bb44cda39a899eb1ac7be2 => generated 409 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:54.006389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.043981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333e48-2727-4b25-9e6d-f6ac88812ab4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.069502 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3649/7275] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:16:53 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:16:54.074577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.081598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.084087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.085511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.088417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/4e36721cd7714b9ea579dda990f9d610` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.095330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=4e36721cd7714b9ea579dda990f9d610)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.106679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.203366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role 4e36721cd7714b9ea579dda990f9d610 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:54.203366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:54.203366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:54.206695 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3627/7276] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:54 2022] DELETE /identity/v3/roles/4e36721cd7714b9ea579dda990f9d610 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:54.212456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.213700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:54.281728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62faa1b-9658-40b0-9234-380fda893c67 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.364764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9303ee4-a317-476c-8a68-ea684f6a8fea tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.371196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.371958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.372260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.372852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.373677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Adding query filter params (domain_id=2ce5935f95bb44cda39a899eb1ac7be2) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:16:54.374126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.376031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.384038 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3628/7277] 10.222.0.98 () {58 vars in 1206 bytes} [Thu Jul 14 15:16:54 2022] GET /identity/v3/roles?domain_id=2ce5935f95bb44cda39a899eb1ac7be2 => generated 148 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:54.384721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.385438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.386967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.387299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.388071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.389777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.390294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.402435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339735-91e3-426f-bda3-587591df41b0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.408879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.410102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.410565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.410862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/4e36721cd7714b9ea579dda990f9d610` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.432926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:16:54.437541 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3650/7278] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:16:54 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:16:54.442825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.452451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Could not find role: 4e36721cd7714b9ea579dda990f9d610.: keystone.exception.RoleNotFound: Could not find role: 4e36721cd7714b9ea579dda990f9d610. Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 14 15:16:54.454223 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:16:54.455248 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4e36721cd7714b9ea579dda990f9d610. Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:16:54.456341 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3629/7279] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:16:54 2022] DELETE /identity/v3/roles/4e36721cd7714b9ea579dda990f9d610 => generated 110 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:16:54.468142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.491396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fddefd-7629-485e-8eef-6f29765de4e9 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.497706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.503799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.504191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.504494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.513664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcffc4-d0c1-46d5-87d5-69a486dec33b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.515661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.520733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.534169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.535509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.536021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.536521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.543898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.547197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.559435 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3630/7280] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:54 2022] PUT /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:54.564484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.574339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:54.615530 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3651/7281] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:54 2022] GET /identity/v3/roles => generated 2320 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:54.617771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.654164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55523848-b821-4a91-86df-66d2ebe17e29 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.712874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca76b2-84aa-4ad8-9ca3-7c98ca32f2a7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.722470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.723414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.723711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.724001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.726023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, group_id=578d20e98f164946aeba863d35f2b0b7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.731427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.773793 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3631/7282] 10.222.0.98 () {58 vars in 1364 bytes} [Thu Jul 14 15:16:54 2022] GET /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles => generated 409 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:54.780966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.798374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d00724-7e8a-464f-b895-4918feb54dc7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.807258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.809138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.810440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.811451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.815773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.820225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.833090 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3632/7283] 10.222.0.98 () {58 vars in 1464 bytes} [Thu Jul 14 15:16:54 2022] HEAD /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:54.839412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.847194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.848707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.849287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.849891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.852643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.857239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.885962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea81b04-4005-4e0c-841e-f28157a8f95e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.889024 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3652/7284] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:16:54 2022] GET /identity/v3/roles => generated 2320 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:16:54.894328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.900332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.902968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.903314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.905561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.915290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:54.920248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:54.922170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e503e-39e6-4df8-9419-1f4bf48a526e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:54.936776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role d1320f2d89b04b4c8f827b318fb97396 was removed from group 578d20e98f164946aeba863d35f2b0b7 on domain 2ce5935f95bb44cda39a899eb1ac7be2. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:54.937749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:54.938963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:54.939771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f0c5-037f-4411-9f33-676b42f1caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:54.941670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f0c5-037f-4411-9f33-676b42f1caa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:54.942244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f0c5-037f-4411-9f33-676b42f1caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:54.942798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f0c5-037f-4411-9f33-676b42f1caa5 admin admin] PATH_INFO: `/v3/projects/e077c5a4c14941f28b107c91952a0de8/users/3d6431ad47224fc384a9110b02b5b6bb/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:54.964886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3633/7285] 10.222.0.98 () {58 vars in 1466 bytes} [Thu Jul 14 15:16:54 2022] DELETE /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:54.974496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:54.977223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:54.989384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:54.997916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66f0c5-037f-4411-9f33-676b42f1caa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e077c5a4c14941f28b107c91952a0de8, user_id=3d6431ad47224fc384a9110b02b5b6bb, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:55.005322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66f0c5-037f-4411-9f33-676b42f1caa5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:55.056269 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3653/7286] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:54 2022] PUT /identity/v3/projects/e077c5a4c14941f28b107c91952a0de8/users/3d6431ad47224fc384a9110b02b5b6bb/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:55.060485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:55.060708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:55.061410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:55.136560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee3925-858c-4fb7-8fad-915fbddbbda2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:55.149538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] MFA Rules not processed for user `3d6431ad47224fc384a9110b02b5b6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:55.151892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:55.281302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:55.282373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:55.282771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:55.283159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:55.286551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9fd105db988943569f2415957a5af184, group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:55.290913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:55.315721 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3634/7287] 10.222.0.98 () {60 vars in 1485 bytes} [Thu Jul 14 15:16:54 2022] PUT /identity/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:55.322013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:55.344222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:55.462280 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3654/7288] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:55.473383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:55.477044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:55.479694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d578c19-fec5-4c75-9439-e976623f6f7d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:55.514644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:55.519247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:55.522934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:55.524524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:55.533704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_grants(project_id=9fd105db988943569f2415957a5af184, group_id=578d20e98f164946aeba863d35f2b0b7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:55.556360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:55.659571 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3635/7289] 10.222.0.98 () {58 vars in 1367 bytes} [Thu Jul 14 15:16:55 2022] GET /identity/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles => generated 410 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:55.666020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:55.719005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb7af-4d9e-4854-9089-4b08794cc3a6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:55.738297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2e9e4-9b41-4a42-865b-882fb3e4df50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:55.738741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898cb14-9d5f-4417-8e9b-49e322fc295f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:55.742234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e9e4-9b41-4a42-865b-882fb3e4df50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:55.746016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e9e4-9b41-4a42-865b-882fb3e4df50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:55.746524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2e9e4-9b41-4a42-865b-882fb3e4df50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/groups/578d20e98f164946aeba863d35f2b0b7/users/92ec18c6a0be4d51ab865152b4a0cabb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:55.754306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2e9e4-9b41-4a42-865b-882fb3e4df50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=578d20e98f164946aeba863d35f2b0b7, user_id=92ec18c6a0be4d51ab865152b4a0cabb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:55.765510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2e9e4-9b41-4a42-865b-882fb3e4df50 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:55.860635 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3636/7290] 10.222.0.98 () {60 vars in 1359 bytes} [Thu Jul 14 15:16:55 2022] PUT /identity/v3/groups/578d20e98f164946aeba863d35f2b0b7/users/92ec18c6a0be4d51ab865152b4a0cabb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:55.868763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5764-526d-4008-bdb0-58cf66c8de28 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:55.869568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5764-526d-4008-bdb0-58cf66c8de28 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:55.870238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5764-526d-4008-bdb0-58cf66c8de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:55.878592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:55.881880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:55.882545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:55.885243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:56.031383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2a4c5764-526d-4008-bdb0-58cf66c8de28 None None] MFA Rules not processed for user `92ec18c6a0be4d51ab865152b4a0cabb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:16:56.040267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a4c5764-526d-4008-bdb0-58cf66c8de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:56.145638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:56.180547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:56.182053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:56.211908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3655/7291] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:16:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:16:56.460782 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3637/7292] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:16:55 2022] POST /identity/v3/auth/tokens => generated 3255 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:16:56.462194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:56.478229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdcd1-dcc6-4302-95f8-32967f0b2fde service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:56.644836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:56.648876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:56.649243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:56.649542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:56.654946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:check_grant(project_id=9fd105db988943569f2415957a5af184, group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:56.657798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:56.675974 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3656/7293] 10.222.0.98 () {58 vars in 1467 bytes} [Thu Jul 14 15:16:56 2022] HEAD /identity/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:56.678261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5764-526d-4008-bdb0-58cf66c8de28 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:56.706739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5764-526d-4008-bdb0-58cf66c8de28 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:56.716159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:56.718796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:56.719970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:56.720820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:56.728188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9fd105db988943569f2415957a5af184, group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:56.733589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:56.748634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role d1320f2d89b04b4c8f827b318fb97396 was removed from group 578d20e98f164946aeba863d35f2b0b7 on project 9fd105db988943569f2415957a5af184. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:56.749633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:56.751321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:56.796135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3638/7294] 10.222.0.98 () {58 vars in 1469 bytes} [Thu Jul 14 15:16:56 2022] DELETE /identity/v3/projects/9fd105db988943569f2415957a5af184/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:56.806031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:56.809909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:56.883594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff860ff-8a58-49c7-967f-4b360677d4c7 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:57.178243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:57.182462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:57.183045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:57.185411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/groups/578d20e98f164946aeba863d35f2b0b7/users/92ec18c6a0be4d51ab865152b4a0cabb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:57.203497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=578d20e98f164946aeba863d35f2b0b7, user_id=92ec18c6a0be4d51ab865152b4a0cabb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:57.213282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:57.245079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '92ec18c6a0be4d51ab865152b4a0cabb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:57.325109 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3657/7295] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 15:16:56 2022] DELETE /identity/v3/groups/578d20e98f164946aeba863d35f2b0b7/users/92ec18c6a0be4d51ab865152b4a0cabb => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:57.333911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:57.366058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9990ef-11bf-42b1-95e9-87f571a4a22d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:57.423782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:57.597870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:57.601958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:57.602687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:57.604439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:57.615410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:57.621844 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:57.621844 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:57.621844 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:57.625879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:57.659730 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3639/7296] 10.222.0.98 () {60 vars in 1380 bytes} [Thu Jul 14 15:16:57 2022] PUT /identity/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:57.666315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:57.713277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136415-2a88-4ba6-8115-0f73adf40203 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:57.735519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:57.738793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:57.743171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:57.743837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:57.747052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=578d20e98f164946aeba863d35f2b0b7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:57.755583 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:57.755583 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:57.755583 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:57.757218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:57.809078 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3658/7297] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:16:57 2022] GET /identity/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles => generated 375 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:57.815791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:57.833104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5b6dd-6a43-4aba-8375-82217f9b00c3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:57.851977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:57.854105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:57.855109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:57.855470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:57.867724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:57.869439 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:57.869439 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:57.869439 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:57.870757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:57.880691 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3640/7298] 10.222.0.98 () {58 vars in 1362 bytes} [Thu Jul 14 15:16:57 2022] HEAD /identity/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:57.889105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:57.921256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82530ec-1566-4433-ba5e-2b03b6e8b7b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:57.932080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:57.932445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:57.934241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:57.934783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:57.941251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=578d20e98f164946aeba863d35f2b0b7, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:57.948861 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:57.948861 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:57.948861 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:57.957265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:58.012434 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3659/7299] 10.222.0.98 () {58 vars in 1364 bytes} [Thu Jul 14 15:16:57 2022] DELETE /identity/v3/system/groups/578d20e98f164946aeba863d35f2b0b7/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:58.014391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:58.046233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a357c5-8cfa-4006-bf8c-5b198db85910 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:58.071674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:58.073110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:58.073635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:58.074216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:58.087307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:58.094952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:58.134097 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3641/7300] 10.222.0.98 () {60 vars in 1479 bytes} [Thu Jul 14 15:16:58 2022] PUT /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:58.140058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:58.158923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd556e-abdd-489f-81aa-b0a54566832e tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:58.277732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:58.298319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:58.299250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:58.299578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:58.299867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:58.306151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, user_id=92ec18c6a0be4d51ab865152b4a0cabb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:58.308889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:58.352945 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3660/7301] 10.222.0.98 () {58 vars in 1361 bytes} [Thu Jul 14 15:16:58 2022] GET /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles => generated 408 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:16:58.358253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:58.375737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346f7f-fdc6-44e0-86d1-609c405168c0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:58.394564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:58.395602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:58.395892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:58.396371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:58.400234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:58.403065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:58.440382 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3642/7302] 10.222.0.98 () {58 vars in 1461 bytes} [Thu Jul 14 15:16:58 2022] HEAD /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:58.447952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:58.469879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f21c8-a96c-4c91-b5f6-c4c18b00e1cf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:58.488881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:58.489862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:58.490159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:58.490464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:58.497095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2ce5935f95bb44cda39a899eb1ac7be2, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:58.501302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:58.531688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role d1320f2d89b04b4c8f827b318fb97396 was removed from user 92ec18c6a0be4d51ab865152b4a0cabb on domain 2ce5935f95bb44cda39a899eb1ac7be2. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:58.531996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:58.538123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:58.580509 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3661/7303] 10.222.0.98 () {58 vars in 1463 bytes} [Thu Jul 14 15:16:58 2022] DELETE /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:58.597583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:58.601910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:58.634898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d19e-a9d2-41f6-9182-00595951f3a4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:58.827024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:58.828033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:58.828320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:58.828790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:58.835036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:58.842187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:58.873919 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3643/7304] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:16:58 2022] PUT /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:58.880351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:58.891988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75c08-8592-4676-925c-464b4258d8bf tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.048081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.048994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.049289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.049574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.052947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_grants(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.065058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:59.092933 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3662/7305] 10.222.0.98 () {58 vars in 1364 bytes} [Thu Jul 14 15:16:58 2022] GET /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles => generated 409 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:59.100377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:59.122016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536351d8-5758-4cf5-b671-2e731d726a46 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.149524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.152454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.153173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.153825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.164232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:check_grant(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.187636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:59.211795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:59.212828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3644/7306] 10.222.0.98 () {58 vars in 1464 bytes} [Thu Jul 14 15:16:59 2022] HEAD /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:59.227605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0e2eb-99a1-4e93-808e-d66945bfac3d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.256474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.258509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.259054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.259597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.265690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9fd105db988943569f2415957a5af184, user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.276185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:59.285861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role d1320f2d89b04b4c8f827b318fb97396 was removed from user 92ec18c6a0be4d51ab865152b4a0cabb on project 9fd105db988943569f2415957a5af184. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:16:59.286570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:59.287692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:16:59.318233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:59.320970 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3663/7307] 10.222.0.98 () {58 vars in 1466 bytes} [Thu Jul 14 15:16:59 2022] DELETE /identity/v3/projects/9fd105db988943569f2415957a5af184/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:59.323318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:16:59.346789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ae0cf-4210-4297-9065-74fa362633fc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.505603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.506709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.507077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.507532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.509829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.511425 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:59.511425 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:59.511425 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:59.512693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:59.532617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3645/7308] 10.222.0.98 () {60 vars in 1377 bytes} [Thu Jul 14 15:16:59 2022] PUT /identity/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:59.537564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:59.557085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d39076-8cc2-4fd6-b670-fd2ca638b187 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.573307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.574759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.575358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.575912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.579052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=92ec18c6a0be4d51ab865152b4a0cabb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.583258 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:59.583258 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:59.583258 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:59.586508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:59.639358 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3664/7309] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 15:16:59 2022] GET /identity/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles => generated 374 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:16:59.642919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:59.673176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5de4d-e46b-4b57-8df2-1ce2c0bb05f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.690282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.697661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.700712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.702484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.721419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.737782 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:59.737782 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:16:59.737782 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:16:59.754173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:59.770111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:59.783115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:59.783374 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3646/7310] 10.222.0.98 () {58 vars in 1359 bytes} [Thu Jul 14 15:16:59 2022] HEAD /identity/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:16:59.820806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058156-9a6d-422d-b7da-39a596505a10 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.841950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.848686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.850284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.853209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.865837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=92ec18c6a0be4d51ab865152b4a0cabb, role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.869074 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:16:59.869074 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:16:59.869074 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:16:59.871715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:16:59.907680 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3665/7311] 10.222.0.98 () {58 vars in 1361 bytes} [Thu Jul 14 15:16:59 2022] DELETE /identity/v3/system/users/92ec18c6a0be4d51ab865152b4a0cabb/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:16:59.916281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:16:59.944637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21309-3fef-43e9-8567-591af2785476 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:16:59.964685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:16:59.965473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:16:59.965779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:16:59.966176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:16:59.967151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:16:59.968901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:00.007844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3647/7312] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:16:59 2022] POST /identity/v3/roles => generated 270 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:00.013722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:00.043582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9936-6cf3-416a-a0a3-ad3da8f26258 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:00.077474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:00.080356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:00.081845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:00.082604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:00.086407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:00.090391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:00.130971 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3666/7313] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:17:00 2022] POST /identity/v3/roles => generated 269 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:00.131880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:00.155325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68dba-acf5-428a-af92-fa636a733ac4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:00.160952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134e13-ea17-4951-bea6-bcd61f77f694 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:00.161922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134e13-ea17-4951-bea6-bcd61f77f694 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:00.162227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134e13-ea17-4951-bea6-bcd61f77f694 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:00.162525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134e13-ea17-4951-bea6-bcd61f77f694 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/1f492d9d7e574eff8206d7148e18d8f2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:00.174690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134e13-ea17-4951-bea6-bcd61f77f694 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0b676e0cc7964ad4a9aa0d3cffccfebf, implied_role_id=1f492d9d7e574eff8206d7148e18d8f2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:00.175947 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-17134e13-ea17-4951-bea6-bcd61f77f694 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:00.175947 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:17:00.175947 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:17:00.176908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134e13-ea17-4951-bea6-bcd61f77f694 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:00.238511 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3648/7314] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:00 2022] PUT /identity/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/1f492d9d7e574eff8206d7148e18d8f2 => generated 530 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:00.244206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:00.280542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d325a3-bfac-4647-8bee-62e0c7411300 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:00.449794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b10dc-737d-4f35-a15d-5d94181c8cd6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:00.453628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b10dc-737d-4f35-a15d-5d94181c8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:00.457680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b10dc-737d-4f35-a15d-5d94181c8cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:00.526169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:00.526916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:00.527228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:00.527536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:00.528981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:00.532305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:00.544841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:00.563643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-300b10dc-737d-4f35-a15d-5d94181c8cd6 None None] MFA Rules not processed for user `ab2ce820ae4f482283fe985fdb2fee84`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:00.567512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-300b10dc-737d-4f35-a15d-5d94181c8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:00.578558 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3667/7315] 10.222.0.98 () {60 vars in 1148 bytes} [Thu Jul 14 15:17:00 2022] POST /identity/v3/domains => generated 276 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:00.589069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:00.801674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3649/7316] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:17:00.847739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d5c8b-b685-48ec-8ee2-5e6ea28dd833 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:00.892776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c845a-645a-43d1-8226-448337533055 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:00.893106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:00.893317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c845a-645a-43d1-8226-448337533055 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:00.893566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c845a-645a-43d1-8226-448337533055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:00.893745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:00.893917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:00.894248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:00.895217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:00.897192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:00.918815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ca8c845a-645a-43d1-8226-448337533055 None None] MFA Rules not processed for user `3d6431ad47224fc384a9110b02b5b6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:00.920381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca8c845a-645a-43d1-8226-448337533055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:00.931770 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3668/7317] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:17:00 2022] POST /identity/v3/roles => generated 270 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:00.937286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:00.956630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f605876-19d3-440a-a6d5-00b042383b67 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:00.967529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:00.968490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:00.968781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:00.969112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/dbccc485f71d4acfa7b247df9d1a79bf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:00.980974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0b676e0cc7964ad4a9aa0d3cffccfebf, implied_role_id=dbccc485f71d4acfa7b247df9d1a79bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:00.982675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:01.031064 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3669/7318] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:00 2022] PUT /identity/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/dbccc485f71d4acfa7b247df9d1a79bf => generated 531 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:17:01.036976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:01.182098 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3650/7319] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:17:01.199566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd1330-fd54-4d90-ae36-6837ac886c78 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:01.205570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:01.206650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:01.206942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:01.207551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:01.211568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0b676e0cc7964ad4a9aa0d3cffccfebf, implied_role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:01.213430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:01.277503 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3670/7320] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:01 2022] PUT /identity/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/d1320f2d89b04b4c8f827b318fb97396 => generated 525 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:01.278109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c845a-645a-43d1-8226-448337533055 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:01.301737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c845a-645a-43d1-8226-448337533055 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:01.444935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:01.446599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:01.447072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:01.447634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/d1320f2d89b04b4c8f827b318fb97396/implies/0b676e0cc7964ad4a9aa0d3cffccfebf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:01.451555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d1320f2d89b04b4c8f827b318fb97396, implied_role_id=0b676e0cc7964ad4a9aa0d3cffccfebf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:01.457993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:01.508229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] 0b676e0cc7964ad4a9aa0d3cffccfebf cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 0b676e0cc7964ad4a9aa0d3cffccfebf cannot be an implied roles. Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 14 15:17:01.543965 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 14 15:17:01.545155 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:01.545155 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:01.545155 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 14 15:17:01.545155 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 14 15:17:01.545155 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 0b676e0cc7964ad4a9aa0d3cffccfebf cannot be an implied roles. Jul 14 15:17:01.545155 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:01.548434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3651/7321] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:01 2022] PUT /identity/v3/roles/d1320f2d89b04b4c8f827b318fb97396/implies/0b676e0cc7964ad4a9aa0d3cffccfebf => generated 116 bytes in 271 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 14 15:17:01.555649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:01.587551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900cf42-bfcb-4a05-92b0-241129cb05fb tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:01.603023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:01.605078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:01.608052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:01.608833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:01.613052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0b676e0cc7964ad4a9aa0d3cffccfebf, implied_role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:01.623788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:01.662613 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3671/7322] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:01 2022] DELETE /identity/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:01.669382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:01.705555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27b950-1851-4b79-a886-d46aac67e64c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:01.925752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:01.926738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:01.927028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:01.927355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/dbccc485f71d4acfa7b247df9d1a79bf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:01.930617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0b676e0cc7964ad4a9aa0d3cffccfebf, implied_role_id=dbccc485f71d4acfa7b247df9d1a79bf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:01.932176 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:01.932176 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:17:01.932176 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:17:01.933386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:01.953780 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3652/7323] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:01 2022] DELETE /identity/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/dbccc485f71d4acfa7b247df9d1a79bf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:01.960853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:01.982729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a998-e441-4249-9233-d6bce1d35b56 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:02.068892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:02.124563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:02.125701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:02.126027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:02.126347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/dbccc485f71d4acfa7b247df9d1a79bf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:02.128312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=dbccc485f71d4acfa7b247df9d1a79bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:02.129389 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:02.129389 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:17:02.129389 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:17:02.130315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:02.201602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role dbccc485f71d4acfa7b247df9d1a79bf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:02.201967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:02.202620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:02.207339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3672/7324] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:01 2022] DELETE /identity/v3/roles/dbccc485f71d4acfa7b247df9d1a79bf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:02.211609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:02.214932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:02.248265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b36d8-28c2-4447-a08f-de79ea6f4ae0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:02.439200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:02.441674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:02.441993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:02.442310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/01fdbdf0c3ef4afcb9000f724222c942` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:02.470669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=01fdbdf0c3ef4afcb9000f724222c942)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:02.498435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:02.582117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:02.583297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:02.644041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:02.648441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:02.652521 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3653/7325] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:17:02 2022] PATCH /identity/v3/domains/01fdbdf0c3ef4afcb9000f724222c942 => generated 277 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:02.658521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:02.716562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050a2e-4c6f-44c4-a9f0-5cacfab684cd tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:02.948256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:02.949198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:02.961077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:02.962843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/01fdbdf0c3ef4afcb9000f724222c942` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:03.003338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=01fdbdf0c3ef4afcb9000f724222c942)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:03.004745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:03.059637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.076810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.173567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942', 'request_id': 'req-b7551cfb-5d65-4c0d-9f99-94192ad93f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.204670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942', 'request_id': 'req-b7551cfb-5d65-4c0d-9f99-94192ad93f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.223783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942', 'request_id': 'req-b7551cfb-5d65-4c0d-9f99-94192ad93f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.238629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:03.241098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:03.251402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:03.283428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] The token cache is being invalidate because project 01fdbdf0c3ef4afcb9000f724222c942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:03.283723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.287688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.309696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942', 'request_id': 'req-b7551cfb-5d65-4c0d-9f99-94192ad93f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.320101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942', 'request_id': 'req-b7551cfb-5d65-4c0d-9f99-94192ad93f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.321066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '01fdbdf0c3ef4afcb9000f724222c942', 'request_id': 'req-b7551cfb-5d65-4c0d-9f99-94192ad93f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.337665 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3673/7326] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:17:02 2022] DELETE /identity/v3/domains/01fdbdf0c3ef4afcb9000f724222c942 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:03.339019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:03.340397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:03.392972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:03.435227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ada4c4-615f-44b9-942a-282d55fe10e6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:03.494657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7551cfb-5d65-4c0d-9f99-94192ad93f40 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:03.508361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:03.509334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:03.509624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:03.510035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/1f492d9d7e574eff8206d7148e18d8f2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:03.515011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0b676e0cc7964ad4a9aa0d3cffccfebf, implied_role_id=1f492d9d7e574eff8206d7148e18d8f2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:03.517170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:03.545408 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3674/7327] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:03 2022] DELETE /identity/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf/implies/1f492d9d7e574eff8206d7148e18d8f2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:03.551481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:03.683956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830efec2903242cf94886f6bef322e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b54b822f9a48c0a6fd9ec6861760c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:03.685171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:03.685945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:03.686345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:03.688664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:17:03.689443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:03.695003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:03.695949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240a489-37e4-4ddc-81d0-334ff8100f73 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:03.716147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:03.717066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:03.717502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:03.717792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/1f492d9d7e574eff8206d7148e18d8f2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:03.719520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=1f492d9d7e574eff8206d7148e18d8f2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:03.721195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:03.727139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3654/7328] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:17:03.734645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:03.742889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:03.785821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b20ef2-32eb-49e7-b955-9c7f50c22ce6 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:03.797083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role 1f492d9d7e574eff8206d7148e18d8f2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:03.797083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.797868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:03.801041 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3675/7329] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:03 2022] DELETE /identity/v3/roles/1f492d9d7e574eff8206d7148e18d8f2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:03.807983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:03.809618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:03.942362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:04.009678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6578a-5c4b-44b6-8ac2-fd6fb61ed9d4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:04.033736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:04.034788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:04.035092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:04.035407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:04.036813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0b676e0cc7964ad4a9aa0d3cffccfebf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.037707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830efec2903242cf94886f6bef322e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b54b822f9a48c0a6fd9ec6861760c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:04.039042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:04.039722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:04.040294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:04.041577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:04.042554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.046967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:04.131762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role 0b676e0cc7964ad4a9aa0d3cffccfebf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:04.132704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:04.134295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:04.143351 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3676/7330] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:03 2022] DELETE /identity/v3/roles/0b676e0cc7964ad4a9aa0d3cffccfebf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:04.145619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:04.147995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:04.162617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3655/7331] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:17:03 2022] POST /identity/v3/projects => generated 348 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:04.167873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:04.172061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:04.373883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8bac9-c111-4099-94b4-9d07a2d3f47d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:04.468342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88353-9039-4a3d-96ec-8f543e0468cd tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:04.484744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830efec2903242cf94886f6bef322e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b54b822f9a48c0a6fd9ec6861760c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:04.485638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:04.486050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:04.486449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:04.487520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:17:04.487989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.489833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:04.561173 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3656/7332] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:04.599589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:04.601533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:04.602695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:04.603339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:04.605800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.608692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:04.668245 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3677/7333] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:04 2022] PUT /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 519 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:04.674696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:04.706199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a274-7372-492c-ab99-a8d2f4bb95f3 tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:04.736191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:04.850585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:04.852467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:04.853122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:04.853992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:04.861177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.864411 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:04.864411 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:17:04.864411 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:17:04.868572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:04.872093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.874753 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:04.874753 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:17:04.874753 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:17:04.877035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:04.893316 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3657/7334] 10.222.0.98 () {58 vars in 1344 bytes} [Thu Jul 14 15:17:04 2022] HEAD /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:04.897940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:04.911711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa438b-609f-4164-9e40-2c4691f54150 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:04.918189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:04.919389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:04.920937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:04.920937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:04.923045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.924532 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:04.924532 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:17:04.924532 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:17:04.925834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:04.939734 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3678/7335] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 15:17:04 2022] GET /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 519 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:17:04.939982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:04.965488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914c1b-4071-45db-8da9-0f75e25f8ff3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:04.975849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:04.978442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:04.979775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:04.980336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:04.984581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:04.989130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:05.016552 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3658/7336] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:04 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:05.018957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:05.041561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad177fd-26ed-4e6e-b04f-d37c90302a53 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:05.094586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:05.201915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:05.203048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:05.203483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:05.204525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:05.207549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:05.209366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417.: keystone.exception.ImpliedRoleNotFound: b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417. Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = query.one() Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._iter().one() Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._only_one_row( Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:05.239106 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 14 15:17:05.242140 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 14 15:17:05.244397 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 14 15:17:05.244397 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417. Jul 14 15:17:05.244397 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:17:05.246661 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3679/7337] 10.222.0.98 () {58 vars in 1343 bytes} [Thu Jul 14 15:17:05 2022] GET /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 137 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:17:05.247957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:05.291213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d548a3-179b-4f58-a056-ce2d19bc507a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:05.312838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:05.316730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:05.317251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:05.318246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:05.328334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:05.334187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417.: keystone.exception.ImpliedRoleNotFound: b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417. Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = query.one() Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._iter().one() Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._only_one_row( Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:05.396592 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 14 15:17:05.397750 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 14 15:17:05.398745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 14 15:17:05.398745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 14 15:17:05.398745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 14 15:17:05.398745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b09fafaf38d249ce8ef7f29337958f65 does not imply 8501d188817445f2a341c2af3419f417. Jul 14 15:17:05.398745 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:05.400694 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3659/7338] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:05 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 137 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:17:05.406001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:05.443063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eccbd8-adef-450a-97e8-84e15b2fdf51 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:05.466543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:05.471317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:05.471775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:05.481254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:05.494253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:05.497471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:05.622268 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3680/7339] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:05 2022] PUT /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 519 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:17:05.628671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:05.664257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:05.713616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d339104-b5fd-46a1-a0dd-b1e8b2bd38ad tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:05.869208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d025e02-3e6d-44e9-a3ea-d65da807f1b4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:05.888633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830efec2903242cf94886f6bef322e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34b54b822f9a48c0a6fd9ec6861760c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:05.892017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:05.894739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:05.895090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] PATH_INFO: `/v3/projects/1dc06b27e7914c6787236abbc0eccda3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:05.900928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1dc06b27e7914c6787236abbc0eccda3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:05.905269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:06.048439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:06.049465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:06.049764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:06.050052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:06.052078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=bb80bbb0494b42e98fe78962af9ec848)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:06.053959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:06.071950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc06b27e7914c6787236abbc0eccda3', 'request_id': 'req-87b75801-31e2-40f8-bf0f-a1912d9af63d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:06.089241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc06b27e7914c6787236abbc0eccda3', 'request_id': 'req-87b75801-31e2-40f8-bf0f-a1912d9af63d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:06.101969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc06b27e7914c6787236abbc0eccda3', 'request_id': 'req-87b75801-31e2-40f8-bf0f-a1912d9af63d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:06.103512 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3660/7340] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:05 2022] PUT /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848 => generated 519 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:06.104743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:06.125020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] The token cache is being invalidate because project 1dc06b27e7914c6787236abbc0eccda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:06.125832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:06.127209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:06.137746 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3681/7341] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:17:05 2022] DELETE /identity/v3/projects/1dc06b27e7914c6787236abbc0eccda3 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:06.258010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c48f7-dbd8-437d-a5c8-f923562f4f25 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:06.278951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:06.280753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:06.281248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:06.281750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:06.285946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb80bbb0494b42e98fe78962af9ec848, implied_role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:06.289647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:06.331618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:06.353519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:06.355934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:06.373464 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3661/7342] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:06 2022] PUT /identity/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396 => generated 519 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:17:06.379447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:06.385064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:06.419388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:06.585649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b75801-31e2-40f8-bf0f-a1912d9af63d tempest-RoutersAdminTest-21352336 tempest-RoutersAdminTest-21352336-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:06.677725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca32fff-39ba-4f34-92ae-ede049a22f1d tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:06.693167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:06.697850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:06.699256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:06.699836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:06.702129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:06.704291 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:06.704291 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:17:06.704291 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:17:06.706305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:06.719001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:06.720105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:06.720580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:06.721076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:06.732846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:06.794530 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3662/7343] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 15:17:06 2022] GET /identity/v3/role_inferences => generated 1603 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:06.807712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:06.861250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcd941-107e-4c51-8514-d6ef1ac2cd5f tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:06.874176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:06.877998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:06.878792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:06.879597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:06.884420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb80bbb0494b42e98fe78962af9ec848, implied_role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:06.888905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:06.920903 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3663/7344] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:06 2022] DELETE /identity/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:06.927092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:06.928645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:06.940132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:06.980599 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3682/7345] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:17:07.094235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e252-7402-4aa1-a14a-79221131e3d0 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.101826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.102984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.103351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.104496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.106701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=bb80bbb0494b42e98fe78962af9ec848)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.109033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.124187 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3664/7346] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:06 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:07.128299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:07.146371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7cc6-b739-4e14-b158-6ffbfa7e4c38 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.300206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.302413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.303089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.304008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.308447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.313549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.356412 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3683/7347] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:07 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:07.357930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:07.375021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ea7b6-7390-4806-8010-68d134740233 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.562769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.564171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.564627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.565095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.566019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.568534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.604185 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3665/7348] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:07 2022] GET /identity/v3/roles => generated 2320 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:07.605427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:07.626358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5913b34-4322-4fcb-a715-9d4d5d666608 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.643821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.645704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.646003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.646293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.649074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.653785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.684148 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3684/7349] 10.222.0.98 () {60 vars in 1142 bytes} [Thu Jul 14 15:17:07 2022] POST /identity/v3/roles => generated 234 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:07.690368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:07.719847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5a16-54ec-4ea8-a9a5-a40b3d7a5b74 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.734857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.736731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.739127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.739545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/abc839e67bf547919b1cf7218b0a0c2b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.744594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:update_role(role_id=abc839e67bf547919b1cf7218b0a0c2b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.747988 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:07.747988 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:17:07.747988 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:17:07.752157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.761130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:07.846614 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3666/7350] 10.222.0.98 () {60 vars in 1242 bytes} [Thu Jul 14 15:17:07 2022] PATCH /identity/v3/roles/abc839e67bf547919b1cf7218b0a0c2b => generated 238 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:07.846912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:07.865968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0faba-3322-40f6-8b7f-e4a5f48581b6 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.891648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.893335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.893787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.894306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/abc839e67bf547919b1cf7218b0a0c2b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.912003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:get_role(role_id=abc839e67bf547919b1cf7218b0a0c2b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.913964 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:07.913964 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:17:07.913964 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:17:07.916008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.919891 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3685/7351] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:17:07 2022] GET /identity/v3/roles/abc839e67bf547919b1cf7218b0a0c2b => generated 238 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:07.923566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:07.935594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125267-3dd6-4fbe-8a82-e87e52457558 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.941644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.942363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.942658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.942948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.943839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.946133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.963749 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3667/7352] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:07 2022] GET /identity/v3/roles => generated 2549 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:17:07.965445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:07.980789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114aab5-b86b-4032-98b7-d84d6b9c1366 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:07.987450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:07.990169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:07.990169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:07.990442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/abc839e67bf547919b1cf7218b0a0c2b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:07.993237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=abc839e67bf547919b1cf7218b0a0c2b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:07.996609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:07.999505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:08.060890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:08.063557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:08.099330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role abc839e67bf547919b1cf7218b0a0c2b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:08.099885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:08.101000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:08.107448 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3686/7353] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:07 2022] DELETE /identity/v3/roles/abc839e67bf547919b1cf7218b0a0c2b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:08.112948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:08.115557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:08.268409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff530f-b597-44c7-bac4-f67121594962 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:08.279930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:08.280877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a292ac-d697-419b-9b0d-959551eb0658 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:08.281443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:08.281743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:08.282077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:08.284720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:08.286530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:08.342448 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3687/7354] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:08 2022] PUT /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 519 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:08.347621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:08.416362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:08.417271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:08.418554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:08.418860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:08.424227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:08.476683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:08.479078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:08.498541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67a681-5477-4f61-912b-1889a3c533d2 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:08.509867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:08.512909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:08.513205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:08.513513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:08.516240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3668/7355] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:17:08.519115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=bb80bbb0494b42e98fe78962af9ec848)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:08.520733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:08.582724 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3688/7356] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:08 2022] PUT /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848 => generated 519 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:08.584240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:08.606867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc06c3-03e5-453f-8911-f84dc5950014 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:08.742990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:08.753609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:08.756659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:08.758817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:08.758817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:08.766134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb80bbb0494b42e98fe78962af9ec848, implied_role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:08.769390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:08.834568 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3669/7357] 10.222.0.98 () {60 vars in 1362 bytes} [Thu Jul 14 15:17:08 2022] PUT /identity/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396 => generated 519 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:08.840097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:08.854699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbd615-efea-470b-a39f-79c181ee89f4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:08.932002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:09.032901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:09.035433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:09.037089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:09.037421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:09.041931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=bb80bbb0494b42e98fe78962af9ec848)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:09.045204 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:09.045204 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:17:09.045204 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:17:09.046287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:09.062790 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3689/7358] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:17:08 2022] GET /identity/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies => generated 488 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:09.069741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:09.087574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7f15-f441-4c02-b56e-32b023348f1c tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:09.099671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:09.101548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:09.101903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:09.102117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:09.106081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=b09fafaf38d249ce8ef7f29337958f65)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:09.108324 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:17:09.108324 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:17:09.108324 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:17:09.111187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:09.133485 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3670/7359] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:17:09 2022] GET /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies => generated 658 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:09.135682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:09.160502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105a4b-3d4e-47fc-8e54-e2e947b47d85 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:09.182128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:09.189982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:09.190289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:09.190642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:09.198709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb80bbb0494b42e98fe78962af9ec848, implied_role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:09.207802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:09.231190 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3690/7360] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:09 2022] DELETE /identity/v3/roles/bb80bbb0494b42e98fe78962af9ec848/implies/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:09.235957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:09.252127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a558c-e498-492e-90ab-b88ae714e141 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:09.451451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:09.452551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:09.453988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:09.454321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:09.462920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=bb80bbb0494b42e98fe78962af9ec848)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:09.469068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:09.493825 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3671/7361] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:09 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/bb80bbb0494b42e98fe78962af9ec848 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:09.498299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:09.514891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1d07-64de-4587-bdc2-3304a1c05314 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:09.674760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:09.675771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:09.676065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:09.676354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:09.683833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b09fafaf38d249ce8ef7f29337958f65, implied_role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:09.685845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:09.712534 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3691/7362] 10.222.0.98 () {58 vars in 1346 bytes} [Thu Jul 14 15:17:09 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65/implies/8501d188817445f2a341c2af3419f417 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:09.717979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:09.731753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b083d-6747-4c2c-9be5-6b44fb0bfb59 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:09.834434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:09.835348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:09.835646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:09.835975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/01fdbdf0c3ef4afcb9000f724222c942` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:09.844863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Could not find domain: 01fdbdf0c3ef4afcb9000f724222c942.: keystone.exception.DomainNotFound: Could not find domain: 01fdbdf0c3ef4afcb9000f724222c942. Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 01fdbdf0c3ef4afcb9000f724222c942. Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:17:09.856790 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:09.858134 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 01fdbdf0c3ef4afcb9000f724222c942. Jul 14 15:17:09.859680 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:09.861010 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3672/7363] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:17:09 2022] PATCH /identity/v3/domains/01fdbdf0c3ef4afcb9000f724222c942 => generated 112 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:17:09.862149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:09.880309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b2d92-a7fc-4c30-be47-ba294e996e41 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:09.890390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:09.891361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:09.891637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:09.892162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/users/92ec18c6a0be4d51ab865152b4a0cabb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:09.894098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_user(user_id=92ec18c6a0be4d51ab865152b4a0cabb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:09.896153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:10.042020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ec18c6a0be4d51ab865152b4a0cabb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:10.124061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ec18c6a0be4d51ab865152b4a0cabb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:10.139104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ec18c6a0be4d51ab865152b4a0cabb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:10.139951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ec18c6a0be4d51ab865152b4a0cabb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:10.159550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ec18c6a0be4d51ab865152b4a0cabb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:10.187781 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3692/7364] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:09 2022] DELETE /identity/v3/users/92ec18c6a0be4d51ab865152b4a0cabb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:10.192129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:10.195663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:10.273596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0734ad-5907-42db-be19-8e885985eee3 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:10.476301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:10.477595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:10.478092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:10.478581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/d1320f2d89b04b4c8f827b318fb97396` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:10.480769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d1320f2d89b04b4c8f827b318fb97396)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:10.482887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:10.486180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:10.578757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role d1320f2d89b04b4c8f827b318fb97396 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:10.579220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:10.579968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:10.585746 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3673/7365] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:10 2022] DELETE /identity/v3/roles/d1320f2d89b04b4c8f827b318fb97396 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:10.586947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:10.605152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769324c5-ef81-4220-973f-b13db3ab5cb4 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:10.656337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:10.734789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:10.736402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:10.737388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:10.737844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/groups/578d20e98f164946aeba863d35f2b0b7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:10.739606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_group(group_id=578d20e98f164946aeba863d35f2b0b7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:10.742163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:10.813175 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3693/7366] 10.222.0.98 () {58 vars in 1226 bytes} [Thu Jul 14 15:17:10 2022] DELETE /identity/v3/groups/578d20e98f164946aeba863d35f2b0b7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:10.818530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:10.821825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:10.854841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aac9b6-ce28-4a31-80b6-12a4a06666dc tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:10.979322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:10.980365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:10.980725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:10.981223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/projects/9fd105db988943569f2415957a5af184` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:10.982742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9fd105db988943569f2415957a5af184)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:10.984889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:11.111722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd105db988943569f2415957a5af184', 'request_id': 'req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.126626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd105db988943569f2415957a5af184', 'request_id': 'req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.150558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd105db988943569f2415957a5af184', 'request_id': 'req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.177686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] The token cache is being invalidate because project 9fd105db988943569f2415957a5af184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:11.178036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.178762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.180767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3674/7367] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:17:10 2022] DELETE /identity/v3/projects/9fd105db988943569f2415957a5af184 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:11.184659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:11.186608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:11.214757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ee1a-5dff-4085-9362-1bde55753f3a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:11.379908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:11.384524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:11.385467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:11.387035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:11.390195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2ce5935f95bb44cda39a899eb1ac7be2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:11.392197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:11.430156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.430931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.492218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.493921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.504016 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3694/7368] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 15:17:11 2022] PATCH /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2 => generated 277 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:11.504936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:11.524220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fa777-f32a-4426-a0e1-1e324fbdf8ed tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:11.695100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:11.702089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:11.703343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:11.705779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:11.706773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:11.745871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2ce5935f95bb44cda39a899eb1ac7be2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:11.748018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:11.838178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.849701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:11.992071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2', 'request_id': 'req-345709c6-49ae-4d0a-8971-e4c576cfd62a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.019782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2', 'request_id': 'req-345709c6-49ae-4d0a-8971-e4c576cfd62a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.032611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2', 'request_id': 'req-345709c6-49ae-4d0a-8971-e4c576cfd62a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.056921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] The token cache is being invalidate because project 2ce5935f95bb44cda39a899eb1ac7be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:12.059087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.060634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.100445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2', 'request_id': 'req-345709c6-49ae-4d0a-8971-e4c576cfd62a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.110766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:12.112102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2', 'request_id': 'req-345709c6-49ae-4d0a-8971-e4c576cfd62a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.113349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:12.114251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2ce5935f95bb44cda39a899eb1ac7be2', 'request_id': 'req-345709c6-49ae-4d0a-8971-e4c576cfd62a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.128889 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3675/7369] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:17:11 2022] DELETE /identity/v3/domains/2ce5935f95bb44cda39a899eb1ac7be2 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:12.136913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:12.139730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:12.206297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:12.297150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc18435-941a-4120-bdd1-6f698ec84947 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:12.357608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345709c6-49ae-4d0a-8971-e4c576cfd62a tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:12.368957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:12.372954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:12.373639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:12.373840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/bb80bbb0494b42e98fe78962af9ec848` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:12.378613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bb80bbb0494b42e98fe78962af9ec848)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:12.384343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:12.519493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:12.521865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:12.523145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:12.523723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:12.528085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:12.536463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:12.546114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role bb80bbb0494b42e98fe78962af9ec848 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:12.546600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.548852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.558437 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3676/7370] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:12 2022] DELETE /identity/v3/roles/bb80bbb0494b42e98fe78962af9ec848 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:12.563781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:12.566975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:12.580393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:12.584396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:12.634882 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3695/7371] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:17:12.777780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d25dee-4b14-4de4-97e9-cc3d91095b37 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:12.796109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:12.797107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:12.801125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:12.804881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/8501d188817445f2a341c2af3419f417` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:12.819200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8501d188817445f2a341c2af3419f417)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:12.833381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:12.899091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role 8501d188817445f2a341c2af3419f417 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:12.899526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.900580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:12.902941 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3677/7372] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:12 2022] DELETE /identity/v3/roles/8501d188817445f2a341c2af3419f417 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:12.906959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:12.920588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8dd0-766a-4640-9594-0e3fdadb0128 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:13.064285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a070af80e1c7486b873d946f9774369a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e09abcec6448dea4cdcb29db24fcbe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:13.066262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:13.066662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:13.067020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] PATH_INFO: `/v3/roles/b09fafaf38d249ce8ef7f29337958f65` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:13.070594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b09fafaf38d249ce8ef7f29337958f65)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:13.072559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:13.157947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invalidating the token cache because role b09fafaf38d249ce8ef7f29337958f65 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:13.158870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:13.160196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-36c8701d-d4a8-4995-ae81-7a89bc12cf49 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:13.164998 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3696/7373] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:12 2022] DELETE /identity/v3/roles/b09fafaf38d249ce8ef7f29337958f65 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:13.174041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:13.175997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:13.421724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b648ae-953e-48ad-bd07-23cab16a88f1 tempest-RolesV3TestJSON-1643920604 tempest-RolesV3TestJSON-1643920604-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:13.685626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:13.690854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:13.691085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:13.695702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] PATH_INFO: `/v3/users/77ffc8f16876405fb6307d1bcd50512e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:13.697295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ffc8f16876405fb6307d1bcd50512e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:13.706555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:13.766288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:13.943359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ffc8f16876405fb6307d1bcd50512e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:14.003691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ffc8f16876405fb6307d1bcd50512e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:14.006844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ffc8f16876405fb6307d1bcd50512e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:14.043957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ffc8f16876405fb6307d1bcd50512e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:14.052415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ffc8f16876405fb6307d1bcd50512e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:14.109510 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3678/7374] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:13 2022] DELETE /identity/v3/users/77ffc8f16876405fb6307d1bcd50512e => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:14.111080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:14.111689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:14.112118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:14.200819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:14.202290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:14.313314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:14.347977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:14.349594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:14.423220 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3697/7375] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:17:14.457466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:14.459025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:14.616867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640a5f5-ebd1-4b01-a6d2-d60a139e092b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:14.620769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef6145-a1f3-42ae-8aaa-5bc2797f2673 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:14.626899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:14.628919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:14.633103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:14.635969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:14.653999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:14.654745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:14.656600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:14.656600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:14.665390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:14.665831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:14.667165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:14.701894 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3698/7376] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:17:14.714721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:14.716681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:14.776215 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3679/7377] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:17:17.494118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:17.503588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:17.534008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68f0e7-effc-4cc4-b8bc-52c312db788a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:17.557596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:17.558503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:17.558981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:17.559360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] PATH_INFO: `/v3/projects/2459905bde664a5798b275453827ab11` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:17.564379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2459905bde664a5798b275453827ab11)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:17.575449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:17.697188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2459905bde664a5798b275453827ab11', 'request_id': 'req-bb705585-0c10-4a9d-9c11-b4f2ec93209a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:17.710483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2459905bde664a5798b275453827ab11', 'request_id': 'req-bb705585-0c10-4a9d-9c11-b4f2ec93209a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:17.724342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2459905bde664a5798b275453827ab11', 'request_id': 'req-bb705585-0c10-4a9d-9c11-b4f2ec93209a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:17.764081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] The token cache is being invalidate because project 2459905bde664a5798b275453827ab11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:17.764457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:17.765395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb705585-0c10-4a9d-9c11-b4f2ec93209a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:17.767389 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3699/7378] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:17:17 2022] DELETE /identity/v3/projects/2459905bde664a5798b275453827ab11 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:17.773560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:17.797850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fcbe9-4614-4463-b040-f6630a3698dc service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:17.983501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:17.985427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:17.985920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:17.986596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] PATH_INFO: `/v3/users/a070af80e1c7486b873d946f9774369a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:17.989846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a070af80e1c7486b873d946f9774369a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:17.994229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:18.068179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:18.160226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a070af80e1c7486b873d946f9774369a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:18.192801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a070af80e1c7486b873d946f9774369a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:18.193599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a070af80e1c7486b873d946f9774369a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:18.212660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a070af80e1c7486b873d946f9774369a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:18.213405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a070af80e1c7486b873d946f9774369a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:18.244112 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3680/7379] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:17 2022] DELETE /identity/v3/users/a070af80e1c7486b873d946f9774369a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:19.468830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:19.469563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:19.469563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:19.579532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] MFA Rules not processed for user `9d308a61b80a441fa7a891d3b0f4dd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:19.583230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:19.810248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:19.904266 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3700/7380] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:17:20.187810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:20.190475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:20.269426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:20.270528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:20.439684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b5b31-4630-43fa-84a8-2753ac7fac48 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:20.465841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:20.467164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:20.470261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:20.471756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] PATH_INFO: `/v3/projects/f6e09abcec6448dea4cdcb29db24fcbe` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:20.478947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e09abcec6448dea4cdcb29db24fcbe)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:20.492931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:20.517036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d574-c8a4-4435-a062-7fbb52b0f449 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:20.544015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed26e26-9dd6-4bad-b08a-0174da531de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:20.546919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26e26-9dd6-4bad-b08a-0174da531de0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:20.546919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26e26-9dd6-4bad-b08a-0174da531de0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:20.546919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26e26-9dd6-4bad-b08a-0174da531de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:20.557950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ed26e26-9dd6-4bad-b08a-0174da531de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:20.641391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e09abcec6448dea4cdcb29db24fcbe', 'request_id': 'req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:20.658939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e09abcec6448dea4cdcb29db24fcbe', 'request_id': 'req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:20.674160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e09abcec6448dea4cdcb29db24fcbe', 'request_id': 'req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:20.706134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] The token cache is being invalidate because project f6e09abcec6448dea4cdcb29db24fcbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:20.706134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:20.706955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-35cc4faa-5c28-4d8b-a94c-58520ea4a45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:20.711150 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3681/7381] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:17:20 2022] DELETE /identity/v3/projects/f6e09abcec6448dea4cdcb29db24fcbe => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:20.723863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce9cae-2b98-43f5-870d-6e4288365410 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:20.725476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce9cae-2b98-43f5-870d-6e4288365410 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:20.727002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce9cae-2b98-43f5-870d-6e4288365410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:20.765844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed26e26-9dd6-4bad-b08a-0174da531de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:20.771177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed26e26-9dd6-4bad-b08a-0174da531de0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:20.786352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-19ce9cae-2b98-43f5-870d-6e4288365410 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:20.789640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-19ce9cae-2b98-43f5-870d-6e4288365410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:20.803355 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3701/7382] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:17:20.856996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:21.019874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3682/7383] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:21.028876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371619c-9e9f-49be-a21b-8b6eeff8952e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.029249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371619c-9e9f-49be-a21b-8b6eeff8952e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.029452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371619c-9e9f-49be-a21b-8b6eeff8952e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.078631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1371619c-9e9f-49be-a21b-8b6eeff8952e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:21.081870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1371619c-9e9f-49be-a21b-8b6eeff8952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:21.117537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3702/7384] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:21.120974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce9cae-2b98-43f5-870d-6e4288365410 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:21.135846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce9cae-2b98-43f5-870d-6e4288365410 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:21.148237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:21.149971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.151444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.152905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.154788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:17:21.155303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:21.160637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:21.203873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371619c-9e9f-49be-a21b-8b6eeff8952e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:21.209796 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3683/7385] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:17:21.217635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371619c-9e9f-49be-a21b-8b6eeff8952e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:21.223526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:21.224993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.225434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.225821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.227304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:21.229442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:21.288370 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3703/7386] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:17:21 2022] POST /identity/v3/projects => generated 389 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:21.290109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:21.307893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045acd3f-d24f-4c37-a8c4-1ee821f9f96e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:21.410638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:21.412046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.412984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.413390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.414255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:21.421160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:21.481618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:21.482061 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3684/7387] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:17:21 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:17:21.505968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02c8c-b0a0-49c4-9931-973b0e04b35e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:21.536822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:21.538095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.538225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.538426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.546360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:21.549788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:21.585583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:21.588795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3704/7388] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:21.618459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6f46-3aa4-4ca9-8062-933b7dc3fa0b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:21.635638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b6475-91cd-4858-8eb6-78194e089291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:21.639211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6475-91cd-4858-8eb6-78194e089291 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.641238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6475-91cd-4858-8eb6-78194e089291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.642203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6475-91cd-4858-8eb6-78194e089291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.643693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b6475-91cd-4858-8eb6-78194e089291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:21.651299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b6475-91cd-4858-8eb6-78194e089291 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:21.689852 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3685/7389] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:21.695234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:21.713489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9fa62-f67e-4198-8367-706dd12f3d35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:21.730628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:21.731620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.731920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.732215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] PATH_INFO: `/v3/projects/96b043d9c6cc4694aaa9ac0b714f72e0/users/4c931d9c0f684e6ea9db65d33df7fd5a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.807427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b043d9c6cc4694aaa9ac0b714f72e0, user_id=4c931d9c0f684e6ea9db65d33df7fd5a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:21.815617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:21.868726 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3705/7390] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:17:21 2022] PUT /identity/v3/projects/96b043d9c6cc4694aaa9ac0b714f72e0/users/4c931d9c0f684e6ea9db65d33df7fd5a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:21.871420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19547-ab93-4d63-af28-4ec5f3ed9c4e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:21.871982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19547-ab93-4d63-af28-4ec5f3ed9c4e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:21.874836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19547-ab93-4d63-af28-4ec5f3ed9c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:21.916098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-20c19547-ab93-4d63-af28-4ec5f3ed9c4e None None] MFA Rules not processed for user `4c931d9c0f684e6ea9db65d33df7fd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:21.918249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20c19547-ab93-4d63-af28-4ec5f3ed9c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:22.176642 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3686/7391] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:22.182482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:22.233827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef2864-1bb2-4c9c-b3a3-0e050c9dbb1c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:22.245249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed30711-a5e5-452b-ba40-e6e2ecfca4b3 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:22.246818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30711-a5e5-452b-ba40-e6e2ecfca4b3 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:22.247630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30711-a5e5-452b-ba40-e6e2ecfca4b3 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:22.251555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30711-a5e5-452b-ba40-e6e2ecfca4b3 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:22.252731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed30711-a5e5-452b-ba40-e6e2ecfca4b3 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:create_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:22.254214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed30711-a5e5-452b-ba40-e6e2ecfca4b3 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:22.299745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:22.455134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3706/7392] 10.222.0.98 () {60 vars in 1313 bytes} [Thu Jul 14 15:17:22 2022] POST /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 789 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:22.456093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c19547-ab93-4d63-af28-4ec5f3ed9c4e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:22.468315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c19547-ab93-4d63-af28-4ec5f3ed9c4e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:22.482985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:22.484354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:22.484826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:22.485194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/5640694364dc446e8024aa60ebd0f29b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:22.512251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:get_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=5640694364dc446e8024aa60ebd0f29b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:22.516533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:22.525044 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3687/7393] 10.222.0.98 () {58 vars in 1391 bytes} [Thu Jul 14 15:17:22 2022] GET /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/5640694364dc446e8024aa60ebd0f29b => generated 689 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:17:22.529562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f57469-876b-4da0-b81b-de02f836413b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:22.530105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f57469-876b-4da0-b81b-de02f836413b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:22.530495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f57469-876b-4da0-b81b-de02f836413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:22.564040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b1f57469-876b-4da0-b81b-de02f836413b None None] MFA Rules not processed for user `4c931d9c0f684e6ea9db65d33df7fd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:22.568429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1f57469-876b-4da0-b81b-de02f836413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:23.037630 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3707/7394] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:22 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 14 15:17:23.040710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:23.055980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762216b-56c1-4c29-8487-7a01326eeb67 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:23.075619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:23.078511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:23.079630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:23.080380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/5640694364dc446e8024aa60ebd0f29b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:23.082240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=5640694364dc446e8024aa60ebd0f29b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:23.084067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:23.089634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:23.146042 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3688/7395] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:17:23 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/5640694364dc446e8024aa60ebd0f29b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:23.152079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f57469-876b-4da0-b81b-de02f836413b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:23.174063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f57469-876b-4da0-b81b-de02f836413b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:23.189284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:23.190270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:23.192191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:23.192191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:23.192876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:create_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:23.194872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:23.396456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:23.422111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:23.422466 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3708/7396] 10.222.0.98 () {60 vars in 1314 bytes} [Thu Jul 14 15:17:23 2022] POST /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 921 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:23.449645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c4d43-cedd-40a6-8a5d-85194109568e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:23.455319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:23.456896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:23.457527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:23.457527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/8fec385ad2144a369ad172520137e9e1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:23.472410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=8fec385ad2144a369ad172520137e9e1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:23.475130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:23.524538 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3689/7397] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:17:23 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/8fec385ad2144a369ad172520137e9e1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:23.529934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:23.542486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c32aa5-c2d8-4cca-bcc7-27ec1b4d7727 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:23.557566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:23.560145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:23.561959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:23.563071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:23.565482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:create_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:23.568491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:23.789883 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3709/7398] 10.222.0.98 () {60 vars in 1314 bytes} [Thu Jul 14 15:17:23 2022] POST /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 813 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:23.790367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:23.809875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d20c5-19cb-4579-8092-540884cf5dab tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:23.835832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:23.836838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:23.837127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:23.837414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/2db11341fbcb4190a69ad0bee49ccb7f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:23.873101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=2db11341fbcb4190a69ad0bee49ccb7f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:23.875084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:23.929418 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3690/7399] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:17:23 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/2db11341fbcb4190a69ad0bee49ccb7f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:23.935796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:23.985038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76481673-8fc6-4303-a7c3-bbf7ba80c77c tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:23.994938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:23.996279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:23.996958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:23.997931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:23.998942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:create_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:24.000446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:24.172929 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3710/7400] 10.222.0.98 () {60 vars in 1313 bytes} [Thu Jul 14 15:17:23 2022] POST /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 788 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:24.176826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:24.189652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdc150-b9ba-472d-8975-db0ea14dfceb tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:24.215646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:24.216509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:24.216802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:24.217087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:24.217838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:create_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:24.225663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:24.476047 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3691/7401] 10.222.0.98 () {60 vars in 1313 bytes} [Thu Jul 14 15:17:24 2022] POST /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 788 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:24.478214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:24.499046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a7ca4-f108-4400-881c-76dea7cd2288 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:24.520203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:24.525845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:24.526347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:24.526831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:24.537679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:list_application_credentials(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:24.544333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:24.593216 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3711/7402] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:17:24 2022] GET /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 1500 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:24.598458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:24.626168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c33c-fe86-43f7-b9e8-5591e640dbaa tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:24.634407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:24.635858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:24.636419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:24.637388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/26453cf5b20e4c0981a8918e72db7d81` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:24.668791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=26453cf5b20e4c0981a8918e72db7d81)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:24.671883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:24.736387 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3692/7403] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:17:24 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/26453cf5b20e4c0981a8918e72db7d81 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:24.737539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:24.752143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ff44-4abe-4f5a-ae71-0de8c999d355 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:24.764517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:24.766751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:24.768759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:24.769692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/e6a9d837b1254709acde506eccb3bc26` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:24.800390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=e6a9d837b1254709acde506eccb3bc26)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:24.802242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:24.846158 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3712/7404] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:17:24 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/e6a9d837b1254709acde506eccb3bc26 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:24.851760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:24.903683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9e7ba-1473-4788-97f6-93fde389ae2e tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:24.921200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:24.922910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:24.924399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:24.924942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:24.927584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:create_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:24.934223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:25.085966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:25.141826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3693/7405] 10.222.0.98 () {60 vars in 1313 bytes} [Thu Jul 14 15:17:24 2022] POST /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 789 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:25.146719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:25.165951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2c2d-129d-47b2-92ae-aa1932d0cf25 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:25.172701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:25.173633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:25.173921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:25.174525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:25.175168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:create_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:25.177790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:25.287881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:25.364283 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3713/7406] 10.222.0.98 () {60 vars in 1313 bytes} [Thu Jul 14 15:17:25 2022] POST /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials => generated 789 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:25.370490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:25.385501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646d58f-eda2-4dde-a949-88c83d51fd94 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:25.400562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:25.432336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:25.434054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:25.434362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:25.438651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Adding query filter params (name=tempest-application_credential-1770521163) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:17:25.440273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:list_application_credentials(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:25.452850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:25.491749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:25.496785 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3694/7407] 10.222.0.98 () {58 vars in 1385 bytes} [Thu Jul 14 15:17:25 2022] GET /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials?name=tempest-application_credential-1770521163 => generated 887 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:17:25.526426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27082929-3a67-4a48-9f51-1bec27c90f3a tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:25.555095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:25.556267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:25.556665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:25.556961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/afaf9ddb63f747dfa5ad1927eea04c65` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:25.587808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=afaf9ddb63f747dfa5ad1927eea04c65)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:25.595336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:25.650107 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3714/7408] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:17:25 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/afaf9ddb63f747dfa5ad1927eea04c65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:25.659649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:25.687862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520ec1d-e22c-4032-8981-bf90f37d5b0f tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:25.714633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eb182-4541-4568-bfe9-4f6703d141f7 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c931d9c0f684e6ea9db65d33df7fd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96b043d9c6cc4694aaa9ac0b714f72e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:25.722003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb182-4541-4568-bfe9-4f6703d141f7 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:25.724342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb182-4541-4568-bfe9-4f6703d141f7 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:25.726770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb182-4541-4568-bfe9-4f6703d141f7 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/f34e9c69c83e4534806c2bc32b6d88b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:25.761355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb182-4541-4568-bfe9-4f6703d141f7 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4c931d9c0f684e6ea9db65d33df7fd5a, application_credential_id=f34e9c69c83e4534806c2bc32b6d88b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:25.765664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb182-4541-4568-bfe9-4f6703d141f7 tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:25.860301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3695/7409] 10.222.0.98 () {58 vars in 1394 bytes} [Thu Jul 14 15:17:25 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a/application_credentials/f34e9c69c83e4534806c2bc32b6d88b1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:25.862038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:26.059514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ee033-a33c-4367-a840-7cd9293a9d5d tempest-ApplicationCredentialsV3Test-50813859 tempest-ApplicationCredentialsV3Test-50813859-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:26.083080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:26.084064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:26.084943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:26.085290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] PATH_INFO: `/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:26.088446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c931d9c0f684e6ea9db65d33df7fd5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:26.091597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:26.182751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:26.183257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:26.185071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:26.227859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c931d9c0f684e6ea9db65d33df7fd5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:26.255147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] MFA Rules not processed for user `a5636dbc7f0745bf845d714249f88de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:26.261942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:26.281607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c931d9c0f684e6ea9db65d33df7fd5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:26.296901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c931d9c0f684e6ea9db65d33df7fd5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:26.297956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c931d9c0f684e6ea9db65d33df7fd5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:26.320766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b398c87-49df-4f99-bf23-962a557df850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c931d9c0f684e6ea9db65d33df7fd5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:26.349989 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3715/7410] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:25 2022] DELETE /identity/v3/users/4c931d9c0f684e6ea9db65d33df7fd5a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:26.353612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:26.354017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:26.354429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:26.434384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:26.436954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:26.469970 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3696/7411] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:26.478753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:26.590905 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3716/7412] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:26.648771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:26.651149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:26.750487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91600a87-7a15-4f59-b6d3-412418139514 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:26.825915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2d80-94a3-4aa1-8f5f-47e319d6e7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:26.826741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2d80-94a3-4aa1-8f5f-47e319d6e7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:26.827027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2d80-94a3-4aa1-8f5f-47e319d6e7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:26.827357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2d80-94a3-4aa1-8f5f-47e319d6e7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:26.843546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2d80-94a3-4aa1-8f5f-47e319d6e7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:26.845645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2d80-94a3-4aa1-8f5f-47e319d6e7eb service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:26.873052 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3697/7413] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:17:28.024508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:28.025960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:28.046713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720742f-a062-4d92-a5cc-a47a7ff6ad06 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:28.065087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:28.065980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:28.066464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:28.066919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] PATH_INFO: `/v3/projects/96b043d9c6cc4694aaa9ac0b714f72e0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:28.069177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b043d9c6cc4694aaa9ac0b714f72e0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:28.071480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:28.254817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b043d9c6cc4694aaa9ac0b714f72e0', 'request_id': 'req-c89a20a2-a859-4a93-9b2f-4f50486058b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:28.265275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b043d9c6cc4694aaa9ac0b714f72e0', 'request_id': 'req-c89a20a2-a859-4a93-9b2f-4f50486058b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:28.289038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b043d9c6cc4694aaa9ac0b714f72e0', 'request_id': 'req-c89a20a2-a859-4a93-9b2f-4f50486058b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:28.308351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] The token cache is being invalidate because project 96b043d9c6cc4694aaa9ac0b714f72e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:28.309329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:28.310699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89a20a2-a859-4a93-9b2f-4f50486058b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:28.314453 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3717/7414] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:17:28 2022] DELETE /identity/v3/projects/96b043d9c6cc4694aaa9ac0b714f72e0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:28.319966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c3338-59cc-4dcf-be0a-0a38d794ed55 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:28.324030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c3338-59cc-4dcf-be0a-0a38d794ed55 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:28.324823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c3338-59cc-4dcf-be0a-0a38d794ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:28.351653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:28.387064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e97c3338-59cc-4dcf-be0a-0a38d794ed55 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:28.389123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e97c3338-59cc-4dcf-be0a-0a38d794ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:28.528247 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3698/7415] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:28.536855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c9aa8-0689-4748-8e87-1d2163c52e15 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:28.537930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c9aa8-0689-4748-8e87-1d2163c52e15 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:28.538033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c9aa8-0689-4748-8e87-1d2163c52e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:28.578878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7b9c9aa8-0689-4748-8e87-1d2163c52e15 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:28.583752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b9c9aa8-0689-4748-8e87-1d2163c52e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:28.614003 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3718/7416] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:28.615773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c3338-59cc-4dcf-be0a-0a38d794ed55 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:28.630089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c3338-59cc-4dcf-be0a-0a38d794ed55 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:28.652015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:28.655010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:28.655329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:28.655620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:28.656386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:17:28.661810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:28.663671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:28.700279 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3699/7417] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:28.704663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c9aa8-0689-4748-8e87-1d2163c52e15 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:28.718711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c9aa8-0689-4748-8e87-1d2163c52e15 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:28.735852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:28.746945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:28.749007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:28.749516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:28.750582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:28.759040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:28.819074 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3719/7418] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:17:28 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:28.822313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:28.837962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d936e-229c-4b70-9889-90cec93b585f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:28.984329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:28.985052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:28.985352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:28.985619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:28.986337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:28.992004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:29.087321 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3700/7419] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:17:28 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:17:29.089378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:29.111679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98574a3-e67a-4b79-bd4a-9dbaf36f19ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:29.127848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:29.139550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:29.140002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:29.140410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:29.141242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:29.143128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:29.191034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:29.206990 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3720/7420] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:29.209733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff28c-feda-4d7e-84a0-897fea8576b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:29.231427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937099d-db1e-4fbf-95b7-704d63f59963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:29.232887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937099d-db1e-4fbf-95b7-704d63f59963 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:29.233181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937099d-db1e-4fbf-95b7-704d63f59963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:29.233467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937099d-db1e-4fbf-95b7-704d63f59963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:29.234253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937099d-db1e-4fbf-95b7-704d63f59963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:29.247437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937099d-db1e-4fbf-95b7-704d63f59963 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:29.287846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:29.300905 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3701/7421] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:17:29.307142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3074f-4ef5-4909-9d9e-b913cff0ccd8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:29.329648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:29.333660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:29.335512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:29.335869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] PATH_INFO: `/v3/projects/489c36cfd834452f9d8464c1566d5e23/users/16a23bbe3bc147638001428f06d9ed4e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:29.396050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=489c36cfd834452f9d8464c1566d5e23, user_id=16a23bbe3bc147638001428f06d9ed4e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:29.416768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:29.464321 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3721/7422] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:17:29 2022] PUT /identity/v3/projects/489c36cfd834452f9d8464c1566d5e23/users/16a23bbe3bc147638001428f06d9ed4e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:29.480602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba040e6-d5fb-4c25-915b-323e706f2022 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:29.481665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba040e6-d5fb-4c25-915b-323e706f2022 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:29.482151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba040e6-d5fb-4c25-915b-323e706f2022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:29.576211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5ba040e6-d5fb-4c25-915b-323e706f2022 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:29.579514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5ba040e6-d5fb-4c25-915b-323e706f2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:29.720154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:29.746012 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3702/7423] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:17:29.746250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:29.760809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe13ad-860e-494e-a0b4-2b1192eef99f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:29.776126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d518f-cade-4baf-960b-6f43fc139c39 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:29.777398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d518f-cade-4baf-960b-6f43fc139c39 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:29.778061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d518f-cade-4baf-960b-6f43fc139c39 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:29.778404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d518f-cade-4baf-960b-6f43fc139c39 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:29.884892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ac2d518f-cade-4baf-960b-6f43fc139c39 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:29.899815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3722/7424] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:29 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:30.905886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8dc82-b15e-40bb-be09-80427539c378 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:30.906961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8dc82-b15e-40bb-be09-80427539c378 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:30.907426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8dc82-b15e-40bb-be09-80427539c378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:30.968722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bcc8dc82-b15e-40bb-be09-80427539c378 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:30.974678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bcc8dc82-b15e-40bb-be09-80427539c378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:31.001629 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3703/7425] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:30 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:31.006904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2cc27-9998-41c4-a93b-7d472d699016 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:31.007860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2cc27-9998-41c4-a93b-7d472d699016 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:31.008304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2cc27-9998-41c4-a93b-7d472d699016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:31.033792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:31.066485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-92a2cc27-9998-41c4-a93b-7d472d699016 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:31.084668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92a2cc27-9998-41c4-a93b-7d472d699016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:31.117998 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3723/7426] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:31.122737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8dc82-b15e-40bb-be09-80427539c378 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:31.217238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8dc82-b15e-40bb-be09-80427539c378 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:31.264547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c9678-a3f8-4ba2-adc1-3fa975ede23e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:31.267861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c9678-a3f8-4ba2-adc1-3fa975ede23e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:31.268699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c9678-a3f8-4ba2-adc1-3fa975ede23e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:31.273758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c9678-a3f8-4ba2-adc1-3fa975ede23e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-167c9678-a3f8-4ba2-adc1-3fa975ede23e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:17:31.567111 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 14 15:17:31.568417 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:31.573345 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3704/7427] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:31 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 188 bytes in 450 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:17:31.574377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2cc27-9998-41c4-a93b-7d472d699016 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:31.589663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2cc27-9998-41c4-a93b-7d472d699016 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:31.622342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9346f4-3d5b-4feb-98ef-48b5e345578d tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:31.628691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9346f4-3d5b-4feb-98ef-48b5e345578d tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:31.629177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9346f4-3d5b-4feb-98ef-48b5e345578d tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:31.629714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9346f4-3d5b-4feb-98ef-48b5e345578d tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0d9346f4-3d5b-4feb-98ef-48b5e345578d tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:17:31.794132 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 14 15:17:31.796084 n-d-768852-23 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 14 15:17:31.803656 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3724/7428] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:31 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 188 bytes in 229 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 14 15:17:31.803952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c9678-a3f8-4ba2-adc1-3fa975ede23e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:31.840244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c9678-a3f8-4ba2-adc1-3fa975ede23e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:31.854506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614dbe-1521-4b80-b841-9e4b0a5023d2 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:31.856087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614dbe-1521-4b80-b841-9e4b0a5023d2 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:31.856581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614dbe-1521-4b80-b841-9e4b0a5023d2 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:31.857073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614dbe-1521-4b80-b841-9e4b0a5023d2 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:31.956516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9614dbe-1521-4b80-b841-9e4b0a5023d2 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:31.972892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3705/7429] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:31 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:32.977005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3130-5a60-4bfc-ab25-ae096cf29c03 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:32.978685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3130-5a60-4bfc-ab25-ae096cf29c03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:32.978685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3130-5a60-4bfc-ab25-ae096cf29c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:33.030380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c95f3130-5a60-4bfc-ab25-ae096cf29c03 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:33.038235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c95f3130-5a60-4bfc-ab25-ae096cf29c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:33.064594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a247c8-b929-436d-aa16-2ff10afe4b6e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:33.065452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a247c8-b929-436d-aa16-2ff10afe4b6e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:33.065452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a247c8-b929-436d-aa16-2ff10afe4b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:33.067852 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3725/7430] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:17:33.143058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-19a247c8-b929-436d-aa16-2ff10afe4b6e None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:33.166007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-19a247c8-b929-436d-aa16-2ff10afe4b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:33.227179 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3706/7431] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:33.231405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f3130-5a60-4bfc-ab25-ae096cf29c03 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:33.268124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f3130-5a60-4bfc-ab25-ae096cf29c03 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:33.284191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480d220-cbeb-49a3-a8ad-6bff5c63ee13 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:33.285117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d220-cbeb-49a3-a8ad-6bff5c63ee13 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:33.285419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d220-cbeb-49a3-a8ad-6bff5c63ee13 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:33.285702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d220-cbeb-49a3-a8ad-6bff5c63ee13 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:33.459476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0480d220-cbeb-49a3-a8ad-6bff5c63ee13 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:33.514050 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3726/7432] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:33 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:34.518104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1b7ee-e9fd-414d-9ae4-d6668a46d632 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:34.518890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1b7ee-e9fd-414d-9ae4-d6668a46d632 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:34.518890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1b7ee-e9fd-414d-9ae4-d6668a46d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:34.579373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-11d1b7ee-e9fd-414d-9ae4-d6668a46d632 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:34.593066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11d1b7ee-e9fd-414d-9ae4-d6668a46d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:34.631658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aeddf-d25a-4202-9781-31b444b3bc4c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:34.632467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aeddf-d25a-4202-9781-31b444b3bc4c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:34.632467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aeddf-d25a-4202-9781-31b444b3bc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:34.640521 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3707/7433] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:34.708633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e9aeddf-d25a-4202-9781-31b444b3bc4c None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:34.709926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e9aeddf-d25a-4202-9781-31b444b3bc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:34.750823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3727/7434] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:34.753735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1b7ee-e9fd-414d-9ae4-d6668a46d632 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:34.819503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1b7ee-e9fd-414d-9ae4-d6668a46d632 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:34.854210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:34.859502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:34.861517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:34.866879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:35.046867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:35.065250 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3708/7435] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:34 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:35.084742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dce4d-ceda-41fb-86ab-9a46ae002462 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:35.085787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dce4d-ceda-41fb-86ab-9a46ae002462 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:35.086556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dce4d-ceda-41fb-86ab-9a46ae002462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:35.331220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-241dce4d-ceda-41fb-86ab-9a46ae002462 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:35.340941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-241dce4d-ceda-41fb-86ab-9a46ae002462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:35.555690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3728/7436] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:35.655697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:35.658612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:35.974636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdea92-5d78-4cc6-b25d-52c1f3745c7f tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:35.996518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6712-45e7-42ab-add3-575d1c7a6102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:36.000130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6712-45e7-42ab-add3-575d1c7a6102 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:36.001721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6712-45e7-42ab-add3-575d1c7a6102 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:36.002557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6712-45e7-42ab-add3-575d1c7a6102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:36.039817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e6712-45e7-42ab-add3-575d1c7a6102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:36.045288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e6712-45e7-42ab-add3-575d1c7a6102 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:36.070881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275fa4-8988-4e57-8d7c-22ab6640fb29 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:36.071718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275fa4-8988-4e57-8d7c-22ab6640fb29 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:36.071718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275fa4-8988-4e57-8d7c-22ab6640fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:36.105539 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3709/7437] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:17:36.164415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-72275fa4-8988-4e57-8d7c-22ab6640fb29 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:36.171768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72275fa4-8988-4e57-8d7c-22ab6640fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:36.206044 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3729/7438] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:36 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:17:36.209960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726633-19b4-4014-afb0-85a08ca9bec3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:36.210990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726633-19b4-4014-afb0-85a08ca9bec3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:36.211831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726633-19b4-4014-afb0-85a08ca9bec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:36.313450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fe726633-19b4-4014-afb0-85a08ca9bec3 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:36.323506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe726633-19b4-4014-afb0-85a08ca9bec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:36.366263 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3710/7439] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:36.372289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72275fa4-8988-4e57-8d7c-22ab6640fb29 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:36.419714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72275fa4-8988-4e57-8d7c-22ab6640fb29 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:36.435554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b1652-2c95-4c7b-abb6-91ad4798f1b5 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:36.439739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1652-2c95-4c7b-abb6-91ad4798f1b5 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:36.441439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1652-2c95-4c7b-abb6-91ad4798f1b5 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:36.442689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1652-2c95-4c7b-abb6-91ad4798f1b5 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:36.614241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea8b1652-2c95-4c7b-abb6-91ad4798f1b5 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:36.669410 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3730/7440] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:36 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:37.670483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc070-cc8b-4016-92bc-fe0cc10aa917 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:37.672102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc070-cc8b-4016-92bc-fe0cc10aa917 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:37.672616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc070-cc8b-4016-92bc-fe0cc10aa917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:37.714030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1c1fc070-cc8b-4016-92bc-fe0cc10aa917 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:37.715738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c1fc070-cc8b-4016-92bc-fe0cc10aa917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:37.732460 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3711/7441] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:38.730289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:38.730840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:38.731408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:38.778533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:38.786211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:38.817430 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3731/7442] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:38.820154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6340-c684-444f-a58c-80424539a64f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:38.820670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6340-c684-444f-a58c-80424539a64f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:38.820961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6340-c684-444f-a58c-80424539a64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:38.858435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-281f6340-c684-444f-a58c-80424539a64f None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:38.861596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-281f6340-c684-444f-a58c-80424539a64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:38.868306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:38.869992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:38.878843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:38.890308 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3712/7443] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:38.892259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15e726-7a81-4c89-818d-b99e5042cf4b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:38.892679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15e726-7a81-4c89-818d-b99e5042cf4b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:38.893091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15e726-7a81-4c89-818d-b99e5042cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:39.024989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:39.106317 n-d-768852-23 devstack@keystone.service[80582]: WARNING keystone.server.flask.application [None req-fa15e726-7a81-4c89-818d-b99e5042cf4b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.98: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 14 15:17:39.114185 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3713/7444] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 223 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 14 15:17:39.116867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252009ec-5dfc-4777-a1e3-ffed2d3b47a2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:39.117158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252009ec-5dfc-4777-a1e3-ffed2d3b47a2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:39.117446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252009ec-5dfc-4777-a1e3-ffed2d3b47a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:39.127695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c126d85-4eb8-4766-8ec0-da61485f98fb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:39.139653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:39.141834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:39.142148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:39.142439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:39.159844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:39.344025 n-d-768852-23 devstack@keystone.service[80582]: WARNING keystone.server.flask.application [None req-252009ec-5dfc-4777-a1e3-ffed2d3b47a2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.98: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 14 15:17:39.345600 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3714/7445] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 231 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 14 15:17:39.348683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252009ec-5dfc-4777-a1e3-ffed2d3b47a2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:39.358836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-252009ec-5dfc-4777-a1e3-ffed2d3b47a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:39.418179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:39.420335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:39.457618 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3732/7446] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:17:39.460702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:39.464149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:39.632150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252009ec-5dfc-4777-a1e3-ffed2d3b47a2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:39.650947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d885-7a33-4e56-a08b-015f05ca8ed2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:39.653309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d885-7a33-4e56-a08b-015f05ca8ed2 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:39.653625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d885-7a33-4e56-a08b-015f05ca8ed2 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:39.653905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d885-7a33-4e56-a08b-015f05ca8ed2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:39.658080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3473d885-7a33-4e56-a08b-015f05ca8ed2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:39.671408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039abe6-65ce-4aa4-bd05-38ad94f19dfd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:39.689762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:39.690878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:39.691336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:39.691891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] PATH_INFO: `/v3/users/83513b7f5185436b8ea320c025f673af` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:39.694359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=83513b7f5185436b8ea320c025f673af)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:39.697064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:39.698515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473d885-7a33-4e56-a08b-015f05ca8ed2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:39.700967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473d885-7a33-4e56-a08b-015f05ca8ed2 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:39.746883 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3715/7447] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:17:39.765498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02749d02-cc92-439c-8d43-6413510b376c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:39.765721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02749d02-cc92-439c-8d43-6413510b376c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:39.765845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02749d02-cc92-439c-8d43-6413510b376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:39.829354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83513b7f5185436b8ea320c025f673af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:39.842885 n-d-768852-23 devstack@keystone.service[80582]: WARNING keystone.server.flask.application [None req-02749d02-cc92-439c-8d43-6413510b376c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.98: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 14 15:17:39.844347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:39.855103 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3716/7448] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 105 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 14 15:17:39.858078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83513b7f5185436b8ea320c025f673af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:39.890402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83513b7f5185436b8ea320c025f673af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:39.892150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83513b7f5185436b8ea320c025f673af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:39.922734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5288c275-2690-40a3-848b-c438757cb96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83513b7f5185436b8ea320c025f673af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:39.958867 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3733/7449] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:39 2022] DELETE /identity/v3/users/83513b7f5185436b8ea320c025f673af => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:41.313534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02749d02-cc92-439c-8d43-6413510b376c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:41.319192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02749d02-cc92-439c-8d43-6413510b376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:41.692636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02749d02-cc92-439c-8d43-6413510b376c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:41.727325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:41.731212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:41.733635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:41.734420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] PATH_INFO: `/v3/projects/105c133485b84b21a9b029141b5053ad` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:41.743746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105c133485b84b21a9b029141b5053ad)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:41.766911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:41.975485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105c133485b84b21a9b029141b5053ad', 'request_id': 'req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:42.016381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105c133485b84b21a9b029141b5053ad', 'request_id': 'req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:42.031826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:42.055436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105c133485b84b21a9b029141b5053ad', 'request_id': 'req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:42.102123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] The token cache is being invalidate because project 105c133485b84b21a9b029141b5053ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:17:42.102629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:42.105324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3b12312-7da3-4cf2-a92b-d1c7f4bb0b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:42.108763 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3717/7450] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:17:41 2022] DELETE /identity/v3/projects/105c133485b84b21a9b029141b5053ad => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:42.113916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91a4a-bfaf-4152-a9c0-066b7d27af66 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:42.114514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91a4a-bfaf-4152-a9c0-066b7d27af66 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:42.114514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91a4a-bfaf-4152-a9c0-066b7d27af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:42.184252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2ff91a4a-bfaf-4152-a9c0-066b7d27af66 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:42.185542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2ff91a4a-bfaf-4152-a9c0-066b7d27af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:42.385967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3734/7451] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:42.394563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19eaa7-45b4-47eb-acf9-cb5399183e4b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:42.396403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19eaa7-45b4-47eb-acf9-cb5399183e4b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:42.396943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19eaa7-45b4-47eb-acf9-cb5399183e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:42.457735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ce19eaa7-45b4-47eb-acf9-cb5399183e4b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:42.460106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce19eaa7-45b4-47eb-acf9-cb5399183e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:42.483672 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3718/7452] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:42.487125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91a4a-bfaf-4152-a9c0-066b7d27af66 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:42.502463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91a4a-bfaf-4152-a9c0-066b7d27af66 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:42.537150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:42.538030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:42.538513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:42.538912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:42.539833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:17:42.540543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:42.544446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:42.572385 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3735/7453] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:17:42.576605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19eaa7-45b4-47eb-acf9-cb5399183e4b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:42.594115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19eaa7-45b4-47eb-acf9-cb5399183e4b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:42.603935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:42.604905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:42.608172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:42.610319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:42.612081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:42.616263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:42.679481 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3719/7454] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:17:42 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:17:42.683730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:42.700013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a737a3-60e4-4a77-9596-28804dbd359f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:42.873645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:42.874541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:42.875062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:42.875497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:42.876364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:42.884350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:42.919207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3736/7455] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:17:42 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:17:42.923390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:42.940461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea76b-845e-41a0-a743-b9bb2b4096ea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:42.952337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:42.955897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:42.956227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:42.956908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:42.957708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:42.964092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:43.006913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3720/7456] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:43.008831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:43.037721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496efb7-27cf-4d43-92b8-bca9024824b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:43.055560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0b9c-54a5-40cb-8d09-77fb335dbdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:43.056479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0b9c-54a5-40cb-8d09-77fb335dbdcd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:43.056774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0b9c-54a5-40cb-8d09-77fb335dbdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:43.057062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0b9c-54a5-40cb-8d09-77fb335dbdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:43.058327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc0b9c-54a5-40cb-8d09-77fb335dbdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:43.064385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc0b9c-54a5-40cb-8d09-77fb335dbdcd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:43.112682 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3737/7457] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:17:43.114102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:43.171062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14157c-8a55-4737-83d0-83cc07e1bb4e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:43.205832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:43.206780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:43.207069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:43.207378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] PATH_INFO: `/v3/projects/cc180baee4ea4158b008e3a5c227aac8/users/7a00a929a3dd4608961f50265fd35caa/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:43.310202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc180baee4ea4158b008e3a5c227aac8, user_id=7a00a929a3dd4608961f50265fd35caa, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:43.313701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:43.363291 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3721/7458] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:17:43 2022] PUT /identity/v3/projects/cc180baee4ea4158b008e3a5c227aac8/users/7a00a929a3dd4608961f50265fd35caa/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:43.366169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865006-a084-4dd2-92ca-ae773193b744 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:43.366648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865006-a084-4dd2-92ca-ae773193b744 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:43.366761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865006-a084-4dd2-92ca-ae773193b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:43.430508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d2865006-a084-4dd2-92ca-ae773193b744 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:43.443923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2865006-a084-4dd2-92ca-ae773193b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:43.625551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:43.830999 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3738/7459] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:44.049224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:44.051108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:44.335311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16db10-c546-47e6-8459-cc48d44ba815 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:44.342384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:44.343439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:44.343918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:44.344417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:44.382315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:44.384011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:44.404769 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3722/7460] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:17:50.866810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d0e1-169c-4623-aa59-dd39042ac4f5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:50.867841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d0e1-169c-4623-aa59-dd39042ac4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:50.868304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d0e1-169c-4623-aa59-dd39042ac4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:50.928453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6dd0d0e1-169c-4623-aa59-dd39042ac4f5 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:50.931835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6dd0d0e1-169c-4623-aa59-dd39042ac4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:50.939008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3739/7461] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:50 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:50.945266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:50.948113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:51.210995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18362bdf-0091-4c51-955c-35b35d7870b3 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:51.247457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0f08c-bd29-49f3-a663-718d96ff590c tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:51.249151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0f08c-bd29-49f3-a663-718d96ff590c tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:51.251022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0f08c-bd29-49f3-a663-718d96ff590c tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:51.251675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0f08c-bd29-49f3-a663-718d96ff590c tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:51.420069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-07d0f08c-bd29-49f3-a663-718d96ff590c tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:51.459083 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3723/7462] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:50 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:17:52.463925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cec6d-5e32-4c4c-bb0a-d0bb2f49ac5b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:52.464479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cec6d-5e32-4c4c-bb0a-d0bb2f49ac5b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:52.464479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cec6d-5e32-4c4c-bb0a-d0bb2f49ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:52.550950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-713cec6d-5e32-4c4c-bb0a-d0bb2f49ac5b None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:52.562528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-713cec6d-5e32-4c4c-bb0a-d0bb2f49ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:52.583806 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3740/7463] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:52 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:52.588706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c57043-92e0-4233-985a-2b9b912304c1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:52.589711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c57043-92e0-4233-985a-2b9b912304c1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:52.589711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c57043-92e0-4233-985a-2b9b912304c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:52.598423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f6c57043-92e0-4233-985a-2b9b912304c1 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 14 15:17:52.683241 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:52.685776 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:17:52.688401 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3724/7464] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:52 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:17:52.691325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4b7d-c83e-4912-a1ee-a7ac1e719be3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:52.691738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4b7d-c83e-4912-a1ee-a7ac1e719be3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:52.692664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4b7d-c83e-4912-a1ee-a7ac1e719be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:52.848932 n-d-768852-23 devstack@keystone.service[80581]: WARNING keystone.server.flask.application [None req-b9db4b7d-c83e-4912-a1ee-a7ac1e719be3 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.98: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 14 15:17:52.855691 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3741/7465] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:52 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 167 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 14 15:17:52.857471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd893-2f03-49bd-847a-5d509b287c5b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:52.857824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd893-2f03-49bd-847a-5d509b287c5b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:52.858285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd893-2f03-49bd-847a-5d509b287c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:52.973492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fa8cd893-2f03-49bd-847a-5d509b287c5b None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:52.975396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa8cd893-2f03-49bd-847a-5d509b287c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:53.022146 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3725/7466] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:53.027340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4b7d-c83e-4912-a1ee-a7ac1e719be3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:53.050560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4b7d-c83e-4912-a1ee-a7ac1e719be3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:53.086292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc83f6-fb8f-43ec-b8d8-1c772e4518dc tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:53.092073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc83f6-fb8f-43ec-b8d8-1c772e4518dc tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:53.093934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc83f6-fb8f-43ec-b8d8-1c772e4518dc tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:53.094498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc83f6-fb8f-43ec-b8d8-1c772e4518dc tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:53.340673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7dcc83f6-fb8f-43ec-b8d8-1c772e4518dc tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:53.368444 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3742/7467] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:53 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:54.114210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd893-2f03-49bd-847a-5d509b287c5b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:54.152120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd893-2f03-49bd-847a-5d509b287c5b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:54.164908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdadf5e-d624-4559-bece-7d73eade7176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:54.165740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdadf5e-d624-4559-bece-7d73eade7176 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:54.166028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdadf5e-d624-4559-bece-7d73eade7176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:54.169468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdadf5e-d624-4559-bece-7d73eade7176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:54.179723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7cdadf5e-d624-4559-bece-7d73eade7176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:54.374153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6952d-1878-4114-a942-83f949fbfe94 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:54.374711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6952d-1878-4114-a942-83f949fbfe94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:54.375157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6952d-1878-4114-a942-83f949fbfe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:54.399644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdadf5e-d624-4559-bece-7d73eade7176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:54.401507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdadf5e-d624-4559-bece-7d73eade7176 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:54.432787 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3726/7468] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:17:54.487029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dee6952d-1878-4114-a942-83f949fbfe94 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:54.487495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dee6952d-1878-4114-a942-83f949fbfe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:54.522053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e787-7447-4368-9adf-9b98c612d28d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:54.522355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e787-7447-4368-9adf-9b98c612d28d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:54.522644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e787-7447-4368-9adf-9b98c612d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:54.527879 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3743/7469] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:54 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:54.598165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3ea0e787-7447-4368-9adf-9b98c612d28d None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:54.600040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3ea0e787-7447-4368-9adf-9b98c612d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:54.650245 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3727/7470] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:17:54.657547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6952d-1878-4114-a942-83f949fbfe94 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:54.703186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6952d-1878-4114-a942-83f949fbfe94 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:54.729747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057e2f-7a3f-4552-84d7-c9bb94746e0e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:54.739856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057e2f-7a3f-4552-84d7-c9bb94746e0e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:54.740439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057e2f-7a3f-4552-84d7-c9bb94746e0e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:54.740956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057e2f-7a3f-4552-84d7-c9bb94746e0e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:54.875423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1057e2f-7a3f-4552-84d7-c9bb94746e0e tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:54.891432 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3744/7471] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:54 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:55.899035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548efa32-80f4-4919-a81e-f529c55fbfcd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:55.899730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548efa32-80f4-4919-a81e-f529c55fbfcd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:55.899730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548efa32-80f4-4919-a81e-f529c55fbfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:55.934951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-548efa32-80f4-4919-a81e-f529c55fbfcd None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:55.936545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-548efa32-80f4-4919-a81e-f529c55fbfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:55.955095 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3728/7472] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:55 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:55.963527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b566463-48fa-42ff-a5e8-807153e80fbe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:55.964130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b566463-48fa-42ff-a5e8-807153e80fbe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:55.964656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b566463-48fa-42ff-a5e8-807153e80fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:56.050440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3b566463-48fa-42ff-a5e8-807153e80fbe None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:56.067693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b566463-48fa-42ff-a5e8-807153e80fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:56.132774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3745/7473] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:56.142043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548efa32-80f4-4919-a81e-f529c55fbfcd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:56.198636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548efa32-80f4-4919-a81e-f529c55fbfcd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:56.249960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c172ca-ac75-4664-a660-24692e006118 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a23bbe3bc147638001428f06d9ed4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489c36cfd834452f9d8464c1566d5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:56.250932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c172ca-ac75-4664-a660-24692e006118 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:56.251224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c172ca-ac75-4664-a660-24692e006118 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:56.251556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c172ca-ac75-4664-a660-24692e006118 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e/password` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:56.467005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-05c172ca-ac75-4664-a660-24692e006118 tempest-IdentityV3UsersTest-1329950676 tempest-IdentityV3UsersTest-1329950676-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:56.497928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3729/7474] 10.222.0.98 () {60 vars in 1268 bytes} [Thu Jul 14 15:17:56 2022] POST /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e/password => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:57.505167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:57.506541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:57.507218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:57.597876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:57.607895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:57.621563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3746/7475] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:58.627866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb84a-8cc1-42a5-988a-d49862df581f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:58.628679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb84a-8cc1-42a5-988a-d49862df581f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:58.628679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb84a-8cc1-42a5-988a-d49862df581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:58.670269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e72cb84a-8cc1-42a5-988a-d49862df581f None None] MFA Rules not processed for user `16a23bbe3bc147638001428f06d9ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:58.685107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e72cb84a-8cc1-42a5-988a-d49862df581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:58.733784 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3730/7476] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:58.740690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:58.742468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:58.794275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ce8e5-5a8b-4361-9c68-934d5cdef5e8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:58.824763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:58.826065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:58.831861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:58.831861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] PATH_INFO: `/v3/users/16a23bbe3bc147638001428f06d9ed4e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:58.845775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a23bbe3bc147638001428f06d9ed4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:58.856502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:59.016637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:59.055984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=80,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:59.078614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:59.102940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:59.104531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:59.118698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a23bbe3bc147638001428f06d9ed4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:17:59.147024 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3747/7477] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:17:58 2022] DELETE /identity/v3/users/16a23bbe3bc147638001428f06d9ed4e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:17:59.151976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:59.157881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:59.158344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:59.243166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:17:59.247986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:59.487073 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3731/7478] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:17:59.528145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:17:59.530064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:17:59.688679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84822a38-9d9d-4eea-95da-30b9be868c7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:17:59.702804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820629ff-bd1e-4988-9635-6cc1e25f50ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:17:59.703822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820629ff-bd1e-4988-9635-6cc1e25f50ea service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:17:59.704488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820629ff-bd1e-4988-9635-6cc1e25f50ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:17:59.704984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820629ff-bd1e-4988-9635-6cc1e25f50ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:17:59.731897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820629ff-bd1e-4988-9635-6cc1e25f50ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:17:59.733972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820629ff-bd1e-4988-9635-6cc1e25f50ea service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:17:59.763719 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3748/7479] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:03.251875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:03.259176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:03.436636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbca49-a878-4d5f-921c-cfcb8c6f065e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:03.484479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:03.493438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:03.493925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:03.495618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] PATH_INFO: `/v3/projects/489c36cfd834452f9d8464c1566d5e23` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:03.508468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489c36cfd834452f9d8464c1566d5e23)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:03.526815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:03.696890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:03.889722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489c36cfd834452f9d8464c1566d5e23', 'request_id': 'req-96020daa-6d71-4230-82ee-ca6fbc0edb96'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:03.923650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489c36cfd834452f9d8464c1566d5e23', 'request_id': 'req-96020daa-6d71-4230-82ee-ca6fbc0edb96'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:03.959876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489c36cfd834452f9d8464c1566d5e23', 'request_id': 'req-96020daa-6d71-4230-82ee-ca6fbc0edb96'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:03.998887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] The token cache is being invalidate because project 489c36cfd834452f9d8464c1566d5e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:18:03.999225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:04.005099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-96020daa-6d71-4230-82ee-ca6fbc0edb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:04.009667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3732/7480] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:18:03 2022] DELETE /identity/v3/projects/489c36cfd834452f9d8464c1566d5e23 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:04.017379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967c9c-845b-4573-9d6a-5b29689f1b6a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:04.017822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967c9c-845b-4573-9d6a-5b29689f1b6a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:04.018110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967c9c-845b-4573-9d6a-5b29689f1b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:04.079990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-24967c9c-845b-4573-9d6a-5b29689f1b6a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:04.085773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24967c9c-845b-4573-9d6a-5b29689f1b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:04.379957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9e35-1f9a-4411-9d83-fae0250b560f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:04.379957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9e35-1f9a-4411-9d83-fae0250b560f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:04.379957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9e35-1f9a-4411-9d83-fae0250b560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:04.382842 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3749/7481] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:04.417102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-280a9e35-1f9a-4411-9d83-fae0250b560f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:04.418481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-280a9e35-1f9a-4411-9d83-fae0250b560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:04.437246 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3733/7482] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:18:04.444292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967c9c-845b-4573-9d6a-5b29689f1b6a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:04.478105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967c9c-845b-4573-9d6a-5b29689f1b6a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:04.502718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:04.503477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:04.503780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:04.504151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:04.504917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:18:04.505229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:04.510591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:04.566800 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3750/7483] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:18:04.571247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9e35-1f9a-4411-9d83-fae0250b560f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:04.600426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9e35-1f9a-4411-9d83-fae0250b560f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:04.610835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:04.611475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:04.611776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:04.612065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:04.612812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:04.624647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:04.717159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3734/7484] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:04 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:18:04.718773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:04.734982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802804-bc1e-4f04-a469-5952cd8bff68 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:05.069686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:05.071141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:05.071632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:05.072085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:05.072963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:05.075527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:05.104035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:05.143976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:05.146956 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3751/7485] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:04 2022] POST /identity/v3/users => generated 293 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:05.159579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0951968-3b13-4c86-9c9d-1c3be78bf4bd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:05.184910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:05.190226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:05.190846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:05.195069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:05.198683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:05.201359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:05.242687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:05.296981 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3735/7486] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:18:05.307491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc0df-5813-45fe-886b-f77485add2b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:05.329035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c32a88-92fd-40b0-9194-cfd59c40496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:05.330027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32a88-92fd-40b0-9194-cfd59c40496a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:05.330504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32a88-92fd-40b0-9194-cfd59c40496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:05.339688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c32a88-92fd-40b0-9194-cfd59c40496a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:05.340867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c32a88-92fd-40b0-9194-cfd59c40496a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:05.345228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c32a88-92fd-40b0-9194-cfd59c40496a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:05.387700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:05.397144 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3752/7487] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:05.402208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42477a91-9704-4739-b6cc-eb917400db23 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:05.423372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:05.424317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:05.424626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:05.424891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] PATH_INFO: `/v3/projects/53b640cd0678482182ecc53c7d37efe9/users/964af21cddec4429a56c4236766461ad/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:05.470022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b640cd0678482182ecc53c7d37efe9, user_id=964af21cddec4429a56c4236766461ad, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:05.473576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:05.509778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3736/7488] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:05 2022] PUT /identity/v3/projects/53b640cd0678482182ecc53c7d37efe9/users/964af21cddec4429a56c4236766461ad/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:05.522393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7a10-eed4-46ee-822a-8d29e7f9bdcd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:05.523188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7a10-eed4-46ee-822a-8d29e7f9bdcd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:05.523678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7a10-eed4-46ee-822a-8d29e7f9bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:05.648275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-156f7a10-eed4-46ee-822a-8d29e7f9bdcd None None] MFA Rules not processed for user `964af21cddec4429a56c4236766461ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:05.672941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-156f7a10-eed4-46ee-822a-8d29e7f9bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:05.977346 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3753/7489] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:06.008589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:06.011820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:06.156203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902cb6-7118-462f-972d-765bdeebc326 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:06.168092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:06.168803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:06.169134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:06.169432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:06.192528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:06.197418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:06.218699 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3737/7490] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:06.541722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c833f2-518e-4854-a715-d22d235299fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:06.542665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c833f2-518e-4854-a715-d22d235299fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:06.543213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c833f2-518e-4854-a715-d22d235299fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:06.580266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f8c833f2-518e-4854-a715-d22d235299fe None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:06.582579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8c833f2-518e-4854-a715-d22d235299fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:06.754851 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3754/7491] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:18:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:06.792574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:06.794303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:06.870081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:06.937217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942fe51-9ab3-4936-a3d5-cc68007b95d9 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:06.978433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:06.984490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:06.985124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:06.985827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:07.006646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:07.009246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:07.031229 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3738/7492] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:08.002104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5f79-30d9-49e4-a627-706a99a07a28 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:08.008131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5f79-30d9-49e4-a627-706a99a07a28 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:08.008749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5f79-30d9-49e4-a627-706a99a07a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:08.104987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e1c5f79-30d9-49e4-a627-706a99a07a28 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:08.108562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e1c5f79-30d9-49e4-a627-706a99a07a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:08.125579 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3755/7493] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:18:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:08.150085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:08.241263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a9989-0174-4f10-94bd-4fbec41fef51 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:08.306171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:08.306872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:08.307181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:08.307592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:08.381655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:08.383755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:08.430775 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3739/7494] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:09.497924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d504c-9411-448b-86d9-ee14a7ff38a6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:09.498465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d504c-9411-448b-86d9-ee14a7ff38a6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:09.499056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d504c-9411-448b-86d9-ee14a7ff38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:09.586475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f4d504c-9411-448b-86d9-ee14a7ff38a6 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:09.589194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f4d504c-9411-448b-86d9-ee14a7ff38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:09.652315 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3756/7495] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:18:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:18:09.661224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:09.682009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80636ed-f8d6-48ff-adcd-6cfe6df40b20 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:09.693591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:09.694533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:09.694979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:09.695476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:09.707710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:09.710146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:09.722663 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3740/7496] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:10.296645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4dc6-d550-4a61-8743-8163e95fdb19 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:10.297189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4dc6-d550-4a61-8743-8163e95fdb19 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:10.297757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4dc6-d550-4a61-8743-8163e95fdb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:10.324107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-326d4dc6-d550-4a61-8743-8163e95fdb19 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:10.326801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-326d4dc6-d550-4a61-8743-8163e95fdb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:10.358022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:10.376205 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3757/7497] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:18:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:10.405373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aabe4e-d77b-4953-b1c6-9ddf6b949658 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:10.429978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:10.430763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:10.431057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:10.431371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:10.504370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:10.506043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:10.538934 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3741/7498] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:18:11.533917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298edf08-a486-4581-a31b-2322d515954b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:11.535500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298edf08-a486-4581-a31b-2322d515954b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:11.536323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298edf08-a486-4581-a31b-2322d515954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:11.666805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-298edf08-a486-4581-a31b-2322d515954b None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:11.686272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-298edf08-a486-4581-a31b-2322d515954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:11.735502 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3758/7499] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:18:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:11.757514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:11.793289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ffcb-9a65-413a-a427-cac806dfe208 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:11.853938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:11.856768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:11.857888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:11.865669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:11.924834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:11.928826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:11.971383 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3742/7500] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:12.785310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a618c-2145-49db-ae99-ce0546f42e16 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:12.786328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a618c-2145-49db-ae99-ce0546f42e16 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:12.786868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a618c-2145-49db-ae99-ce0546f42e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:12.830998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a20a618c-2145-49db-ae99-ce0546f42e16 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:12.835067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a20a618c-2145-49db-ae99-ce0546f42e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:12.864958 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3759/7501] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:12.868821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:12.890081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a78f1-2533-4cde-b03b-a48c4d1e131e service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:12.901209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c7d97-9f81-4a75-9be5-afc2ade52cac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:12.904556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c7d97-9f81-4a75-9be5-afc2ade52cac service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:12.905184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c7d97-9f81-4a75-9be5-afc2ade52cac service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:12.905675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c7d97-9f81-4a75-9be5-afc2ade52cac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:12.930168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c7d97-9f81-4a75-9be5-afc2ade52cac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:12.932238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c7d97-9f81-4a75-9be5-afc2ade52cac service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:12.951937 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3743/7502] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:13.487422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a618c-2145-49db-ae99-ce0546f42e16 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:13.638475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:13.740732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a618c-2145-49db-ae99-ce0546f42e16 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:13.764152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:13.765140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:13.765397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:13.765668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] PATH_INFO: `/v3/users/964af21cddec4429a56c4236766461ad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:13.767087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964af21cddec4429a56c4236766461ad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:13.772089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:14.000630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964af21cddec4429a56c4236766461ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:14.046119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964af21cddec4429a56c4236766461ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:14.082290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964af21cddec4429a56c4236766461ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:14.085620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964af21cddec4429a56c4236766461ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:14.110909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964af21cddec4429a56c4236766461ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:14.143176 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3760/7503] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:13 2022] DELETE /identity/v3/users/964af21cddec4429a56c4236766461ad => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:18:14.150573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711612-0b80-4559-81db-bf3a3a13bd24 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:14.151009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711612-0b80-4559-81db-bf3a3a13bd24 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:14.151009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711612-0b80-4559-81db-bf3a3a13bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:14.217765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3c711612-0b80-4559-81db-bf3a3a13bd24 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:14.219736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c711612-0b80-4559-81db-bf3a3a13bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:14.439100 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3744/7504] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:14.451828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:14.453302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:14.526980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a84e8-7994-431a-907a-407abf16a05b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:14.527349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a84e8-7994-431a-907a-407abf16a05b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:14.527578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a84e8-7994-431a-907a-407abf16a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:14.587641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-792a84e8-7994-431a-907a-407abf16a05b None None] MFA Rules not processed for user `7a00a929a3dd4608961f50265fd35caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:14.588895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-792a84e8-7994-431a-907a-407abf16a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:14.671220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba6b8a-cc30-4b15-b5f0-fab1e646a225 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:14.680660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:14.681305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:14.681598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:14.682098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:14.723125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:14.732520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3745/7505] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:18:14.760362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:14.766027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:14.767382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:14.770980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:14.773087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:14.825227 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3761/7506] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:14.844271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] MFA Rules not processed for user `7a00a929a3dd4608961f50265fd35caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:14.846183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:14.868213 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3746/7507] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:14.887943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:14.890688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:15.101399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:15.128426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1bedb-aaec-44be-b193-033e60680ee5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:15.176069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67837370-53b3-42f1-b3c6-9e02a87d1de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:15.176796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67837370-53b3-42f1-b3c6-9e02a87d1de9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:15.177090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67837370-53b3-42f1-b3c6-9e02a87d1de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:15.177378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67837370-53b3-42f1-b3c6-9e02a87d1de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:15.212536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67837370-53b3-42f1-b3c6-9e02a87d1de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:15.221571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67837370-53b3-42f1-b3c6-9e02a87d1de9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:15.260038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3762/7508] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:15.602547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:15.610212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:15.651840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a0615-188d-4f81-9da4-3698611ab493 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:15.658241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:15.659546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:15.660117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:15.660627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] PATH_INFO: `/v3/projects/53b640cd0678482182ecc53c7d37efe9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:15.662326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b640cd0678482182ecc53c7d37efe9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:15.665253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:15.818165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b640cd0678482182ecc53c7d37efe9', 'request_id': 'req-5f1f740b-81ff-4682-94df-83b1f6d55f85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:15.841415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b640cd0678482182ecc53c7d37efe9', 'request_id': 'req-5f1f740b-81ff-4682-94df-83b1f6d55f85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:15.856251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b640cd0678482182ecc53c7d37efe9', 'request_id': 'req-5f1f740b-81ff-4682-94df-83b1f6d55f85'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:15.891071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] The token cache is being invalidate because project 53b640cd0678482182ecc53c7d37efe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:18:15.891945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:15.893702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5f1f740b-81ff-4682-94df-83b1f6d55f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:15.898232 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3747/7509] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:18:15 2022] DELETE /identity/v3/projects/53b640cd0678482182ecc53c7d37efe9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:15.903829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad2b56-c1e4-4ffc-85a0-343265f46add None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:15.904332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad2b56-c1e4-4ffc-85a0-343265f46add None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:15.904748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad2b56-c1e4-4ffc-85a0-343265f46add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:15.944821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-24ad2b56-c1e4-4ffc-85a0-343265f46add None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:15.950992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24ad2b56-c1e4-4ffc-85a0-343265f46add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:16.104303 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3763/7510] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:16.113470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b981be-4e4c-4d02-affd-dbc3e9ce82aa None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:16.113929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b981be-4e4c-4d02-affd-dbc3e9ce82aa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:16.114324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b981be-4e4c-4d02-affd-dbc3e9ce82aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:16.155343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f6b981be-4e4c-4d02-affd-dbc3e9ce82aa None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:16.156748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f6b981be-4e4c-4d02-affd-dbc3e9ce82aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:16.179589 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3748/7511] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:16.183471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad2b56-c1e4-4ffc-85a0-343265f46add None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:16.202187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad2b56-c1e4-4ffc-85a0-343265f46add None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:16.217702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:16.218801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:16.219336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:16.219835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:16.220808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:18:16.221649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:16.223898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:16.241725 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3764/7512] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:18:16.245659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b981be-4e4c-4d02-affd-dbc3e9ce82aa None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:16.257338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b981be-4e4c-4d02-affd-dbc3e9ce82aa None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:16.289208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:16.290097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:16.290494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:16.290891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:16.291747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:16.294678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:16.412235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3749/7513] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:16 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:16.413196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:16.440146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb36e-5f7e-46a8-b47c-773f26aa4a03 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:16.676505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:16.677590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:16.678050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:16.678677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:16.681632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:16.684360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:16.726225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:16.738380 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3765/7514] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:16 2022] POST /identity/v3/users => generated 284 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:18:16.742037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7fd2-a2da-4952-984e-55b73d675ad1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:16.752742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:16.753614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:16.754129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:16.755881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:16.756746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:16.758414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:16.813167 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3750/7515] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:16.815597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:16.838210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec94c40-2287-4772-bbf8-48bf50a03fe1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:16.857725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9602f-df59-4ca3-918e-ea1b49438f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:16.858617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9602f-df59-4ca3-918e-ea1b49438f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:16.859713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9602f-df59-4ca3-918e-ea1b49438f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:16.860788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9602f-df59-4ca3-918e-ea1b49438f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:16.863868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9602f-df59-4ca3-918e-ea1b49438f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:16.869765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9602f-df59-4ca3-918e-ea1b49438f36 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:16.883296 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3766/7516] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:16.887602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:16.906310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce8f5c-cfdf-4db5-b70c-74d526d1e75a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:16.919030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:16.920180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:16.921129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:16.923967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] PATH_INFO: `/v3/projects/c747cc8d0342453dbb2220c67c3f1f8f/users/8dbb6d9b5eb84d6995969264bff22d7f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:16.968213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c747cc8d0342453dbb2220c67c3f1f8f, user_id=8dbb6d9b5eb84d6995969264bff22d7f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:16.971485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:17.004248 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3751/7517] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:16 2022] PUT /identity/v3/projects/c747cc8d0342453dbb2220c67c3f1f8f/users/8dbb6d9b5eb84d6995969264bff22d7f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:18:17.017045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65496d6-31f0-4c22-a7b0-2fd64fa46346 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:17.017342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65496d6-31f0-4c22-a7b0-2fd64fa46346 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:17.017684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65496d6-31f0-4c22-a7b0-2fd64fa46346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:17.113315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c65496d6-31f0-4c22-a7b0-2fd64fa46346 None None] MFA Rules not processed for user `8dbb6d9b5eb84d6995969264bff22d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:17.115217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c65496d6-31f0-4c22-a7b0-2fd64fa46346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:17.223177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:17.296193 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3767/7518] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:17.301636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:17.412650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd46e5-06ae-4d62-b4e7-a00019d59b0a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:17.412950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd46e5-06ae-4d62-b4e7-a00019d59b0a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:17.413245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd46e5-06ae-4d62-b4e7-a00019d59b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:17.468511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a8fd46e5-06ae-4d62-b4e7-a00019d59b0a None None] MFA Rules not processed for user `7a00a929a3dd4608961f50265fd35caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:17.469794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8fd46e5-06ae-4d62-b4e7-a00019d59b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:17.487243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda15ea-101f-4760-9f7d-656dbeb5fecd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:17.500412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:17.501099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:17.501591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:17.502086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:17.504147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:17.508403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:17.545705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:17.589264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3752/7519] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:17 2022] POST /identity/v3/projects => generated 369 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:17.595512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:17.722362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3768/7520] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:18:17.834329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3b921-cef1-47cf-b65b-cd13df88c9f7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:17.910576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:17.921783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:17.921783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:17.921783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:17.921783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:17.948276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:18.106658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd46e5-06ae-4d62-b4e7-a00019d59b0a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:18.109109 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3753/7521] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:17 2022] POST /identity/v3/users => generated 285 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:18.126476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd46e5-06ae-4d62-b4e7-a00019d59b0a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:18.137547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:18.139120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:18.144447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:18.147302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:18.150239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:18.152033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:18.190012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:18.192038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3769/7522] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:18.229414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d74a-6984-40e4-b227-0b3fee38cc1c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:18.268809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681a726-c32e-4481-a186-c6580efc151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:18.274898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681a726-c32e-4481-a186-c6580efc151c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:18.279321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681a726-c32e-4481-a186-c6580efc151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:18.281584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681a726-c32e-4481-a186-c6580efc151c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:18.282419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681a726-c32e-4481-a186-c6580efc151c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:18.290601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681a726-c32e-4481-a186-c6580efc151c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:18.342984 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3754/7523] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:18.345398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:18.363378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504aeb56-f49f-404a-8dfe-7437f6294c40 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:18.397861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:18.401384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:18.403529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:18.405371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] PATH_INFO: `/v3/projects/e7e03a3d07a5462c961eb531d55cd8ba/users/81392e38eb1041ef9f6a941526b5a01c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:18.464509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e03a3d07a5462c961eb531d55cd8ba, user_id=81392e38eb1041ef9f6a941526b5a01c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:18.474199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:18.548893 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3770/7524] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:18 2022] PUT /identity/v3/projects/e7e03a3d07a5462c961eb531d55cd8ba/users/81392e38eb1041ef9f6a941526b5a01c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:18.561077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097311b8-e32a-46a8-8c54-2d338793f2df None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:18.561817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097311b8-e32a-46a8-8c54-2d338793f2df None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:18.562419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097311b8-e32a-46a8-8c54-2d338793f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:18.680734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-097311b8-e32a-46a8-8c54-2d338793f2df None None] MFA Rules not processed for user `81392e38eb1041ef9f6a941526b5a01c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:18.682176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-097311b8-e32a-46a8-8c54-2d338793f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:18.897471 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3755/7525] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:18.914232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:18.930853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:19.174722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27820-fe8e-4acf-a4e2-a64eec871666 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:19.183528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:19.184512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:19.185020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:19.185456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:19.308282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:19.310300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:19.319216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:19.334358 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3771/7526] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:19.569152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097311b8-e32a-46a8-8c54-2d338793f2df None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:19.610749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097311b8-e32a-46a8-8c54-2d338793f2df None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:19.637039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:19.638203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:19.638415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:19.638991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:19.669030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:19.670831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:19.694329 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3756/7527] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:23.132606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:23.343782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e52447-c517-4655-92f6-8894320b8f55 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:23.349583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:23.351155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:23.351803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:23.352343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] PATH_INFO: `/v3/users/8dbb6d9b5eb84d6995969264bff22d7f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:23.354237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbb6d9b5eb84d6995969264bff22d7f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:23.356929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:23.428476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:23.430853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:23.488490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbb6d9b5eb84d6995969264bff22d7f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:23.564041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbb6d9b5eb84d6995969264bff22d7f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:23.616098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbb6d9b5eb84d6995969264bff22d7f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:23.619205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbb6d9b5eb84d6995969264bff22d7f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:23.660130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f380a22-51d4-43ef-b846-83b483a69a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbb6d9b5eb84d6995969264bff22d7f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:23.675910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:23.676996 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3772/7528] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:23 2022] DELETE /identity/v3/users/8dbb6d9b5eb84d6995969264bff22d7f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:23.682710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:23.683184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:23.683669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:23.724111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:23.725567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:23.727154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d902d-6f3b-4bb7-8563-42134ac16279 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:23.895362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3773/7529] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:23.896345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:23.897459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:23.897968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:23.898436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:23.913113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:23.914312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:23.914911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:23.953583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:23.955874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:23.982439 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3757/7530] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:18:24.004550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:24.150904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77677c71-8e89-4bd0-8027-a2a037ff2b56 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:24.173860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:24.176591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:24.176591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:24.176591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:24.207523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:24.210268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:24.285673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3774/7531] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:26.394640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:26.396947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:26.458910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca041282-ada2-4aa3-9cbc-9a9b5eda313c service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:26.481797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:26.483068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:26.483596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:26.484080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] PATH_INFO: `/v3/projects/c747cc8d0342453dbb2220c67c3f1f8f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:26.488284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c747cc8d0342453dbb2220c67c3f1f8f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:26.491050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:26.718568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c747cc8d0342453dbb2220c67c3f1f8f', 'request_id': 'req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:26.738533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c747cc8d0342453dbb2220c67c3f1f8f', 'request_id': 'req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:26.778043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c747cc8d0342453dbb2220c67c3f1f8f', 'request_id': 'req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:26.845871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] The token cache is being invalidate because project c747cc8d0342453dbb2220c67c3f1f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:18:26.846554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:26.852315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:26.859899 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3758/7532] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:18:26 2022] DELETE /identity/v3/projects/c747cc8d0342453dbb2220c67c3f1f8f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:26.861412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:26.899538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b6dc0-b10a-4f33-b38b-987df9ed3dfe service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:27.203346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:27.204345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:27.204630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:27.204914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] PATH_INFO: `/v3/users/81392e38eb1041ef9f6a941526b5a01c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:27.208175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81392e38eb1041ef9f6a941526b5a01c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:27.213922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:27.389921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81392e38eb1041ef9f6a941526b5a01c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:27.438251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81392e38eb1041ef9f6a941526b5a01c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:27.469014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81392e38eb1041ef9f6a941526b5a01c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:27.469014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81392e38eb1041ef9f6a941526b5a01c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:27.501295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81392e38eb1041ef9f6a941526b5a01c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:27.537207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3775/7533] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:26 2022] DELETE /identity/v3/users/81392e38eb1041ef9f6a941526b5a01c => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:28.324080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:28.326123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:28.532666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f3b23-d1f7-4e47-aaef-5b21cf855e74 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:28.625404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:28.739313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2428e-bc50-40ef-b8be-e741d4be68f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:28.741644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2428e-bc50-40ef-b8be-e741d4be68f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:28.742808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2428e-bc50-40ef-b8be-e741d4be68f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:28.744135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2428e-bc50-40ef-b8be-e741d4be68f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:28.750267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99a2428e-bc50-40ef-b8be-e741d4be68f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:28.790590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2428e-bc50-40ef-b8be-e741d4be68f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:28.792952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2428e-bc50-40ef-b8be-e741d4be68f3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:28.835484 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3759/7534] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:18:30.332420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:30.335045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:30.605381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:30.727896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50623c03-77a2-4286-8fc6-502f97d523b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:30.749232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:30.753250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:30.753751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:30.756515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] PATH_INFO: `/v3/projects/e7e03a3d07a5462c961eb531d55cd8ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:30.763704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e03a3d07a5462c961eb531d55cd8ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:30.775743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:31.040794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e03a3d07a5462c961eb531d55cd8ba', 'request_id': 'req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:31.076108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e03a3d07a5462c961eb531d55cd8ba', 'request_id': 'req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:31.091448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e03a3d07a5462c961eb531d55cd8ba', 'request_id': 'req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:31.128458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] The token cache is being invalidate because project e7e03a3d07a5462c961eb531d55cd8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:18:31.128967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:31.130212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00e2bd67-48b5-4515-9ea6-04b6c4c35f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:31.139157 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3776/7535] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:18:30 2022] DELETE /identity/v3/projects/e7e03a3d07a5462c961eb531d55cd8ba => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:31.148682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be75db-f8a2-48c5-9b4c-11f4715292fc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:31.150510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be75db-f8a2-48c5-9b4c-11f4715292fc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:31.151308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be75db-f8a2-48c5-9b4c-11f4715292fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:31.265303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d7be75db-f8a2-48c5-9b4c-11f4715292fc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:31.268187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d7be75db-f8a2-48c5-9b4c-11f4715292fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:31.771055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3760/7536] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 629 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:31.777306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d767d2-d038-46f4-9fb9-b1d4a7691c59 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:31.778131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d767d2-d038-46f4-9fb9-b1d4a7691c59 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:31.778326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d767d2-d038-46f4-9fb9-b1d4a7691c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:31.894079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-47d767d2-d038-46f4-9fb9-b1d4a7691c59 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:31.906575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47d767d2-d038-46f4-9fb9-b1d4a7691c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:31.962709 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3777/7537] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:31.968384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be75db-f8a2-48c5-9b4c-11f4715292fc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:32.022028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be75db-f8a2-48c5-9b4c-11f4715292fc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:32.065735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:32.067026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:32.071878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:32.072471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:32.073918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:18:32.074407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:32.090634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:32.153887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3761/7538] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:18:32.160888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d767d2-d038-46f4-9fb9-b1d4a7691c59 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:32.200648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d767d2-d038-46f4-9fb9-b1d4a7691c59 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:32.224946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:32.229668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:32.231244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:32.232603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:32.240172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:32.252229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:32.410896 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3778/7539] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:32 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:32.415535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:32.458803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f9c0-72b7-40be-a09b-e6cfc4e1a338 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:32.803319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:32.804067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:32.804689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:32.804977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:32.806564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:32.812872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:32.893406 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3762/7540] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:32 2022] POST /identity/v3/users => generated 288 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:32.901356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:32.936228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acf4a9-bd77-418d-93c3-549924d9b9e8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:32.951596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:32.952896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:32.954758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:32.957074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:32.959292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:32.964344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:33.005267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3779/7541] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:33.011392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:33.062728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414039b-d61b-4f41-9649-36ea9a6003ab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:33.100508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421923f9-862a-4b92-99c7-af56da157927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:33.101873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421923f9-862a-4b92-99c7-af56da157927 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:33.102427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421923f9-862a-4b92-99c7-af56da157927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:33.107452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421923f9-862a-4b92-99c7-af56da157927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:33.114698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421923f9-862a-4b92-99c7-af56da157927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:33.118152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421923f9-862a-4b92-99c7-af56da157927 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:33.165471 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3763/7542] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:33.172160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:33.212093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c808-203c-4c15-852d-aedcd963307e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:33.234757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:33.237518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:33.240558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:33.241045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] PATH_INFO: `/v3/projects/9c292cb67cbb4aa2bbf743b61fa2884a/users/7379f0121464470ba074aa9de996acdb/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:33.289866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c292cb67cbb4aa2bbf743b61fa2884a, user_id=7379f0121464470ba074aa9de996acdb, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:33.293302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:33.324085 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3780/7543] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:33 2022] PUT /identity/v3/projects/9c292cb67cbb4aa2bbf743b61fa2884a/users/7379f0121464470ba074aa9de996acdb/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:33.349960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872bd3-2bd6-411a-9d8f-6928148c7ba6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:33.350755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872bd3-2bd6-411a-9d8f-6928148c7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:33.351332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872bd3-2bd6-411a-9d8f-6928148c7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:33.505296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-11872bd3-2bd6-411a-9d8f-6928148c7ba6 None None] MFA Rules not processed for user `7379f0121464470ba074aa9de996acdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:33.510651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11872bd3-2bd6-411a-9d8f-6928148c7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:33.606564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:33.801754 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3764/7544] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:33.805217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:34.215065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34db7-3823-411f-ac27-9d98ca4dbb01 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:34.285204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:34.286394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:34.286904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:34.301027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:34.302555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:34.306454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:34.420259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:34.495141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11872bd3-2bd6-411a-9d8f-6928148c7ba6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:34.496415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3781/7545] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:33 2022] POST /identity/v3/projects => generated 375 bytes in 685 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:34.534342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11872bd3-2bd6-411a-9d8f-6928148c7ba6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:34.812816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:34.814089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:34.814578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:34.815105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:34.817355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:34.821760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:34.875352 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3765/7546] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:34 2022] POST /identity/v3/users => generated 294 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:34.882899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:34.972313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c0ec-5ddb-42c1-9e13-e6dc05328660 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:34.990022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:34.992606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:34.993347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:34.994034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:34.996426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:35.001766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:35.036983 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3782/7547] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:35.038528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:35.070798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5eae-2bc7-400c-88e3-c63588baab75 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:35.091638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:35.092621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:35.092909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:35.093193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] PATH_INFO: `/v3/projects/615ae446454346e7bcf753d774ad87da/users/a0801f869cc44f2c8d5e0de60fba46ee/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:35.140739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] RBAC: Authorizing `identity:create_grant(project_id=615ae446454346e7bcf753d774ad87da, user_id=a0801f869cc44f2c8d5e0de60fba46ee, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:35.146250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:35.187470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3766/7548] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:35 2022] PUT /identity/v3/projects/615ae446454346e7bcf753d774ad87da/users/a0801f869cc44f2c8d5e0de60fba46ee/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:35.194395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:35.242250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f7734-0ad8-4e5c-8b60-9e61cbe16e94 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:35.482985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9324bfd-ea79-4378-a759-6fb4b8f94dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:35.483737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324bfd-ea79-4378-a759-6fb4b8f94dab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:35.484027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324bfd-ea79-4378-a759-6fb4b8f94dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:35.484311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324bfd-ea79-4378-a759-6fb4b8f94dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:35.485231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9324bfd-ea79-4378-a759-6fb4b8f94dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:35.487092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9324bfd-ea79-4378-a759-6fb4b8f94dab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:35.519621 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3783/7549] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:35.521129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:35.537949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e60b4-e358-40b5-954a-ef450c05518a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:35.554364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:35.560434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:35.561160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:35.562287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] PATH_INFO: `/v3/projects/615ae446454346e7bcf753d774ad87da/users/a0801f869cc44f2c8d5e0de60fba46ee/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:35.570496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=615ae446454346e7bcf753d774ad87da, user_id=a0801f869cc44f2c8d5e0de60fba46ee, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:35.585343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:35.617086 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3767/7550] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:35 2022] PUT /identity/v3/projects/615ae446454346e7bcf753d774ad87da/users/a0801f869cc44f2c8d5e0de60fba46ee/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:35.630003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31835658-2093-4b2c-ab11-3bc810c143c9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:35.630735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31835658-2093-4b2c-ab11-3bc810c143c9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:35.631246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31835658-2093-4b2c-ab11-3bc810c143c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:35.708085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-31835658-2093-4b2c-ab11-3bc810c143c9 None None] MFA Rules not processed for user `a0801f869cc44f2c8d5e0de60fba46ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:35.710955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-31835658-2093-4b2c-ab11-3bc810c143c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:35.984931 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3784/7551] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:36.148025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:36.150777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:36.331795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21dcf9-db40-4794-9817-8468b331daaa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:36.342853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:36.344361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:36.344780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:36.345181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:36.389183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:36.390788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:36.423858 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3768/7552] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:38.557122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875cea8-52d0-43ce-8970-a679e8d7e940 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:38.557632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875cea8-52d0-43ce-8970-a679e8d7e940 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:38.558988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875cea8-52d0-43ce-8970-a679e8d7e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:38.677297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3875cea8-52d0-43ce-8970-a679e8d7e940 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:38.683334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3875cea8-52d0-43ce-8970-a679e8d7e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:38.890555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3785/7553] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:18:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:38.923946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:38.937418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:38.980509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:39.183025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c68f71-9d44-4feb-8c8a-da80de6a7726 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:39.210541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:39.211749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:39.212193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:39.212637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:39.250232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:39.253938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:39.283906 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3769/7554] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:39.389431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875cea8-52d0-43ce-8970-a679e8d7e940 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:39.430843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875cea8-52d0-43ce-8970-a679e8d7e940 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:39.443122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b886f-8c5f-4f29-a9ff-762c30f5bbd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:39.445080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b886f-8c5f-4f29-a9ff-762c30f5bbd3 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:39.446349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b886f-8c5f-4f29-a9ff-762c30f5bbd3 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:39.447248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b886f-8c5f-4f29-a9ff-762c30f5bbd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:39.452095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da0b886f-8c5f-4f29-a9ff-762c30f5bbd3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:39.515865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:39.696177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b886f-8c5f-4f29-a9ff-762c30f5bbd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:39.699660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b886f-8c5f-4f29-a9ff-762c30f5bbd3 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:39.723559 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3786/7555] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:42.174995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:42.641182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d952af-b744-43b4-8aef-8d480b14658e service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:42.664659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:42.666157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:42.668151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:42.668695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] PATH_INFO: `/v3/users/7379f0121464470ba074aa9de996acdb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:42.679256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7379f0121464470ba074aa9de996acdb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:42.683293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:42.944887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7379f0121464470ba074aa9de996acdb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:42.990661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7379f0121464470ba074aa9de996acdb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:42.996721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7379f0121464470ba074aa9de996acdb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:43.024287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7379f0121464470ba074aa9de996acdb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:43.025255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7379f0121464470ba074aa9de996acdb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:43.066583 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3770/7556] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:42 2022] DELETE /identity/v3/users/7379f0121464470ba074aa9de996acdb => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:43.069676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:43.070274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:43.070711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:43.132385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:43.134916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:43.385234 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3787/7557] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:43.438823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:43.440479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:43.510846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:43.591153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1892ae-7184-4236-9b00-8400779ebc83 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:43.601762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:43.602518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:43.602808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:43.603090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:43.627959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:43.629550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:43.655330 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3771/7558] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:44.521263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:44.527703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:44.615841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cbf53-3676-4c00-a269-2f4d2b82620e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:44.639623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:44.640614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:44.640887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:44.641114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] PATH_INFO: `/v3/projects/9c292cb67cbb4aa2bbf743b61fa2884a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:44.642478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c292cb67cbb4aa2bbf743b61fa2884a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:44.645337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:44.835526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c292cb67cbb4aa2bbf743b61fa2884a', 'request_id': 'req-3dc590ef-26b9-4333-9941-67334172665e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:44.851321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c292cb67cbb4aa2bbf743b61fa2884a', 'request_id': 'req-3dc590ef-26b9-4333-9941-67334172665e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:44.864143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c292cb67cbb4aa2bbf743b61fa2884a', 'request_id': 'req-3dc590ef-26b9-4333-9941-67334172665e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:44.896135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] The token cache is being invalidate because project 9c292cb67cbb4aa2bbf743b61fa2884a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:18:44.896746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:44.907812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:44.910518 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3788/7559] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:18:44 2022] DELETE /identity/v3/projects/9c292cb67cbb4aa2bbf743b61fa2884a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:44.915173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:44.926658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f503fe9-4825-46d2-a5b5-05f25521754a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:44.996587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:44.997831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:44.998313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:44.998787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] PATH_INFO: `/v3/users/a0801f869cc44f2c8d5e0de60fba46ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:45.000368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0801f869cc44f2c8d5e0de60fba46ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:45.002750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:45.076390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0801f869cc44f2c8d5e0de60fba46ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:45.101678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0801f869cc44f2c8d5e0de60fba46ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:45.102238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0801f869cc44f2c8d5e0de60fba46ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:45.118836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0801f869cc44f2c8d5e0de60fba46ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:45.121272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0801f869cc44f2c8d5e0de60fba46ee'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:45.160579 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3772/7560] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:44 2022] DELETE /identity/v3/users/a0801f869cc44f2c8d5e0de60fba46ee => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:46.752858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:46.754475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:46.768108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:46.770300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:46.796479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc590ef-26b9-4333-9941-67334172665e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:46.872571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:46.979564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:47.037306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:47.038241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:47.038534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:47.038828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] PATH_INFO: `/v3/users/450b7ea9a4e44d149bd7ea40eaf0d31d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:47.040840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450b7ea9a4e44d149bd7ea40eaf0d31d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:47.042878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:47.186993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ab276-136d-48e1-9680-e43198f1d456 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:47.189159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450b7ea9a4e44d149bd7ea40eaf0d31d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.252991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f60345-1235-4570-9875-72ddf236ea4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:47.254880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450b7ea9a4e44d149bd7ea40eaf0d31d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.258011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f60345-1235-4570-9875-72ddf236ea4b service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:47.258530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f60345-1235-4570-9875-72ddf236ea4b service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:47.259038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f60345-1235-4570-9875-72ddf236ea4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:47.269581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450b7ea9a4e44d149bd7ea40eaf0d31d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.275828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450b7ea9a4e44d149bd7ea40eaf0d31d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.293761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450b7ea9a4e44d149bd7ea40eaf0d31d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.300756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-39f60345-1235-4570-9875-72ddf236ea4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:47.329546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3789/7561] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:46 2022] DELETE /identity/v3/users/450b7ea9a4e44d149bd7ea40eaf0d31d => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:47.329546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:47.329546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:47.405767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f60345-1235-4570-9875-72ddf236ea4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:47.418647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f60345-1235-4570-9875-72ddf236ea4b service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:47.503085 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3773/7562] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:47.655042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f6717-4f33-4589-8276-b5fb9a0fcce6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:47.662811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:47.663976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:47.664473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:47.664944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] PATH_INFO: `/v3/projects/615ae446454346e7bcf753d774ad87da` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:47.666739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=615ae446454346e7bcf753d774ad87da)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:47.669713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:47.806095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:47.818532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615ae446454346e7bcf753d774ad87da', 'request_id': 'req-66c93f8f-24e1-4057-9153-e1294963e12a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.835300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615ae446454346e7bcf753d774ad87da', 'request_id': 'req-66c93f8f-24e1-4057-9153-e1294963e12a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.852515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615ae446454346e7bcf753d774ad87da', 'request_id': 'req-66c93f8f-24e1-4057-9153-e1294963e12a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.883020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] The token cache is being invalidate because project 615ae446454346e7bcf753d774ad87da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:18:47.883633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.884597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:47.888063 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3790/7563] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:18:47 2022] DELETE /identity/v3/projects/615ae446454346e7bcf753d774ad87da => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:47.895598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a63de-4e60-4409-aa38-de42eb3d1ab4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:47.896108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a63de-4e60-4409-aa38-de42eb3d1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:47.896998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a63de-4e60-4409-aa38-de42eb3d1ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:47.985135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fb1a63de-4e60-4409-aa38-de42eb3d1ab4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:47.987835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb1a63de-4e60-4409-aa38-de42eb3d1ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:48.146081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:48.148073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:48.167426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3774/7564] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:48.175980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c93f8f-24e1-4057-9153-e1294963e12a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:48.184243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12b7b-d647-4ca7-827c-b0a6747fbf26 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:48.185041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12b7b-d647-4ca7-827c-b0a6747fbf26 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:48.185576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12b7b-d647-4ca7-827c-b0a6747fbf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:48.185898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:48.186997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:48.187479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:48.187945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] PATH_INFO: `/v3/projects/178964408b17444d8a2c38c9b3e64359` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:48.192913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178964408b17444d8a2c38c9b3e64359)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:48.195190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:48.289490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e7a12b7b-d647-4ca7-827c-b0a6747fbf26 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:48.292456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e7a12b7b-d647-4ca7-827c-b0a6747fbf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:48.345321 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3775/7565] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:48.349299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12b7b-d647-4ca7-827c-b0a6747fbf26 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:48.373007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178964408b17444d8a2c38c9b3e64359', 'request_id': 'req-81ecdfee-592f-4c92-88fc-8296ce533159'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:48.384393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12b7b-d647-4ca7-827c-b0a6747fbf26 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:48.408618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178964408b17444d8a2c38c9b3e64359', 'request_id': 'req-81ecdfee-592f-4c92-88fc-8296ce533159'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:48.444203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178964408b17444d8a2c38c9b3e64359', 'request_id': 'req-81ecdfee-592f-4c92-88fc-8296ce533159'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:48.495514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] The token cache is being invalidate because project 178964408b17444d8a2c38c9b3e64359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:18:48.496057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:48.498216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-81ecdfee-592f-4c92-88fc-8296ce533159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:48.501371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3791/7566] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:18:48 2022] DELETE /identity/v3/projects/178964408b17444d8a2c38c9b3e64359 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:18:48.507640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759afa6d-4cb0-4408-ad74-0db60ed3b0f8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:48.508126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759afa6d-4cb0-4408-ad74-0db60ed3b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:48.508527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759afa6d-4cb0-4408-ad74-0db60ed3b0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:48.554112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-759afa6d-4cb0-4408-ad74-0db60ed3b0f8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:48.556117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-759afa6d-4cb0-4408-ad74-0db60ed3b0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:48.572605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:48.573671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:48.574077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:48.574476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:48.575504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:18:48.575939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:48.577938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:48.588099 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3792/7567] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:48.590946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:48.591470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:48.591941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:48.622578 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3776/7568] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:18:48.625070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:48.626640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:48.629807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:48.632537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:48.640360 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3793/7569] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:48.641569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:48.643815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:48.661584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fa941-3449-439b-9ef2-f506b77c0289 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:48.670475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:48.671343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:48.671808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:48.672148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:48.673038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:48.675777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:48.751235 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3777/7570] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:48 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:18:48.756224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:48.866330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4159f-0ca6-45ad-8f43-ae59778e98e3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:48.868190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:48.906217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3936-059f-4de7-96ca-07425a8f1b5d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:48.924612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:48.927215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:48.927838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:48.928777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:48.930064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:18:48.933304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:48.936162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:49.009925 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3778/7571] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:18:49.025021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:49.076151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:49.097048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36059319-ee79-4032-9e0d-f72812404c3c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:49.103621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:49.104408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:49.104700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:49.104980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:49.105791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:49.121687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:49.169884 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3779/7572] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:49 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:49.171851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:49.198552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:49.199593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:49.199977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:49.200334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:49.215471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:49.228511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acbc74-4d75-4b97-a849-beba365d8d9a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:49.248493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:49.254663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:49.255907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:49.259894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:49.259894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:49.259894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:49.276020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:49.286090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:49.325213 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3794/7573] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:49.326437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:49.363774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7190f-0b25-457b-b58a-75b55b4b9d22 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:49.390689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:49.396159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:49.396907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:49.398385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:49.402518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:49.413681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:49.471838 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3780/7574] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:49 2022] POST /identity/v3/projects => generated 375 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:49.478008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:49.488300 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3795/7575] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:49.503892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:49.546761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf681bf-396f-4368-9722-ef94a93777c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:49.821472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:49.826838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:49.827910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:49.828558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:49.829934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:49.838551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:49.852734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e31e-004e-4b53-aaa9-918aefda8468 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:49.872042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:49.884798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:49.885667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:49.886358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:49.887917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:49.894778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:49.916239 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3796/7576] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:49.929540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:49.976907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0ad0-8490-4828-bd2d-000022d9e0e6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:49.984159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3781/7577] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:49 2022] POST /identity/v3/users => generated 288 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:49.985380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.000441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.000441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.001094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.001729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] PATH_INFO: `/v3/projects/7b9157f45dbd4b26a0444fc1958ca85e/users/36116f998c064a77944dbfe9f98321b7/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.020073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fc2af-9e1e-416c-b823-76cc8a3fc206 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.028587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec34b0-481f-4a9c-8d46-92c1ba184b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.029833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec34b0-481f-4a9c-8d46-92c1ba184b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.030291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec34b0-481f-4a9c-8d46-92c1ba184b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.030917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec34b0-481f-4a9c-8d46-92c1ba184b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.032442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec34b0-481f-4a9c-8d46-92c1ba184b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.034256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9157f45dbd4b26a0444fc1958ca85e, user_id=36116f998c064a77944dbfe9f98321b7, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.036285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec34b0-481f-4a9c-8d46-92c1ba184b99 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:50.041807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:50.067740 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3797/7578] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:49 2022] PUT /identity/v3/projects/7b9157f45dbd4b26a0444fc1958ca85e/users/36116f998c064a77944dbfe9f98321b7/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:50.069016 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3782/7579] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:50.075772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.083428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b36c1-d899-4f93-be8d-154de823a749 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.083920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b36c1-d899-4f93-be8d-154de823a749 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.084376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b36c1-d899-4f93-be8d-154de823a749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.144520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a02b36c1-d899-4f93-be8d-154de823a749 None None] MFA Rules not processed for user `36116f998c064a77944dbfe9f98321b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:50.146048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a02b36c1-d899-4f93-be8d-154de823a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:50.213139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc898-9e22-4051-9afa-13b4954fae7b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.230451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.231253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.231754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.232111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.232955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.235497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:50.272765 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3798/7580] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:50.277092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.306627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8893-6872-40bb-8b31-6e78886cd450 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.308925 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3783/7581] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:50.315481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b36c1-d899-4f93-be8d-154de823a749 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.327756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8d5f-1263-4fc9-937b-e564a85e9e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.329362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8d5f-1263-4fc9-937b-e564a85e9e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.330049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8d5f-1263-4fc9-937b-e564a85e9e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.330668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8d5f-1263-4fc9-937b-e564a85e9e88 admin admin] PATH_INFO: `/v3/projects/ff686edfadf043f3a0a1bdcac2eba712/users/a85e467c4d684346b1a576e99229b551/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.333272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:50.346511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b36c1-d899-4f93-be8d-154de823a749 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.372156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.373472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.373472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.373819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.374734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.379465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:50.413473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8d5f-1263-4fc9-937b-e564a85e9e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff686edfadf043f3a0a1bdcac2eba712, user_id=a85e467c4d684346b1a576e99229b551, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.419793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8d5f-1263-4fc9-937b-e564a85e9e88 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:50.445932 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3799/7582] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:50 2022] PUT /identity/v3/projects/ff686edfadf043f3a0a1bdcac2eba712/users/a85e467c4d684346b1a576e99229b551/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:50.466140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.466438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.466721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.490562 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3784/7583] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:18:50 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:18:50.492452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.494097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:50.592631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] MFA Rules not processed for user `a85e467c4d684346b1a576e99229b551`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:50.594062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:50.721711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51f35c-3864-4006-85e7-ded4d4927641 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.727689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.729132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.729583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.730022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.730888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.734317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:50.775801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3785/7584] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:18:50 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:18:50.781999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.783736 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3800/7585] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:50.797468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.802360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:50.815004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f36b1-7078-4dc9-a29a-5c7b4c551756 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.828749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.829461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.830284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.830556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.831327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.835388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:50.865766 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3786/7586] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:18:50.866715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:50.918789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78058-be1b-481c-9a8e-3994c59e44f8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.927204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.931290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.932271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.932567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] PATH_INFO: `/v3/projects/5df06bf79059427fa5ba2b510a0b00be/users/c8a4a08941db4198a8b369a894f02821/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.943374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b4ba6-8284-448f-a36d-48605ca7b1ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:50.978758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:50.983759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:50.985003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:50.985505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:50.988396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df06bf79059427fa5ba2b510a0b00be, user_id=c8a4a08941db4198a8b369a894f02821, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:50.993225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:51.017624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:51.019384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:51.035488 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3787/7587] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:50 2022] PUT /identity/v3/projects/5df06bf79059427fa5ba2b510a0b00be/users/c8a4a08941db4198a8b369a894f02821/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:51.036684 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3801/7588] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:51.040164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:51.050320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:51.055868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:51.079590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939091-2073-411d-9f93-9e628d2b934f service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:51.370868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:51.371758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:51.372135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:51.372523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:51.373392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:51.381120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:51.412620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c8ae7-7b68-405a-9021-e844f57fbaa2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:51.421197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3802/7589] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:18:51.425121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:51.432465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:51.434937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:51.437676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:51.438154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:51.442831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:51.462468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643245-1a14-4221-b934-adff77f16093 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:51.490073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6e559-050a-41d1-bc04-435c6c2d4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:51.491610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e559-050a-41d1-bc04-435c6c2d4a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:51.492016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e559-050a-41d1-bc04-435c6c2d4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:51.492419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e559-050a-41d1-bc04-435c6c2d4a9f admin admin] PATH_INFO: `/v3/projects/5df06bf79059427fa5ba2b510a0b00be/users/c8a4a08941db4198a8b369a894f02821/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:51.496751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6e559-050a-41d1-bc04-435c6c2d4a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df06bf79059427fa5ba2b510a0b00be, user_id=c8a4a08941db4198a8b369a894f02821, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:51.507622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6e559-050a-41d1-bc04-435c6c2d4a9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:51.560399 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3803/7590] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:18:51 2022] PUT /identity/v3/projects/5df06bf79059427fa5ba2b510a0b00be/users/c8a4a08941db4198a8b369a894f02821/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:51.562213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7bc-5ddf-46da-897c-ef07eb714af8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:51.565136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7bc-5ddf-46da-897c-ef07eb714af8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:51.565590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cd7bc-5ddf-46da-897c-ef07eb714af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:51.620106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:51.648355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c0cd7bc-5ddf-46da-897c-ef07eb714af8 None None] MFA Rules not processed for user `c8a4a08941db4198a8b369a894f02821`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:51.654466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c0cd7bc-5ddf-46da-897c-ef07eb714af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:51.665091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:51.749150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:51.752640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:51.772660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3788/7591] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:18:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:51.875317 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3804/7592] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:51.888924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:51.890532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:52.036060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b91b-c180-4b99-8247-2b3e16b45539 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:52.194016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:52.195575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:52.197811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:52.198740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:52.257148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:52.267973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:52.334527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3789/7593] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:55.388997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:55.392663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:55.393379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:55.438847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] MFA Rules not processed for user `a85e467c4d684346b1a576e99229b551`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:55.443786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:55.535471 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3805/7594] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:57.928361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:58.048034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c87cc6-1ac4-4e3c-948b-58ee464067f4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:58.063610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:58.079675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:58.081124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:58.081573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] PATH_INFO: `/v3/users/36116f998c064a77944dbfe9f98321b7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:58.083852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36116f998c064a77944dbfe9f98321b7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:58.102310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:58.233285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:58.263096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36116f998c064a77944dbfe9f98321b7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.273920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:58.275527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:58.305968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867bbb-7d0c-4dc3-8e7b-8cfc94436ed6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:58.313900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:58.316119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:58.316575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:58.317046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] PATH_INFO: `/v3/users/c2799f8be87741fe899900267ea6d1ff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:58.319033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2799f8be87741fe899900267ea6d1ff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:58.321337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:58.321540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36116f998c064a77944dbfe9f98321b7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.324166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36116f998c064a77944dbfe9f98321b7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.349371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36116f998c064a77944dbfe9f98321b7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.350158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6035273b-4cb6-446f-9579-7cf51a4e722d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36116f998c064a77944dbfe9f98321b7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.378664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3790/7595] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:57 2022] DELETE /identity/v3/users/36116f998c064a77944dbfe9f98321b7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:58.383507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:58.383804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:58.384087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:58.450728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:58.457313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:58.464372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2799f8be87741fe899900267ea6d1ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.514101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2799f8be87741fe899900267ea6d1ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.532986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2799f8be87741fe899900267ea6d1ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.534450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2799f8be87741fe899900267ea6d1ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.552769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-825b88a5-19d1-4e02-84ee-f12f080734d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2799f8be87741fe899900267ea6d1ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:18:58.570140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3806/7596] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:18:58 2022] DELETE /identity/v3/users/c2799f8be87741fe899900267ea6d1ff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:18:58.575925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:58.576427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:58.576875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:58.624488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:18:58.627018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:58.646606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:58.762183 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3791/7597] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:18:58.773849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:58.776152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:58.810611 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3807/7598] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:18:58.821838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:18:58.826123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:18:58.958456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafe048-6adc-4ba4-ba4b-3e98be032b5d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:58.972255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:58.973409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:58.973919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:58.974435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:58.988426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc98cd-f240-4b40-a8a9-7a59606962b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:18:58.999538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:18:59.000304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:18:59.000595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:18:59.000875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:18:59.006756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:59.008932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:59.023871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:18:59.025337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:18:59.035356 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3792/7599] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:18:59.041705 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3808/7600] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:00.170323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:00.172511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:00.216634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5cd5-4c70-422e-b5e9-981d38eb9d91 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:00.240693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:00.243006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:00.252160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:00.254970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] PATH_INFO: `/v3/projects/7b9157f45dbd4b26a0444fc1958ca85e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:00.258625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9157f45dbd4b26a0444fc1958ca85e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:00.264069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:00.307058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:00.310288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:00.337403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e0818-583b-4450-8b19-f521e8ff1eae service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:00.377122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:00.381614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9157f45dbd4b26a0444fc1958ca85e', 'request_id': 'req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.398598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9157f45dbd4b26a0444fc1958ca85e', 'request_id': 'req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.410608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9157f45dbd4b26a0444fc1958ca85e', 'request_id': 'req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.430621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] The token cache is being invalidate because project 7b9157f45dbd4b26a0444fc1958ca85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:00.433631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.437342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.451100 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3793/7601] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:00 2022] DELETE /identity/v3/projects/7b9157f45dbd4b26a0444fc1958ca85e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:00.455989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:00.459793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:00.550553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:00.552285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:00.552734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:00.553224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] PATH_INFO: `/v3/projects/a3da7e6cd5474133a96a05e44a3fd445` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:00.554803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3da7e6cd5474133a96a05e44a3fd445)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:00.557302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:00.665646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3da7e6cd5474133a96a05e44a3fd445', 'request_id': 'req-812946b5-5e06-4b1b-be83-5c96839dc9ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.681892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3da7e6cd5474133a96a05e44a3fd445', 'request_id': 'req-812946b5-5e06-4b1b-be83-5c96839dc9ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.686109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:00.703219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3da7e6cd5474133a96a05e44a3fd445', 'request_id': 'req-812946b5-5e06-4b1b-be83-5c96839dc9ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.711668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0e0a-8aef-4a57-9e34-a3a195bf3b32 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:00.735257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] The token cache is being invalidate because project a3da7e6cd5474133a96a05e44a3fd445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:00.736331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.737087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.745202 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3809/7602] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:00 2022] DELETE /identity/v3/projects/a3da7e6cd5474133a96a05e44a3fd445 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:00.746195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:00.748820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:00.858295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:00.862653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:00.863128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:00.863553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] PATH_INFO: `/v3/users/c8a4a08941db4198a8b369a894f02821` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:00.868018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a4a08941db4198a8b369a894f02821)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:00.874366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:00.904944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812946b5-5e06-4b1b-be83-5c96839dc9ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:00.915337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:00.916036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:00.916322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:00.916603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:00.920882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:00.944202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:00.948918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:00.990602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a4a08941db4198a8b369a894f02821'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:00.998115 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3810/7603] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:01.002487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:01.006444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:01.044990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a4a08941db4198a8b369a894f02821'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.046611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a4a08941db4198a8b369a894f02821'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.052418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae13f-cb6e-407f-a75f-3c71da57ebe6 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:01.068047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:01.068896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a4a08941db4198a8b369a894f02821'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.069036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:01.069229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:01.069511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] PATH_INFO: `/v3/users/830efec2903242cf94886f6bef322e13` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:01.070941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a4a08941db4198a8b369a894f02821'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.078662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830efec2903242cf94886f6bef322e13)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:01.081608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:01.087373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:01.097667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3794/7604] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:19:00 2022] DELETE /identity/v3/users/c8a4a08941db4198a8b369a894f02821 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:19:01.197225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830efec2903242cf94886f6bef322e13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.223548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830efec2903242cf94886f6bef322e13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.237396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830efec2903242cf94886f6bef322e13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.239174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830efec2903242cf94886f6bef322e13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.249804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830efec2903242cf94886f6bef322e13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:01.259864 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3811/7605] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:19:00 2022] DELETE /identity/v3/users/830efec2903242cf94886f6bef322e13 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:02.318026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:02.319805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:02.454375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:02.456197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:02.560997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd33af4-9ef7-4833-81ba-968a76fd3f7d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:02.702139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b49f19-6f24-4242-aff6-46aaa60bf6d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:02.725804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:02.726526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:02.726825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:02.727211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] PATH_INFO: `/v3/projects/5df06bf79059427fa5ba2b510a0b00be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:02.729180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df06bf79059427fa5ba2b510a0b00be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:02.731710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:02.748295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:02.797234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:02.800196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:02.801101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:02.801392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] PATH_INFO: `/v3/projects/34b54b822f9a48c0a6fd9ec6861760c7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:02.807151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b54b822f9a48c0a6fd9ec6861760c7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:02.811898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:02.872008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df06bf79059427fa5ba2b510a0b00be', 'request_id': 'req-f23d8c04-3de1-45d9-8530-3f67d6589288'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.887359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df06bf79059427fa5ba2b510a0b00be', 'request_id': 'req-f23d8c04-3de1-45d9-8530-3f67d6589288'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.909069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df06bf79059427fa5ba2b510a0b00be', 'request_id': 'req-f23d8c04-3de1-45d9-8530-3f67d6589288'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.910438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b54b822f9a48c0a6fd9ec6861760c7', 'request_id': 'req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.923906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b54b822f9a48c0a6fd9ec6861760c7', 'request_id': 'req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.937085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] The token cache is being invalidate because project 5df06bf79059427fa5ba2b510a0b00be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:02.937397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.939199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d8c04-3de1-45d9-8530-3f67d6589288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.942066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b54b822f9a48c0a6fd9ec6861760c7', 'request_id': 'req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.948259 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3812/7606] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:02 2022] DELETE /identity/v3/projects/5df06bf79059427fa5ba2b510a0b00be => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:02.956417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] The token cache is being invalidate because project 34b54b822f9a48c0a6fd9ec6861760c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:02.956858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:02.957031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.957204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:02.957419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:02.958191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f293aa06-6f53-4f81-b5ee-b79ed600a3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:02.961020 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3795/7607] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:02 2022] DELETE /identity/v3/projects/34b54b822f9a48c0a6fd9ec6861760c7 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:02.966092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370373e-8dbb-4146-847b-c2abf7c15b88 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:02.966788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370373e-8dbb-4146-847b-c2abf7c15b88 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:02.967194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370373e-8dbb-4146-847b-c2abf7c15b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:02.992599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5370373e-8dbb-4146-847b-c2abf7c15b88 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:02.994328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5370373e-8dbb-4146-847b-c2abf7c15b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:03.005952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:03.007405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:03.038628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:03.133605 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3796/7608] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:19:03.146685 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3813/7609] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:19:03.151608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19901385-66a2-4f11-ac3e-12fd3d104abd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:03.151918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19901385-66a2-4f11-ac3e-12fd3d104abd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:03.152215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19901385-66a2-4f11-ac3e-12fd3d104abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:03.154590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:03.156129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:03.197853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-19901385-66a2-4f11-ac3e-12fd3d104abd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:03.204122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-19901385-66a2-4f11-ac3e-12fd3d104abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:03.232529 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3797/7610] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:03.234008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8fe79-8e40-4473-9368-722f88e0ee19 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:03.234307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8fe79-8e40-4473-9368-722f88e0ee19 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:03.234592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8fe79-8e40-4473-9368-722f88e0ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:03.297553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c93c-6e40-4f43-bb16-193856f9224a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:03.303550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-87b8fe79-8e40-4473-9368-722f88e0ee19 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:03.304804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-87b8fe79-8e40-4473-9368-722f88e0ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:03.308613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:03.309561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:03.309858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:03.310147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:03.313356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:03.327498 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3798/7611] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:03.332141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8fe79-8e40-4473-9368-722f88e0ee19 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:03.353146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8fe79-8e40-4473-9368-722f88e0ee19 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:03.368858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:03.369564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:03.369850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:03.370126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:03.370883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:19:03.371190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:03.372868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:03.411403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3799/7612] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:19:03.412497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:03.421855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:03.441179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dbf1e-8bd9-41e6-9c38-78d7551e19b2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:03.452459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:03.453265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:03.453559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:03.453907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:03.456135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:19:03.456575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:03.461208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:03.462919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:03.470518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:03.496008 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3800/7613] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:19:03.497694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:03.512722 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3814/7614] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:03.513920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:03.541627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a73bb-b866-4d3e-a50f-69fdfe65a4e6 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:03.550354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537f25-962c-449b-9b3d-24576b685b01 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:03.558506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:03.560558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:03.560958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:03.561507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:03.563825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:03.568038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:03.568225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:03.569508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:03.569807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:03.570092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:03.570816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:03.572832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:03.635644 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3801/7615] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:19:03 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:03.639753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:03.641160 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3815/7616] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:19:03 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:03.646590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:03.955943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb85a77-169f-4952-8fec-a4af3349fd74 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.024048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5739fc-c3af-42a8-9ef3-44878b1300bc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.097458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.105269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.112289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.115141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.120343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.132213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.182543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.183440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.183901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.184698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.185616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.192554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.289489 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3816/7617] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:19:03 2022] POST /identity/v3/users => generated 286 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:04.291970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:04.308073 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3802/7618] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:19:03 2022] POST /identity/v3/users => generated 289 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:04.313426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:04.321772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f439f-4565-4345-b635-48f80dc2a5c4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.335543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.336699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.337222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.337731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.338739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.340748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.372351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b03b-c50a-4ea6-8391-e8ec1e13b85b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.383768 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3817/7619] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:04.389802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:04.393862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.394594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.394874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.395159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.396225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.398155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.411427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371174a-fa8d-493f-91f7-b993c993f8dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.428830 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3803/7620] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:04.430075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:04.431073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.432497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.432989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.433305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.434873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.436977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.441798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:04.465552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22937e-4bbb-4ecc-89c7-72daa93d0626 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.471905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.472618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.472911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.473590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.474212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.476353 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3818/7621] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:04.479561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:04.481579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.507363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a44ed-4ef7-4bcf-95a0-2d7bdd756540 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.509020 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3804/7622] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:19:04.516389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:04.529441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8b16c-9f5d-41e9-9b81-6e2cc8c1b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.533020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b16c-9f5d-41e9-9b81-6e2cc8c1b5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.533850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b16c-9f5d-41e9-9b81-6e2cc8c1b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.534324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b16c-9f5d-41e9-9b81-6e2cc8c1b5e6 admin admin] PATH_INFO: `/v3/projects/dc601c352f2b4b47a85aae7ea10731fa/users/771c4dfa564f4045bd3eded33c5da705/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.557787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e88f0-38f5-44fe-9ab4-b2a7db41f029 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:04.578392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8b16c-9f5d-41e9-9b81-6e2cc8c1b5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc601c352f2b4b47a85aae7ea10731fa, user_id=771c4dfa564f4045bd3eded33c5da705, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.587451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae120-92d7-416b-bcc6-cfd28acc3587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:04.588203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8b16c-9f5d-41e9-9b81-6e2cc8c1b5e6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.589169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae120-92d7-416b-bcc6-cfd28acc3587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.589683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae120-92d7-416b-bcc6-cfd28acc3587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.590182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae120-92d7-416b-bcc6-cfd28acc3587 admin admin] PATH_INFO: `/v3/projects/0ce225c2b7f54a81af9146e14440b969/users/afba11c2eb9244b0b3a5b237f91a20ff/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.624339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3819/7623] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:19:04 2022] PUT /identity/v3/projects/dc601c352f2b4b47a85aae7ea10731fa/users/771c4dfa564f4045bd3eded33c5da705/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:04.638372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328efe0-73c7-4b12-97a1-9f6e00147ccd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.638829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328efe0-73c7-4b12-97a1-9f6e00147ccd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.640161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328efe0-73c7-4b12-97a1-9f6e00147ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.649681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ae120-92d7-416b-bcc6-cfd28acc3587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce225c2b7f54a81af9146e14440b969, user_id=afba11c2eb9244b0b3a5b237f91a20ff, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:04.660555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ae120-92d7-416b-bcc6-cfd28acc3587 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:04.705328 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3805/7624] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:19:04 2022] PUT /identity/v3/projects/0ce225c2b7f54a81af9146e14440b969/users/afba11c2eb9244b0b3a5b237f91a20ff/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:04.719350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a328efe0-73c7-4b12-97a1-9f6e00147ccd None None] MFA Rules not processed for user `771c4dfa564f4045bd3eded33c5da705`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:04.720786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a328efe0-73c7-4b12-97a1-9f6e00147ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:04.751628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2882-5385-4ce0-a896-b5e17813b0ce None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:04.783874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2882-5385-4ce0-a896-b5e17813b0ce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:04.793712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2882-5385-4ce0-a896-b5e17813b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:04.886295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-57fd2882-5385-4ce0-a896-b5e17813b0ce None None] MFA Rules not processed for user `afba11c2eb9244b0b3a5b237f91a20ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:04.887689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-57fd2882-5385-4ce0-a896-b5e17813b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:04.922175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:04.937131 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3820/7625] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:04.939175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328efe0-73c7-4b12-97a1-9f6e00147ccd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.005724 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3806/7626] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:05.011309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd2882-5385-4ce0-a896-b5e17813b0ce None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.133768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd2882-5385-4ce0-a896-b5e17813b0ce None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.149786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328efe0-73c7-4b12-97a1-9f6e00147ccd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.151326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.152833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.153609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.154352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.159626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.163455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.169557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.170400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.170841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.171356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.172216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.174372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.237027 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3821/7627] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:19:04 2022] POST /identity/v3/projects => generated 371 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:05.240189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.263824 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3807/7628] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:19:05 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:05.265914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.384620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:05.401689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d936-67e6-4d51-ba73-5dc35b5d507d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.436129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.436845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.437136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.437422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.438131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.443756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.444888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda83a7-adb8-4f53-85e7-41287da81f50 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.465290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.466014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.466299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.466582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.467325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.469350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.509935 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3822/7629] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:19:05 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:05.513632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.545115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3808/7630] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:19:05 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:05.546130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.551314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08786f-70b6-47db-af86-53aa7bcf6aba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.576741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.577445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.577738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.578015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.584890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.587014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a720-3aef-4f72-9b92-e66b47c780e6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.588115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.605703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.606403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.606727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.607018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.617286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.619917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.636636 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3823/7631] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:05.642825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.668061 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3809/7632] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:05.671553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.675079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba133f0-6d9a-40e5-b864-eebc6fbf1a7e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.692932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffefe37-401a-4af4-850d-410a3447de28 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:05.693920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.694850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.695196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.695452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] PATH_INFO: `/v3/projects/3fffb4f3de034f15b813db926f47a681/users/a9f44aa4a3e345ba887a5fd1327d606d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.740005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:05.741325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:05.741816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:05.742609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] PATH_INFO: `/v3/projects/3698515ffe484672b6ecfa7e42c165f6/users/0d7eefc4c25b40bbadc56bbc227800bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:05.762052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fffb4f3de034f15b813db926f47a681, user_id=a9f44aa4a3e345ba887a5fd1327d606d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.765261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.778797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3698515ffe484672b6ecfa7e42c165f6, user_id=0d7eefc4c25b40bbadc56bbc227800bb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:05.782578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:05.790800 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3824/7633] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:19:05 2022] PUT /identity/v3/projects/3fffb4f3de034f15b813db926f47a681/users/a9f44aa4a3e345ba887a5fd1327d606d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:05.795597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.829532 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3810/7634] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:19:05 2022] PUT /identity/v3/projects/3698515ffe484672b6ecfa7e42c165f6/users/0d7eefc4c25b40bbadc56bbc227800bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:05.835917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:05.969770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:06.042638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f92f-e00d-4def-9e0f-efedad7202b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.056991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb929c-4b13-4d7e-bbbb-f4e352808495 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.064525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.065236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.067004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.067349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.068122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.069814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:06.092752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3811/7635] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:06.099716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:06.129095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278213-05ac-4a07-991f-a5d93708ea91 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.147221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812eb23-0591-4df8-a538-3025c2ce5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.148177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812eb23-0591-4df8-a538-3025c2ce5b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.148463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812eb23-0591-4df8-a538-3025c2ce5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.148804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812eb23-0591-4df8-a538-3025c2ce5b65 admin admin] PATH_INFO: `/v3/projects/3698515ffe484672b6ecfa7e42c165f6/users/0d7eefc4c25b40bbadc56bbc227800bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.156261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812eb23-0591-4df8-a538-3025c2ce5b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3698515ffe484672b6ecfa7e42c165f6, user_id=0d7eefc4c25b40bbadc56bbc227800bb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.161052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812eb23-0591-4df8-a538-3025c2ce5b65 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:06.201531 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3812/7636] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:19:06 2022] PUT /identity/v3/projects/3698515ffe484672b6ecfa7e42c165f6/users/0d7eefc4c25b40bbadc56bbc227800bb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:06.203167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.203496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.203787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.221896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.222599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.222887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.223168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.223948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.225611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:06.245967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] MFA Rules not processed for user `0d7eefc4c25b40bbadc56bbc227800bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:06.247420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:06.256605 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3825/7637] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:06.274248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:06.290142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b67ad4-e57d-4010-859d-574e078ad1ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.436772 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3813/7638] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:06.444026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:06.446683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:06.455557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:06.467069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dbf68-7fe3-4b2d-902c-5c4d685dd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.468807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dbf68-7fe3-4b2d-902c-5c4d685dd465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.469262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dbf68-7fe3-4b2d-902c-5c4d685dd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.469776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dbf68-7fe3-4b2d-902c-5c4d685dd465 admin admin] PATH_INFO: `/v3/projects/3fffb4f3de034f15b813db926f47a681/users/a9f44aa4a3e345ba887a5fd1327d606d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.472623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dbf68-7fe3-4b2d-902c-5c4d685dd465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fffb4f3de034f15b813db926f47a681, user_id=a9f44aa4a3e345ba887a5fd1327d606d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.476248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dbf68-7fe3-4b2d-902c-5c4d685dd465 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:06.493073 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3826/7639] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:19:06 2022] PUT /identity/v3/projects/3fffb4f3de034f15b813db926f47a681/users/a9f44aa4a3e345ba887a5fd1327d606d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:06.504404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72191cc-4c07-4b6a-8789-1695afc09b6c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.504404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72191cc-4c07-4b6a-8789-1695afc09b6c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.504404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72191cc-4c07-4b6a-8789-1695afc09b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.529833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a1589-a6c8-4be2-b047-6844f1f0b3d8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.549093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b72191cc-4c07-4b6a-8789-1695afc09b6c None None] MFA Rules not processed for user `a9f44aa4a3e345ba887a5fd1327d606d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:06.550609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b72191cc-4c07-4b6a-8789-1695afc09b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:06.659732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.661550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.662451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.663168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.673703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:06.683953 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3827/7640] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:19:06.685613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72191cc-4c07-4b6a-8789-1695afc09b6c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:06.697605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72191cc-4c07-4b6a-8789-1695afc09b6c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.706282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f44aa4a3e345ba887a5fd1327d606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fffb4f3de034f15b813db926f47a681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.707580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.707884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.708291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.709131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:19:06.709467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.711135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:06.736367 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3828/7641] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:19:06.740359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:06.754899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab270d2-be53-43c9-a2d0-30c34c64a423 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.761593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f44aa4a3e345ba887a5fd1327d606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fffb4f3de034f15b813db926f47a681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.762633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.763040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.763618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.764546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.771334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:06.774144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.778372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:06.793107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3814/7642] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:06.806989 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3829/7643] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:19:06 2022] POST /identity/v3/projects => generated 348 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:06.809243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:06.839761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4791e9-ebfb-46bd-8e1b-dce84f92d797 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:06.978313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f44aa4a3e345ba887a5fd1327d606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fffb4f3de034f15b813db926f47a681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:06.979654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:06.980147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:06.980613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:06.982018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:19:06.982558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:06.984574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:07.051379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3815/7644] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:19:07.144217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:07.146011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:07.379211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02281c3-ee2c-4a58-950f-ce640c5adce2 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:07.391057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:07.392946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:07.395078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:07.395783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:07.423856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:07.428279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:07.462466 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3830/7645] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:12.816971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:12.840279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:12.857254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8227-7ca4-403b-aaeb-d022bb634e58 tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:12.872463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f44aa4a3e345ba887a5fd1327d606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fffb4f3de034f15b813db926f47a681', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:12.884944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:12.885896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:12.886593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] PATH_INFO: `/v3/projects/bd32f0ea44ca4bf8987215a5cdfe5861` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:12.888925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd32f0ea44ca4bf8987215a5cdfe5861)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:12.894290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:13.030592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd32f0ea44ca4bf8987215a5cdfe5861', 'request_id': 'req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.049075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd32f0ea44ca4bf8987215a5cdfe5861', 'request_id': 'req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.068503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd32f0ea44ca4bf8987215a5cdfe5861', 'request_id': 'req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.091639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] The token cache is being invalidate because project bd32f0ea44ca4bf8987215a5cdfe5861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:13.092599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.095474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8c4efc18-7929-4c3f-a4e1-b9836a205b4a tempest-QuotasNegativeTest-289761517 tempest-QuotasNegativeTest-289761517-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.102668 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3816/7646] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:12 2022] DELETE /identity/v3/projects/bd32f0ea44ca4bf8987215a5cdfe5861 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:13.104042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:13.201457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3e2a-35ba-4d22-aac9-18b2089a22d5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:13.329658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:13.330593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:13.330953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:13.331754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] PATH_INFO: `/v3/users/771c4dfa564f4045bd3eded33c5da705` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:13.332737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771c4dfa564f4045bd3eded33c5da705)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:13.334792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:13.373727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:13.467969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771c4dfa564f4045bd3eded33c5da705'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.494725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771c4dfa564f4045bd3eded33c5da705'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.518560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771c4dfa564f4045bd3eded33c5da705'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.519343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771c4dfa564f4045bd3eded33c5da705'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.534960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771c4dfa564f4045bd3eded33c5da705'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:13.573852 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3831/7647] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:19:13 2022] DELETE /identity/v3/users/771c4dfa564f4045bd3eded33c5da705 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:13.585489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:13.585489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:13.585489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:13.609739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:13.632725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:13.932984 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3817/7648] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:19:13.934079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:13.935925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:14.134172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cbe18-e656-49bf-abe8-132d0ca30690 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:14.150014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:14.151232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:14.151810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:14.152306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:14.197490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:14.201384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:14.236003 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3832/7649] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:15.080941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:15.084692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:15.114440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c30d-72c6-4bcb-9095-84551270bdcb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:15.125546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:15.127954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:15.129002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:15.129800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] PATH_INFO: `/v3/projects/dc601c352f2b4b47a85aae7ea10731fa` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:15.134049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc601c352f2b4b47a85aae7ea10731fa)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:15.141934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:15.300560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc601c352f2b4b47a85aae7ea10731fa', 'request_id': 'req-65271ba2-6600-4869-868b-ee655db9dc79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.325563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc601c352f2b4b47a85aae7ea10731fa', 'request_id': 'req-65271ba2-6600-4869-868b-ee655db9dc79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.358951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc601c352f2b4b47a85aae7ea10731fa', 'request_id': 'req-65271ba2-6600-4869-868b-ee655db9dc79'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.389874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] The token cache is being invalidate because project dc601c352f2b4b47a85aae7ea10731fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:15.390605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.392456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.400313 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3818/7650] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:15 2022] DELETE /identity/v3/projects/dc601c352f2b4b47a85aae7ea10731fa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:15.401334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:15.418316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658fcd-3f89-473b-bb23-b747f952c861 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:15.651812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:15.654472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:15.654739 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:15.655023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] PATH_INFO: `/v3/users/a9f44aa4a3e345ba887a5fd1327d606d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:15.657917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f44aa4a3e345ba887a5fd1327d606d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:15.659923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:15.779888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:15.799718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f44aa4a3e345ba887a5fd1327d606d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.817828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f44aa4a3e345ba887a5fd1327d606d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.832715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f44aa4a3e345ba887a5fd1327d606d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.833810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f44aa4a3e345ba887a5fd1327d606d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.846565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59d12671-da9a-44b9-9d82-847a7cac07ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f44aa4a3e345ba887a5fd1327d606d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:15.854748 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3833/7651] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:19:15 2022] DELETE /identity/v3/users/a9f44aa4a3e345ba887a5fd1327d606d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:17.568218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:17.570120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:17.612349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271ba2-6600-4869-868b-ee655db9dc79 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:17.636779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:17.833713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:17.835662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:17.836399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:17.837724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] PATH_INFO: `/v3/projects/3fffb4f3de034f15b813db926f47a681` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:17.840041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fffb4f3de034f15b813db926f47a681)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:17.845496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:17.968614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fffb4f3de034f15b813db926f47a681', 'request_id': 'req-f8c74efc-5df2-47b4-aa14-00fad474f6a2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:17.999244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fffb4f3de034f15b813db926f47a681', 'request_id': 'req-f8c74efc-5df2-47b4-aa14-00fad474f6a2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:18.018654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fffb4f3de034f15b813db926f47a681', 'request_id': 'req-f8c74efc-5df2-47b4-aa14-00fad474f6a2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:18.049926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] The token cache is being invalidate because project 3fffb4f3de034f15b813db926f47a681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:18.050804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:18.052578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f8c74efc-5df2-47b4-aa14-00fad474f6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:18.057231 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3819/7652] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:17 2022] DELETE /identity/v3/projects/3fffb4f3de034f15b813db926f47a681 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:18.062592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53195a-96e4-4fa0-9e36-a6efc78fcb94 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:18.064056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53195a-96e4-4fa0-9e36-a6efc78fcb94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:18.064056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53195a-96e4-4fa0-9e36-a6efc78fcb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:18.111241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0f53195a-96e4-4fa0-9e36-a6efc78fcb94 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:18.114685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f53195a-96e4-4fa0-9e36-a6efc78fcb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:18.267384 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3834/7653] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:19:18.274617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6a99-cce5-4f1b-ae43-e9e7535f1f3c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:18.274920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6a99-cce5-4f1b-ae43-e9e7535f1f3c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:18.275596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6a99-cce5-4f1b-ae43-e9e7535f1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:18.316846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e6cc6a99-cce5-4f1b-ae43-e9e7535f1f3c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:18.318147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6cc6a99-cce5-4f1b-ae43-e9e7535f1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:18.351911 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3820/7654] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:18.357523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53195a-96e4-4fa0-9e36-a6efc78fcb94 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:18.374236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53195a-96e4-4fa0-9e36-a6efc78fcb94 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:18.416194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:18.417797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:18.418858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:18.419256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:18.421915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:19:18.422828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:18.425145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:18.507717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6a99-cce5-4f1b-ae43-e9e7535f1f3c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:18.512869 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3835/7655] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:19:18.528214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6a99-cce5-4f1b-ae43-e9e7535f1f3c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:18.548510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:18.549502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:18.549946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:18.550395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:18.553897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:18.557146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:18.663809 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3821/7656] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:19:18 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:19:18.667676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:18.709076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f49cd-0f41-44e1-b3e6-4af6eb534513 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:18.945154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:18.946716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:18.946716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:18.946716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:18.947244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:18.949500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:19.019044 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3836/7657] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:19:18 2022] POST /identity/v3/users => generated 283 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:19.025880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:19.061407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3a71-c795-4a41-81d6-404eddf7c151 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:19.083843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:19.085085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:19.085846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:19.086404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:19.087845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:19.091787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:19.129053 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3822/7658] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:19.135961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:19.180594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e33a8-c670-44db-87fa-a9573946c26d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:19.211255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da21916-cd25-4464-bd5f-d614a9b8b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:19.212913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da21916-cd25-4464-bd5f-d614a9b8b629 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:19.215634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da21916-cd25-4464-bd5f-d614a9b8b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:19.216202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da21916-cd25-4464-bd5f-d614a9b8b629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:19.220577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da21916-cd25-4464-bd5f-d614a9b8b629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:19.233532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da21916-cd25-4464-bd5f-d614a9b8b629 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:19.289940 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3837/7659] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:19:19.299261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:19.360430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644ebef-c6d5-45a0-a062-a6645730078d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:19.387040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:19.390809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:19.394637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:19.394954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] PATH_INFO: `/v3/projects/1cf974d7640942eaa30703bad59896ca/users/8e7b038154ce492b95f136bb07fa84d5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:19.440381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf974d7640942eaa30703bad59896ca, user_id=8e7b038154ce492b95f136bb07fa84d5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:19.443682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:19.489597 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3823/7660] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:19:19 2022] PUT /identity/v3/projects/1cf974d7640942eaa30703bad59896ca/users/8e7b038154ce492b95f136bb07fa84d5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:19.505537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:19.506179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:19.506671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:19.649530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] MFA Rules not processed for user `8e7b038154ce492b95f136bb07fa84d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:19.652798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:19.680018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:19.867133 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3838/7661] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:20.010545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:20.013787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:20.107290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:20.148478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50645cd-b435-4eff-adb2-22dc4cc4bf6b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:20.159326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:20.160226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:20.160491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:20.161386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:20.192831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:20.196429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:20.232218 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3824/7662] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:21.142249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:21.146404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:21.342925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc38f9-c7d1-4171-bcee-67603695911f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:21.355821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:21.357109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:21.357617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:21.358105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] PATH_INFO: `/v3/users/ab2ce820ae4f482283fe985fdb2fee84` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:21.365270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2ce820ae4f482283fe985fdb2fee84)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:21.370348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:21.575249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:21.579568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:21.599855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2ce820ae4f482283fe985fdb2fee84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:21.635095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2ce820ae4f482283fe985fdb2fee84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:21.655778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2ce820ae4f482283fe985fdb2fee84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:21.657768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2ce820ae4f482283fe985fdb2fee84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:21.674808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2ce820ae4f482283fe985fdb2fee84'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:21.690938 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3839/7663] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:19:21 2022] DELETE /identity/v3/users/ab2ce820ae4f482283fe985fdb2fee84 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:21.702730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede73-8b46-4358-a0fb-a30e5a8f6b68 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:21.880316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d7eefc4c25b40bbadc56bbc227800bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3698515ffe484672b6ecfa7e42c165f6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:21.880316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:21.880316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:21.899526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:21.899526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:19:21.899526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:21.899526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:21.930341 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3825/7664] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:19:21.953188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:21.961849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:22.042623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d46ca-a3da-4463-b96d-bab9b205c841 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:22.077828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d7eefc4c25b40bbadc56bbc227800bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3698515ffe484672b6ecfa7e42c165f6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:22.088808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:22.089337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:22.089843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:22.097080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:22.133677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:22.293856 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3840/7665] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:19:21 2022] POST /identity/v3/projects => generated 348 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:19:22.300863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:22.330834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94828873-18c8-4a79-a7f1-c1514c973574 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:22.485409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:22.487164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:22.503720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:22.554020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d7eefc4c25b40bbadc56bbc227800bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3698515ffe484672b6ecfa7e42c165f6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:22.554686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:22.554813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:22.555006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:22.555802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:19:22.556288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:22.560985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:22.606673 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3826/7666] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:19:22.743506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d877a-38a5-4204-a9b6-621122e263b8 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:22.760212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:22.762561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:22.763480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:22.763937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] PATH_INFO: `/v3/projects/2e30ed5aa78f4ba5bdbeb80ddc88b38f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:22.796046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e30ed5aa78f4ba5bdbeb80ddc88b38f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:22.812534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:22.977684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'request_id': 'req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:22.989175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'request_id': 'req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:22.998319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'request_id': 'req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.026501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] The token cache is being invalidate because project 2e30ed5aa78f4ba5bdbeb80ddc88b38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:23.027188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.028904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dfdb105-69f8-4575-a3e5-ecbcd67756d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.031723 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3841/7667] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:22 2022] DELETE /identity/v3/projects/2e30ed5aa78f4ba5bdbeb80ddc88b38f => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:23.036442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:23.039681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:23.108052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011fc13-54d2-4b0d-8cc5-c7b1f5b87678 tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:23.111985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:23.112458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:23.112746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:23.153071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:23.205510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:23.212278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:23.388104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:23.388957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:23.389246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:23.389529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] PATH_INFO: `/v3/users/7a36eebeb29b4d3ab18d1f8419407c30` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:23.396946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a36eebeb29b4d3ab18d1f8419407c30)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:23.399126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:23.536267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3842/7668] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:19:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:19:23.546440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:23.550487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a36eebeb29b4d3ab18d1f8419407c30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.552586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:23.588623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a36eebeb29b4d3ab18d1f8419407c30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.591396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a36eebeb29b4d3ab18d1f8419407c30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.622738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a36eebeb29b4d3ab18d1f8419407c30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.624530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a36eebeb29b4d3ab18d1f8419407c30'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:23.662028 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3827/7669] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:19:23 2022] DELETE /identity/v3/users/7a36eebeb29b4d3ab18d1f8419407c30 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:23.700415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:23.806184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef86a58-a655-4167-b9a8-ab878e3df801 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:23.988379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:23.989216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:23.989568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:23.990148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:23.995421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:24.185491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:24.189364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:24.217248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3843/7670] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:19:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:19:24.372410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:24.376374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:24.581449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a1c0-b462-45a1-a1e4-39928c70aded admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:24.598102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:24.599250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:24.599813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:24.600340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] PATH_INFO: `/v3/projects/da1c226717844d699b5cabb95f51bb98` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:24.605177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1c226717844d699b5cabb95f51bb98)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:24.609154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:24.668550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:24.670528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:24.733716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:24.787649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1c226717844d699b5cabb95f51bb98', 'request_id': 'req-70cb4af2-70fe-494e-8b84-13419db81bb4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:24.802958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1c226717844d699b5cabb95f51bb98', 'request_id': 'req-70cb4af2-70fe-494e-8b84-13419db81bb4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:24.825710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1c226717844d699b5cabb95f51bb98', 'request_id': 'req-70cb4af2-70fe-494e-8b84-13419db81bb4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:24.869329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] The token cache is being invalidate because project da1c226717844d699b5cabb95f51bb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:24.869859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:24.871241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59777-54ca-493c-8371-38f890164f0c service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:24.872503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:24.878875 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3828/7671] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:24 2022] DELETE /identity/v3/projects/da1c226717844d699b5cabb95f51bb98 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:19:24.940297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:25.018459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d7eefc4c25b40bbadc56bbc227800bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3698515ffe484672b6ecfa7e42c165f6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:25.019665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:25.020114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:25.020516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] PATH_INFO: `/v3/projects/42c4209dfec34bd0bd331f69fed5d6d1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:25.022788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=42c4209dfec34bd0bd331f69fed5d6d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:25.029225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:25.213540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c4209dfec34bd0bd331f69fed5d6d1', 'request_id': 'req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:25.230848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c4209dfec34bd0bd331f69fed5d6d1', 'request_id': 'req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:25.247969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c4209dfec34bd0bd331f69fed5d6d1', 'request_id': 'req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:25.277332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] The token cache is being invalidate because project 42c4209dfec34bd0bd331f69fed5d6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:25.278159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:25.280401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb411cbd-bbf3-4fe0-ae52-8f9be025455e tempest-RoutersIpV6AdminTest-320897510 tempest-RoutersIpV6AdminTest-320897510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:25.302847 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3844/7672] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:24 2022] DELETE /identity/v3/projects/42c4209dfec34bd0bd331f69fed5d6d1 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:25.305943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:25.308226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:25.610400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4af2-70fe-494e-8b84-13419db81bb4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:25.690203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:25.691868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:25.692351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:25.722134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:25.723698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:25.725802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f6143-7c2b-4d9c-ada7-e111ead9ec7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:25.726643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6143-7c2b-4d9c-ada7-e111ead9ec7e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:25.727020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6143-7c2b-4d9c-ada7-e111ead9ec7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:25.727505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6143-7c2b-4d9c-ada7-e111ead9ec7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:25.732705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-364f6143-7c2b-4d9c-ada7-e111ead9ec7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:25.850557 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3845/7673] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:19:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:19:25.883691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:25.887431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:25.888443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f6143-7c2b-4d9c-ada7-e111ead9ec7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:25.890187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f6143-7c2b-4d9c-ada7-e111ead9ec7e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:25.923134 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3829/7674] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:26.093938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e726c-5344-4ab4-a5c1-e6bd29bd225a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:26.106583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:26.108579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:26.110617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:26.111153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:26.149982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:26.154661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:26.168444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:26.207346 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3846/7675] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:19:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:26.585847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f4e7-016e-4514-b686-10be3fffb78a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:26.586319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f4e7-016e-4514-b686-10be3fffb78a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:26.586796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f4e7-016e-4514-b686-10be3fffb78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:26.640244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e05f4e7-016e-4514-b686-10be3fffb78a None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:26.641542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e05f4e7-016e-4514-b686-10be3fffb78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:26.667465 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3830/7676] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:26.674779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:26.694789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4d16-1d35-4fed-8ac0-ef70e57ba23a service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:26.713180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:26.713953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:26.714150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:26.714476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:26.741721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:26.742145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:26.822095 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3847/7677] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:19:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:27.696927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26ea6a-d370-4d0c-bc59-9c3fa4b25371 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:27.697546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26ea6a-d370-4d0c-bc59-9c3fa4b25371 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:27.697546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26ea6a-d370-4d0c-bc59-9c3fa4b25371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:27.736889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ff26ea6a-d370-4d0c-bc59-9c3fa4b25371 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:27.738159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff26ea6a-d370-4d0c-bc59-9c3fa4b25371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:27.769441 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3831/7678] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:19:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:27.786537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:27.910415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620230f9-22fd-4641-9ca6-6e9d8e1d5388 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:27.918291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:27.919050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:27.919514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:27.920033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:27.939299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:27.941406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:27.969838 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3848/7679] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:19:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:28.347686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebc861-fda1-4e47-b2ac-c9eed165c52f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:28.347968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebc861-fda1-4e47-b2ac-c9eed165c52f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:28.348500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebc861-fda1-4e47-b2ac-c9eed165c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:28.386126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-63ebc861-fda1-4e47-b2ac-c9eed165c52f None None] MFA Rules not processed for user `df8c67406d8f4722a1234aad34c75194`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:28.387487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63ebc861-fda1-4e47-b2ac-c9eed165c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:28.436359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:28.592161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3832/7680] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:35.337279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:35.341170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:35.514958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629828c8-87ed-4eb5-920f-d30ac832d446 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:35.522594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:35.524080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:35.524631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:35.525145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] PATH_INFO: `/v3/users/a85e467c4d684346b1a576e99229b551` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:35.526845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85e467c4d684346b1a576e99229b551)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:35.529163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:35.660019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85e467c4d684346b1a576e99229b551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:35.718957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85e467c4d684346b1a576e99229b551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:35.730482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85e467c4d684346b1a576e99229b551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:35.731215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85e467c4d684346b1a576e99229b551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:35.745946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85e467c4d684346b1a576e99229b551'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:35.754929 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3849/7681] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:19:35 2022] DELETE /identity/v3/users/a85e467c4d684346b1a576e99229b551 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:35.760492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:35.761023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:35.761133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:35.810612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:19:35.811877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:36.013630 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3833/7682] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:19:36.050680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:36.052282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:36.132106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:36.197614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6efcf-1e6a-49ac-b5c0-bf764471346b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:36.211964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8d39a-b3ad-4474-8241-46e956f273a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:36.212709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d39a-b3ad-4474-8241-46e956f273a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:36.213004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d39a-b3ad-4474-8241-46e956f273a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:36.213286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d39a-b3ad-4474-8241-46e956f273a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:36.230810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8d39a-b3ad-4474-8241-46e956f273a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:36.232670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8d39a-b3ad-4474-8241-46e956f273a2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:36.262489 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3850/7683] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:19:36.971759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:19:36.973333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:19:37.005386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f61b1e-798e-4542-80ee-8829d98135d8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:19:37.019195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:19:37.020808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:19:37.021094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:19:37.021574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] PATH_INFO: `/v3/projects/ff686edfadf043f3a0a1bdcac2eba712` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:19:37.028563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff686edfadf043f3a0a1bdcac2eba712)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:19:37.031493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:19:37.144415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff686edfadf043f3a0a1bdcac2eba712', 'request_id': 'req-1c5342e1-2073-4941-b56b-657e508f94e5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:37.160443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff686edfadf043f3a0a1bdcac2eba712', 'request_id': 'req-1c5342e1-2073-4941-b56b-657e508f94e5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:37.173603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff686edfadf043f3a0a1bdcac2eba712', 'request_id': 'req-1c5342e1-2073-4941-b56b-657e508f94e5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:37.200070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] The token cache is being invalidate because project ff686edfadf043f3a0a1bdcac2eba712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:19:37.200371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:37.201418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:19:37.203322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3834/7684] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:19:36 2022] DELETE /identity/v3/projects/ff686edfadf043f3a0a1bdcac2eba712 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:19:46.253119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=13 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:47.201958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:05.825281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e2e2-59b1-4f01-be9e-4b644058a923 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:05.826828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e2e2-59b1-4f01-be9e-4b644058a923 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:05.827426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e2e2-59b1-4f01-be9e-4b644058a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:05.868276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5646e2e2-59b1-4f01-be9e-4b644058a923 None None] MFA Rules not processed for user `7a00a929a3dd4608961f50265fd35caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:05.869562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5646e2e2-59b1-4f01-be9e-4b644058a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:05.985555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3851/7685] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:15.976954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=25 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:22.253335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:22.259040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:22.433388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5342e1-2073-4941-b56b-657e508f94e5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:22.440836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:22.441202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:22.450323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:22.450770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] PATH_INFO: `/v3/users/afba11c2eb9244b0b3a5b237f91a20ff` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:22.462155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afba11c2eb9244b0b3a5b237f91a20ff)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:22.462155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:22.558101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afba11c2eb9244b0b3a5b237f91a20ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:22.588698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afba11c2eb9244b0b3a5b237f91a20ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:22.589069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afba11c2eb9244b0b3a5b237f91a20ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:22.601129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afba11c2eb9244b0b3a5b237f91a20ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:22.602042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afba11c2eb9244b0b3a5b237f91a20ff'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:22.628940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3835/7686] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:20:22 2022] DELETE /identity/v3/users/afba11c2eb9244b0b3a5b237f91a20ff => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:22.633682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:22.634665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:22.634665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:22.669170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:22.671495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:22.759720 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3852/7687] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:22.770188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:22.771799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:22.924893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc27274-a9cc-485a-ab83-ecb7394c7273 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:22.932400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:22.933453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:22.934024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:22.934532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:22.950050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:22.951827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:22.965864 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3836/7688] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:23.996079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:24.000988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:24.079907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b68c-4c26-4b9d-a56e-51a1402431a5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:24.088819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:24.091744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:24.092381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:24.092987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] PATH_INFO: `/v3/projects/0ce225c2b7f54a81af9146e14440b969` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:24.095931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce225c2b7f54a81af9146e14440b969)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:24.102379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:24.247514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce225c2b7f54a81af9146e14440b969', 'request_id': 'req-c31dc428-71f9-4d61-bb18-576694a08074'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.269868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce225c2b7f54a81af9146e14440b969', 'request_id': 'req-c31dc428-71f9-4d61-bb18-576694a08074'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.293659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce225c2b7f54a81af9146e14440b969', 'request_id': 'req-c31dc428-71f9-4d61-bb18-576694a08074'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.331721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] The token cache is being invalidate because project 0ce225c2b7f54a81af9146e14440b969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:20:24.332092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.332977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.335305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3853/7689] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:20:23 2022] DELETE /identity/v3/projects/0ce225c2b7f54a81af9146e14440b969 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:24.341085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:24.349741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:24.369612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5538-75c9-42cb-b023-c85e2d556d0e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:24.529152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:24.530620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:24.530912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:24.531196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] PATH_INFO: `/v3/users/0d7eefc4c25b40bbadc56bbc227800bb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:24.534695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7eefc4c25b40bbadc56bbc227800bb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:24.536969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:24.627864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7eefc4c25b40bbadc56bbc227800bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.664682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7eefc4c25b40bbadc56bbc227800bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.666419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7eefc4c25b40bbadc56bbc227800bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.696049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7eefc4c25b40bbadc56bbc227800bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.699395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-64c5f395-d6f1-4b19-b3cf-602094ebbd23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7eefc4c25b40bbadc56bbc227800bb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:24.733428 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3837/7690] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:20:24 2022] DELETE /identity/v3/users/0d7eefc4c25b40bbadc56bbc227800bb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:25.577200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:25.579751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:25.645963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc428-71f9-4d61-bb18-576694a08074 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:25.771654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:25.772563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:25.772854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:25.773140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] PATH_INFO: `/v3/projects/3698515ffe484672b6ecfa7e42c165f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:25.778219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3698515ffe484672b6ecfa7e42c165f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:25.780946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:25.840485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:25.883641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3698515ffe484672b6ecfa7e42c165f6', 'request_id': 'req-68a32a00-4fd6-4f68-b61a-4a62985835af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:25.901903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3698515ffe484672b6ecfa7e42c165f6', 'request_id': 'req-68a32a00-4fd6-4f68-b61a-4a62985835af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:25.924623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3698515ffe484672b6ecfa7e42c165f6', 'request_id': 'req-68a32a00-4fd6-4f68-b61a-4a62985835af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:25.955530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] The token cache is being invalidate because project 3698515ffe484672b6ecfa7e42c165f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:20:25.956217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:25.957804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-68a32a00-4fd6-4f68-b61a-4a62985835af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:25.961820 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3854/7691] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:20:25 2022] DELETE /identity/v3/projects/3698515ffe484672b6ecfa7e42c165f6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:25.966845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c500e1a-67c3-4a07-b075-db58c29d3a84 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:25.967739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c500e1a-67c3-4a07-b075-db58c29d3a84 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:25.967739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c500e1a-67c3-4a07-b075-db58c29d3a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.007627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0c500e1a-67c3-4a07-b075-db58c29d3a84 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:26.008938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c500e1a-67c3-4a07-b075-db58c29d3a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:26.199005 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3838/7692] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:26.206827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99692c5-1921-45e8-a703-b456f8c6683f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:26.207098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99692c5-1921-45e8-a703-b456f8c6683f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:26.207441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99692c5-1921-45e8-a703-b456f8c6683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.243941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b99692c5-1921-45e8-a703-b456f8c6683f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:26.245529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b99692c5-1921-45e8-a703-b456f8c6683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:26.266150 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3855/7693] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:26.269985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c500e1a-67c3-4a07-b075-db58c29d3a84 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:26.291862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c500e1a-67c3-4a07-b075-db58c29d3a84 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:26.310043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:26.313779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:26.314286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:26.315465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.316442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:20:26.317592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:26.323122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:26.347318 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3839/7694] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:20:26.351337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99692c5-1921-45e8-a703-b456f8c6683f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:26.374562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99692c5-1921-45e8-a703-b456f8c6683f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:26.383109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:26.384324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:26.384928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:26.386324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.388389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:26.396766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:26.457638 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3856/7695] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:20:26 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:20:26.461715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:26.482832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3b55-76bb-4fe4-8cc9-ecdb18cae419 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:26.493455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:26.609284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:26.610326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:26.612785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:26.614018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.618097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:26.629195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:26.686396 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3840/7696] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:20:26 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:20:26.686510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:26.700000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c639-0160-4f37-882c-5bae189d12e3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:26.733218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:26.733933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:26.734227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:26.734505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.735304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:26.736920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:26.772244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3857/7697] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:20:26.776251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:26.801064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2657a-3986-403d-a737-fef5f9cdfdc6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:26.832150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1005f-433d-402e-ae5f-0c121b54aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:26.832914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1005f-433d-402e-ae5f-0c121b54aa21 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:26.833226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1005f-433d-402e-ae5f-0c121b54aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:26.840986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1005f-433d-402e-ae5f-0c121b54aa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.842449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1005f-433d-402e-ae5f-0c121b54aa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:26.846340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1005f-433d-402e-ae5f-0c121b54aa21 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:26.892126 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3841/7698] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:20:26.892640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:26.905580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9882c-6c58-4d75-bd2f-6cf6124f0a48 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:26.916095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:26.917912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:26.918442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:26.918737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] PATH_INFO: `/v3/projects/e11fc9a04dc2497a995cb6cf9a337b9c/users/ecebc01ec0814541ac1d4383de4eebd4/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:26.963564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11fc9a04dc2497a995cb6cf9a337b9c, user_id=ecebc01ec0814541ac1d4383de4eebd4, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:26.972734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:27.008740 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3858/7699] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:20:26 2022] PUT /identity/v3/projects/e11fc9a04dc2497a995cb6cf9a337b9c/users/ecebc01ec0814541ac1d4383de4eebd4/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:20:27.021357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ef92-0483-41dd-a6b6-84fd6af0645b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:27.021940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ef92-0483-41dd-a6b6-84fd6af0645b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:27.021940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ef92-0483-41dd-a6b6-84fd6af0645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:27.072404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b827ef92-0483-41dd-a6b6-84fd6af0645b None None] MFA Rules not processed for user `ecebc01ec0814541ac1d4383de4eebd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:27.073654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b827ef92-0483-41dd-a6b6-84fd6af0645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:27.187479 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3842/7700] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:27.205896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:27.208364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:27.300180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fc8e3-8a9e-4482-ab2d-6befbb3e0bee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:27.308109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50076a07-3f86-4986-868a-01c3a8bf1b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:27.309161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50076a07-3f86-4986-868a-01c3a8bf1b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:27.309718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50076a07-3f86-4986-868a-01c3a8bf1b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:27.310604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50076a07-3f86-4986-868a-01c3a8bf1b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:27.323198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50076a07-3f86-4986-868a-01c3a8bf1b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:27.324174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50076a07-3f86-4986-868a-01c3a8bf1b98 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:27.348516 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3859/7701] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:27.382677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ef92-0483-41dd-a6b6-84fd6af0645b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:27.538818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ef92-0483-41dd-a6b6-84fd6af0645b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:27.552232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:27.553168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:27.553736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:27.554033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] PATH_INFO: `/v3/users/ecebc01ec0814541ac1d4383de4eebd4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:27.555704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecebc01ec0814541ac1d4383de4eebd4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:27.558448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:27.614267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:27.673369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecebc01ec0814541ac1d4383de4eebd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:27.725120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecebc01ec0814541ac1d4383de4eebd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:27.731572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecebc01ec0814541ac1d4383de4eebd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:27.762395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecebc01ec0814541ac1d4383de4eebd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:27.764192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecebc01ec0814541ac1d4383de4eebd4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:27.815403 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3843/7702] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:20:27 2022] DELETE /identity/v3/users/ecebc01ec0814541ac1d4383de4eebd4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:20:27.822106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:27.822615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:27.822718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:27.850940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:27.852730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:27.938482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:27.965574 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3860/7703] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:27.977979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:27.979673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:28.081279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bd364-9579-4417-89d5-e9a3980a6a83 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:28.085687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136292-913b-44c7-bbb2-6c49f5c9cd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:28.086730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136292-913b-44c7-bbb2-6c49f5c9cd8d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:28.087225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136292-913b-44c7-bbb2-6c49f5c9cd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:28.087720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136292-913b-44c7-bbb2-6c49f5c9cd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:28.102994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136292-913b-44c7-bbb2-6c49f5c9cd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:28.104576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136292-913b-44c7-bbb2-6c49f5c9cd8d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:28.131404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3844/7704] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:28.580905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:28.583074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:28.608937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561829ac-12cb-4976-8afe-d70eaac01bfe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:28.615158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:28.616671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:28.616956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:28.617237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] PATH_INFO: `/v3/projects/e11fc9a04dc2497a995cb6cf9a337b9c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:28.618666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11fc9a04dc2497a995cb6cf9a337b9c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:28.620717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:28.698664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11fc9a04dc2497a995cb6cf9a337b9c', 'request_id': 'req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:28.708271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11fc9a04dc2497a995cb6cf9a337b9c', 'request_id': 'req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:28.718376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11fc9a04dc2497a995cb6cf9a337b9c', 'request_id': 'req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:28.739196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] The token cache is being invalidate because project e11fc9a04dc2497a995cb6cf9a337b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:20:28.739623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:28.740417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43c57c39-e020-4c5a-a7fd-31a7c9b27a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:28.742566 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3861/7705] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:20:28 2022] DELETE /identity/v3/projects/e11fc9a04dc2497a995cb6cf9a337b9c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:28.748071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608314ac-37e4-491a-8948-f5aabff66684 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:28.748707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608314ac-37e4-491a-8948-f5aabff66684 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:28.749222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608314ac-37e4-491a-8948-f5aabff66684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:28.779795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-608314ac-37e4-491a-8948-f5aabff66684 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:28.781106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-608314ac-37e4-491a-8948-f5aabff66684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:28.871693 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3845/7706] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:20:28.879976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160ef7-3816-4bdc-a4a7-5795fe68a611 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:28.881422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160ef7-3816-4bdc-a4a7-5795fe68a611 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:28.881945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160ef7-3816-4bdc-a4a7-5795fe68a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:28.932560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0160ef7-3816-4bdc-a4a7-5795fe68a611 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:28.933469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0160ef7-3816-4bdc-a4a7-5795fe68a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:28.949008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3862/7707] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:28.951136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608314ac-37e4-491a-8948-f5aabff66684 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:28.965767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608314ac-37e4-491a-8948-f5aabff66684 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:28.977524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:28.979096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:28.979696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:28.980307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:28.981998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:20:28.983002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:28.985166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:29.003675 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3846/7708] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:20:29.003908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160ef7-3816-4bdc-a4a7-5795fe68a611 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:29.016353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160ef7-3816-4bdc-a4a7-5795fe68a611 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:29.023560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:29.024352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:29.024644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:29.025001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:29.025810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:29.028325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:29.071542 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3863/7709] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:20:29 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:20:29.076461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:29.093859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a67b8-ed57-4b60-a92e-5fd898cafe31 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:29.154567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:29.254962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:29.255895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:29.256883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:29.257271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:29.258086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:29.261470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:29.313928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3847/7710] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:20:29 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:20:29.318370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:29.333720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1de1-a117-46cd-a074-bf8dbddbcd1b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:29.351643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:29.354298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:29.354625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:29.354918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:29.357574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:29.362166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:29.401092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:29.405503 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3864/7711] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:20:29.421328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077bb2b-7659-4145-a081-fc32a93169ac admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:29.431899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc33e5e-1a71-4386-a0f2-794792c348bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:29.433853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc33e5e-1a71-4386-a0f2-794792c348bb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:29.435492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc33e5e-1a71-4386-a0f2-794792c348bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:29.436679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc33e5e-1a71-4386-a0f2-794792c348bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:29.437819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc33e5e-1a71-4386-a0f2-794792c348bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:29.440765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc33e5e-1a71-4386-a0f2-794792c348bb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:29.456801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3848/7712] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:20:29.461571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:29.473885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea3a7-6240-4896-9812-f4310b07b651 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:29.480453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:29.481971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:29.482494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:29.482858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] PATH_INFO: `/v3/projects/b1b4268736b54e8baf9bd77dcf16904e/users/c181f2d7d1ac4fd1ad63ff8849587592/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:29.508497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b4268736b54e8baf9bd77dcf16904e, user_id=c181f2d7d1ac4fd1ad63ff8849587592, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:29.511980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:29.546073 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3865/7713] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:20:29 2022] PUT /identity/v3/projects/b1b4268736b54e8baf9bd77dcf16904e/users/c181f2d7d1ac4fd1ad63ff8849587592/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:29.547393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36466-649d-46b7-b028-b5614f4f1168 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:29.547914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36466-649d-46b7-b028-b5614f4f1168 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:29.550005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36466-649d-46b7-b028-b5614f4f1168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:29.627455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-58f36466-649d-46b7-b028-b5614f4f1168 None None] MFA Rules not processed for user `c181f2d7d1ac4fd1ad63ff8849587592`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:29.631223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-58f36466-649d-46b7-b028-b5614f4f1168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:29.771779 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3849/7714] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:29.782790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:29.784892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:29.906702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730960ff-5710-4750-b708-e2bee1b2afd5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:29.910417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545ad4-48bf-40c4-93a7-9cf0920dc110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:29.911085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545ad4-48bf-40c4-93a7-9cf0920dc110 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:29.911573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545ad4-48bf-40c4-93a7-9cf0920dc110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:29.911859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545ad4-48bf-40c4-93a7-9cf0920dc110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:29.922129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7545ad4-48bf-40c4-93a7-9cf0920dc110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:29.923779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7545ad4-48bf-40c4-93a7-9cf0920dc110 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:29.938031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3866/7715] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:30.850524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f36466-649d-46b7-b028-b5614f4f1168 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:31.017463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f36466-649d-46b7-b028-b5614f4f1168 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:31.035911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:31.037288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:31.037806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:31.038324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] PATH_INFO: `/v3/users/c181f2d7d1ac4fd1ad63ff8849587592` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:31.039995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c181f2d7d1ac4fd1ad63ff8849587592)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:31.045307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:31.142481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:31.163153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c181f2d7d1ac4fd1ad63ff8849587592'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:31.192503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c181f2d7d1ac4fd1ad63ff8849587592'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:31.193783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c181f2d7d1ac4fd1ad63ff8849587592'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:31.215522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c181f2d7d1ac4fd1ad63ff8849587592'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:31.218376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c181f2d7d1ac4fd1ad63ff8849587592'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:31.266319 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3850/7716] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:20:30 2022] DELETE /identity/v3/users/c181f2d7d1ac4fd1ad63ff8849587592 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:31.268329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:31.269224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:31.269725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:31.312614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:31.314328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:31.335746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:31.479357 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3867/7717] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:31.489859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:31.491377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:31.684473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc64620-dda7-4c35-b1a7-0a764f61df17 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:31.705767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac79f88-7bf1-419a-8f3b-dc4be2792e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:31.706424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac79f88-7bf1-419a-8f3b-dc4be2792e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:31.706790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac79f88-7bf1-419a-8f3b-dc4be2792e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:31.707017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac79f88-7bf1-419a-8f3b-dc4be2792e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:31.740141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac79f88-7bf1-419a-8f3b-dc4be2792e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:31.742812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac79f88-7bf1-419a-8f3b-dc4be2792e84 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:31.759516 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3851/7718] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:32.298674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:32.300196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:32.325754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5ffe7-f630-4ba6-812a-f811c163dee8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:32.337968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:32.338766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:32.339053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:32.340390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] PATH_INFO: `/v3/projects/b1b4268736b54e8baf9bd77dcf16904e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:32.343142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b4268736b54e8baf9bd77dcf16904e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:32.346880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:32.437467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b4268736b54e8baf9bd77dcf16904e', 'request_id': 'req-d3be5e20-3810-4734-b986-585161078de5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:32.450994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b4268736b54e8baf9bd77dcf16904e', 'request_id': 'req-d3be5e20-3810-4734-b986-585161078de5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:32.467752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b4268736b54e8baf9bd77dcf16904e', 'request_id': 'req-d3be5e20-3810-4734-b986-585161078de5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:32.496232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] The token cache is being invalidate because project b1b4268736b54e8baf9bd77dcf16904e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:20:32.496785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:32.497862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:32.500026 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3868/7719] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:20:32 2022] DELETE /identity/v3/projects/b1b4268736b54e8baf9bd77dcf16904e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:32.504915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4637785-6b52-4cc6-bb0d-66116c4ff69a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:32.506420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4637785-6b52-4cc6-bb0d-66116c4ff69a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:32.506965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4637785-6b52-4cc6-bb0d-66116c4ff69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:32.548034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b4637785-6b52-4cc6-bb0d-66116c4ff69a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:32.549725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b4637785-6b52-4cc6-bb0d-66116c4ff69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:32.616855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:32.618326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:32.680086 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3852/7720] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:20:32.688857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b934-1d2d-4e1e-acd8-eb997f06ecd5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:32.689380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b934-1d2d-4e1e-acd8-eb997f06ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:32.689761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b934-1d2d-4e1e-acd8-eb997f06ecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:32.736794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-51a6b934-1d2d-4e1e-acd8-eb997f06ecd5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:32.738111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-51a6b934-1d2d-4e1e-acd8-eb997f06ecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:32.764683 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3853/7721] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:32.768704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6b934-1d2d-4e1e-acd8-eb997f06ecd5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:32.799555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6b934-1d2d-4e1e-acd8-eb997f06ecd5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:32.803567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be5e20-3810-4734-b986-585161078de5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:32.808285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:32.808613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:32.808979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:32.809265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:32.811230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:32.828293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:32.829177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:32.829572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:32.829962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:32.831050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:20:32.831499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:32.833627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:32.853055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3854/7722] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:20:32.858344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:32.877287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883984-1865-49cd-a6a8-2c703ba4e031 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:32.884841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:32.887059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:32.890468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:32.890874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:32.891284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:32.892160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:32.895315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:32.945489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:32.945721 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3855/7723] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:20:32 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:20:32.946017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:32.950780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:32.981158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:32.982726 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3869/7724] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:20:33.116705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340355d5-4850-43b7-90ff-d89086293a70 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:33.128586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:33.130127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:33.131702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:33.132340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:33.133756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:33.140473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:33.204101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3856/7725] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:20:32 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:20:33.208946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:33.244018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cdb16-ab62-45ba-aef0-1c79e7408ce4 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:33.256015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:33.256979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:33.257397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:33.257824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:33.258854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:33.269123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:33.281568 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3870/7726] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:20:33.285558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:33.297379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06a804-9282-4439-836b-3d71129b3274 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:33.304162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2baf4f-138c-4c2f-a1e0-47d2b38867ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:33.304976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2baf4f-138c-4c2f-a1e0-47d2b38867ce admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:33.305341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2baf4f-138c-4c2f-a1e0-47d2b38867ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:33.305701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2baf4f-138c-4c2f-a1e0-47d2b38867ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:33.306769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2baf4f-138c-4c2f-a1e0-47d2b38867ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:33.308544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2baf4f-138c-4c2f-a1e0-47d2b38867ce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:33.325287 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3857/7727] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:20:33.326004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:33.339096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e903294-4e7c-4864-a58a-719cfccd4491 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:33.344822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:33.346575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:33.346980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:33.347415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] PATH_INFO: `/v3/projects/047c7246f2c8446780f2225b6289c287/users/8d61ef3f1bb64df6b751965135b6fdf5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:33.369172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=047c7246f2c8446780f2225b6289c287, user_id=8d61ef3f1bb64df6b751965135b6fdf5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:33.372952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:33.403919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:33.404373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:33.404787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:33.411095 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3871/7728] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:20:33 2022] PUT /identity/v3/projects/047c7246f2c8446780f2225b6289c287/users/8d61ef3f1bb64df6b751965135b6fdf5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:20:33.440142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] MFA Rules not processed for user `8d61ef3f1bb64df6b751965135b6fdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:33.441574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:33.549908 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3858/7729] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:33.562463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:33.634698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6f28-26f8-4e6e-a2d2-010a0a8d5a57 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:33.639145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:33.640020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:33.640411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:33.640867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:33.650573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:33.652393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:33.669552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3872/7730] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:34.356322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:34.357783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:34.384694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084da7d-74be-4d84-92fa-2279029debe4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:34.389573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9ef4a-0dda-4f36-8e76-3f945350f220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:34.390255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ef4a-0dda-4f36-8e76-3f945350f220 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:34.390541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ef4a-0dda-4f36-8e76-3f945350f220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:34.390820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ef4a-0dda-4f36-8e76-3f945350f220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:34.397688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ca9ef4a-0dda-4f36-8e76-3f945350f220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:34.524764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9ef4a-0dda-4f36-8e76-3f945350f220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:34.526780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9ef4a-0dda-4f36-8e76-3f945350f220 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:34.569912 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3859/7731] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:43.658685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=54,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:44.550212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:45.745664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:45.979309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5cf76-ed94-4edc-aea5-7e2028b4ed30 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:45.986555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:45.987635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:45.987904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:45.988184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] PATH_INFO: `/v3/users/8d61ef3f1bb64df6b751965135b6fdf5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:46.000641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d61ef3f1bb64df6b751965135b6fdf5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:46.004981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:46.118488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d61ef3f1bb64df6b751965135b6fdf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:46.171807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d61ef3f1bb64df6b751965135b6fdf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:46.188775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d61ef3f1bb64df6b751965135b6fdf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:46.191326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d61ef3f1bb64df6b751965135b6fdf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:46.216840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d61ef3f1bb64df6b751965135b6fdf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:46.238220 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3873/7732] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:20:45 2022] DELETE /identity/v3/users/8d61ef3f1bb64df6b751965135b6fdf5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:46.240262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:46.240944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:46.242831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:46.300247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:46.301569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:46.495946 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3860/7733] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:20:46.501837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:46.503544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:46.664223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51697f-d98f-4683-b4d9-df2768f3e5f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:46.669580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ff628-5a48-4747-81dc-5cc05d562f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:46.670466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff628-5a48-4747-81dc-5cc05d562f10 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:46.670766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff628-5a48-4747-81dc-5cc05d562f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:46.671063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff628-5a48-4747-81dc-5cc05d562f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:46.693601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ff628-5a48-4747-81dc-5cc05d562f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:46.695731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ff628-5a48-4747-81dc-5cc05d562f10 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:46.710006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3874/7734] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:47.067354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:47.069814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:47.101911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79924b4f-33e8-44a9-a058-ce35d7cfe196 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:47.113557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:47.114493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:47.114726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:47.115012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] PATH_INFO: `/v3/projects/047c7246f2c8446780f2225b6289c287` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:47.117099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] RBAC: Authorizing `identity:delete_project(project_id=047c7246f2c8446780f2225b6289c287)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:47.119370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:47.219040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047c7246f2c8446780f2225b6289c287', 'request_id': 'req-510ff7de-0fa9-4b2d-bddf-c1608362624a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:47.237916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047c7246f2c8446780f2225b6289c287', 'request_id': 'req-510ff7de-0fa9-4b2d-bddf-c1608362624a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:47.246872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047c7246f2c8446780f2225b6289c287', 'request_id': 'req-510ff7de-0fa9-4b2d-bddf-c1608362624a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:47.280820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] The token cache is being invalidate because project 047c7246f2c8446780f2225b6289c287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:20:47.281187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:47.283490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-510ff7de-0fa9-4b2d-bddf-c1608362624a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:20:47.289421 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3861/7735] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:20:47 2022] DELETE /identity/v3/projects/047c7246f2c8446780f2225b6289c287 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:20:47.297741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d330ba6-be48-4812-a87a-a4d632bd5b79 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:47.297741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d330ba6-be48-4812-a87a-a4d632bd5b79 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:47.298458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d330ba6-be48-4812-a87a-a4d632bd5b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:47.336726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0d330ba6-be48-4812-a87a-a4d632bd5b79 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:47.343113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d330ba6-be48-4812-a87a-a4d632bd5b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:47.435848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:47.591733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3875/7736] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:47.600171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109ae27-1ff2-481d-a2eb-f38c88cbe253 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:47.600461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109ae27-1ff2-481d-a2eb-f38c88cbe253 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:47.601343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109ae27-1ff2-481d-a2eb-f38c88cbe253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:47.646077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7109ae27-1ff2-481d-a2eb-f38c88cbe253 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:47.646863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7109ae27-1ff2-481d-a2eb-f38c88cbe253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:47.678875 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3862/7737] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:47.680669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d330ba6-be48-4812-a87a-a4d632bd5b79 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:47.694962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d330ba6-be48-4812-a87a-a4d632bd5b79 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:47.718538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:47.719640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:47.720138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:47.722599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:47.723890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:20:47.724419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:47.726654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:47.773288 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3876/7738] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:20:47.774750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109ae27-1ff2-481d-a2eb-f38c88cbe253 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:47.790111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109ae27-1ff2-481d-a2eb-f38c88cbe253 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:47.805291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:47.806472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:47.807033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:47.807525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:47.808710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:47.812773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:47.886279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:47.887207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3863/7739] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:20:47 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:20:47.901498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc970b-eb7b-4863-a010-6ae1178b0bad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:48.094205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:48.095694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:48.096334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:48.098309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:48.107458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:48.109335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:48.181633 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3877/7740] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:20:47 2022] POST /identity/v3/users => generated 287 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:20:48.187150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:48.217280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433ce4-da11-4b99-8280-5e68de03bebd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:48.234203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:48.235561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:48.236158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:48.236510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:48.237736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:48.253397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:48.287313 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3864/7741] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:20:48.289066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:48.323994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9852e-553d-4c44-b446-3cf9f04832a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:48.347352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccde645-a498-43ad-b020-255c7028c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:48.348692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccde645-a498-43ad-b020-255c7028c81c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:48.349296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccde645-a498-43ad-b020-255c7028c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:48.353742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccde645-a498-43ad-b020-255c7028c81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:48.355382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccde645-a498-43ad-b020-255c7028c81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:48.367144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccde645-a498-43ad-b020-255c7028c81c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:48.400916 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3878/7742] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:20:48.412929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:48.443374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d5980-8fd2-48a5-88a6-adca39fd146c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:48.468397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:48.470199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:48.470790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:48.471346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] PATH_INFO: `/v3/projects/666df7fd9e754e36b8143a3645ccc1d8/users/7201c706d7cc47f1a1fd8d9dd16cccec/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:48.512007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] RBAC: Authorizing `identity:create_grant(project_id=666df7fd9e754e36b8143a3645ccc1d8, user_id=7201c706d7cc47f1a1fd8d9dd16cccec, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:48.515918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:48.547627 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3865/7743] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:20:48 2022] PUT /identity/v3/projects/666df7fd9e754e36b8143a3645ccc1d8/users/7201c706d7cc47f1a1fd8d9dd16cccec/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:20:48.557265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:48.558084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:48.559460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:48.656767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] MFA Rules not processed for user `7201c706d7cc47f1a1fd8d9dd16cccec`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:20:48.658490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:48.867603 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3879/7744] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:20:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:20:48.888114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:20:48.890790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:20:48.978103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:49.080642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35431d-829e-419a-a75d-e52be060469e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:20:49.088923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:20:49.091470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:20:49.091911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:20:49.092331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:20:49.112205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:20:49.114793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:20:49.143246 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3866/7745] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:20:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:20:58.864147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:59.127893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=17 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:12.096140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:12.099987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:12.149017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e04d5-d675-432b-9615-bae9cadccfb7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:12.159153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ee32e-a23a-43aa-be4c-2f5a142d823a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:12.160473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee32e-a23a-43aa-be4c-2f5a142d823a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:12.160935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee32e-a23a-43aa-be4c-2f5a142d823a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:12.161555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee32e-a23a-43aa-be4c-2f5a142d823a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:12.164478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df2ee32e-a23a-43aa-be4c-2f5a142d823a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:12.192970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ee32e-a23a-43aa-be4c-2f5a142d823a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:12.201268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ee32e-a23a-43aa-be4c-2f5a142d823a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:12.202106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:12.279799 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3880/7746] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:12.380433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88d2d3-d87a-4374-b85f-2f9164dc9c30 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:12.398656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:12.400802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:12.401219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:12.402518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] PATH_INFO: `/v3/users/7201c706d7cc47f1a1fd8d9dd16cccec` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:12.406215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7201c706d7cc47f1a1fd8d9dd16cccec)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:12.412316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:12.618987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7201c706d7cc47f1a1fd8d9dd16cccec'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:12.645389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7201c706d7cc47f1a1fd8d9dd16cccec'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:12.646471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7201c706d7cc47f1a1fd8d9dd16cccec'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:12.659083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7201c706d7cc47f1a1fd8d9dd16cccec'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:12.660076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7201c706d7cc47f1a1fd8d9dd16cccec'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:12.694914 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3867/7747] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:21:12 2022] DELETE /identity/v3/users/7201c706d7cc47f1a1fd8d9dd16cccec => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:21:12.700216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:12.700894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:12.701410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:12.773041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:12.773041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:12.933714 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3881/7748] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:12.947961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:12.949904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:13.041044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ed343-0a48-44db-ae06-bd70c427e11c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:13.046690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dfdef-1eee-4b0e-8421-ecab313bb47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:13.047845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfdef-1eee-4b0e-8421-ecab313bb47d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:13.048439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfdef-1eee-4b0e-8421-ecab313bb47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:13.049852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dfdef-1eee-4b0e-8421-ecab313bb47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:13.065328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dfdef-1eee-4b0e-8421-ecab313bb47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:13.067971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dfdef-1eee-4b0e-8421-ecab313bb47d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:13.083242 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3868/7749] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:13.583931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:13.586268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:13.605049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3571-f419-4eb1-b11e-d7a0f01ab9ea None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:13.631452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:13.632580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:13.632895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:13.633218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] PATH_INFO: `/v3/projects/666df7fd9e754e36b8143a3645ccc1d8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:13.645117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=666df7fd9e754e36b8143a3645ccc1d8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:13.650062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:13.763958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666df7fd9e754e36b8143a3645ccc1d8', 'request_id': 'req-80105569-6695-443a-9011-25e830f1c4ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:13.771801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666df7fd9e754e36b8143a3645ccc1d8', 'request_id': 'req-80105569-6695-443a-9011-25e830f1c4ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:13.780761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666df7fd9e754e36b8143a3645ccc1d8', 'request_id': 'req-80105569-6695-443a-9011-25e830f1c4ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:13.798812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] The token cache is being invalidate because project 666df7fd9e754e36b8143a3645ccc1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:21:13.798812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:13.799558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80105569-6695-443a-9011-25e830f1c4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:13.805144 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3882/7750] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:21:13 2022] DELETE /identity/v3/projects/666df7fd9e754e36b8143a3645ccc1d8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:13.807871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063de9a-9b9e-4c90-bfeb-b2fbc65a92ff None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:13.808359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063de9a-9b9e-4c90-bfeb-b2fbc65a92ff None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:13.808541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063de9a-9b9e-4c90-bfeb-b2fbc65a92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:13.830791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0063de9a-9b9e-4c90-bfeb-b2fbc65a92ff None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:13.832107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0063de9a-9b9e-4c90-bfeb-b2fbc65a92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:13.852475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:13.909129 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3869/7751] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:13.918219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996889-22d1-48a0-bb07-1d82785a5ef0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:13.918518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996889-22d1-48a0-bb07-1d82785a5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:13.918805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996889-22d1-48a0-bb07-1d82785a5ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:13.944386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13996889-22d1-48a0-bb07-1d82785a5ef0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:13.946334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13996889-22d1-48a0-bb07-1d82785a5ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:13.964463 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3883/7752] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:13.966429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063de9a-9b9e-4c90-bfeb-b2fbc65a92ff None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:13.987680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063de9a-9b9e-4c90-bfeb-b2fbc65a92ff None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:13.993275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:13.994038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:13.994335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:13.994617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:13.995510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:21:13.996093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:13.999979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:14.021495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13996889-22d1-48a0-bb07-1d82785a5ef0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:14.030898 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3870/7753] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:21:14.039477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13996889-22d1-48a0-bb07-1d82785a5ef0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:14.050708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:14.051929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:14.052228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:14.052566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:14.054455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:14.058074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:14.132764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:14.146079 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3884/7754] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:21:14 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:14.169573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d4b1-4974-4f93-9ab2-74278f6e942d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:14.253810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:14.257621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:14.257974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:14.258274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:14.259154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:14.262434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:14.297262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:14.311329 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3871/7755] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:21:14 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:14.314147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb17de-bb12-41f5-aeae-ea6470b2ac0a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:14.327610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:14.328338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:14.328629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:14.328917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:14.329793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:14.332314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:14.349307 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3885/7756] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:14.354699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:14.369716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598fcb-0a64-425c-9aee-ac76679c367b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:14.375757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f30e77-a6b4-4f1e-8855-cd7acc4a8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:14.376812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f30e77-a6b4-4f1e-8855-cd7acc4a8370 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:14.377268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f30e77-a6b4-4f1e-8855-cd7acc4a8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:14.377867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f30e77-a6b4-4f1e-8855-cd7acc4a8370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:14.378861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f30e77-a6b4-4f1e-8855-cd7acc4a8370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:14.380839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f30e77-a6b4-4f1e-8855-cd7acc4a8370 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:14.395059 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3872/7757] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:14.401215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:14.415476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640122f-d9fb-43f8-bbec-c82d59cecf08 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:14.424152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:14.425533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:14.426027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:14.426682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] PATH_INFO: `/v3/projects/5c206a7dac8e47508420d73d2bf79f31/users/0736ebe2d750429da2cb05e1a080cb59/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:14.449122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c206a7dac8e47508420d73d2bf79f31, user_id=0736ebe2d750429da2cb05e1a080cb59, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:14.452827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:14.487000 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3886/7758] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:14 2022] PUT /identity/v3/projects/5c206a7dac8e47508420d73d2bf79f31/users/0736ebe2d750429da2cb05e1a080cb59/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:14.490375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:14.491283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:14.491599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:14.526638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] MFA Rules not processed for user `0736ebe2d750429da2cb05e1a080cb59`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:14.528423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:14.618021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3873/7759] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:14.628653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:14.631519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:14.659578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:14.811977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab489b1-f8c8-4957-862e-74ade925df4d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:14.817237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d587c-704b-43bc-a29c-8c928f560d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:14.817932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d587c-704b-43bc-a29c-8c928f560d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:14.818218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d587c-704b-43bc-a29c-8c928f560d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:14.818499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d587c-704b-43bc-a29c-8c928f560d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:14.835662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d587c-704b-43bc-a29c-8c928f560d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:14.837257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d587c-704b-43bc-a29c-8c928f560d45 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:14.859144 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3887/7760] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:24.616125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:24.844307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=23 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:26.001950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:26.005768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:26.259948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b52e3-b706-4aa3-9fc8-21470e65b93b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:26.299906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:26.301693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:26.301991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:26.302277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] PATH_INFO: `/v3/users/8e7b038154ce492b95f136bb07fa84d5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:26.310307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7b038154ce492b95f136bb07fa84d5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:26.333350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:26.560450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7b038154ce492b95f136bb07fa84d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:26.601355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7b038154ce492b95f136bb07fa84d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:26.604437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7b038154ce492b95f136bb07fa84d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:26.631192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7b038154ce492b95f136bb07fa84d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:26.632465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7b038154ce492b95f136bb07fa84d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:26.690243 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3874/7761] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:21:25 2022] DELETE /identity/v3/users/8e7b038154ce492b95f136bb07fa84d5 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:26.702412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:26.702938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:26.703457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:26.771119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:26.776442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:27.021579 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3888/7762] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:27.033376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:27.035452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:27.253552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e0d6-3ff8-4773-a48b-810354f2374f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:27.261946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53b921-f3d6-4886-bcdf-8d70a1c1f413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:27.268969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b921-f3d6-4886-bcdf-8d70a1c1f413 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:27.268969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b921-f3d6-4886-bcdf-8d70a1c1f413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:27.269406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b921-f3d6-4886-bcdf-8d70a1c1f413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:27.290657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53b921-f3d6-4886-bcdf-8d70a1c1f413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:27.296383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53b921-f3d6-4886-bcdf-8d70a1c1f413 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:27.324583 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3875/7763] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:27.818975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:27.820769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:27.841803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336ad40-2f6a-4082-ac74-a06f9082f8f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:27.851860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:27.853075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:27.854859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:27.855308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] PATH_INFO: `/v3/projects/1cf974d7640942eaa30703bad59896ca` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:27.860707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf974d7640942eaa30703bad59896ca)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:27.864363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:27.976093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf974d7640942eaa30703bad59896ca', 'request_id': 'req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:27.987476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf974d7640942eaa30703bad59896ca', 'request_id': 'req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:27.999502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf974d7640942eaa30703bad59896ca', 'request_id': 'req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:28.028780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] The token cache is being invalidate because project 1cf974d7640942eaa30703bad59896ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:21:28.029458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:28.030491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6e021456-9717-4bc8-b4c3-aebf1d8bbdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:28.037186 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3889/7764] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:21:27 2022] DELETE /identity/v3/projects/1cf974d7640942eaa30703bad59896ca => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:28.039375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f68ba-2018-4e25-95a5-c2fe07a5207b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.040711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f68ba-2018-4e25-95a5-c2fe07a5207b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.041371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f68ba-2018-4e25-95a5-c2fe07a5207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.065276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cd9f68ba-2018-4e25-95a5-c2fe07a5207b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:28.066986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd9f68ba-2018-4e25-95a5-c2fe07a5207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:28.093850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:28.172514 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3876/7765] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:28.173930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981dcf-813d-49a7-9772-b997b3c13d47 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.174234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981dcf-813d-49a7-9772-b997b3c13d47 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.174519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981dcf-813d-49a7-9772-b997b3c13d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.209216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2a981dcf-813d-49a7-9772-b997b3c13d47 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:28.210675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a981dcf-813d-49a7-9772-b997b3c13d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:28.224612 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3890/7766] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:28.229658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f68ba-2018-4e25-95a5-c2fe07a5207b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:28.245646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f68ba-2018-4e25-95a5-c2fe07a5207b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:28.251071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:28.252199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.252740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.253269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.254265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:21:28.254861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:28.256943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:28.278326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3877/7767] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:21:28.280238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a981dcf-813d-49a7-9772-b997b3c13d47 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:28.294462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a981dcf-813d-49a7-9772-b997b3c13d47 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:28.305972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:28.306835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.308221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.308782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.310510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:28.331557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:28.379375 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3891/7768] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:21:28 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:28.381711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:28.394912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572dab0-99d5-448b-a28f-b959d9bc2e97 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:28.522849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:28.524670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.525217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.526042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.527197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:28.530111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:28.571132 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3878/7769] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:21:28 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:28.575692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:28.596385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bf305-baf7-4d02-9407-b2bdb9e16f16 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:28.617070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:28.618213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.619762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.621242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.622202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:28.626789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:28.658209 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3892/7770] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:28.662156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:28.692977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfaf477-b270-4c0c-a235-b5a16a7d3c0a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:28.700123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8bad7-41bc-48b3-9f29-613c6bffd65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:28.701913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8bad7-41bc-48b3-9f29-613c6bffd65f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.702623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8bad7-41bc-48b3-9f29-613c6bffd65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.703709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8bad7-41bc-48b3-9f29-613c6bffd65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.719192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8bad7-41bc-48b3-9f29-613c6bffd65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:28.726110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8bad7-41bc-48b3-9f29-613c6bffd65f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:28.783894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:28.785342 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3879/7771] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:28.802776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864727-5b4a-4ba0-8f8b-9b75a867708a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:28.829314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:28.830373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.830734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.831177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] PATH_INFO: `/v3/projects/9aa7d852c314425ca4a565da7b4ba6ba/users/27228b960d0247a8b737dcaa137dc44b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:28.885422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa7d852c314425ca4a565da7b4ba6ba, user_id=27228b960d0247a8b737dcaa137dc44b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:28.889201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:28.956224 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3893/7772] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:28 2022] PUT /identity/v3/projects/9aa7d852c314425ca4a565da7b4ba6ba/users/27228b960d0247a8b737dcaa137dc44b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:28.975701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771652b-96e6-438a-9ee6-c485e2f59cf9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:28.976326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771652b-96e6-438a-9ee6-c485e2f59cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:28.978718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771652b-96e6-438a-9ee6-c485e2f59cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:29.050867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0771652b-96e6-438a-9ee6-c485e2f59cf9 None None] MFA Rules not processed for user `27228b960d0247a8b737dcaa137dc44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:29.052154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0771652b-96e6-438a-9ee6-c485e2f59cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:29.212005 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3880/7773] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:29.216881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:29.275024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:29.357051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7e52-cea0-49ea-85be-528ee9340678 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:29.372659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:29.374028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:29.374325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:29.374612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:29.375359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:29.381682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:29.438794 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3894/7774] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:21:29 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:29.440080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771652b-96e6-438a-9ee6-c485e2f59cf9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:29.459962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771652b-96e6-438a-9ee6-c485e2f59cf9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:29.494507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:29.607843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:29.608724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:29.609110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:29.613260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:29.614148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:29.623237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:29.679055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3881/7775] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:21:29 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:29.680550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:29.700130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6295f8a-2957-439b-a640-a98fbff22ec0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:29.711159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:29.711834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:29.712131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:29.712420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:29.713172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:29.715356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:29.740916 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3895/7776] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:29.742040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:29.758462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4442480-23f7-4d49-93d1-9fb3a4ff5880 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:29.773978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:29.774912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:29.775245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:29.776361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] PATH_INFO: `/v3/projects/4954c033fbd9421fb02e9d14172889cf/users/963897e593404da7a7eec44b4585716f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:29.818347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4954c033fbd9421fb02e9d14172889cf, user_id=963897e593404da7a7eec44b4585716f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:29.821532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:29.858986 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3882/7777] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:29 2022] PUT /identity/v3/projects/4954c033fbd9421fb02e9d14172889cf/users/963897e593404da7a7eec44b4585716f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:29.859830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:29.874352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d798779-794e-4ee2-ac26-a35016d39c09 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:29.983828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eb64f-8ea9-4555-a350-0dcd83705546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:29.985496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eb64f-8ea9-4555-a350-0dcd83705546 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:29.986199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eb64f-8ea9-4555-a350-0dcd83705546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:29.986706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eb64f-8ea9-4555-a350-0dcd83705546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:29.987754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eb64f-8ea9-4555-a350-0dcd83705546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:29.990091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eb64f-8ea9-4555-a350-0dcd83705546 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:30.015182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:30.024049 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3896/7778] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:21:30.040465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f2764-b5fb-4b47-837d-2b5f03e1ad3a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:30.059175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:30.060383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:30.060911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:30.061274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] PATH_INFO: `/v3/projects/4954c033fbd9421fb02e9d14172889cf/users/963897e593404da7a7eec44b4585716f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:30.063501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4954c033fbd9421fb02e9d14172889cf, user_id=963897e593404da7a7eec44b4585716f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:30.074852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:30.128434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34209493-e205-4d54-b068-0cf27d5ff659 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:30.134756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34209493-e205-4d54-b068-0cf27d5ff659 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:30.134756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34209493-e205-4d54-b068-0cf27d5ff659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:30.136079 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3883/7779] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:30 2022] PUT /identity/v3/projects/4954c033fbd9421fb02e9d14172889cf/users/963897e593404da7a7eec44b4585716f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:21:30.165687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-34209493-e205-4d54-b068-0cf27d5ff659 None None] MFA Rules not processed for user `963897e593404da7a7eec44b4585716f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:30.167683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34209493-e205-4d54-b068-0cf27d5ff659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:30.319012 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3897/7780] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:30.340535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:30.344078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:30.555618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16ff9-d8ca-4c3a-9dd6-426a2a0affcb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:30.560765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:30.561712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:30.562195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:30.562649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:30.575312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:30.577543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:30.608638 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3884/7781] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:30.795525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34209493-e205-4d54-b068-0cf27d5ff659 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:30.840721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34209493-e205-4d54-b068-0cf27d5ff659 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:30.872860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:30.877709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:30.883198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:30.883198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:30.950231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:31.027454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:31.029082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:31.040541 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3898/7782] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:39.261428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:39.267133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:39.485664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7dd2-c4a6-489f-917a-b2cf76ed09de service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:39.492576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36824b95-5452-4695-8628-54b801842ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:39.493463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824b95-5452-4695-8628-54b801842ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:39.498117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824b95-5452-4695-8628-54b801842ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:39.498581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824b95-5452-4695-8628-54b801842ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:39.504555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-36824b95-5452-4695-8628-54b801842ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:39.536595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36824b95-5452-4695-8628-54b801842ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:39.538298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36824b95-5452-4695-8628-54b801842ffc service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:39.578250 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3885/7783] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:41.035170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=21 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:47.571083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:47.573997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:47.696363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515414ea-98ac-40f3-9d45-9d1e9e5787ce service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:47.701619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:47.702809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:47.703304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:47.703757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] PATH_INFO: `/v3/users/0736ebe2d750429da2cb05e1a080cb59` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:47.705228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0736ebe2d750429da2cb05e1a080cb59)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:47.707462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:47.785090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0736ebe2d750429da2cb05e1a080cb59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:47.800095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0736ebe2d750429da2cb05e1a080cb59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:47.819984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0736ebe2d750429da2cb05e1a080cb59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:47.820930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0736ebe2d750429da2cb05e1a080cb59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:47.836458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0736ebe2d750429da2cb05e1a080cb59'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:47.849304 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3899/7784] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:21:47 2022] DELETE /identity/v3/users/0736ebe2d750429da2cb05e1a080cb59 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:47.854744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10abcb5-ed72-4cb5-82ca-bf1273541cbb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:47.855822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10abcb5-ed72-4cb5-82ca-bf1273541cbb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:47.856337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10abcb5-ed72-4cb5-82ca-bf1273541cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:47.884899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:47.909719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c10abcb5-ed72-4cb5-82ca-bf1273541cbb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:47.910973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c10abcb5-ed72-4cb5-82ca-bf1273541cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:47.999826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3886/7785] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:48.008147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:48.010170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:48.169252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acdaf6-5063-44fe-8253-c78e4e7eba77 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:48.182150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:48.182859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:48.183150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:48.183498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:48.209351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:48.212652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:48.235400 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3900/7786] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:48.951025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b74159-485e-447f-b893-c58efc099f86 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:48.951538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b74159-485e-447f-b893-c58efc099f86 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:48.951780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b74159-485e-447f-b893-c58efc099f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:48.956547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:48.958735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:48.978165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bd188-9616-49eb-916c-c318ff06f197 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:48.993598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:48.995673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:48.996224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:48.996759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] PATH_INFO: `/v3/projects/5c206a7dac8e47508420d73d2bf79f31` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:48.998588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c206a7dac8e47508420d73d2bf79f31)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:49.002645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:49.011938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-59b74159-485e-447f-b893-c58efc099f86 None None] MFA Rules not processed for user `7a00a929a3dd4608961f50265fd35caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:49.013182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-59b74159-485e-447f-b893-c58efc099f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:49.028912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:49.107705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c206a7dac8e47508420d73d2bf79f31', 'request_id': 'req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:49.121608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c206a7dac8e47508420d73d2bf79f31', 'request_id': 'req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:49.131071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c206a7dac8e47508420d73d2bf79f31', 'request_id': 'req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:49.157859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] The token cache is being invalidate because project 5c206a7dac8e47508420d73d2bf79f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:21:49.160823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:49.162602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b84e48dd-5c19-4a7d-a4b9-13ebe3841cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:49.165268 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3901/7787] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:21:48 2022] DELETE /identity/v3/projects/5c206a7dac8e47508420d73d2bf79f31 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:49.182694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad323f-9511-424a-ad8a-3660aaa726ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:49.184124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad323f-9511-424a-ad8a-3660aaa726ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:49.184794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad323f-9511-424a-ad8a-3660aaa726ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:49.216649 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3887/7788] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:49.259791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c1ad323f-9511-424a-ad8a-3660aaa726ab None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:49.262836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c1ad323f-9511-424a-ad8a-3660aaa726ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:49.379901 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3902/7789] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:49.388710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9637-6498-4389-b259-750b27f2738a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:49.389379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9637-6498-4389-b259-750b27f2738a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:49.390024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9637-6498-4389-b259-750b27f2738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:49.422253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6cee9637-6498-4389-b259-750b27f2738a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:49.423882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6cee9637-6498-4389-b259-750b27f2738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:49.434461 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3888/7790] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:49.439252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad323f-9511-424a-ad8a-3660aaa726ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:49.453907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad323f-9511-424a-ad8a-3660aaa726ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:49.489997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:49.490809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:49.491202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:49.491665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:49.503543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:21:49.504198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:49.508539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:49.579089 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3903/7791] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:21:49.583677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9637-6498-4389-b259-750b27f2738a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:49.614840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9637-6498-4389-b259-750b27f2738a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:49.649548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:49.652425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:49.655349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:49.656438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:49.657724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:49.661460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:49.721668 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3889/7792] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:21:49 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:49.730282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:49.777955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2239-8e0a-4893-b43c-de890c6fe062 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:49.968193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:49.969021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:49.969415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:49.972661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:49.979505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:49.986977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:50.006101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:50.011565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:50.037084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eafc2-5f07-428f-b04c-aa08994aa75d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:50.049289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:50.050427 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3904/7793] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:21:49 2022] POST /identity/v3/users => generated 291 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:50.050704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:50.051165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:50.051662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] PATH_INFO: `/v3/users/27228b960d0247a8b737dcaa137dc44b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:50.053198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27228b960d0247a8b737dcaa137dc44b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:50.055663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:50.055972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:50.099377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc1a7-b125-4b29-ada3-0233281526c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:50.120965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:50.126025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:50.126326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:50.126622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:50.127446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:50.130349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:50.153864 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3905/7794] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:50.159848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:50.162180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27228b960d0247a8b737dcaa137dc44b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:50.194399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e84f-de40-45bb-8ae3-b4bfbe2f1abb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:50.194917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27228b960d0247a8b737dcaa137dc44b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:50.196397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27228b960d0247a8b737dcaa137dc44b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:50.212308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27228b960d0247a8b737dcaa137dc44b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:50.213114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:50.213696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2cccf4d5-3439-42e0-b7c2-619e83fd2460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27228b960d0247a8b737dcaa137dc44b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:50.213829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:50.214186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:50.214398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:50.215201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:50.225869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:50.229908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:50.252572 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3890/7795] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:21:50 2022] DELETE /identity/v3/users/27228b960d0247a8b737dcaa137dc44b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:50.254803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:50.255208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:50.255699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:50.260951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:50.276430 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3906/7796] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:50.288503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:50.292511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:50.293761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:50.296111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:50.330087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914718ad-2221-4168-9bd1-91b69b219aa4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:50.444984 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3891/7797] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:21:50.455915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:50.458326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:50.502056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a367a-3a07-47da-b60a-60f1212dfc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:50.503534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a367a-3a07-47da-b60a-60f1212dfc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:50.504374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a367a-3a07-47da-b60a-60f1212dfc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:50.506970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a367a-3a07-47da-b60a-60f1212dfc34 admin admin] PATH_INFO: `/v3/projects/dc0703e1bf9049abaf7c7381d30d0ac8/users/74655ae69fc04877af8063e52004f9f5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:50.555602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a367a-3a07-47da-b60a-60f1212dfc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0703e1bf9049abaf7c7381d30d0ac8, user_id=74655ae69fc04877af8063e52004f9f5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:50.561793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a367a-3a07-47da-b60a-60f1212dfc34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:50.614390 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3907/7798] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:50 2022] PUT /identity/v3/projects/dc0703e1bf9049abaf7c7381d30d0ac8/users/74655ae69fc04877af8063e52004f9f5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:50.617392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3f65-b9e5-405f-a969-d89e317526ee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:50.619607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3f65-b9e5-405f-a969-d89e317526ee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:50.620024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3f65-b9e5-405f-a969-d89e317526ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:50.648599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05bdd-e8fd-45f7-8ba4-ad57679f5dc8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:50.746392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a40b3f65-b9e5-405f-a969-d89e317526ee None None] MFA Rules not processed for user `74655ae69fc04877af8063e52004f9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:50.746392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a40b3f65-b9e5-405f-a969-d89e317526ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:50.932994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:50.943391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:50.943751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:50.948299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:51.080677 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3908/7799] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:51.094795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b3f65-b9e5-405f-a969-d89e317526ee None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:51.118540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b3f65-b9e5-405f-a969-d89e317526ee None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:51.128125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:51.128811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:51.129100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:51.129379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:51.150512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:51.157626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:51.160863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:51.164635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:51.185938 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3909/7800] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:51.186188 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3892/7801] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:52.162661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:52.165135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:52.197139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc3d1-cd4c-432b-9c49-0adfa3624733 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:52.218703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:52.219642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:52.219919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:52.220194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] PATH_INFO: `/v3/projects/9aa7d852c314425ca4a565da7b4ba6ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:52.223045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa7d852c314425ca4a565da7b4ba6ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:52.226537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:52.334131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa7d852c314425ca4a565da7b4ba6ba', 'request_id': 'req-d7e7a51d-17a9-4854-b27d-27727e1dc012'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.342736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:52.346210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa7d852c314425ca4a565da7b4ba6ba', 'request_id': 'req-d7e7a51d-17a9-4854-b27d-27727e1dc012'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.359523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa7d852c314425ca4a565da7b4ba6ba', 'request_id': 'req-d7e7a51d-17a9-4854-b27d-27727e1dc012'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.392652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] The token cache is being invalidate because project 9aa7d852c314425ca4a565da7b4ba6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:21:52.392992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.393648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.398347 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3910/7802] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:21:52 2022] DELETE /identity/v3/projects/9aa7d852c314425ca4a565da7b4ba6ba => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:52.399905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:52.408157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:52.418544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c353453-49de-4168-8991-622560f7bc35 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:52.506090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:52.508443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:52.509594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:52.510386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] PATH_INFO: `/v3/users/963897e593404da7a7eec44b4585716f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:52.513483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963897e593404da7a7eec44b4585716f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:52.517978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:52.624392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963897e593404da7a7eec44b4585716f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.646050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963897e593404da7a7eec44b4585716f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.646885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963897e593404da7a7eec44b4585716f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.658962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963897e593404da7a7eec44b4585716f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.660304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f47e585-11e5-4f11-98f5-57931c720e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963897e593404da7a7eec44b4585716f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:52.695246 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3893/7803] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:21:52 2022] DELETE /identity/v3/users/963897e593404da7a7eec44b4585716f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:53.492421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:53.494513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:53.531216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7a51d-17a9-4854-b27d-27727e1dc012 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:53.699964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:53.700875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:53.701156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:53.701587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] PATH_INFO: `/v3/projects/4954c033fbd9421fb02e9d14172889cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:53.703063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4954c033fbd9421fb02e9d14172889cf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:53.705383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:53.849597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4954c033fbd9421fb02e9d14172889cf', 'request_id': 'req-838dfb1e-f07f-491e-a497-c13793438abd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:53.867840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4954c033fbd9421fb02e9d14172889cf', 'request_id': 'req-838dfb1e-f07f-491e-a497-c13793438abd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:53.878792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4954c033fbd9421fb02e9d14172889cf', 'request_id': 'req-838dfb1e-f07f-491e-a497-c13793438abd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:53.906154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] The token cache is being invalidate because project 4954c033fbd9421fb02e9d14172889cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:21:53.906470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:53.908050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-838dfb1e-f07f-491e-a497-c13793438abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:53.911455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3911/7804] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:21:53 2022] DELETE /identity/v3/projects/4954c033fbd9421fb02e9d14172889cf => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:53.917137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acd2b6-c1cc-48cc-ab5d-023ea2d48a78 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:53.917637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acd2b6-c1cc-48cc-ab5d-023ea2d48a78 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:53.917707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acd2b6-c1cc-48cc-ab5d-023ea2d48a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:53.987857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e1acd2b6-c1cc-48cc-ab5d-023ea2d48a78 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:53.989099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e1acd2b6-c1cc-48cc-ab5d-023ea2d48a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:54.158739 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3894/7805] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:21:54.167441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571cac5-03ce-4114-aeda-db2f9c115267 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:54.167813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571cac5-03ce-4114-aeda-db2f9c115267 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:54.168173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571cac5-03ce-4114-aeda-db2f9c115267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:54.194277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d571cac5-03ce-4114-aeda-db2f9c115267 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:54.195889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d571cac5-03ce-4114-aeda-db2f9c115267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:54.207261 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3912/7806] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:54.211489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acd2b6-c1cc-48cc-ab5d-023ea2d48a78 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:54.238126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acd2b6-c1cc-48cc-ab5d-023ea2d48a78 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:54.258005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:54.259040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:54.259471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:54.259762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:54.260524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:21:54.279863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:54.288892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:54.334617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3895/7807] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:21:54.338982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571cac5-03ce-4114-aeda-db2f9c115267 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:54.356598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571cac5-03ce-4114-aeda-db2f9c115267 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:54.373202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:54.373905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:54.374194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:54.374477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:54.375200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:54.379779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:54.444094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3913/7808] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:21:54 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:21:54.448975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:54.464368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd8444-8d2f-496d-b725-0ed847f47a87 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:54.475750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:54.622175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:54.624403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:54.625400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:54.625400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:54.627243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:54.632637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:54.686172 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3896/7809] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:21:54 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:54.689829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:54.708685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37503e3-16df-4495-8626-3e801b5c5bc6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:54.725377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:54.726309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:54.726596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:54.726931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:54.728382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:54.733076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:54.767121 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3914/7810] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:54.771053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:54.786547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452fdee-bfbc-4e13-b9a0-617ecbfa8a7d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:54.798630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba627ee-5b8f-4275-9128-ea634ea035d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:54.799093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba627ee-5b8f-4275-9128-ea634ea035d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:54.799522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba627ee-5b8f-4275-9128-ea634ea035d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:54.800743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba627ee-5b8f-4275-9128-ea634ea035d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:54.801753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba627ee-5b8f-4275-9128-ea634ea035d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:54.808010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba627ee-5b8f-4275-9128-ea634ea035d5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:54.839843 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3897/7811] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:54.842745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:54.858745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab985-ac8c-411d-a2a7-937756be7d81 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:54.874605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:54.875673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:54.876124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:54.876572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] PATH_INFO: `/v3/projects/acaef55a3b74441690d0fcc094c7c423/users/0db3555d73fe40a8bae666fdae594651/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:54.919835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaef55a3b74441690d0fcc094c7c423, user_id=0db3555d73fe40a8bae666fdae594651, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:54.923262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:54.958042 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3915/7812] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:54 2022] PUT /identity/v3/projects/acaef55a3b74441690d0fcc094c7c423/users/0db3555d73fe40a8bae666fdae594651/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:55.119870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e6ed-e3c2-4203-99a8-f804122ca5c3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:55.120367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e6ed-e3c2-4203-99a8-f804122ca5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:55.120466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e6ed-e3c2-4203-99a8-f804122ca5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:55.220778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1b92e6ed-e3c2-4203-99a8-f804122ca5c3 None None] MFA Rules not processed for user `0db3555d73fe40a8bae666fdae594651`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:55.222056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1b92e6ed-e3c2-4203-99a8-f804122ca5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:55.501765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:55.502561 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3898/7813] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:55.539577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:55.764206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f0ae9-15b2-4df5-b075-5c1e7302cdd6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:55.785699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:55.786453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:55.786905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:55.787378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:55.788285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:55.791166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:55.869155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92e6ed-e3c2-4203-99a8-f804122ca5c3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:55.869344 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3916/7814] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:21:55 2022] POST /identity/v3/projects => generated 365 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:55.894642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92e6ed-e3c2-4203-99a8-f804122ca5c3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:56.048395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:56.049197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:56.049485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:56.049762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:56.050470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:56.064590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:56.106826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3899/7815] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:21:55 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:21:56.111189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:56.128189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a878-52ea-403b-a364-d706b9985ba6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:56.136250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:56.137171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:56.137925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:56.139022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:56.140091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:56.142156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:56.164479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:56.165030 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3917/7816] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:56.201843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617637d-fd0e-4c36-9b5a-211a29ef9228 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:56.202504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:56.206114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:56.218386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:56.226509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:56.228073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:56.228380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] PATH_INFO: `/v3/projects/b5a08e20687a424ebbd082ed834ae79a/users/9ddd22899f4f411982d8c9785df96ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:56.237383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:56.282250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a08e20687a424ebbd082ed834ae79a, user_id=9ddd22899f4f411982d8c9785df96ff4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:56.285183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:56.314405 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3900/7817] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:56 2022] PUT /identity/v3/projects/b5a08e20687a424ebbd082ed834ae79a/users/9ddd22899f4f411982d8c9785df96ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:21:56.320811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:56.436034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c378ddf-2f12-44b6-8d96-e7521189fe5a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:56.559344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e474-8002-4ad8-8bda-906f1b50e9b5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:56.579338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:56.580675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:56.580967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:56.581252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:56.582013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:56.593309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:56.615081 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3901/7818] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:21:56.622284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:56.636418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:56.637149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:56.638803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:56.638803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:56.640813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:56.646880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ec483-75e6-4aef-a901-68db2f932a2e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:56.657802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50302459-d1d8-4225-9527-059f58f199b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:56.661594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50302459-d1d8-4225-9527-059f58f199b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:56.662721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50302459-d1d8-4225-9527-059f58f199b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:56.662959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50302459-d1d8-4225-9527-059f58f199b6 admin admin] PATH_INFO: `/v3/projects/b5a08e20687a424ebbd082ed834ae79a/users/9ddd22899f4f411982d8c9785df96ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:56.668065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50302459-d1d8-4225-9527-059f58f199b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a08e20687a424ebbd082ed834ae79a, user_id=9ddd22899f4f411982d8c9785df96ff4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:56.682060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50302459-d1d8-4225-9527-059f58f199b6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:56.747719 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3902/7819] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:21:56 2022] PUT /identity/v3/projects/b5a08e20687a424ebbd082ed834ae79a/users/9ddd22899f4f411982d8c9785df96ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:56.761296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb608c1-1773-4a08-91ac-d1c35379948a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:56.761590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb608c1-1773-4a08-91ac-d1c35379948a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:56.761878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb608c1-1773-4a08-91ac-d1c35379948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:56.885814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ddb608c1-1773-4a08-91ac-d1c35379948a None None] MFA Rules not processed for user `9ddd22899f4f411982d8c9785df96ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:56.888397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ddb608c1-1773-4a08-91ac-d1c35379948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:56.915012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:56.923060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:56.925066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:56.939644 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3918/7820] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:57.174715 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3903/7821] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:21:57.187598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:57.203924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb9c8-ee28-4d79-920e-cf16bc34160a service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:57.441735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b96678-be8e-4f05-a3a2-69566c291b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:57.442474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96678-be8e-4f05-a3a2-69566c291b33 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:57.442743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96678-be8e-4f05-a3a2-69566c291b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:57.443069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96678-be8e-4f05-a3a2-69566c291b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:57.480619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b96678-be8e-4f05-a3a2-69566c291b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:57.482387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b96678-be8e-4f05-a3a2-69566c291b33 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:57.524867 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3919/7822] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:21:58.632235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb608c1-1773-4a08-91ac-d1c35379948a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:58.925530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:59.018028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb608c1-1773-4a08-91ac-d1c35379948a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:59.051848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:59.053488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:59.053944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:59.054696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] PATH_INFO: `/v3/users/0db3555d73fe40a8bae666fdae594651` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:59.064530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db3555d73fe40a8bae666fdae594651)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:59.076660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:59.360774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db3555d73fe40a8bae666fdae594651'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:59.392454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db3555d73fe40a8bae666fdae594651'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:59.393282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db3555d73fe40a8bae666fdae594651'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:59.406655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db3555d73fe40a8bae666fdae594651'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:59.407503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db3555d73fe40a8bae666fdae594651'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:21:59.431690 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3904/7823] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:21:58 2022] DELETE /identity/v3/users/0db3555d73fe40a8bae666fdae594651 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:21:59.436396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:59.437395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:59.437861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:59.471538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:21:59.476933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:59.626781 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3920/7824] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:21:59.641338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:21:59.642000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:21:59.820176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260eddf-c2f1-49e1-87c8-3cadcc5e26c2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:21:59.825912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:21:59.826598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:21:59.826892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:21:59.827168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:21:59.854545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:21:59.856070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:21:59.869544 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3905/7825] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:00.822859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:00.824844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:00.900215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76c0c-2e9f-4342-8e00-1b45ee89f062 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:00.943153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:00.948927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:00.954156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:00.954778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] PATH_INFO: `/v3/projects/acaef55a3b74441690d0fcc094c7c423` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:00.958908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] RBAC: Authorizing `identity:delete_project(project_id=acaef55a3b74441690d0fcc094c7c423)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:00.961182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:01.156074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acaef55a3b74441690d0fcc094c7c423', 'request_id': 'req-648597c6-2d20-40cc-87bc-9e7cdc82689c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.165924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acaef55a3b74441690d0fcc094c7c423', 'request_id': 'req-648597c6-2d20-40cc-87bc-9e7cdc82689c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.175027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acaef55a3b74441690d0fcc094c7c423', 'request_id': 'req-648597c6-2d20-40cc-87bc-9e7cdc82689c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.207823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] The token cache is being invalidate because project acaef55a3b74441690d0fcc094c7c423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:01.212879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.212879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.220140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3921/7826] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:00 2022] DELETE /identity/v3/projects/acaef55a3b74441690d0fcc094c7c423 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:01.221306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:01.248029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd2991-b105-40df-9d98-007db18d4946 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:01.406523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:01.407813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:01.408206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:01.408592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] PATH_INFO: `/v3/users/9ddd22899f4f411982d8c9785df96ff4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:01.410742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddd22899f4f411982d8c9785df96ff4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:01.415677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:01.469804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:01.553737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddd22899f4f411982d8c9785df96ff4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.595962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddd22899f4f411982d8c9785df96ff4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.600026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddd22899f4f411982d8c9785df96ff4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.619124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddd22899f4f411982d8c9785df96ff4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.621687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17e86dc5-13d8-4429-8c30-c2265b41cd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddd22899f4f411982d8c9785df96ff4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:01.649407 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3906/7827] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:01 2022] DELETE /identity/v3/users/9ddd22899f4f411982d8c9785df96ff4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:02.422053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:02.424344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:02.480284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648597c6-2d20-40cc-87bc-9e7cdc82689c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:02.515157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:02.636465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:02.637603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:02.638030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:02.638474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] PATH_INFO: `/v3/projects/b5a08e20687a424ebbd082ed834ae79a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:02.640570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a08e20687a424ebbd082ed834ae79a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:02.644365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:02.733642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a08e20687a424ebbd082ed834ae79a', 'request_id': 'req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:02.749367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a08e20687a424ebbd082ed834ae79a', 'request_id': 'req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:02.760465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a08e20687a424ebbd082ed834ae79a', 'request_id': 'req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:02.780044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] The token cache is being invalidate because project b5a08e20687a424ebbd082ed834ae79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:02.780385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:02.781161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4be732e-ae3a-4f24-a06a-c3545e4c2a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:02.787679 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3922/7828] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:02 2022] DELETE /identity/v3/projects/b5a08e20687a424ebbd082ed834ae79a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:02.790678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba384-27f1-4e1f-819c-ba12f3336277 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:02.791159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba384-27f1-4e1f-819c-ba12f3336277 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:02.791316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba384-27f1-4e1f-819c-ba12f3336277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:02.838777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-46cba384-27f1-4e1f-819c-ba12f3336277 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:02.840831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46cba384-27f1-4e1f-819c-ba12f3336277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:02.927611 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3907/7829] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:02.928583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac308a-e3fb-4eb3-8ba0-91c293e25c58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:02.928879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac308a-e3fb-4eb3-8ba0-91c293e25c58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:02.929167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac308a-e3fb-4eb3-8ba0-91c293e25c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:02.954745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4bac308a-e3fb-4eb3-8ba0-91c293e25c58 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:02.956022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4bac308a-e3fb-4eb3-8ba0-91c293e25c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:02.970561 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3923/7830] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:02.972392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba384-27f1-4e1f-819c-ba12f3336277 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:02.984521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba384-27f1-4e1f-819c-ba12f3336277 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:02.990765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:02.992694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:02.993995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:02.994496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:02.995732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:02.996268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:02.998396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:03.024404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3908/7831] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:03.025226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac308a-e3fb-4eb3-8ba0-91c293e25c58 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:03.036863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac308a-e3fb-4eb3-8ba0-91c293e25c58 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:03.044834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:03.045921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:03.046211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:03.046504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:03.047337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:03.050462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:03.089733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3924/7832] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:03 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:03.097187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:03.123176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0305a31-3064-4170-9ec3-16ad0c38553f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:03.272614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:03.273249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:03.274054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:03.274340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:03.275722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:03.277788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:03.322831 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3909/7833] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:03 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:03.324744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:03.373646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea90213-0eb7-4a2b-a6c4-8142afdb6b14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:03.410924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:03.412470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:03.412666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:03.412803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:03.413706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:03.423633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:03.461340 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3925/7834] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:03.463007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:03.488411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6907e2f-c727-4eca-9a3e-1ad062fcbc54 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:03.528139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89d649-f422-49e2-9984-ec03f609e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:03.533119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d649-f422-49e2-9984-ec03f609e398 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:03.534943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d649-f422-49e2-9984-ec03f609e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:03.542693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d649-f422-49e2-9984-ec03f609e398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:03.550840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89d649-f422-49e2-9984-ec03f609e398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:03.558645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89d649-f422-49e2-9984-ec03f609e398 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:03.565405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:03.597616 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3910/7835] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:03.603675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:03.629405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dce2bc-6fef-4dad-9d61-32e136a07644 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:03.639757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:03.641057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:03.641543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:03.641960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] PATH_INFO: `/v3/projects/85be80ac09924033a886aba8c5c3fd35/users/7f903c9b5ed24ec1a93917a46e57151d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:03.697249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85be80ac09924033a886aba8c5c3fd35, user_id=7f903c9b5ed24ec1a93917a46e57151d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:03.700806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:03.736441 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3926/7836] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:03 2022] PUT /identity/v3/projects/85be80ac09924033a886aba8c5c3fd35/users/7f903c9b5ed24ec1a93917a46e57151d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:03.755611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46b6a-4774-40d4-920d-f499a9d4f681 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:03.756281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46b6a-4774-40d4-920d-f499a9d4f681 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:03.756730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46b6a-4774-40d4-920d-f499a9d4f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:03.831407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-87f46b6a-4774-40d4-920d-f499a9d4f681 None None] MFA Rules not processed for user `7f903c9b5ed24ec1a93917a46e57151d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:03.834872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-87f46b6a-4774-40d4-920d-f499a9d4f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:04.057781 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3911/7837] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:04.062459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:04.161399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:04.204217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c70721-a3a3-4670-b821-97d753540c96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:04.215874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:04.217122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:04.217849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:04.218357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:04.220943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:04.224038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:04.283959 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3927/7838] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:04 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:04.285756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46b6a-4774-40d4-920d-f499a9d4f681 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:04.325252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46b6a-4774-40d4-920d-f499a9d4f681 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:04.637529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:04.638601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:04.639076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:04.639566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:04.640779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:04.644092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:04.687222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:04.688558 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3912/7839] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:04 2022] POST /identity/v3/users => generated 298 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:04.710233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e63d-88e0-42aa-af69-964e0cd6acd1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:04.723779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:04.724494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:04.724786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:04.725076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:04.725840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:04.728222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:04.760284 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3928/7840] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:04.764657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:04.810013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aba39-ecd3-4f18-86cc-2ba107eec187 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:04.828014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:04.830198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:04.830495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:04.831996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] PATH_INFO: `/v3/projects/a6d485c0990d4d0ea244b25adab45bee/users/9ed28f05664f45618b079c4aceaf8ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:04.881531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d485c0990d4d0ea244b25adab45bee, user_id=9ed28f05664f45618b079c4aceaf8ff4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:04.887406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:04.933967 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3913/7841] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:04 2022] PUT /identity/v3/projects/a6d485c0990d4d0ea244b25adab45bee/users/9ed28f05664f45618b079c4aceaf8ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:04.935371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:04.950912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2c5e-be65-4965-bcc8-c37edaded1eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:05.078700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62c7c0-e5f9-4e0b-b7e0-9e6478bfd3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:05.080600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62c7c0-e5f9-4e0b-b7e0-9e6478bfd3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:05.081135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62c7c0-e5f9-4e0b-b7e0-9e6478bfd3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:05.081631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62c7c0-e5f9-4e0b-b7e0-9e6478bfd3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:05.082687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62c7c0-e5f9-4e0b-b7e0-9e6478bfd3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:05.086625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62c7c0-e5f9-4e0b-b7e0-9e6478bfd3b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:05.119465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:05.129864 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3929/7842] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:05.150069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1977de9-203f-489e-860f-4536166ba527 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:05.161188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:05.162616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:05.163633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:05.164262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] PATH_INFO: `/v3/projects/a6d485c0990d4d0ea244b25adab45bee/users/9ed28f05664f45618b079c4aceaf8ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:05.168852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d485c0990d4d0ea244b25adab45bee, user_id=9ed28f05664f45618b079c4aceaf8ff4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:05.173878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:05.190232 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3914/7843] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:05 2022] PUT /identity/v3/projects/a6d485c0990d4d0ea244b25adab45bee/users/9ed28f05664f45618b079c4aceaf8ff4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:05.201288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:05.201776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:05.202375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:05.279420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] MFA Rules not processed for user `9ed28f05664f45618b079c4aceaf8ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:05.281774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:05.400599 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3930/7844] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:05.420669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:05.422528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:05.516355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:05.563260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c428-f839-4c40-a502-6622047589a3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:05.579093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:05.579093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:05.579093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:05.579093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:05.590234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:05.592112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:05.752494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:05.794434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e9240-9bd5-4274-a4f8-5af1a30ec927 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:05.807686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:05.808466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:05.808899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:05.809267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:05.811714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:05.813860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:05.818219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:05.845997 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3915/7845] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:05.942824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:05.945511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:05.976660 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3931/7846] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:07.328154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:07.331427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:07.425466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632c63-eb8e-4d51-be7a-8fd75e80beb4 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:07.442055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:07.444488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:07.445347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:07.447918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] PATH_INFO: `/v3/users/df8c67406d8f4722a1234aad34c75194` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:07.452554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8c67406d8f4722a1234aad34c75194)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:07.459234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:07.639800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8c67406d8f4722a1234aad34c75194'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:07.675513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8c67406d8f4722a1234aad34c75194'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:07.676296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8c67406d8f4722a1234aad34c75194'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:07.698024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8c67406d8f4722a1234aad34c75194'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:07.698796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c27ab111-8627-4477-aa3d-28c3ec4408d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8c67406d8f4722a1234aad34c75194'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:07.726105 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3916/7847] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:07 2022] DELETE /identity/v3/users/df8c67406d8f4722a1234aad34c75194 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:08.206540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:08.224320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af655d0e-3579-4ccc-a40d-39ef30f0d610 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:08.333132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:08.333132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:08.333599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:08.333832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] PATH_INFO: `/v3/projects/406107b53d424678a716867f11bebae2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:08.336093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=406107b53d424678a716867f11bebae2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:08.338449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:08.411590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406107b53d424678a716867f11bebae2', 'request_id': 'req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:08.423929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406107b53d424678a716867f11bebae2', 'request_id': 'req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:08.435968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406107b53d424678a716867f11bebae2', 'request_id': 'req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:08.456139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] The token cache is being invalidate because project 406107b53d424678a716867f11bebae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:08.457604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:08.458535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9d8c930-3531-455e-8fa8-b11f02d7e6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:08.466309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3932/7848] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:08 2022] DELETE /identity/v3/projects/406107b53d424678a716867f11bebae2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:08.469015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347437-e3fd-4cf6-b83a-f0f322485df1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:08.470236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347437-e3fd-4cf6-b83a-f0f322485df1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:08.470998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347437-e3fd-4cf6-b83a-f0f322485df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:08.522128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a347437-e3fd-4cf6-b83a-f0f322485df1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:08.525450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a347437-e3fd-4cf6-b83a-f0f322485df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:08.676328 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3917/7849] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:08.685392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e5e6-01c4-4c5f-81ee-8708433c7168 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:08.685885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e5e6-01c4-4c5f-81ee-8708433c7168 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:08.686244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e5e6-01c4-4c5f-81ee-8708433c7168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:08.712447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a82e5e6-01c4-4c5f-81ee-8708433c7168 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:08.715962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a82e5e6-01c4-4c5f-81ee-8708433c7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:08.745110 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3933/7850] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:08.747693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347437-e3fd-4cf6-b83a-f0f322485df1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:08.786512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347437-e3fd-4cf6-b83a-f0f322485df1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:08.809222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:08.809222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:08.809222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:08.809222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:08.810350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:08.810350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:08.810350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:08.811170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:08.835128 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3918/7851] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:08.842782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82e5e6-01c4-4c5f-81ee-8708433c7168 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:08.859216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82e5e6-01c4-4c5f-81ee-8708433c7168 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:08.867958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:08.868675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:08.868970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:08.869255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:08.869986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:08.872078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:08.896218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:08.923324 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3934/7852] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:08 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:08.926725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:08.950861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70b4e3-3c3e-4532-b528-1a49174691e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:09.121924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:09.123808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:09.124904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:09.125406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:09.127116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:09.132594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:09.183990 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3919/7853] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:08 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:09.184814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:09.208066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cc4d2-8576-42d1-8cf2-2c5e34955e16 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:09.234237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:09.234955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:09.235247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:09.235641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:09.237445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:09.252014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:09.295440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:09.296116 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3935/7854] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:09.311035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda574-ba91-48dc-8993-b15112a6a285 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:09.317311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5e82d-c19b-4af8-adeb-a8fee60b30fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:09.318156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5e82d-c19b-4af8-adeb-a8fee60b30fa admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:09.318456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5e82d-c19b-4af8-adeb-a8fee60b30fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:09.318746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5e82d-c19b-4af8-adeb-a8fee60b30fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:09.319646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5e82d-c19b-4af8-adeb-a8fee60b30fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:09.322188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5e82d-c19b-4af8-adeb-a8fee60b30fa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:09.350728 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3920/7855] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:09.354012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:09.380292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d4cad-a436-429a-9389-ebfcf50e2560 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:09.394816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:09.395871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:09.396255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:09.396623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] PATH_INFO: `/v3/projects/e4d5f64edea14cbab1392d17e3be9de9/users/db9dcb86f53e466392563a143ee4654f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:09.435909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5f64edea14cbab1392d17e3be9de9, user_id=db9dcb86f53e466392563a143ee4654f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:09.441389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:09.471232 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3936/7856] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:09 2022] PUT /identity/v3/projects/e4d5f64edea14cbab1392d17e3be9de9/users/db9dcb86f53e466392563a143ee4654f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:09.493898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34ca8e-5f63-40ac-891f-8c47a95552f1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:09.493898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34ca8e-5f63-40ac-891f-8c47a95552f1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:09.493898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34ca8e-5f63-40ac-891f-8c47a95552f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:09.562993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2f34ca8e-5f63-40ac-891f-8c47a95552f1 None None] MFA Rules not processed for user `db9dcb86f53e466392563a143ee4654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:09.565566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f34ca8e-5f63-40ac-891f-8c47a95552f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:09.699322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3921/7857] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:09.705412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:09.970819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5994e5-9095-4afd-9206-8845ce297187 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:09.987430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:09.988979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:09.989625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:09.990237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:09.998668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:10.002817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:10.076015 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3937/7858] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:09 2022] POST /identity/v3/projects => generated 393 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:10.077558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34ca8e-5f63-40ac-891f-8c47a95552f1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:10.096809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34ca8e-5f63-40ac-891f-8c47a95552f1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:10.215157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:10.216133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:10.216495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:10.216883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:10.217878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:10.220190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:10.230591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:10.260438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:10.271532 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3922/7859] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:10 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:22:10.278530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b17e77-eae2-4e25-9029-cae772c40dac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:10.291243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:10.292152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:10.292444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:10.292730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:10.296105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:10.306592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:10.334601 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3938/7860] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:10.339181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:10.352356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba89b5-ed10-4a7d-86f6-090c4d879e2d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:10.358844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:10.360228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:10.360650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:10.361027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] PATH_INFO: `/v3/projects/6403ba8e6e4743a1a04c575cefcc89ea/users/8353a4c231db48a9bc9e58c3f33a8cd9/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:10.384686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6403ba8e6e4743a1a04c575cefcc89ea, user_id=8353a4c231db48a9bc9e58c3f33a8cd9, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:10.389344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:10.408740 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3923/7861] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:10 2022] PUT /identity/v3/projects/6403ba8e6e4743a1a04c575cefcc89ea/users/8353a4c231db48a9bc9e58c3f33a8cd9/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:10.413577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:10.431946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc45de-9580-4859-9900-1035d8e5dfbb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:10.555348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282194b-2405-4878-a725-592233c40af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:10.556975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282194b-2405-4878-a725-592233c40af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:10.557979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282194b-2405-4878-a725-592233c40af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:10.558568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282194b-2405-4878-a725-592233c40af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:10.559736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282194b-2405-4878-a725-592233c40af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:10.564313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282194b-2405-4878-a725-592233c40af8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:10.605164 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3939/7862] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:10.609606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:10.630543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d7e10-f714-4294-85f6-3de1bd1f7a43 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:10.644740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:10.645559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:10.645957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:10.646349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] PATH_INFO: `/v3/projects/6403ba8e6e4743a1a04c575cefcc89ea/users/8353a4c231db48a9bc9e58c3f33a8cd9/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:10.650583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6403ba8e6e4743a1a04c575cefcc89ea, user_id=8353a4c231db48a9bc9e58c3f33a8cd9, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:10.654575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:10.697524 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3924/7863] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:10 2022] PUT /identity/v3/projects/6403ba8e6e4743a1a04c575cefcc89ea/users/8353a4c231db48a9bc9e58c3f33a8cd9/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:10.699159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:10.699684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:10.700152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:10.845869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] MFA Rules not processed for user `8353a4c231db48a9bc9e58c3f33a8cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:10.855860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:10.971979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:11.145648 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3940/7864] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:11.186133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:11.191827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:11.382804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b01ad-5d74-4ad3-918c-292c52514f26 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:11.393091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea71446-ce7b-49f3-ad8b-ecf311df159c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:11.394141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71446-ce7b-49f3-ad8b-ecf311df159c service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:11.394548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71446-ce7b-49f3-ad8b-ecf311df159c service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:11.394944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71446-ce7b-49f3-ad8b-ecf311df159c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:11.604675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea71446-ce7b-49f3-ad8b-ecf311df159c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:11.607623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea71446-ce7b-49f3-ad8b-ecf311df159c service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:11.633959 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3925/7865] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:22:13.727758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:13.730452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:13.853768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a751d2-2399-4bdb-a807-cba03f88f0e4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:13.865305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:13.865305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:13.865893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:13.866138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:13.870995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:14.057432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:14.063003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:14.087009 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3941/7866] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:18.158953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:18.158953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:18.158953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:18.259607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:18.261517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:18.328462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:18.401040 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3926/7867] 10.222.0.98 () {58 vars in 1061 bytes} [Thu Jul 14 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:18.408185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:18.420627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015171c-d5c0-4d13-bad6-fe9d60dd8037 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:18.426472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cff80-5eff-4ab6-9c40-d7d7239004e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:18.427592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cff80-5eff-4ab6-9c40-d7d7239004e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:18.427984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cff80-5eff-4ab6-9c40-d7d7239004e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:18.429368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cff80-5eff-4ab6-9c40-d7d7239004e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:18.447583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cff80-5eff-4ab6-9c40-d7d7239004e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:18.449467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cff80-5eff-4ab6-9c40-d7d7239004e1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:18.483558 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3942/7868] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:22:23.515627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:23.515627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:23.685511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5746e-491b-46aa-b9d3-ffadde332606 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:23.695226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3944248-0957-4024-8458-8961367226bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:23.697100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3944248-0957-4024-8458-8961367226bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:23.697560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3944248-0957-4024-8458-8961367226bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:23.697995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3944248-0957-4024-8458-8961367226bc admin admin] PATH_INFO: `/v3/users/74655ae69fc04877af8063e52004f9f5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:23.699697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3944248-0957-4024-8458-8961367226bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=74655ae69fc04877af8063e52004f9f5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:23.701905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3944248-0957-4024-8458-8961367226bc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:23.784168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74655ae69fc04877af8063e52004f9f5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:23.800165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74655ae69fc04877af8063e52004f9f5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:23.800941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74655ae69fc04877af8063e52004f9f5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:23.829844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74655ae69fc04877af8063e52004f9f5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:23.830529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74655ae69fc04877af8063e52004f9f5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:23.864562 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3927/7869] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:23 2022] DELETE /identity/v3/users/74655ae69fc04877af8063e52004f9f5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:23.870912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:23.871494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:23.871494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:23.900364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:23.902031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:23.968661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:23.996565 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3943/7870] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:24.007442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:24.009806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:24.171012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3944248-0957-4024-8458-8961367226bc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:24.187365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01749c6f-f5f5-4942-991c-58aa69efb21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:24.188640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01749c6f-f5f5-4942-991c-58aa69efb21f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:24.189045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01749c6f-f5f5-4942-991c-58aa69efb21f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:24.189445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01749c6f-f5f5-4942-991c-58aa69efb21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:24.205609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01749c6f-f5f5-4942-991c-58aa69efb21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:24.211813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01749c6f-f5f5-4942-991c-58aa69efb21f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:24.233738 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3928/7871] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:24.656901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:24.662264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:24.688880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750af5b-e92a-4878-95c8-91e30b4747db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:24.695011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:24.696269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:24.696669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:24.697061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] PATH_INFO: `/v3/projects/dc0703e1bf9049abaf7c7381d30d0ac8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:24.698770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0703e1bf9049abaf7c7381d30d0ac8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:24.700923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:24.811741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0703e1bf9049abaf7c7381d30d0ac8', 'request_id': 'req-d175afff-b909-4c9a-b976-5371c4d5bb0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:24.825246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0703e1bf9049abaf7c7381d30d0ac8', 'request_id': 'req-d175afff-b909-4c9a-b976-5371c4d5bb0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:24.841695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0703e1bf9049abaf7c7381d30d0ac8', 'request_id': 'req-d175afff-b909-4c9a-b976-5371c4d5bb0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:24.877383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] The token cache is being invalidate because project dc0703e1bf9049abaf7c7381d30d0ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:24.878148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:24.880487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d175afff-b909-4c9a-b976-5371c4d5bb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:24.883356 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3944/7872] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:24 2022] DELETE /identity/v3/projects/dc0703e1bf9049abaf7c7381d30d0ac8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:24.888487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3445-c35a-4a56-8edf-60469ff00423 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:24.889079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3445-c35a-4a56-8edf-60469ff00423 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:24.889079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3445-c35a-4a56-8edf-60469ff00423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:24.922228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bf5e3445-c35a-4a56-8edf-60469ff00423 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:24.923663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bf5e3445-c35a-4a56-8edf-60469ff00423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:24.933121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:24.935444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076fc3-1c8d-4d95-a0ef-d44750ff72fa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:24.936041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076fc3-1c8d-4d95-a0ef-d44750ff72fa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:24.936521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076fc3-1c8d-4d95-a0ef-d44750ff72fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:24.984191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6e076fc3-1c8d-4d95-a0ef-d44750ff72fa None None] MFA Rules not processed for user `db9dcb86f53e466392563a143ee4654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:24.987025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e076fc3-1c8d-4d95-a0ef-d44750ff72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:25.103108 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3929/7873] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:25.106614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3945/7874] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:25.111842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3fdc6-a0cc-4cec-b0d5-b3d25217a63b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.112151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3fdc6-a0cc-4cec-b0d5-b3d25217a63b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.112612 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3fdc6-a0cc-4cec-b0d5-b3d25217a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:25.141268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c1b3fdc6-a0cc-4cec-b0d5-b3d25217a63b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:25.142589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c1b3fdc6-a0cc-4cec-b0d5-b3d25217a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:25.163926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3930/7875] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:25.164751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076fc3-1c8d-4d95-a0ef-d44750ff72fa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:25.186612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076fc3-1c8d-4d95-a0ef-d44750ff72fa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:25.197119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:25.198001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.198373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.198738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:25.200326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:25.200772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:25.202728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:25.223770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3fdc6-a0cc-4cec-b0d5-b3d25217a63b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:25.230939 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3946/7876] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:25.237109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3fdc6-a0cc-4cec-b0d5-b3d25217a63b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:25.274834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:25.276636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.277554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.277721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:25.279256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:25.286254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:25.354816 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3931/7877] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:25 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:22:25.356400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:25.373795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7c40-be4b-4faa-b326-dea16b37f163 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:25.571425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:25.572297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.572593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.572887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:25.574068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:25.581762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:25.621960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:25.656677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:25.656956 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3947/7878] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:25 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:25.674858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4fed1-a8ce-46b2-b3e4-e5549dc70cfc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:25.709034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:25.712294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.713645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.715826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:25.719124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:25.724677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:25.760852 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3932/7879] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:25.764798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:25.781434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5d65-bd6c-4e70-b524-97969d4b6cd0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:25.801715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ec6b-b5fe-457c-8b9d-1c67c412ca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:25.802461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ec6b-b5fe-457c-8b9d-1c67c412ca97 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.802730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ec6b-b5fe-457c-8b9d-1c67c412ca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.803088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ec6b-b5fe-457c-8b9d-1c67c412ca97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:25.804550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ec6b-b5fe-457c-8b9d-1c67c412ca97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:25.806448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ec6b-b5fe-457c-8b9d-1c67c412ca97 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:25.836706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:25.837914 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3948/7880] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:25.851433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dfc16-c134-4285-9017-bbcf0f75f42d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:25.866128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:25.872357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.872771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.872925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] PATH_INFO: `/v3/projects/c3f8e2b2012e4eb0bdbe342a80309381/users/703a3362ae854c71862df069a564a840/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:25.918435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8e2b2012e4eb0bdbe342a80309381, user_id=703a3362ae854c71862df069a564a840, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:25.921395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:25.977926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3933/7881] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:25 2022] PUT /identity/v3/projects/c3f8e2b2012e4eb0bdbe342a80309381/users/703a3362ae854c71862df069a564a840/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:25.979933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:25.980470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:25.980546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:26.068842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] MFA Rules not processed for user `703a3362ae854c71862df069a564a840`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:26.070185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:26.092822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:26.094703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:26.286258 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3949/7882] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:26.311718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:26.313740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:26.331206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e055e4-dd56-492c-881c-6e382ac41d6b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:26.337254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c22e8a-472e-4863-8b79-daca47c2c544 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:26.341366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:26.342113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:26.342404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:26.342717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:26.348838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:26.358530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:26.359367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:26.359762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:26.360798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:26.374222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:26.376207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:26.384784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:26.387256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:26.400877 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3934/7883] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:22:26.417914 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3950/7884] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:27.724523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:27.728232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:27.895488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:27.993894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f1788-2db6-4078-80f2-1c5d8bc2371e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:28.013917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecde37-838c-4fcc-b07c-5ceabdc38b56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:28.014986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecde37-838c-4fcc-b07c-5ceabdc38b56 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:28.015474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecde37-838c-4fcc-b07c-5ceabdc38b56 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:28.015585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecde37-838c-4fcc-b07c-5ceabdc38b56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:28.017870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a0ecde37-838c-4fcc-b07c-5ceabdc38b56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:28.051426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecde37-838c-4fcc-b07c-5ceabdc38b56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:28.052971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecde37-838c-4fcc-b07c-5ceabdc38b56 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:28.090594 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3935/7885] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:28.313520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:28.318573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:28.636784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb62ea9-c34f-4d90-9457-a27170b1de78 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:28.644780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:28.645986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:28.655836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:28.656371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] PATH_INFO: `/v3/users/7f903c9b5ed24ec1a93917a46e57151d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:28.658092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f903c9b5ed24ec1a93917a46e57151d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:28.660508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:28.768199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f903c9b5ed24ec1a93917a46e57151d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:28.799493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:28.802829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f903c9b5ed24ec1a93917a46e57151d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:28.832437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f903c9b5ed24ec1a93917a46e57151d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:28.833095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f903c9b5ed24ec1a93917a46e57151d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:28.853267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f903c9b5ed24ec1a93917a46e57151d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:28.895659 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3951/7886] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:28 2022] DELETE /identity/v3/users/7f903c9b5ed24ec1a93917a46e57151d => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:28.904582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:28.906664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:28.907634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:29.059099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:29.064967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:29.285018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3936/7887] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:29.287149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:29.291751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:29.663142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be20e-bce6-4aaa-8ecb-9ca20e2d43de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:29.693051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:29.694493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:29.700348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:29.701786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:29.793727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:29.801436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:29.878195 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3952/7888] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:31.004099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:31.006868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:31.055410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dfbe2-3ccf-4b4d-826e-ff7cd5870a21 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:31.075101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:31.076472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:31.078116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:31.079215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] PATH_INFO: `/v3/projects/85be80ac09924033a886aba8c5c3fd35` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:31.083842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85be80ac09924033a886aba8c5c3fd35)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:31.088567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:31.223439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85be80ac09924033a886aba8c5c3fd35', 'request_id': 'req-21b44d03-ecaa-4011-bdd1-29eb18779c60'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.245216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85be80ac09924033a886aba8c5c3fd35', 'request_id': 'req-21b44d03-ecaa-4011-bdd1-29eb18779c60'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.265297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85be80ac09924033a886aba8c5c3fd35', 'request_id': 'req-21b44d03-ecaa-4011-bdd1-29eb18779c60'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.297770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] The token cache is being invalidate because project 85be80ac09924033a886aba8c5c3fd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:31.299635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.301888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.305709 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3937/7889] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:31 2022] DELETE /identity/v3/projects/85be80ac09924033a886aba8c5c3fd35 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:31.311637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:31.330429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba2714-07d5-47e9-a610-89d62fbdd22a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:31.477817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:31.478727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:31.479020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:31.479351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] PATH_INFO: `/v3/users/9ed28f05664f45618b079c4aceaf8ff4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:31.480741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed28f05664f45618b079c4aceaf8ff4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:31.483006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:31.585052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed28f05664f45618b079c4aceaf8ff4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.605775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed28f05664f45618b079c4aceaf8ff4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.619848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed28f05664f45618b079c4aceaf8ff4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.620903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed28f05664f45618b079c4aceaf8ff4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.643994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a16c66e2-dad3-40cc-a4dc-36f2ac9585c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed28f05664f45618b079c4aceaf8ff4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:31.661699 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3953/7890] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:31 2022] DELETE /identity/v3/users/9ed28f05664f45618b079c4aceaf8ff4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:32.549262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:32.552995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:32.584758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44d03-ecaa-4011-bdd1-29eb18779c60 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:32.722872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:32.737950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:32.739924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:32.740470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:32.740980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] PATH_INFO: `/v3/projects/a6d485c0990d4d0ea244b25adab45bee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:32.743758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d485c0990d4d0ea244b25adab45bee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:32.746780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:32.827640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d485c0990d4d0ea244b25adab45bee', 'request_id': 'req-dc04c766-1997-4c03-9ced-7fdb5177d21d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:32.839763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d485c0990d4d0ea244b25adab45bee', 'request_id': 'req-dc04c766-1997-4c03-9ced-7fdb5177d21d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:32.852096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d485c0990d4d0ea244b25adab45bee', 'request_id': 'req-dc04c766-1997-4c03-9ced-7fdb5177d21d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:32.865870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] The token cache is being invalidate because project a6d485c0990d4d0ea244b25adab45bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:32.866756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:32.867840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dc04c766-1997-4c03-9ced-7fdb5177d21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:32.875308 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3938/7891] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:32 2022] DELETE /identity/v3/projects/a6d485c0990d4d0ea244b25adab45bee => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:32.877468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd05c35-7d55-425e-ac92-75196a243762 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:32.878178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd05c35-7d55-425e-ac92-75196a243762 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:32.878178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd05c35-7d55-425e-ac92-75196a243762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:32.886570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:32.903196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-abd05c35-7d55-425e-ac92-75196a243762 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:32.906840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-abd05c35-7d55-425e-ac92-75196a243762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:33.002310 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3954/7892] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:33.020499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7671c-96af-4ed2-be56-77737d43c2af None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.020499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7671c-96af-4ed2-be56-77737d43c2af None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.020499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7671c-96af-4ed2-be56-77737d43c2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.065540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-37d7671c-96af-4ed2-be56-77737d43c2af None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:33.068467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-37d7671c-96af-4ed2-be56-77737d43c2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:33.090514 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3939/7893] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:33.091952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd05c35-7d55-425e-ac92-75196a243762 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:33.108176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd05c35-7d55-425e-ac92-75196a243762 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:33.116911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:33.119188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.119685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.120047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.121013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:33.121584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:33.124302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:33.155593 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3955/7894] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:33.157102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7671c-96af-4ed2-be56-77737d43c2af None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:33.169476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7671c-96af-4ed2-be56-77737d43c2af None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:33.176095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:33.176917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.177282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.177636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.178963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:33.181550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:33.239916 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3940/7895] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:33 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:33.241177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:33.258077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8be24-7652-4a20-9c42-8c5c95212e5a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:33.449622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:33.451136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.452055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.452832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.454242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:33.458860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:33.517277 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3956/7896] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:33 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:33.524848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:33.544985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ee22-8d47-42bb-99eb-3c7e6e5d29b1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:33.552077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:33.556321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.556884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.557344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.558763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:33.562517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:33.593447 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3941/7897] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:33.594470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:33.611349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa1f68-a7db-480f-b08a-d78b9775d43f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:33.621670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d42c5-0c3a-474f-bb35-db851d594e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:33.623131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d42c5-0c3a-474f-bb35-db851d594e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.623887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d42c5-0c3a-474f-bb35-db851d594e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.624632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d42c5-0c3a-474f-bb35-db851d594e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.626687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d42c5-0c3a-474f-bb35-db851d594e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:33.630588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d42c5-0c3a-474f-bb35-db851d594e89 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:33.661403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:33.672818 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3957/7898] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:33.674505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b257f-be08-4cd9-8e68-392b0f883e81 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:33.682212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:33.683396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.683779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.684071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] PATH_INFO: `/v3/projects/aee43a937033411bac6000872057b54f/users/3db4fede4f364621b9ec610ae9c56554/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.708178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee43a937033411bac6000872057b54f, user_id=3db4fede4f364621b9ec610ae9c56554, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:33.711644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:33.743408 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3942/7899] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:33 2022] PUT /identity/v3/projects/aee43a937033411bac6000872057b54f/users/3db4fede4f364621b9ec610ae9c56554/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:33.766661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4706fa-48b9-40d7-a1ba-bc3e67fdcb49 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:33.768262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4706fa-48b9-40d7-a1ba-bc3e67fdcb49 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:33.768826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4706fa-48b9-40d7-a1ba-bc3e67fdcb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:33.819429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-db4706fa-48b9-40d7-a1ba-bc3e67fdcb49 None None] MFA Rules not processed for user `3db4fede4f364621b9ec610ae9c56554`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:33.821641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db4706fa-48b9-40d7-a1ba-bc3e67fdcb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:33.969355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:33.989217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:33.989715 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3958/7900] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:34.099406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e0c3-df48-41f8-90de-0f0700f9efe5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.121595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.123518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.123518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.123518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.123989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.126369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:34.166613 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3943/7901] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:33 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:22:34.172631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4706fa-48b9-40d7-a1ba-bc3e67fdcb49 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:34.197808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4706fa-48b9-40d7-a1ba-bc3e67fdcb49 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.377870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.378916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.379476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.380463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.381415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.385609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:34.426717 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3959/7902] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:34 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:34.432509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:34.449791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:34.464978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0c370-9402-41ec-9411-061831b3c020 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.480019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.482275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.482835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.495151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.495151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.499061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:34.529483 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3944/7903] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:34.535417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:34.552453 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f2bd3-7173-4482-b958-64a657421166 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.565914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.569264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.569888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.571098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] PATH_INFO: `/v3/projects/00154efbd9704efd9618bcca4beaea1a/users/9c5f7b13ad644791940a3394c4091a5f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.645291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00154efbd9704efd9618bcca4beaea1a, user_id=9c5f7b13ad644791940a3394c4091a5f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.652098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:34.693227 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3960/7904] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:34 2022] PUT /identity/v3/projects/00154efbd9704efd9618bcca4beaea1a/users/9c5f7b13ad644791940a3394c4091a5f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:34.695883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:34.719915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be0c55-f2ca-49b5-a221-282f6c22df7c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.909735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fdc64-9cd4-4651-924d-0f7e733833e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.911149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fdc64-9cd4-4651-924d-0f7e733833e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.911717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fdc64-9cd4-4651-924d-0f7e733833e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.912200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fdc64-9cd4-4651-924d-0f7e733833e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.915375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fdc64-9cd4-4651-924d-0f7e733833e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.919709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fdc64-9cd4-4651-924d-0f7e733833e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:34.951025 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3945/7905] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:34.959183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:34.971672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3d1f-408a-428c-877d-0456a903d941 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.978321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.979324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.979657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.980005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] PATH_INFO: `/v3/projects/00154efbd9704efd9618bcca4beaea1a/users/9c5f7b13ad644791940a3394c4091a5f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.982416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00154efbd9704efd9618bcca4beaea1a, user_id=9c5f7b13ad644791940a3394c4091a5f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.985252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:35.002877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3961/7906] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:34 2022] PUT /identity/v3/projects/00154efbd9704efd9618bcca4beaea1a/users/9c5f7b13ad644791940a3394c4091a5f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:35.017296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd7e96-960e-408e-b683-abd73310ee4e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:35.017717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd7e96-960e-408e-b683-abd73310ee4e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:35.018190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd7e96-960e-408e-b683-abd73310ee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:35.060554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bdfd7e96-960e-408e-b683-abd73310ee4e None None] MFA Rules not processed for user `9c5f7b13ad644791940a3394c4091a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:35.061915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bdfd7e96-960e-408e-b683-abd73310ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:35.162968 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3946/7907] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:35.180044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:35.182421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:35.333953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecc351-4cfc-4362-8a2e-cf97d1aadfc2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:35.340676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:35.342876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:35.344202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:35.344202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:35.360541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:35.362911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:35.383581 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3962/7908] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:35.441097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd7e96-960e-408e-b683-abd73310ee4e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:35.479030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd7e96-960e-408e-b683-abd73310ee4e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:35.485695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:35.486945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:35.487157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:35.487680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:35.708506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:35.710420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:35.776747 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3947/7909] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:36.105966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:36.108169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:36.268992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:36.329083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becd9a6-1f4c-4021-b9ed-2d919227de15 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:36.344662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:36.344662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:36.344662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:36.344662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:36.358972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:36.418856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:36.423553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:36.478980 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3963/7910] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:36.506242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:36.508531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:36.529780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d4c5-376a-4b56-89fb-4b6e0143ca90 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:36.552403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72663d-9904-493a-8d70-064740e936b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:36.554016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72663d-9904-493a-8d70-064740e936b5 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:36.555035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72663d-9904-493a-8d70-064740e936b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:36.555787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72663d-9904-493a-8d70-064740e936b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:36.568115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad72663d-9904-493a-8d70-064740e936b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:36.591100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:36.675653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72663d-9904-493a-8d70-064740e936b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:36.677351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72663d-9904-493a-8d70-064740e936b5 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:36.690652 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3948/7911] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:39.279002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:39.283569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:39.378487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0877f-8362-48c5-94ae-d6919a5cb162 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:39.384055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:39.385223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:39.385525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:39.385815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] PATH_INFO: `/v3/users/703a3362ae854c71862df069a564a840` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:39.387220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=703a3362ae854c71862df069a564a840)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:39.389270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:39.458578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703a3362ae854c71862df069a564a840'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:39.476468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703a3362ae854c71862df069a564a840'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:39.486993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703a3362ae854c71862df069a564a840'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:39.487712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703a3362ae854c71862df069a564a840'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:39.512030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703a3362ae854c71862df069a564a840'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:39.527331 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3964/7912] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:39 2022] DELETE /identity/v3/users/703a3362ae854c71862df069a564a840 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:39.534300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:39.537346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:39.538516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:39.575412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:39.577752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:39.699426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3949/7913] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:39.713108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:39.715812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:39.825363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87f69-6fb2-4f9a-9179-119c3b774eea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:39.831732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:39.832700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:39.833133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:39.833615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:39.864862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:39.871487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:39.886673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:39.903777 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3965/7914] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:40.415594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:40.418475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:40.448467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579773a9-a1b0-400f-b2c9-79b18bc9064b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:40.464711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:40.466648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.467348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.469142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] PATH_INFO: `/v3/users/3db4fede4f364621b9ec610ae9c56554` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.472125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db4fede4f364621b9ec610ae9c56554)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:40.476995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:40.617586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:40.623825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:40.624284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db4fede4f364621b9ec610ae9c56554'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.689055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db4fede4f364621b9ec610ae9c56554'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.690035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b30cb-85d6-495a-a32e-071c74d3c374 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:40.693991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db4fede4f364621b9ec610ae9c56554'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.701107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:40.703506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.704428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.705192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] PATH_INFO: `/v3/projects/c3f8e2b2012e4eb0bdbe342a80309381` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.714183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f8e2b2012e4eb0bdbe342a80309381)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:40.718697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:40.741475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db4fede4f364621b9ec610ae9c56554'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.746974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-664b541a-4380-4a8d-80e1-ad4f1e0b5a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db4fede4f364621b9ec610ae9c56554'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.806909 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3950/7915] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:40 2022] DELETE /identity/v3/users/3db4fede4f364621b9ec610ae9c56554 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:40.812689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0098f4-1fe9-4215-82df-c229a93819bb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.813864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0098f4-1fe9-4215-82df-c229a93819bb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.815673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0098f4-1fe9-4215-82df-c229a93819bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.872396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ed0098f4-1fe9-4215-82df-c229a93819bb None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:40.874800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ed0098f4-1fe9-4215-82df-c229a93819bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:40.890526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f8e2b2012e4eb0bdbe342a80309381', 'request_id': 'req-bbb1ca86-072f-4e06-a9ef-efc2e3840505'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.907934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f8e2b2012e4eb0bdbe342a80309381', 'request_id': 'req-bbb1ca86-072f-4e06-a9ef-efc2e3840505'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.931441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f8e2b2012e4eb0bdbe342a80309381', 'request_id': 'req-bbb1ca86-072f-4e06-a9ef-efc2e3840505'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.954624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] The token cache is being invalidate because project c3f8e2b2012e4eb0bdbe342a80309381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:40.955857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.956967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bbb1ca86-072f-4e06-a9ef-efc2e3840505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:40.959801 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3966/7916] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:40 2022] DELETE /identity/v3/projects/c3f8e2b2012e4eb0bdbe342a80309381 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:40.962475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:40.968230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31641d01-ad64-4d27-96c7-60d1f9120934 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.970711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31641d01-ad64-4d27-96c7-60d1f9120934 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.972310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31641d01-ad64-4d27-96c7-60d1f9120934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.009565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-31641d01-ad64-4d27-96c7-60d1f9120934 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:41.011817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-31641d01-ad64-4d27-96c7-60d1f9120934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:41.032364 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3951/7917] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:41.046980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9012e6-7d6c-4771-8f80-40d176c30a01 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.047421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9012e6-7d6c-4771-8f80-40d176c30a01 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.047655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9012e6-7d6c-4771-8f80-40d176c30a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.084306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3a9012e6-7d6c-4771-8f80-40d176c30a01 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:41.085375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a9012e6-7d6c-4771-8f80-40d176c30a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:41.165265 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3967/7918] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:41.177089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb775ad-e82a-4cff-ab6a-d98f5735a24b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.177428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb775ad-e82a-4cff-ab6a-d98f5735a24b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.177665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb775ad-e82a-4cff-ab6a-d98f5735a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.214617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3952/7919] 10.222.0.98 () {58 vars in 1061 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:41.219313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8cb775ad-e82a-4cff-ab6a-d98f5735a24b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:41.221632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cb775ad-e82a-4cff-ab6a-d98f5735a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:41.225715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9012e6-7d6c-4771-8f80-40d176c30a01 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.236154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9012e6-7d6c-4771-8f80-40d176c30a01 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.245475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.247778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.250029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.250332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.251475 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3968/7920] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:41.255749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb775ad-e82a-4cff-ab6a-d98f5735a24b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.272330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.273872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.280895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb775ad-e82a-4cff-ab6a-d98f5735a24b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.292451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.293617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3953/7921] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:22:41.293744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.294132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.294639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.296345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:41.296913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.300289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.338932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.339861 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3969/7922] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:41.351030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63f63f-ea87-43f9-a155-a0a069d49446 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.358410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.359145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.359501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.359884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.362574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.365638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.425116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.436684 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3954/7923] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:41.452310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd967e-3492-44d6-9a13-295960111051 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.552471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.553948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.554963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.555878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.557358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.560946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.577825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:41.617441 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3970/7924] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:41.620766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.684849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924b8b0-a268-4974-a109-a156d206f613 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.708996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.709899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.710201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.711129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.712022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.716629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.745529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.759926 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3955/7925] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:41.762425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c313-447a-49c6-9795-e73a94c524d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.776081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1f80-2cbe-42b3-9c27-9eb6f47d8487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.776827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1f80-2cbe-42b3-9c27-9eb6f47d8487 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.777640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1f80-2cbe-42b3-9c27-9eb6f47d8487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.777941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1f80-2cbe-42b3-9c27-9eb6f47d8487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.778726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1f80-2cbe-42b3-9c27-9eb6f47d8487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.780662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1f80-2cbe-42b3-9c27-9eb6f47d8487 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.809574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.825294 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3971/7926] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:41.828502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae293a61-305b-4f8e-b156-ac93ebb969f5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.843860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.844801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.845092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.845436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] PATH_INFO: `/v3/projects/f00e3294179746ef9f8d484583333fd3/users/bcb51b8ec7b948f48d3f7241455e7e76/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.881809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00e3294179746ef9f8d484583333fd3, user_id=bcb51b8ec7b948f48d3f7241455e7e76, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.884989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.937532 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3956/7927] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:41 2022] PUT /identity/v3/projects/f00e3294179746ef9f8d484583333fd3/users/bcb51b8ec7b948f48d3f7241455e7e76/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:41.948091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526ec8d-e0ae-4c6d-8c3d-96a0a1ded737 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.948504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526ec8d-e0ae-4c6d-8c3d-96a0a1ded737 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.948653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526ec8d-e0ae-4c6d-8c3d-96a0a1ded737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.330313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e526ec8d-e0ae-4c6d-8c3d-96a0a1ded737 None None] MFA Rules not processed for user `bcb51b8ec7b948f48d3f7241455e7e76`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:42.332047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e526ec8d-e0ae-4c6d-8c3d-96a0a1ded737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:42.363916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:42.368266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:42.521411 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3972/7928] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:42.538752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:42.559834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac5b71-4f74-4610-8d32-d15a7cfe5e65 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:42.578983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:42.579855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.580154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.581031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.588219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526ec8d-e0ae-4c6d-8c3d-96a0a1ded737 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:42.598369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:42.654670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:42.657556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:42.699239 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3957/7929] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:22:42.700334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:42.705146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:42.754776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526ec8d-e0ae-4c6d-8c3d-96a0a1ded737 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:42.788864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:42.789566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.789856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.790139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.838357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:42.840326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:42.883540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684218b-1b1d-44fb-b29a-874f8bd8dda2 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:42.901450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:42.902059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3973/7930] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:42.902533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.902833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.903120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] PATH_INFO: `/v3/projects/aee43a937033411bac6000872057b54f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.906104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:42.922132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee43a937033411bac6000872057b54f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:42.925673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:42.936165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1331f-aadf-45e6-aed8-7f3aae312e18 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:42.950747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:42.951722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.952014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.952298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] PATH_INFO: `/v3/users/bcb51b8ec7b948f48d3f7241455e7e76` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.955675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb51b8ec7b948f48d3f7241455e7e76)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:42.957735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:43.164679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee43a937033411bac6000872057b54f', 'request_id': 'req-6f817f40-cf98-4226-895d-649997397b33'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.172881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb51b8ec7b948f48d3f7241455e7e76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.206345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee43a937033411bac6000872057b54f', 'request_id': 'req-6f817f40-cf98-4226-895d-649997397b33'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.210891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb51b8ec7b948f48d3f7241455e7e76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.216316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:43.218504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee43a937033411bac6000872057b54f', 'request_id': 'req-6f817f40-cf98-4226-895d-649997397b33'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.225472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb51b8ec7b948f48d3f7241455e7e76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.226948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb51b8ec7b948f48d3f7241455e7e76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.240539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f4393c7-c9ed-487b-a9ed-0f4410b8f276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb51b8ec7b948f48d3f7241455e7e76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.240754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] The token cache is being invalidate because project aee43a937033411bac6000872057b54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:43.240945 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.242375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.247142 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3958/7931] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:42 2022] DELETE /identity/v3/projects/aee43a937033411bac6000872057b54f => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:43.251398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:43.253205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:43.266880 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3974/7932] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:42 2022] DELETE /identity/v3/users/bcb51b8ec7b948f48d3f7241455e7e76 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:43.274634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:43.275393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:43.277542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:43.352938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:43.358389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f817f40-cf98-4226-895d-649997397b33 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:43.360697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:43.397135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:43.477626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:43.478555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:43.478840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:43.479120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] PATH_INFO: `/v3/users/9c5f7b13ad644791940a3394c4091a5f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:43.482538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5f7b13ad644791940a3394c4091a5f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:43.493335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:43.557394 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3975/7933] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:43.610166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5f7b13ad644791940a3394c4091a5f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.666425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5f7b13ad644791940a3394c4091a5f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.668268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5f7b13ad644791940a3394c4091a5f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.693492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5f7b13ad644791940a3394c4091a5f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.694782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5f7b13ad644791940a3394c4091a5f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:43.717377 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3959/7934] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:43 2022] DELETE /identity/v3/users/9c5f7b13ad644791940a3394c4091a5f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:43.811044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:43.813225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:43.995432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b8d61-b28a-4ebf-a15f-cbc86bcb4226 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:44.123327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47fa1-3fc9-483d-bdfc-7309e1faad71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:44.125070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47fa1-3fc9-483d-bdfc-7309e1faad71 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.125953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47fa1-3fc9-483d-bdfc-7309e1faad71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.126755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47fa1-3fc9-483d-bdfc-7309e1faad71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.130887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ea47fa1-3fc9-483d-bdfc-7309e1faad71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:44.382738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:44.397605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea47fa1-3fc9-483d-bdfc-7309e1faad71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:44.400024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea47fa1-3fc9-483d-bdfc-7309e1faad71 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:44.418871 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3976/7935] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:44.590773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:44.593803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:44.627745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394239c-7b62-4017-b116-53140fa12632 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:44.638940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:44.640456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.640885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.641180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] PATH_INFO: `/v3/projects/00154efbd9704efd9618bcca4beaea1a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.649227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00154efbd9704efd9618bcca4beaea1a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:44.652015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:44.786697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00154efbd9704efd9618bcca4beaea1a', 'request_id': 'req-a2b7e955-a905-4519-b220-bcb6553adb28'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:44.823014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00154efbd9704efd9618bcca4beaea1a', 'request_id': 'req-a2b7e955-a905-4519-b220-bcb6553adb28'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:44.856300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00154efbd9704efd9618bcca4beaea1a', 'request_id': 'req-a2b7e955-a905-4519-b220-bcb6553adb28'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:44.888455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] The token cache is being invalidate because project 00154efbd9704efd9618bcca4beaea1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:44.888896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:44.897587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a2b7e955-a905-4519-b220-bcb6553adb28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:44.901661 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3960/7936] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:44 2022] DELETE /identity/v3/projects/00154efbd9704efd9618bcca4beaea1a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:44.907357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b48e1-2e55-44e5-9d84-f819a73b9a17 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.907877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b48e1-2e55-44e5-9d84-f819a73b9a17 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.907965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b48e1-2e55-44e5-9d84-f819a73b9a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.950008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b69b48e1-2e55-44e5-9d84-f819a73b9a17 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:44.951329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b69b48e1-2e55-44e5-9d84-f819a73b9a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:45.129032 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3977/7937] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:45.130907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1952c1-1d17-4499-94a9-88ed3915eda6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.131194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1952c1-1d17-4499-94a9-88ed3915eda6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.131512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1952c1-1d17-4499-94a9-88ed3915eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.170195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8a1952c1-1d17-4499-94a9-88ed3915eda6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:45.175985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8a1952c1-1d17-4499-94a9-88ed3915eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:45.197520 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3961/7938] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:45.203321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b48e1-2e55-44e5-9d84-f819a73b9a17 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.219902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b48e1-2e55-44e5-9d84-f819a73b9a17 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.248963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.259046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.260164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.260954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.263700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:45.264702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.268246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.357755 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3978/7939] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:45.359633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1952c1-1d17-4499-94a9-88ed3915eda6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.391849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1952c1-1d17-4499-94a9-88ed3915eda6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.412298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.414015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.414540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.415036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.418710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.426811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.549854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:45.580143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3962/7940] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:45 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:45.585589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.597722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bad92-cfa5-4b73-8eb5-a6b1485acf8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.628375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.630342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:45.747667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.748298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.748587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.748870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.749606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.752689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.781601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ac00-fa25-4415-83d9-d2b1515dc863 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.800079 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3979/7941] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:45 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:22:45.803651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.807602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.809890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.810132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.810428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] PATH_INFO: `/v3/projects/f00e3294179746ef9f8d484583333fd3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.816395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d1f96-2ca9-48d8-a800-8d250da95d13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.816632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f00e3294179746ef9f8d484583333fd3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.820518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.824708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.825002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.825434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.825809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.830477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.839622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.854513 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3980/7942] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:45.859890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.873349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aca43-61b7-4ba7-bffb-cca91e8ccdc1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.879346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.880375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.880930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.881483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.882857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.884792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.901906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3981/7943] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:45.903492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.915761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db769e-e5ae-4771-bc51-54c0cd37aebf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.954001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f00e3294179746ef9f8d484583333fd3', 'request_id': 'req-b9f12b6f-4647-433a-8abe-ff4edcdcac12'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:45.967316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f00e3294179746ef9f8d484583333fd3', 'request_id': 'req-b9f12b6f-4647-433a-8abe-ff4edcdcac12'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:45.997962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f00e3294179746ef9f8d484583333fd3', 'request_id': 'req-b9f12b6f-4647-433a-8abe-ff4edcdcac12'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:46.034228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] The token cache is being invalidate because project f00e3294179746ef9f8d484583333fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:46.034570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:46.036852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:46.040659 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3963/7944] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:45 2022] DELETE /identity/v3/projects/f00e3294179746ef9f8d484583333fd3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:46.041560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:46.047123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:46.059061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:46.085024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95167-f4b7-443a-9fb3-cbf2f6c0aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:46.086731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95167-f4b7-443a-9fb3-cbf2f6c0aa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.087095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95167-f4b7-443a-9fb3-cbf2f6c0aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.087418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95167-f4b7-443a-9fb3-cbf2f6c0aa64 admin admin] PATH_INFO: `/v3/projects/e16c0223cb1043cda6622dad197cd901/users/2e628e9d69b1488ab8f37bca78a968bf/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.120660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95167-f4b7-443a-9fb3-cbf2f6c0aa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16c0223cb1043cda6622dad197cd901, user_id=2e628e9d69b1488ab8f37bca78a968bf, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:46.123547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95167-f4b7-443a-9fb3-cbf2f6c0aa64 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:46.155802 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3982/7945] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:45 2022] PUT /identity/v3/projects/e16c0223cb1043cda6622dad197cd901/users/2e628e9d69b1488ab8f37bca78a968bf/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:46.155802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114a5b-3ac2-44ef-80b3-be7543d94b7b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.155802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114a5b-3ac2-44ef-80b3-be7543d94b7b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.155802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114a5b-3ac2-44ef-80b3-be7543d94b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.174496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f12b6f-4647-433a-8abe-ff4edcdcac12 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:46.177523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-60114a5b-3ac2-44ef-80b3-be7543d94b7b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:46.179944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60114a5b-3ac2-44ef-80b3-be7543d94b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:46.294058 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3983/7946] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:46.295993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.296482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.296884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.308392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:46.321189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4613-1d0b-4488-836d-a14e1be5a541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:46.323154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4613-1d0b-4488-836d-a14e1be5a541 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.323803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4613-1d0b-4488-836d-a14e1be5a541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.324247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4613-1d0b-4488-836d-a14e1be5a541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.327110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4bae4613-1d0b-4488-836d-a14e1be5a541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:46.352301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] MFA Rules not processed for user `2e628e9d69b1488ab8f37bca78a968bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:46.355580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:46.357427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4613-1d0b-4488-836d-a14e1be5a541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:46.359197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4613-1d0b-4488-836d-a14e1be5a541 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:46.376224 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3964/7947] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:46.377740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c4e16-5940-4c26-8d65-4ce25f244abd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.378038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c4e16-5940-4c26-8d65-4ce25f244abd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.378374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c4e16-5940-4c26-8d65-4ce25f244abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.408089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f99c4e16-5940-4c26-8d65-4ce25f244abd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:46.410390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f99c4e16-5940-4c26-8d65-4ce25f244abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:46.420354 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3965/7948] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:46.424946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c4e16-5940-4c26-8d65-4ce25f244abd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:46.437805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c4e16-5940-4c26-8d65-4ce25f244abd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:46.448311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:46.449158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.449499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.449803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.450572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:46.451021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:46.455717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:46.479886 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3966/7949] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:46.480886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:46.494887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424c53-f0a3-46a7-a7c5-6cc442987622 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:46.504669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:46.505684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.506510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.506813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.508840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:46.512786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:46.555500 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3967/7950] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:46 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:46.560053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:46.562102 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3984/7951] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:46.569320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:46.572871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:46.602091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d24a-48a5-46fd-ac89-ba7f0029ac68 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:46.711904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fea428-8614-45d9-aa65-16f1ca14ea42 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:46.714830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:46.714830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.726507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.727015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.729247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:46.733673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:46.735649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:46.736543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.736905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.737201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.737923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:46.740047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:46.754119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:46.816067 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3968/7952] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:46 2022] POST /identity/v3/users => generated 303 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:22:46.820498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:46.821549 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3985/7953] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:46 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:46.825387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:46.856072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb37cd1-44b2-42cd-9bfb-bf1f31b3e8b8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:46.982857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:46.983618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:46.984245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:46.984574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:46.985361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:46.987263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.005094 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3969/7954] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:47.006508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.027217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789658-dbfe-466f-80e0-767b92043958 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.030649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a4612-ec5a-4ffc-bc00-ae80e11bb7eb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.039679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.041434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.042041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.042673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.044174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.045340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.046062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.046349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.046630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.051123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.052329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.055090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.101854 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3970/7955] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:47.104335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.129509 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3986/7956] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:46 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:47.133139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.141732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62cd22-594b-4da9-8028-77a8e5489a17 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.148232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a0b27-a26a-46b0-b0c7-c4a9c3afab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.149516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a0b27-a26a-46b0-b0c7-c4a9c3afab07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.150949 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a0b27-a26a-46b0-b0c7-c4a9c3afab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.151296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a0b27-a26a-46b0-b0c7-c4a9c3afab07 admin admin] PATH_INFO: `/v3/projects/56e898b392c64fd8ab83eda1cbcd0dac/users/3047377818c445968858a09be378944f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.184131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a0b27-a26a-46b0-b0c7-c4a9c3afab07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e898b392c64fd8ab83eda1cbcd0dac, user_id=3047377818c445968858a09be378944f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.186343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0766a-1558-479a-ae3c-b1a417509188 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.188181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a0b27-a26a-46b0-b0c7-c4a9c3afab07 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.201744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.204333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:47.209607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.210990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.211902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.214441 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3971/7957] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:47 2022] PUT /identity/v3/projects/56e898b392c64fd8ab83eda1cbcd0dac/users/3047377818c445968858a09be378944f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:47.219680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.222449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189911-0fdf-42aa-a866-a0bde909730b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.223402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189911-0fdf-42aa-a866-a0bde909730b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.223915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189911-0fdf-42aa-a866-a0bde909730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.228596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.293565 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3987/7958] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:47.294781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ac189911-0fdf-42aa-a866-a0bde909730b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:47.295356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.296651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ac189911-0fdf-42aa-a866-a0bde909730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:47.340968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf76c-214c-4d95-9d1f-b9ed2ffd3ab7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.584904 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3972/7959] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:47.617908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.621058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189911-0fdf-42aa-a866-a0bde909730b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.622109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.622591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.623061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.633274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.648082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.696055 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3988/7960] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:47.702674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.746868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f37e27-653a-442b-a677-e20ff13cde8a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.768972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.772364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.775734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.776242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] PATH_INFO: `/v3/projects/d488fddeee80411ea57e07909846cbe7/users/d66e6506372c4264abda6ebae42e3d69/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.911833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189911-0fdf-42aa-a866-a0bde909730b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.926528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d488fddeee80411ea57e07909846cbe7, user_id=d66e6506372c4264abda6ebae42e3d69, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.939521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97861369-47b3-4646-a334-0bc9e2ef7f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.940711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861369-47b3-4646-a334-0bc9e2ef7f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.941620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861369-47b3-4646-a334-0bc9e2ef7f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.941771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861369-47b3-4646-a334-0bc9e2ef7f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.943459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:48.002886 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3989/7961] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:47 2022] PUT /identity/v3/projects/d488fddeee80411ea57e07909846cbe7/users/d66e6506372c4264abda6ebae42e3d69/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:48.018083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97861369-47b3-4646-a334-0bc9e2ef7f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:48.039334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:48.040305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97861369-47b3-4646-a334-0bc9e2ef7f96 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:48.045409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:48.076813 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3973/7962] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:48.081032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beaef3-83e3-4a45-98e9-79e6ed2136c5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:48.081541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beaef3-83e3-4a45-98e9-79e6ed2136c5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:48.082037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beaef3-83e3-4a45-98e9-79e6ed2136c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:48.182095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b4beaef3-83e3-4a45-98e9-79e6ed2136c5 None None] MFA Rules not processed for user `d66e6506372c4264abda6ebae42e3d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:48.185050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b4beaef3-83e3-4a45-98e9-79e6ed2136c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:48.204706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:48.399891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47ca2-d164-4e68-972d-43f70bba2cdf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:48.428655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:48.430467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:48.430986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:48.431537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:48.440705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:48.476107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3974/7963] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:48.484480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beaef3-83e3-4a45-98e9-79e6ed2136c5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:48.501860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:48.513288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:48.554519 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3990/7964] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:48.593523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:48.737966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beaef3-83e3-4a45-98e9-79e6ed2136c5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:48.754150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:48.755339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:48.755835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:48.756319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:48.757844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:48.762537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:48.839782 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3975/7965] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:48 2022] POST /identity/v3/projects => generated 385 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:48.840996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:48.883888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5073-f321-4572-abbb-b3d6d2e157ea service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:49.034765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:49.036081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:49.036713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:49.037995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:49.039531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:49.042847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:49.088352 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3991/7966] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:48 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:22:49.096677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:49.126899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01805a32-067f-4773-afd1-9e7ac3e425cc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:49.137356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:49.138330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:49.139041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:49.139500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:49.140788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:49.142938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:49.161131 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3976/7967] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:49.168465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:49.187176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078d809-860e-4c7b-9bbb-28edf1a69131 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:49.223196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:49.224477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:49.226556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:49.226556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] PATH_INFO: `/v3/projects/981681f5f978423c8c981d2ee7711c40/users/e8df1b51ba884dd29dc214cf1d29a81b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:49.280942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981681f5f978423c8c981d2ee7711c40, user_id=e8df1b51ba884dd29dc214cf1d29a81b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:49.286682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:49.321611 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3992/7968] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:49 2022] PUT /identity/v3/projects/981681f5f978423c8c981d2ee7711c40/users/e8df1b51ba884dd29dc214cf1d29a81b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:49.327447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:49.343235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf31bf-8893-4ffb-ac6e-c2774e6a04e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:49.595666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f2f9-f7f5-48c3-9ee7-ffd3aa03eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:49.596393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f2f9-f7f5-48c3-9ee7-ffd3aa03eb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:49.596678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f2f9-f7f5-48c3-9ee7-ffd3aa03eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:49.596959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f2f9-f7f5-48c3-9ee7-ffd3aa03eb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:49.597752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f2f9-f7f5-48c3-9ee7-ffd3aa03eb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:49.599951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f2f9-f7f5-48c3-9ee7-ffd3aa03eb21 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:49.630942 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3977/7969] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:22:49.638532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:49.661123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3fef-36f2-4c93-9887-d087073fb669 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:49.675964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:49.677884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:49.678801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:49.680435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] PATH_INFO: `/v3/projects/981681f5f978423c8c981d2ee7711c40/users/e8df1b51ba884dd29dc214cf1d29a81b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:49.685361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981681f5f978423c8c981d2ee7711c40, user_id=e8df1b51ba884dd29dc214cf1d29a81b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:49.709054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:49.768182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d427d-da17-4372-b674-272865a27e2f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:49.768973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d427d-da17-4372-b674-272865a27e2f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:49.770212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d427d-da17-4372-b674-272865a27e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:49.771381 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3993/7970] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:49 2022] PUT /identity/v3/projects/981681f5f978423c8c981d2ee7711c40/users/e8df1b51ba884dd29dc214cf1d29a81b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:49.834637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-919d427d-da17-4372-b674-272865a27e2f None None] MFA Rules not processed for user `e8df1b51ba884dd29dc214cf1d29a81b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:49.838977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-919d427d-da17-4372-b674-272865a27e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:50.104331 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3978/7971] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:22:50.117706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:50.120441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:50.285162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39606-3a19-42c6-8ce2-307fa3781941 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:50.290395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:50.291398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:50.291802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:50.292195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:50.327250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:50.328962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:50.359251 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3994/7972] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:50.549771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d30a39-a021-425c-ba16-19f441fdeb4b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:50.551449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d30a39-a021-425c-ba16-19f441fdeb4b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:50.552441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d30a39-a021-425c-ba16-19f441fdeb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:50.666140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e8d30a39-a021-425c-ba16-19f441fdeb4b None None] MFA Rules not processed for user `3047377818c445968858a09be378944f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:50.667589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8d30a39-a021-425c-ba16-19f441fdeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:50.702175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:50.907703 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3979/7973] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:50.910786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:50.950945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:51.122842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1cf2-6b62-4b2f-b0b9-b4b37a679349 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.149689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.149689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.149689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.149689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.150251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.150251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.219823 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3995/7974] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:22:50 2022] POST /identity/v3/projects => generated 405 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:22:51.225077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d30a39-a021-425c-ba16-19f441fdeb4b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.258649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d30a39-a021-425c-ba16-19f441fdeb4b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.421636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.425214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.425755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.426240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.427560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.430188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.493972 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3980/7975] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:22:51 2022] POST /identity/v3/users => generated 309 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:51.499590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.511700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46b5c6-5255-4010-abcd-97f35378a1d0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.529625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.530582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.531174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.531700 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.532831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.537420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.569847 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3996/7976] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:51.571200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.582962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c67a-fb2c-4576-8107-9ea3d8daa54c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.609331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.611292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.611679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.612085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] PATH_INFO: `/v3/projects/a2ea760517684e35ad2ef0e86c140b34/users/0a936ec34fc247bfa04dba90a26ed36f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.653978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ea760517684e35ad2ef0e86c140b34, user_id=0a936ec34fc247bfa04dba90a26ed36f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.657216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.684650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3981/7977] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:51 2022] PUT /identity/v3/projects/a2ea760517684e35ad2ef0e86c140b34/users/0a936ec34fc247bfa04dba90a26ed36f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:51.690494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.702153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227783-98c3-4a22-87c7-828e643e6fad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.726943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.890659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.891574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.893480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.893909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.895435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.896998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.901530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac6601-ec40-4ecd-b9e8-a14ec5f54571 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.910363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.911246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.914726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.915177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.924471 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3997/7978] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:22:51.926253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.948934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862f27-ffdf-4c1e-b75b-c88196d38a89 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.961535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88840f-0b65-49a8-b6ba-1483a300119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.964318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88840f-0b65-49a8-b6ba-1483a300119c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.965294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88840f-0b65-49a8-b6ba-1483a300119c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.968160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88840f-0b65-49a8-b6ba-1483a300119c admin admin] PATH_INFO: `/v3/projects/a2ea760517684e35ad2ef0e86c140b34/users/0a936ec34fc247bfa04dba90a26ed36f/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.974204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88840f-0b65-49a8-b6ba-1483a300119c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ea760517684e35ad2ef0e86c140b34, user_id=0a936ec34fc247bfa04dba90a26ed36f, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.977893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88840f-0b65-49a8-b6ba-1483a300119c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.998715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.006140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3998/7979] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:22:51 2022] PUT /identity/v3/projects/a2ea760517684e35ad2ef0e86c140b34/users/0a936ec34fc247bfa04dba90a26ed36f/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:52.061598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.063718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.084215 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3982/7980] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:54.740438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ac070-a22b-4bcf-8c99-d73db208a69d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:54.741089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ac070-a22b-4bcf-8c99-d73db208a69d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:54.741089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ac070-a22b-4bcf-8c99-d73db208a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:54.812514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-841ac070-a22b-4bcf-8c99-d73db208a69d None None] MFA Rules not processed for user `0a936ec34fc247bfa04dba90a26ed36f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:54.817794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-841ac070-a22b-4bcf-8c99-d73db208a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:54.985840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:55.029740 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3999/7981] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:22:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:22:56.244626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.246683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:56.457582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a021df4-3265-42da-b6a0-c8db049f92e9 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.681137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.681929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.682332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.682724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.685262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:56.716666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:56.718500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:56.756719 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3983/7982] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:22:57.186762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ac070-a22b-4bcf-8c99-d73db208a69d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.342695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ac070-a22b-4bcf-8c99-d73db208a69d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.355223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.356205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.356494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.356772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] PATH_INFO: `/v3/users/3047377818c445968858a09be378944f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.358083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3047377818c445968858a09be378944f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:57.360088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:57.460606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3047377818c445968858a09be378944f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:57.492910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3047377818c445968858a09be378944f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:57.514336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3047377818c445968858a09be378944f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:57.514336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3047377818c445968858a09be378944f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:57.528374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3047377818c445968858a09be378944f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:57.538657 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4000/7983] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:57 2022] DELETE /identity/v3/users/3047377818c445968858a09be378944f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:58.183009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.205072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33e43-3be7-4a23-8608-dca7ea3c6fe3 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.371687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.372805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.373263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.373755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] PATH_INFO: `/v3/projects/56e898b392c64fd8ab83eda1cbcd0dac` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.375247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e898b392c64fd8ab83eda1cbcd0dac)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.377540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.395372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.481154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e898b392c64fd8ab83eda1cbcd0dac', 'request_id': 'req-9fce41a9-08df-43fa-9677-fbc461806ec4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.502763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e898b392c64fd8ab83eda1cbcd0dac', 'request_id': 'req-9fce41a9-08df-43fa-9677-fbc461806ec4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.512193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e898b392c64fd8ab83eda1cbcd0dac', 'request_id': 'req-9fce41a9-08df-43fa-9677-fbc461806ec4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.536935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] The token cache is being invalidate because project 56e898b392c64fd8ab83eda1cbcd0dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:22:58.537403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.538793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.543979 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3984/7984] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:22:58 2022] DELETE /identity/v3/projects/56e898b392c64fd8ab83eda1cbcd0dac => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:58.547796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.549342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:58.589981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0039-f118-40b5-8a3d-33d9668e3516 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.776704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.778128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.778614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.779111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] PATH_INFO: `/v3/users/0a936ec34fc247bfa04dba90a26ed36f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.781238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a936ec34fc247bfa04dba90a26ed36f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.784550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.836996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.919522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a936ec34fc247bfa04dba90a26ed36f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.945533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a936ec34fc247bfa04dba90a26ed36f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.961517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a936ec34fc247bfa04dba90a26ed36f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.964258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a936ec34fc247bfa04dba90a26ed36f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:58.987067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09ed65a2-ebe9-46e3-bd31-b62bc2229fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a936ec34fc247bfa04dba90a26ed36f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:22:59.005224 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4001/7985] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:22:58 2022] DELETE /identity/v3/users/0a936ec34fc247bfa04dba90a26ed36f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:00.271181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:00.273378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:00.300786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce41a9-08df-43fa-9677-fbc461806ec4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:00.469006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:00.472579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.473098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.473562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] PATH_INFO: `/v3/projects/a2ea760517684e35ad2ef0e86c140b34` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.481380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ea760517684e35ad2ef0e86c140b34)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:00.487217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:00.674608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ea760517684e35ad2ef0e86c140b34', 'request_id': 'req-601c13c5-64e2-4cd0-ae88-1329d06b647a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:00.702577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ea760517684e35ad2ef0e86c140b34', 'request_id': 'req-601c13c5-64e2-4cd0-ae88-1329d06b647a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:00.728085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ea760517684e35ad2ef0e86c140b34', 'request_id': 'req-601c13c5-64e2-4cd0-ae88-1329d06b647a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:00.788879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] The token cache is being invalidate because project a2ea760517684e35ad2ef0e86c140b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:00.791027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:00.795071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601c13c5-64e2-4cd0-ae88-1329d06b647a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:00.805194 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3985/7986] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:00 2022] DELETE /identity/v3/projects/a2ea760517684e35ad2ef0e86c140b34 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:00.809858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1e7f-e2bd-42a2-b6c5-2fcb59973998 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.810356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1e7f-e2bd-42a2-b6c5-2fcb59973998 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.810460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1e7f-e2bd-42a2-b6c5-2fcb59973998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.929826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd1f1e7f-e2bd-42a2-b6c5-2fcb59973998 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:00.931419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd1f1e7f-e2bd-42a2-b6c5-2fcb59973998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:01.092816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4002/7987] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:01.104396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4efb4-87fd-4ae2-bbd8-99f92e6e81d6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.107246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4efb4-87fd-4ae2-bbd8-99f92e6e81d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.107749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4efb4-87fd-4ae2-bbd8-99f92e6e81d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.172685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-77e4efb4-87fd-4ae2-bbd8-99f92e6e81d6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:01.174381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-77e4efb4-87fd-4ae2-bbd8-99f92e6e81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:01.235514 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3986/7988] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:01.236311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1e7f-e2bd-42a2-b6c5-2fcb59973998 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.255733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1e7f-e2bd-42a2-b6c5-2fcb59973998 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.296715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.298019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.299928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.303072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.311967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:01.312829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.316379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:01.388202 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4003/7989] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:01.392896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4efb4-87fd-4ae2-bbd8-99f92e6e81d6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.403786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4efb4-87fd-4ae2-bbd8-99f92e6e81d6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.437880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.438774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.439070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.439419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.440147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.442194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:01.523953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:01.549863 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3987/7990] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:01 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:01.555097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.605393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce529-888f-4f02-b2c0-88a40d25ed3a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.849419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.857356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.857649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.857933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.858894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.862800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:01.910985 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4004/7991] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:01 2022] POST /identity/v3/users => generated 282 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:01.913408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.960732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0905342-819d-4a75-b5b9-2f9a3761254c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.998818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.000258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.000932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.001604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.003158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.008516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.059453 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3988/7992] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:02.063504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.074783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a91f4-2923-4772-b058-06b79a37cf2b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.101724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdebf15-6f5a-4fc5-b842-af86fdd7f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.102445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdebf15-6f5a-4fc5-b842-af86fdd7f6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.102735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdebf15-6f5a-4fc5-b842-af86fdd7f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.104746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdebf15-6f5a-4fc5-b842-af86fdd7f6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.105594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdebf15-6f5a-4fc5-b842-af86fdd7f6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.107389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdebf15-6f5a-4fc5-b842-af86fdd7f6a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.108892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.162128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.179645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4005/7993] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:02.182161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79dc34-edb8-4c66-84e6-ce05eecb3ff3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.200489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.201435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.201730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.202019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] PATH_INFO: `/v3/projects/0dad30779bf8492d88d1a12103f55cb0/users/466311faa7b94b23a1427d44d0d31306/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.277995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dad30779bf8492d88d1a12103f55cb0, user_id=466311faa7b94b23a1427d44d0d31306, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.281884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.334988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8154b5-c33b-418b-9f78-88c385cba6bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.335798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8154b5-c33b-418b-9f78-88c385cba6bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.336086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8154b5-c33b-418b-9f78-88c385cba6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.337615 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3989/7994] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:02 2022] PUT /identity/v3/projects/0dad30779bf8492d88d1a12103f55cb0/users/466311faa7b94b23a1427d44d0d31306/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:02.387026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d8154b5-c33b-418b-9f78-88c385cba6bc None None] MFA Rules not processed for user `466311faa7b94b23a1427d44d0d31306`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:02.388298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d8154b5-c33b-418b-9f78-88c385cba6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:02.503301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.512637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4006/7995] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:02.626922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d2588-1de7-4863-974e-1626615b6ed5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.640370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.641090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.641383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.641672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.642466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.649635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.723444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8154b5-c33b-418b-9f78-88c385cba6bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.733771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3990/7996] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:02 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:02.766799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8154b5-c33b-418b-9f78-88c385cba6bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.059471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.060111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.060385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.060675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.061399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.063712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.097487 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4007/7997] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:02 2022] POST /identity/v3/users => generated 289 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:03.099677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.113743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8f969-950c-4e38-b727-38246969d6ad admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.120362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.121078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.121429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.122005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.122871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.124745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.142808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.153268 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3991/7998] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:03.157197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6fb5-cd4d-4c86-b234-ddbe4fb20e8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.163424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.165026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.165464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.165892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] PATH_INFO: `/v3/projects/f7d1ba5f87454a9f918e41f10cdaae35/users/7285212dea2d4dcda414b992de703bdd/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.187804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d1ba5f87454a9f918e41f10cdaae35, user_id=7285212dea2d4dcda414b992de703bdd, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.191138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.224947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.231926 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4008/7999] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:03 2022] PUT /identity/v3/projects/f7d1ba5f87454a9f918e41f10cdaae35/users/7285212dea2d4dcda414b992de703bdd/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:03.241229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ec25-b259-4d72-9b9b-90174ec7bb4e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.380180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ad1f9-0adc-4e8d-b12d-2bfee003cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.382837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad1f9-0adc-4e8d-b12d-2bfee003cfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.383458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad1f9-0adc-4e8d-b12d-2bfee003cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.384319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad1f9-0adc-4e8d-b12d-2bfee003cfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.385569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ad1f9-0adc-4e8d-b12d-2bfee003cfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.387736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ad1f9-0adc-4e8d-b12d-2bfee003cfe5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.408189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.410305 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3992/8000] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:03.436665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574756a6-c66d-41f3-9995-a750d01e8f35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.444225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.445807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.446376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.446930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] PATH_INFO: `/v3/projects/f7d1ba5f87454a9f918e41f10cdaae35/users/7285212dea2d4dcda414b992de703bdd/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.450054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d1ba5f87454a9f918e41f10cdaae35, user_id=7285212dea2d4dcda414b992de703bdd, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.453930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.483998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607583-f42e-4524-9ef7-bc217242ddbc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.484244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607583-f42e-4524-9ef7-bc217242ddbc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.484652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607583-f42e-4524-9ef7-bc217242ddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.486546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4009/8001] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:03 2022] PUT /identity/v3/projects/f7d1ba5f87454a9f918e41f10cdaae35/users/7285212dea2d4dcda414b992de703bdd/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:03.549884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2f607583-f42e-4524-9ef7-bc217242ddbc None None] MFA Rules not processed for user `7285212dea2d4dcda414b992de703bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:03.551773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f607583-f42e-4524-9ef7-bc217242ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:03.609885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:03.734173 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3993/8002] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:03.902917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.902917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:04.009102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:04.017557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4bb8-7f22-47d0-ada5-753ff9afeece admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.020980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.021849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.022303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.022848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.034174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.035941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.111720 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4010/8003] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:04.289496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f607583-f42e-4524-9ef7-bc217242ddbc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.329372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f607583-f42e-4524-9ef7-bc217242ddbc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.333648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.334318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.335128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.335445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.514989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.516566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.534523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.536098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:04.563772 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3994/8004] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:04.615144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3eae-5d1b-4163-bd55-aa060d677813 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.626319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.627451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.628521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.628967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.642938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:04.922688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.932819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.968063 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4011/8005] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:05.818380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.828276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:05.990117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7feb-32b0-421b-8e2b-77ffb050c0aa service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.997733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.998810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.999204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.999628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] PATH_INFO: `/v3/users/a5636dbc7f0745bf845d714249f88de2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.001164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5636dbc7f0745bf845d714249f88de2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.004102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.367475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5636dbc7f0745bf845d714249f88de2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:06.389962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.416178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5636dbc7f0745bf845d714249f88de2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:06.417239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5636dbc7f0745bf845d714249f88de2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:06.449482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5636dbc7f0745bf845d714249f88de2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:06.468992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5636dbc7f0745bf845d714249f88de2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:06.528981 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3995/8006] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:05 2022] DELETE /identity/v3/users/a5636dbc7f0745bf845d714249f88de2 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:06.878760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.902701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118163ef-fddd-493c-990e-d5231821a778 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.034526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.039101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.039462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.039778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] PATH_INFO: `/v3/projects/f3becca3bc96409891c05f7bd47f1601` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.042628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3becca3bc96409891c05f7bd47f1601)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.056526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.138029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3becca3bc96409891c05f7bd47f1601', 'request_id': 'req-625bff1f-f526-4d35-8e13-4e2285fbe9d9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.145731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3becca3bc96409891c05f7bd47f1601', 'request_id': 'req-625bff1f-f526-4d35-8e13-4e2285fbe9d9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.153121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3becca3bc96409891c05f7bd47f1601', 'request_id': 'req-625bff1f-f526-4d35-8e13-4e2285fbe9d9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.156867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.175581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] The token cache is being invalidate because project f3becca3bc96409891c05f7bd47f1601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:07.176067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.176947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.179016 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4012/8007] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:06 2022] DELETE /identity/v3/projects/f3becca3bc96409891c05f7bd47f1601 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:07.183621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.185411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:07.202134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4e406-d461-4577-9f9a-46202de0f62c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.319678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.321196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.321639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.322324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] PATH_INFO: `/v3/users/9d308a61b80a441fa7a891d3b0f4dd6e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.325053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d308a61b80a441fa7a891d3b0f4dd6e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.328248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.415959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d308a61b80a441fa7a891d3b0f4dd6e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.445563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d308a61b80a441fa7a891d3b0f4dd6e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.450710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d308a61b80a441fa7a891d3b0f4dd6e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.476660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d308a61b80a441fa7a891d3b0f4dd6e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.477903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d308a61b80a441fa7a891d3b0f4dd6e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:07.511641 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3996/8008] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:07 2022] DELETE /identity/v3/users/9d308a61b80a441fa7a891d3b0f4dd6e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:07.975813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.979593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:08.022323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bff1f-f526-4d35-8e13-4e2285fbe9d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:08.152818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:08.155480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:08.155753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:08.159205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.160350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.160973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] PATH_INFO: `/v3/projects/79c87518b0d44e5aac946893f1d0c0a3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.163939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c87518b0d44e5aac946893f1d0c0a3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:08.169538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:08.186710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc63464-0edc-4b09-aedb-de33f8cfbda0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:08.193185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:08.194337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.194633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.194919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] PATH_INFO: `/v3/users/466311faa7b94b23a1427d44d0d31306` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.196248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466311faa7b94b23a1427d44d0d31306)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:08.198212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:08.248757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c87518b0d44e5aac946893f1d0c0a3', 'request_id': 'req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.257263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c87518b0d44e5aac946893f1d0c0a3', 'request_id': 'req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.265611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c87518b0d44e5aac946893f1d0c0a3', 'request_id': 'req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.283944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] The token cache is being invalidate because project 79c87518b0d44e5aac946893f1d0c0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:08.284793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.285895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92d4d8e1-eeb8-4ea4-af97-c93e8a6c3817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.288652 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4013/8009] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:07 2022] DELETE /identity/v3/projects/79c87518b0d44e5aac946893f1d0c0a3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:08.342134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:08.346364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466311faa7b94b23a1427d44d0d31306'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.396589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466311faa7b94b23a1427d44d0d31306'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.399986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466311faa7b94b23a1427d44d0d31306'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.437142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466311faa7b94b23a1427d44d0d31306'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.438775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466311faa7b94b23a1427d44d0d31306'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:08.480123 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3997/8010] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:08 2022] DELETE /identity/v3/users/466311faa7b94b23a1427d44d0d31306 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:08.485008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.485368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.485619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.524694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:08.525911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:08.718145 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4014/8011] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:08.727090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:08.729678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:08.864078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671df06-d1a4-4a6d-99ca-117a94e02b98 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:08.869772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:08.870779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.871258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.873528 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.902115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:08.903614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:08.917589 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3998/8012] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:09.429806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.431857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:09.450338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285806d5-955f-4367-a684-684f6e8a7db6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.463190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.464557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.465115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.465676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] PATH_INFO: `/v3/projects/0dad30779bf8492d88d1a12103f55cb0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.470632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dad30779bf8492d88d1a12103f55cb0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.473738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.538708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.574761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dad30779bf8492d88d1a12103f55cb0', 'request_id': 'req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.583301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dad30779bf8492d88d1a12103f55cb0', 'request_id': 'req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.593525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dad30779bf8492d88d1a12103f55cb0', 'request_id': 'req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.622861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] The token cache is being invalidate because project 0dad30779bf8492d88d1a12103f55cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:09.623300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.624240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.628197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4015/8013] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:09 2022] DELETE /identity/v3/projects/0dad30779bf8492d88d1a12103f55cb0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:09.633533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.649702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec54dc8-d7d3-4e95-a8c3-ae128c8dbd06 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.759298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.760977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.761266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.761551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] PATH_INFO: `/v3/users/7285212dea2d4dcda414b992de703bdd` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.762904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7285212dea2d4dcda414b992de703bdd)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.765091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.868902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7285212dea2d4dcda414b992de703bdd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.890819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7285212dea2d4dcda414b992de703bdd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.893270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7285212dea2d4dcda414b992de703bdd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.896219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.908533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7285212dea2d4dcda414b992de703bdd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.910217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7285212dea2d4dcda414b992de703bdd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:09.962085 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3999/8014] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:09 2022] DELETE /identity/v3/users/7285212dea2d4dcda414b992de703bdd => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:10.617190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.619776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:10.643295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff9ecd-9ca2-447e-b62c-ae0a3f7019ed admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.690684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.694329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:10.853028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.854046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.854410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.854807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] PATH_INFO: `/v3/users/2e628e9d69b1488ab8f37bca78a968bf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.856235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e628e9d69b1488ab8f37bca78a968bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:10.858827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:10.932162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73f815-07c4-4e03-9a5b-ffb993682b6a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.940127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.941422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.941750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.942105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] PATH_INFO: `/v3/projects/f7d1ba5f87454a9f918e41f10cdaae35` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.944607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d1ba5f87454a9f918e41f10cdaae35)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:10.946320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e628e9d69b1488ab8f37bca78a968bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:10.948238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:10.969127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e628e9d69b1488ab8f37bca78a968bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:10.982509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e628e9d69b1488ab8f37bca78a968bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:10.983617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e628e9d69b1488ab8f37bca78a968bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:11.007179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f998681-d72b-461a-af14-c190f465dc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e628e9d69b1488ab8f37bca78a968bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:11.026221 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4016/8015] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:10 2022] DELETE /identity/v3/users/2e628e9d69b1488ab8f37bca78a968bf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:11.029077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.030128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.030884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.077788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d1ba5f87454a9f918e41f10cdaae35', 'request_id': 'req-f3c00797-ca9e-4a90-b4f3-b8443955aa74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:11.095211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:11.097846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:11.102540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d1ba5f87454a9f918e41f10cdaae35', 'request_id': 'req-f3c00797-ca9e-4a90-b4f3-b8443955aa74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:11.114357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d1ba5f87454a9f918e41f10cdaae35', 'request_id': 'req-f3c00797-ca9e-4a90-b4f3-b8443955aa74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:11.132654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] The token cache is being invalidate because project f7d1ba5f87454a9f918e41f10cdaae35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:11.133321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:11.134248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f3c00797-ca9e-4a90-b4f3-b8443955aa74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:11.136426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4000/8016] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:10 2022] DELETE /identity/v3/projects/f7d1ba5f87454a9f918e41f10cdaae35 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:11.142935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.143359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bb248-94d5-44a6-a85e-a13def81c210 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.143772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bb248-94d5-44a6-a85e-a13def81c210 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.144172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bb248-94d5-44a6-a85e-a13def81c210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.171354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c48bb248-94d5-44a6-a85e-a13def81c210 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:11.173634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c48bb248-94d5-44a6-a85e-a13def81c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:11.199553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4017/8017] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:11.214793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.216311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:11.278671 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4001/8018] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:11.287362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16bfd-cd7a-4c7b-9fba-e7837f8e021e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.288019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16bfd-cd7a-4c7b-9fba-e7837f8e021e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.288348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16bfd-cd7a-4c7b-9fba-e7837f8e021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.307570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f00a-81fe-48fb-9d07-e2d62998fa46 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.315635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.317815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.317815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.317815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.323116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1fc16bfd-cd7a-4c7b-9fba-e7837f8e021e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:11.326161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1fc16bfd-cd7a-4c7b-9fba-e7837f8e021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:11.337596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.339606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.344624 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4002/8019] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:11.346116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc16bfd-cd7a-4c7b-9fba-e7837f8e021e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.357056 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4018/8020] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:11.357205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc16bfd-cd7a-4c7b-9fba-e7837f8e021e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.362714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.363619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.363978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.364325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.365231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:11.365644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.367646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.371119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.399890 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4003/8021] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:11.401424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.419535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba59d-3256-4d1a-b048-ee9be629ab42 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.427860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.428982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.429961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.430779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.431903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.434640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.486653 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4019/8022] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:11 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:11.491815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.509121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb16e3-4bec-437f-ab8d-35e788f74923 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.552799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.555718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:11.661326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.662119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.662636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.663175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.664059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.666401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.671925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349756e2-771a-43f5-9f4e-be9713579501 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.677032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.678926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.679485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.679982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.683046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:11.693761 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4004/8023] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:11 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:11.697549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.698570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.700898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.715219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd322d-472f-43a2-b4f7-1a56fb93bf3e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.715905 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4020/8024] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:11.721723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.722827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.723190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.723780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.724740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.726515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.741844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4005/8025] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:11.745938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.759568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140746d3-0754-41f0-9294-281e717dedb7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.765074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4b9e1-0ed6-4156-b6fb-f5f4f356d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.765868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4b9e1-0ed6-4156-b6fb-f5f4f356d338 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.766225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4b9e1-0ed6-4156-b6fb-f5f4f356d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.766581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4b9e1-0ed6-4156-b6fb-f5f4f356d338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.767438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4b9e1-0ed6-4156-b6fb-f5f4f356d338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.769178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4b9e1-0ed6-4156-b6fb-f5f4f356d338 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.780850 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4021/8026] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:11.785252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.798624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09055c-59c6-4f7a-8dd5-f66ff56e42b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.809189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.810379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.810956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.811434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] PATH_INFO: `/v3/projects/3139d09912874c4e9d42619932c99a0b/users/d9644f1f22344aefbc2c44dce9ae6d3a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.831241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3139d09912874c4e9d42619932c99a0b, user_id=d9644f1f22344aefbc2c44dce9ae6d3a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.833845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.858812 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4006/8027] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:11 2022] PUT /identity/v3/projects/3139d09912874c4e9d42619932c99a0b/users/d9644f1f22344aefbc2c44dce9ae6d3a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:11.868797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.869521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.869521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.910390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] MFA Rules not processed for user `d9644f1f22344aefbc2c44dce9ae6d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:11.911853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:11.959965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.047208 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4022/8028] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:12.052427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.071139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.072951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:12.159719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b2e9-6712-41f8-95bb-232a996ab4e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.161675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbb97b-2eaf-4fa9-9669-d94564bc2004 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.165373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.166350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.166715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.167067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.167771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.167979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.168835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.169894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.170273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] PATH_INFO: `/v3/projects/e16c0223cb1043cda6622dad197cd901` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.170617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.171918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16c0223cb1043cda6622dad197cd901)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.174413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.224288 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4007/8029] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:12.229712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.260616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16c0223cb1043cda6622dad197cd901', 'request_id': 'req-3240efcf-8f71-449c-bbb9-211e658c03a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.283559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16c0223cb1043cda6622dad197cd901', 'request_id': 'req-3240efcf-8f71-449c-bbb9-211e658c03a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.285995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.294886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16c0223cb1043cda6622dad197cd901', 'request_id': 'req-3240efcf-8f71-449c-bbb9-211e658c03a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.314879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] The token cache is being invalidate because project e16c0223cb1043cda6622dad197cd901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:12.316439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.317390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.321050 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4023/8030] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:12 2022] DELETE /identity/v3/projects/e16c0223cb1043cda6622dad197cd901 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:12.327645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.330008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfee91-9823-4091-8beb-18c0bcb36b0e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.330988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:12.429387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.430104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.430395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.430679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.431428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.433556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.462381 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4008/8031] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:12.466617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240efcf-8f71-449c-bbb9-211e658c03a6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.467905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.472168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.472357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:12.473149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.473552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.473875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] PATH_INFO: `/v3/users/d66e6506372c4264abda6ebae42e3d69` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.477589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66e6506372c4264abda6ebae42e3d69)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.481369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.485426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.498079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfa4b-e1b9-4a20-932f-378349289f89 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.508641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.510481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.510999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.511524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.512489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.515359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.528306 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4009/8032] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:12.532754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.545007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385352-96fa-4f4d-ae19-e3e27b6fba65 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.550429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.551769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.552196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.554029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] PATH_INFO: `/v3/projects/0e70775bef20419681b94c0bcda0535c/users/3224113ae2cf49e69f812e7c6a41a2c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.559763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66e6506372c4264abda6ebae42e3d69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.576864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e70775bef20419681b94c0bcda0535c, user_id=3224113ae2cf49e69f812e7c6a41a2c1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.580186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.581134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66e6506372c4264abda6ebae42e3d69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.595841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66e6506372c4264abda6ebae42e3d69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.598039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66e6506372c4264abda6ebae42e3d69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.606406 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4010/8033] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:12 2022] PUT /identity/v3/projects/0e70775bef20419681b94c0bcda0535c/users/3224113ae2cf49e69f812e7c6a41a2c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:12.611097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66e6506372c4264abda6ebae42e3d69'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:12.612146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.616508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:12.624796 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4024/8034] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:12 2022] DELETE /identity/v3/users/d66e6506372c4264abda6ebae42e3d69 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:12.741990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e8c95-996f-422f-ab2f-ef72d1991eef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.802390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.830016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6441e9-de28-4a77-9815-4b587a56de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.831302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6441e9-de28-4a77-9815-4b587a56de1f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.831505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6441e9-de28-4a77-9815-4b587a56de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.831788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6441e9-de28-4a77-9815-4b587a56de1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.832895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6441e9-de28-4a77-9815-4b587a56de1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.835047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6441e9-de28-4a77-9815-4b587a56de1f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.851392 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4011/8035] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:12.854219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.866740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2b54e-4fc3-4b8b-8359-5213729b22b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.872598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.873071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.873471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.873863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] PATH_INFO: `/v3/projects/0e70775bef20419681b94c0bcda0535c/users/3224113ae2cf49e69f812e7c6a41a2c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.877678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e70775bef20419681b94c0bcda0535c, user_id=3224113ae2cf49e69f812e7c6a41a2c1, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.880798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.907320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.907320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.907320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.908068 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4025/8036] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:12 2022] PUT /identity/v3/projects/0e70775bef20419681b94c0bcda0535c/users/3224113ae2cf49e69f812e7c6a41a2c1/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:12.947080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] MFA Rules not processed for user `3224113ae2cf49e69f812e7c6a41a2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:12.948198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:13.073113 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4012/8037] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:13.090446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.092834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:13.169329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.172085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:13.221863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce34258-8ab3-4826-a751-7bfbd2834406 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.229180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.230703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.231030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.231363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.252479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.254387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.277816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4026/8038] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:13.385617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acfba2-327f-4915-a94d-ad3ac5372798 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.399772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.400983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.401365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.401728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] PATH_INFO: `/v3/projects/d488fddeee80411ea57e07909846cbe7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.403621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d488fddeee80411ea57e07909846cbe7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.412199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.424839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.441725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07eab5-9943-49a8-bc83-39058d61fe79 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.459908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.460598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.460865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.461148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.465249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:13.512513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd488fddeee80411ea57e07909846cbe7', 'request_id': 'req-5049846d-b71a-4584-b1f4-e16b899b48c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.548244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd488fddeee80411ea57e07909846cbe7', 'request_id': 'req-5049846d-b71a-4584-b1f4-e16b899b48c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.556793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd488fddeee80411ea57e07909846cbe7', 'request_id': 'req-5049846d-b71a-4584-b1f4-e16b899b48c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.562982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.572572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.574586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.575821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] The token cache is being invalidate because project d488fddeee80411ea57e07909846cbe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:13.576188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.577466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.580749 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4013/8039] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:13 2022] DELETE /identity/v3/projects/d488fddeee80411ea57e07909846cbe7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:13.588425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.589989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:13.599966 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4027/8040] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:13.691707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049846d-b71a-4584-b1f4-e16b899b48c8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.699877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.701395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.701864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.702197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] PATH_INFO: `/v3/users/e8df1b51ba884dd29dc214cf1d29a81b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.704325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8df1b51ba884dd29dc214cf1d29a81b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.707502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.791236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8df1b51ba884dd29dc214cf1d29a81b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.806977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8df1b51ba884dd29dc214cf1d29a81b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.808125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8df1b51ba884dd29dc214cf1d29a81b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.819105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8df1b51ba884dd29dc214cf1d29a81b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.820098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab49c27e-905d-4932-bcd2-535d0e26c7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8df1b51ba884dd29dc214cf1d29a81b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:13.839877 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4014/8041] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:13 2022] DELETE /identity/v3/users/e8df1b51ba884dd29dc214cf1d29a81b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:14.285609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.301971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c6870-747d-476a-8b0d-e357b65dde5b service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.318276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:14.404955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.406098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.406451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.406814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] PATH_INFO: `/v3/projects/981681f5f978423c8c981d2ee7711c40` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.408418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981681f5f978423c8c981d2ee7711c40)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.410698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.486396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981681f5f978423c8c981d2ee7711c40', 'request_id': 'req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:14.494589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981681f5f978423c8c981d2ee7711c40', 'request_id': 'req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:14.505087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981681f5f978423c8c981d2ee7711c40', 'request_id': 'req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:14.533088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] The token cache is being invalidate because project 981681f5f978423c8c981d2ee7711c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:14.533520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:14.534218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d39c7b-1a4a-47ac-bbf3-e2ce6386a716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:14.542267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4028/8042] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:14 2022] DELETE /identity/v3/projects/981681f5f978423c8c981d2ee7711c40 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:14.544821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee992d8-8049-4807-bc1e-f4db278f6ed2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.544821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee992d8-8049-4807-bc1e-f4db278f6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.545183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee992d8-8049-4807-bc1e-f4db278f6ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.572825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-eee992d8-8049-4807-bc1e-f4db278f6ed2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:14.574817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eee992d8-8049-4807-bc1e-f4db278f6ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:14.694414 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4015/8043] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:14.713730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725bbc-cbb4-4565-b9e2-654c79b46998 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.714339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725bbc-cbb4-4565-b9e2-654c79b46998 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.715025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725bbc-cbb4-4565-b9e2-654c79b46998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.745384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cd725bbc-cbb4-4565-b9e2-654c79b46998 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:14.746680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cd725bbc-cbb4-4565-b9e2-654c79b46998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:14.761552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4029/8044] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:14.762505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee992d8-8049-4807-bc1e-f4db278f6ed2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.783545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee992d8-8049-4807-bc1e-f4db278f6ed2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.788657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.790140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.790778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.791136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.801221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:14.801780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.805812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.883624 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4016/8045] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:14.888936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd725bbc-cbb4-4565-b9e2-654c79b46998 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.902778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd725bbc-cbb4-4565-b9e2-654c79b46998 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.921279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.923854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.926043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.931323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.932804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.936463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.995583 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4030/8046] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:14 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:14.999520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.005634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.014271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eab67-9929-4c91-9685-a2e7383c6096 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.143237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.144048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.144354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.144624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.145493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.151863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.203250 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4017/8047] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:14 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:15.206127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.227404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe903-550f-4bbf-98c8-719a91778c5e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.233925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.234963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.235427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.235654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.236814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.239942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.285514 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4031/8048] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:15.285746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.317350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5116bdc-9543-4e15-89e8-dddb4ac004a0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.324316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c7b9-925f-4ad9-ace7-582be4b3dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.325648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c7b9-925f-4ad9-ace7-582be4b3dbcf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.326005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c7b9-925f-4ad9-ace7-582be4b3dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.326211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c7b9-925f-4ad9-ace7-582be4b3dbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.326971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c7b9-925f-4ad9-ace7-582be4b3dbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.329996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c7b9-925f-4ad9-ace7-582be4b3dbcf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.348411 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4018/8049] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:15.353355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.374906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937c330-764f-4e96-9b7d-3dadeb017eee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.390043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.392181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.392476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.392765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] PATH_INFO: `/v3/projects/8ed4aaeff60347a8bae29889ef0a0fb7/users/8d69d4379e344879bba99e1f1d065ca2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.438682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed4aaeff60347a8bae29889ef0a0fb7, user_id=8d69d4379e344879bba99e1f1d065ca2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.442011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.469248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4032/8050] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:15 2022] PUT /identity/v3/projects/8ed4aaeff60347a8bae29889ef0a0fb7/users/8d69d4379e344879bba99e1f1d065ca2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:15.484870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2abe3-3332-4049-a691-20a03457a893 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.484870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2abe3-3332-4049-a691-20a03457a893 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.485561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2abe3-3332-4049-a691-20a03457a893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.535676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a7d2abe3-3332-4049-a691-20a03457a893 None None] MFA Rules not processed for user `8d69d4379e344879bba99e1f1d065ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:15.537554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a7d2abe3-3332-4049-a691-20a03457a893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:15.648854 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4019/8051] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:15.654658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.707670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.763008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5916-d630-4ff6-bf6c-be152d5732a5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.768515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.769206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.769498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.770420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.770593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.773451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.830816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4033/8052] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:15 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:15.834646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2abe3-3332-4049-a691-20a03457a893 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.855909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2abe3-3332-4049-a691-20a03457a893 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.952489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.953514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.953968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.954410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.955422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.958053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.000257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:16.009595 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4020/8053] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:15 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:16.014974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.050755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8dd1b-9836-4314-92c9-4f62a10b8442 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.057116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.057989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.058351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.058705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.059640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.061539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.075429 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4034/8054] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:16.080330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.093304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe11432-86ed-42b7-aa61-cf535b6f98d0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.101017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.101950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.102730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.103020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] PATH_INFO: `/v3/projects/8f817a550a49472abf9868226ebf8dad/users/180ddc500301491abf0661aa0bfaed29/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.122333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f817a550a49472abf9868226ebf8dad, user_id=180ddc500301491abf0661aa0bfaed29, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.125177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.143396 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4021/8055] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:16 2022] PUT /identity/v3/projects/8f817a550a49472abf9868226ebf8dad/users/180ddc500301491abf0661aa0bfaed29/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:16.147711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.158483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840cc79-d625-4f82-bf2d-ac34ab41047e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.252210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1ec85-1c85-4f37-a271-6263e74021c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.253231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1ec85-1c85-4f37-a271-6263e74021c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.253690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1ec85-1c85-4f37-a271-6263e74021c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.254004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1ec85-1c85-4f37-a271-6263e74021c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.255370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1ec85-1c85-4f37-a271-6263e74021c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.256887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1ec85-1c85-4f37-a271-6263e74021c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.296588 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4035/8056] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:16.298284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.311824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae61668-f147-444b-aaa6-ad56d593dbf7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.317940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.319592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.320115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.320669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] PATH_INFO: `/v3/projects/8f817a550a49472abf9868226ebf8dad/users/180ddc500301491abf0661aa0bfaed29/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.336566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f817a550a49472abf9868226ebf8dad, user_id=180ddc500301491abf0661aa0bfaed29, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.341030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.386602 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4022/8057] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:16 2022] PUT /identity/v3/projects/8f817a550a49472abf9868226ebf8dad/users/180ddc500301491abf0661aa0bfaed29/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:16.399912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.400553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.400553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.480751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] MFA Rules not processed for user `180ddc500301491abf0661aa0bfaed29`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:16.482098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:16.627895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4036/8058] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:16.653039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.655395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:16.814418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0829f-fc6d-4cd3-a72c-c10e502534ba admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.835323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.837349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.838937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.839518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.030036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.033494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.057794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4023/8059] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:17.511262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.522550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:17.621129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.716087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05dfad-fb5f-4fcf-8fc7-13a2e0b8e0e4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.744473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.745385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.745851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.746274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] PATH_INFO: `/v3/users/7a00a929a3dd4608961f50265fd35caa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.748049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a00a929a3dd4608961f50265fd35caa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.751084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.853063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a00a929a3dd4608961f50265fd35caa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:17.871381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a00a929a3dd4608961f50265fd35caa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:17.882938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a00a929a3dd4608961f50265fd35caa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:17.883874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a00a929a3dd4608961f50265fd35caa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:17.894373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-486e9536-a5da-4ea8-b643-b7ac4d5b3ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a00a929a3dd4608961f50265fd35caa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:17.902989 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4037/8060] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:17 2022] DELETE /identity/v3/users/7a00a929a3dd4608961f50265fd35caa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:18.202815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.216848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335ad18-5f18-44e7-b259-8d79717c02d0 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.378005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.380038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.381006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.381542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] PATH_INFO: `/v3/projects/cc180baee4ea4158b008e3a5c227aac8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.385279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc180baee4ea4158b008e3a5c227aac8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.390314 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.465384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.503121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc180baee4ea4158b008e3a5c227aac8', 'request_id': 'req-78b7acf4-a9be-4b18-acf7-133f3f922e99'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:18.518270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc180baee4ea4158b008e3a5c227aac8', 'request_id': 'req-78b7acf4-a9be-4b18-acf7-133f3f922e99'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:18.529848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc180baee4ea4158b008e3a5c227aac8', 'request_id': 'req-78b7acf4-a9be-4b18-acf7-133f3f922e99'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:18.562118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] The token cache is being invalidate because project cc180baee4ea4158b008e3a5c227aac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:18.562671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:18.563596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78b7acf4-a9be-4b18-acf7-133f3f922e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:18.566963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4024/8061] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:18 2022] DELETE /identity/v3/projects/cc180baee4ea4158b008e3a5c227aac8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:18.573740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66594e-17e4-443c-8d9d-945ae0f91700 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.575323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66594e-17e4-443c-8d9d-945ae0f91700 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.576817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66594e-17e4-443c-8d9d-945ae0f91700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.598981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3c66594e-17e4-443c-8d9d-945ae0f91700 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:18.600459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c66594e-17e4-443c-8d9d-945ae0f91700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:18.703396 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4038/8062] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:18.709683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c107-6310-4e3f-b01d-1f168926257b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.709979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c107-6310-4e3f-b01d-1f168926257b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.710266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9c107-6310-4e3f-b01d-1f168926257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.783878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-18b9c107-6310-4e3f-b01d-1f168926257b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:18.799694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18b9c107-6310-4e3f-b01d-1f168926257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:18.840253 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4025/8063] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:18.840979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66594e-17e4-443c-8d9d-945ae0f91700 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.858260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66594e-17e4-443c-8d9d-945ae0f91700 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.866606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.867442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.867804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.868156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.869178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:18.869494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.873476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.893967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4039/8064] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:18.898194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9c107-6310-4e3f-b01d-1f168926257b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.909587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9c107-6310-4e3f-b01d-1f168926257b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.915591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.916611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.917057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.917421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.918211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.920401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.953836 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4026/8065] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:18 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:18.958133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.977006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e743-177b-43a9-afd1-01ec1fef69a9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.031485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:19.072332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.073546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.074069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.074604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.076276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.080036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.108915 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4040/8066] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:18 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:19.113023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.130517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f00aa-2f95-4db8-bf61-6100b5e8de16 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.135671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.136516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.136802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.137194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.137991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.139854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.156862 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4027/8067] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:19.160768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.172781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36bc7b-c8e6-4023-bff8-e4d0e64095d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.179083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4bef3-ca4e-4ba8-b7d2-7d27726ba666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.180146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bef3-ca4e-4ba8-b7d2-7d27726ba666 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.180597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bef3-ca4e-4ba8-b7d2-7d27726ba666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.181026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bef3-ca4e-4ba8-b7d2-7d27726ba666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.181899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4bef3-ca4e-4ba8-b7d2-7d27726ba666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.183873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4bef3-ca4e-4ba8-b7d2-7d27726ba666 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.199745 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4041/8068] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:19.201076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.215844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd926a3b-dde5-4d3d-aaf7-de293762af7b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.233618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.233618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.233618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.233618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] PATH_INFO: `/v3/projects/0c5780cff69c4f04a3e42a894d08c716/users/f608c40b07ad477a9707b70bb26bd2ec/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.259958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5780cff69c4f04a3e42a894d08c716, user_id=f608c40b07ad477a9707b70bb26bd2ec, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.262805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.280510 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4028/8069] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:19 2022] PUT /identity/v3/projects/0c5780cff69c4f04a3e42a894d08c716/users/f608c40b07ad477a9707b70bb26bd2ec/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:19.290622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a65d8-8f02-4645-8c8e-872b74cdade9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.291217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a65d8-8f02-4645-8c8e-872b74cdade9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.291493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a65d8-8f02-4645-8c8e-872b74cdade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.331895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d59a65d8-8f02-4645-8c8e-872b74cdade9 None None] MFA Rules not processed for user `f608c40b07ad477a9707b70bb26bd2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:19.333545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d59a65d8-8f02-4645-8c8e-872b74cdade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:19.417776 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4042/8070] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:19.422405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.535182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4d04f-3004-4f0b-a1f3-aa140a722a2f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.541124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.541908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.542270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.542622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.543449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.548200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.595977 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4029/8071] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:19 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:19.598998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a65d8-8f02-4645-8c8e-872b74cdade9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.611254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a65d8-8f02-4645-8c8e-872b74cdade9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.699179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.700177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.700177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.700966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.701758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.704015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.730595 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4043/8072] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:19 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:19.734546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.746015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21f48d-36b5-444f-804f-301ebec7b485 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.752964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.753913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.754347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.754885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.757042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.760010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.781317 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4030/8073] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:19.785370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.804484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a45494-3507-40bf-9963-e0622767b2f6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.813167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.814956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.815668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.816655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] PATH_INFO: `/v3/projects/d2e2a02d9af14c30a5eb74c7759a87a5/users/cf5d3f8e6b8342788ec2b1ba314d7e5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.864102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e2a02d9af14c30a5eb74c7759a87a5, user_id=cf5d3f8e6b8342788ec2b1ba314d7e5e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.869472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.921136 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4044/8074] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:19 2022] PUT /identity/v3/projects/d2e2a02d9af14c30a5eb74c7759a87a5/users/cf5d3f8e6b8342788ec2b1ba314d7e5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:19.924972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.925548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.928649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:19.940872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:19.951107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496af8b2-6a0f-44b8-abb5-484268b9f782 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.974440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.010919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd2ae-e3a2-4b54-a329-855b87ed8ab6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.016332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.017188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.017587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.018117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.018980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.020793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.034985 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4045/8075] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:20.038923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.078305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b502a3-f358-41b6-afc6-fc20c2f5b9be admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.087020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391645e4-ab69-4160-9cec-fd2656eb8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.093279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391645e4-ab69-4160-9cec-fd2656eb8f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.095015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391645e4-ab69-4160-9cec-fd2656eb8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.095590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391645e4-ab69-4160-9cec-fd2656eb8f86 admin admin] PATH_INFO: `/v3/projects/d2e2a02d9af14c30a5eb74c7759a87a5/users/cf5d3f8e6b8342788ec2b1ba314d7e5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.108949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391645e4-ab69-4160-9cec-fd2656eb8f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e2a02d9af14c30a5eb74c7759a87a5, user_id=cf5d3f8e6b8342788ec2b1ba314d7e5e, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.121046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391645e4-ab69-4160-9cec-fd2656eb8f86 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.149871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.151625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.152148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.152440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] PATH_INFO: `/v3/users/d9644f1f22344aefbc2c44dce9ae6d3a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.154439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9644f1f22344aefbc2c44dce9ae6d3a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.156099 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4046/8076] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:20 2022] PUT /identity/v3/projects/d2e2a02d9af14c30a5eb74c7759a87a5/users/cf5d3f8e6b8342788ec2b1ba314d7e5e/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:20.156798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.163611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb73b5-5a5f-4730-bf47-ee7ee2e52fa8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.164136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb73b5-5a5f-4730-bf47-ee7ee2e52fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.164688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb73b5-5a5f-4730-bf47-ee7ee2e52fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.243825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b2eb73b5-5a5f-4730-bf47-ee7ee2e52fa8 None None] MFA Rules not processed for user `cf5d3f8e6b8342788ec2b1ba314d7e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:20.245670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2eb73b5-5a5f-4730-bf47-ee7ee2e52fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.300043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9644f1f22344aefbc2c44dce9ae6d3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:20.324178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9644f1f22344aefbc2c44dce9ae6d3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:20.325492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9644f1f22344aefbc2c44dce9ae6d3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:20.345498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9644f1f22344aefbc2c44dce9ae6d3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:20.346918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6d6f449c-2695-4adb-b285-2301b7e3305f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9644f1f22344aefbc2c44dce9ae6d3a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:20.362724 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4047/8077] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:20.366873 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4031/8078] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:19 2022] DELETE /identity/v3/users/d9644f1f22344aefbc2c44dce9ae6d3a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:20.369629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb73b5-5a5f-4730-bf47-ee7ee2e52fa8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.372980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.373894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.374365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.392935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb73b5-5a5f-4730-bf47-ee7ee2e52fa8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.417237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:20.420189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.521118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.523606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.523606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.523606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.525963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.528235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.557344 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4048/8079] 10.222.0.98 () {60 vars in 1151 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:20.562163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.564839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.603034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.612142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6723f-f0a1-4c57-8866-78ccd3f09b93 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.621405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.622784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.623581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.624084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/f21e934ca9a54a3f81568ace8cd96781` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.625260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f21e934ca9a54a3f81568ace8cd96781)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.629393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.660562 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4032/8080] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:20.683779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.685286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.697533 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4049/8081] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:20 2022] DELETE /identity/v3/services/f21e934ca9a54a3f81568ace8cd96781 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:20.706131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.742463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.759699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54ff06-5a07-4740-855e-b8346dbbe291 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.768647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.770131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.772075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.772205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.773551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.776898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.804188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e636e4-be88-4f37-be3c-f5cbd255f482 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.807735 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4050/8082] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/services => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:20.809627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.833036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.834271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.834672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.834960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.839889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cba0f-1e1d-4545-88b3-ded56211d79f tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.845737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.846672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.847111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.847636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.848108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/37fb8bea9e3d4226849655e212ea9f47` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.848265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.849764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:update_service(service_id=37fb8bea9e3d4226849655e212ea9f47)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.851328 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:23:20.851328 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:23:20.851328 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:23:20.852800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.875080 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4033/8083] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/auth/tokens => generated 3363 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:20.898616 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4051/8084] 10.222.0.98 () {60 vars in 1251 bytes} [Thu Jul 14 15:23:20 2022] PATCH /identity/v3/services/37fb8bea9e3d4226849655e212ea9f47 => generated 284 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:20.905239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.924359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869efecb-8518-4919-b41e-f0634c562d81 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.942925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.944931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.944931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.944931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/37fb8bea9e3d4226849655e212ea9f47` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.946275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:get_service(service_id=37fb8bea9e3d4226849655e212ea9f47)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.946787 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:23:20.946787 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:23:20.946787 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:23:20.947739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.958036 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4034/8085] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/services/37fb8bea9e3d4226849655e212ea9f47 => generated 284 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:20.962586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.980315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080317-b87d-468f-81ab-b75276725df4 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.991774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.992982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.993283 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.993625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/37fb8bea9e3d4226849655e212ea9f47` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.995017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:delete_service(service_id=37fb8bea9e3d4226849655e212ea9f47)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.997394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.044301 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4052/8086] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:20 2022] DELETE /identity/v3/services/37fb8bea9e3d4226849655e212ea9f47 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:21.049590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.084957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4baf7d-2432-47bb-b42f-fe9127885eb0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.111985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.112463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.112922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.113078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/37fb8bea9e3d4226849655e212ea9f47` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.114032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:get_service(service_id=37fb8bea9e3d4226849655e212ea9f47)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.115943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Could not find service: 37fb8bea9e3d4226849655e212ea9f47.: keystone.exception.ServiceNotFound: Could not find service: 37fb8bea9e3d4226849655e212ea9f47. Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 37fb8bea9e3d4226849655e212ea9f47. Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:21.132651 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:21.133765 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 37fb8bea9e3d4226849655e212ea9f47. Jul 14 15:23:21.134799 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:23:21.135861 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4035/8087] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/services/37fb8bea9e3d4226849655e212ea9f47 => generated 113 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 15:23:21.139673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.153325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0327f-1c93-4555-a2b0-1eae3e8d7f85 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.160072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.160953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.161280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.161567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.162929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.164866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.194629 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4053/8088] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:21 2022] POST /identity/v3/services => generated 274 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:21.199151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.214676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887efd-fe17-436f-9ec3-229b2bd9a095 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.267601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.269990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.271602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.273423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.274900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.280298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.323928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4036/8089] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:21 2022] POST /identity/v3/services => generated 274 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:21.327571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.345464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d953627-e047-4034-a448-f0c33308e1e9 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.379609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.380330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.381221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.381542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.382378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.384076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.414315 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4054/8090] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:21 2022] POST /identity/v3/services => generated 274 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:21.418750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.440759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b758-62f4-451f-a793-a3ffc505f6cd tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.475960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.476794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.477213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.477629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.478798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.480028 n-d-768852-23 devstack@keystone.service[80582]: WARNING py.warnings [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:23:21.480028 n-d-768852-23 devstack@keystone.service[80582]: warnings.warn(msg) Jul 14 15:23:21.480028 n-d-768852-23 devstack@keystone.service[80582]: Jul 14 15:23:21.481190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.501667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4037/8091] 10.222.0.98 () {58 vars in 1130 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/services => generated 2977 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:21.508125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.527927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fdfc4-c419-4aef-8464-7e9ae9dba4e0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.529842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.533347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:21.535769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.536771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.537449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.538221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.539617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1406565522) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:21.540126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.541739 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:23:21.541739 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:23:21.541739 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:23:21.543006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.552284 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4055/8092] 10.222.0.98 () {58 vars in 1221 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1406565522 => generated 417 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:21.557257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.584567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe4f7-2302-4fa2-a747-71bf6b2092e6 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.600577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e458df-b671-4a6c-bb7f-864598665958 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.602605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.604173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.604813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.605000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.609604 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.610624 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.610799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.611019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] PATH_INFO: `/v3/projects/3139d09912874c4e9d42619932c99a0b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.611425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1319560899) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:21.611777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.613464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.616777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3139d09912874c4e9d42619932c99a0b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.618936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.625578 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4056/8093] 10.222.0.98 () {58 vars in 1221 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1319560899 => generated 417 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:21.627173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.639773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a238-67d7-43b4-8a3f-af672e503fe7 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.651977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.653867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.656580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.657001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.658328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1951904482) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:21.667804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.670131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.695389 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4057/8094] 10.222.0.98 () {58 vars in 1221 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1951904482 => generated 417 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:21.698341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.712179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8002-c02d-4ebf-bf72-a1c3a7a5d68c tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.732965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3139d09912874c4e9d42619932c99a0b', 'request_id': 'req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:21.778111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3139d09912874c4e9d42619932c99a0b', 'request_id': 'req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:21.789700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3139d09912874c4e9d42619932c99a0b', 'request_id': 'req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:21.804107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] The token cache is being invalidate because project 3139d09912874c4e9d42619932c99a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:21.804391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:21.805450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:21.810369 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4038/8095] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:21 2022] DELETE /identity/v3/projects/3139d09912874c4e9d42619932c99a0b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:21.811335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.812911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:21.816701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.818587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.819578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.820213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/fa12214b44e748e29e1c2ec33f8c1cb2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.821665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fa12214b44e748e29e1c2ec33f8c1cb2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.825999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.832374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.841935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.871170 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4058/8096] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:21 2022] DELETE /identity/v3/services/fa12214b44e748e29e1c2ec33f8c1cb2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:21.875987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.878614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:21.920404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6286d7-070e-4bfd-9817-8922326e52b0 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.931071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.933046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.933534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.933827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/d0242a7b593f4b8fb3fcc5e910a6ab34` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.934953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d0242a7b593f4b8fb3fcc5e910a6ab34)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.936971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.937105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c1de-10b6-48e6-8aa6-3327ac1093fb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.964953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.966066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.966387 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4059/8097] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:21 2022] DELETE /identity/v3/services/d0242a7b593f4b8fb3fcc5e910a6ab34 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:21.966772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.967182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] PATH_INFO: `/v3/users/3224113ae2cf49e69f812e7c6a41a2c1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.968607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3224113ae2cf49e69f812e7c6a41a2c1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.970466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.971472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.000416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766bdbd-74aa-40c6-a09c-ec2929cf8084 tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.021659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf5d3f8e6b8342788ec2b1ba314d7e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.027462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.027462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.027462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] PATH_INFO: `/v3/services/9d37a44f4b744692817858605be7ffd1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.027462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9d37a44f4b744692817858605be7ffd1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.031170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.066238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3224113ae2cf49e69f812e7c6a41a2c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.092932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3224113ae2cf49e69f812e7c6a41a2c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.094225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3224113ae2cf49e69f812e7c6a41a2c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.098638 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4060/8098] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:21 2022] DELETE /identity/v3/services/9d37a44f4b744692817858605be7ffd1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:22.105686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.108766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3224113ae2cf49e69f812e7c6a41a2c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.110565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3224113ae2cf49e69f812e7c6a41a2c1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.122816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.131484 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4039/8099] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:21 2022] DELETE /identity/v3/users/3224113ae2cf49e69f812e7c6a41a2c1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:22.218013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cba30-97b9-427a-b72e-7e182a22b58a tempest-ServicesTestJSON-1961712200 tempest-ServicesTestJSON-1961712200-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.415389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.417088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.417463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.417963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] PATH_INFO: `/v3/users/f608c40b07ad477a9707b70bb26bd2ec` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.420544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f608c40b07ad477a9707b70bb26bd2ec)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.424464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.544174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.545692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.555836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f608c40b07ad477a9707b70bb26bd2ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.584560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f608c40b07ad477a9707b70bb26bd2ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.615843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418b18-e68b-481f-864e-c69126c4b190 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.616335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f608c40b07ad477a9707b70bb26bd2ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.619891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f608c40b07ad477a9707b70bb26bd2ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.627097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.628508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.628978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.629721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] PATH_INFO: `/v3/projects/0e70775bef20419681b94c0bcda0535c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.631997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e70775bef20419681b94c0bcda0535c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.634539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.638999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.647638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-86301343-3b6e-497d-84f8-f3f8eb510be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f608c40b07ad477a9707b70bb26bd2ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.678165 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4061/8100] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:22 2022] DELETE /identity/v3/users/f608c40b07ad477a9707b70bb26bd2ec => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:22.692617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.695638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.697628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.735075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e70775bef20419681b94c0bcda0535c', 'request_id': 'req-d3587468-f30b-4bef-b71c-a6a1747f8ec1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.744384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:22.746784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.763736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e70775bef20419681b94c0bcda0535c', 'request_id': 'req-d3587468-f30b-4bef-b71c-a6a1747f8ec1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.789972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e70775bef20419681b94c0bcda0535c', 'request_id': 'req-d3587468-f30b-4bef-b71c-a6a1747f8ec1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.802792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.812467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] The token cache is being invalidate because project 0e70775bef20419681b94c0bcda0535c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:22.813538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.815131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d3587468-f30b-4bef-b71c-a6a1747f8ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:22.819089 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4040/8101] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:22 2022] DELETE /identity/v3/projects/0e70775bef20419681b94c0bcda0535c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:22.826781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92507aa-a7fa-42c8-8039-107ab1b56c6e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.829662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92507aa-a7fa-42c8-8039-107ab1b56c6e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.830007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92507aa-a7fa-42c8-8039-107ab1b56c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.863662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b92507aa-a7fa-42c8-8039-107ab1b56c6e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:22.865699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b92507aa-a7fa-42c8-8039-107ab1b56c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.914244 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4062/8102] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:22.932251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.935300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.995169 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4041/8103] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:23.004787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adc83-9abb-4347-ba06-37e04916da9f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.005806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adc83-9abb-4347-ba06-37e04916da9f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.006328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adc83-9abb-4347-ba06-37e04916da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.044532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f16adc83-9abb-4347-ba06-37e04916da9f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:23.046827 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f16adc83-9abb-4347-ba06-37e04916da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.060077 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4042/8104] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:23.066736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16adc83-9abb-4347-ba06-37e04916da9f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.089221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559126f8-88b1-4b4b-93e4-6229aece498e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.089929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16adc83-9abb-4347-ba06-37e04916da9f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.097694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.099713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.100505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.101008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.106094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.109118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.110507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.110988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.113408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:23.114157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.119489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.142537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.145501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.167906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4063/8105] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:23.183667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4043/8106] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.184897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.216970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07845d1a-8151-4b25-997a-2847ec675fb3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.250907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.252313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.252825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.253335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.256899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.261625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.338439 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4064/8107] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:23.340342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.361853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4ff03-2d96-48ba-920b-60df2b9cc694 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.521615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.522339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.522625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.522901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.523889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.526034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.556126 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4044/8108] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:23.561119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.573934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e029d2-1c8d-4f97-8350-a46f4cf615c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.579811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.580551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.580903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.581194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.581957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.584504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.603461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4065/8109] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:23.607019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.622336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc3c43-00eb-4dcb-a528-2c9de16aa276 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.635455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.636180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.637836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.638138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.638917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.640647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.655489 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4045/8110] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:23.662836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.680546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84ce0-b073-4cd2-831b-3bd2a6c160b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.696625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cab80-95c9-43ce-8145-3a9ed310d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.699112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cab80-95c9-43ce-8145-3a9ed310d92b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.700099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cab80-95c9-43ce-8145-3a9ed310d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.700819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cab80-95c9-43ce-8145-3a9ed310d92b admin admin] PATH_INFO: `/v3/projects/cbee186d05444090893bc24a54cc6d1e/users/8c773845ea5b4c39a8d2b1a57b5d034b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.731541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cab80-95c9-43ce-8145-3a9ed310d92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbee186d05444090893bc24a54cc6d1e, user_id=8c773845ea5b4c39a8d2b1a57b5d034b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.736570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.738377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cab80-95c9-43ce-8145-3a9ed310d92b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.739189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.764306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e18de6-f6fe-439a-af37-155a532fabfc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.797814 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4066/8111] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:23 2022] PUT /identity/v3/projects/cbee186d05444090893bc24a54cc6d1e/users/8c773845ea5b4c39a8d2b1a57b5d034b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:23.804849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.807835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.808713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.852636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.862763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] MFA Rules not processed for user `8c773845ea5b4c39a8d2b1a57b5d034b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:23.863722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.865733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.866384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.866857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] PATH_INFO: `/v3/projects/0c5780cff69c4f04a3e42a894d08c716` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.868579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.869030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5780cff69c4f04a3e42a894d08c716)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.871536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.913643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.962887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5780cff69c4f04a3e42a894d08c716', 'request_id': 'req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:23.981471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5780cff69c4f04a3e42a894d08c716', 'request_id': 'req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.018326 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4067/8112] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:24.022327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5780cff69c4f04a3e42a894d08c716', 'request_id': 'req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.034089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.036715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:24.048898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] The token cache is being invalidate because project 0c5780cff69c4f04a3e42a894d08c716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:24.049510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.050815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.056310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4046/8113] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:23 2022] DELETE /identity/v3/projects/0c5780cff69c4f04a3e42a894d08c716 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:24.061301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.064512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:24.147445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355718a-62cf-4f90-965a-b00fc6fca50f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.202765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa74340-c516-4f5f-ba6a-ad6464f03f2b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.209472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.210654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.211126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.212217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] PATH_INFO: `/v3/users/cf5d3f8e6b8342788ec2b1ba314d7e5e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.213797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5d3f8e6b8342788ec2b1ba314d7e5e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.216300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.263963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.264809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.265203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.265552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.267877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:24.336536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5d3f8e6b8342788ec2b1ba314d7e5e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.353849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.356543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5d3f8e6b8342788ec2b1ba314d7e5e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.357421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5d3f8e6b8342788ec2b1ba314d7e5e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.357774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.369533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5d3f8e6b8342788ec2b1ba314d7e5e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.370991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-15d79967-edc6-4973-9441-224d2d7b1b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5d3f8e6b8342788ec2b1ba314d7e5e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.385395 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4068/8114] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:24.395711 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4047/8115] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:24 2022] DELETE /identity/v3/users/cf5d3f8e6b8342788ec2b1ba314d7e5e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:24.430980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.433361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:24.471958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7df62-36bc-462d-bfea-04ee5a5d6223 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.498167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.561229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.562901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.563900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.564456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] PATH_INFO: `/v3/users/8c773845ea5b4c39a8d2b1a57b5d034b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.566402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c773845ea5b4c39a8d2b1a57b5d034b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.570567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.748151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c773845ea5b4c39a8d2b1a57b5d034b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.802195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c773845ea5b4c39a8d2b1a57b5d034b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.824315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c773845ea5b4c39a8d2b1a57b5d034b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.825564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c773845ea5b4c39a8d2b1a57b5d034b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.854854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c773845ea5b4c39a8d2b1a57b5d034b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:24.872372 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4069/8116] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:24 2022] DELETE /identity/v3/users/8c773845ea5b4c39a8d2b1a57b5d034b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:24.876374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.876955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.877643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.918061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.922764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.925601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:24.935038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:24.939124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:25.053000 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4048/8117] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:25.071389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.075416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:25.119057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1f9f6-f703-4ae5-98be-cee1cdb05320 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.130929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.132815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.133333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.133851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] PATH_INFO: `/v3/projects/d2e2a02d9af14c30a5eb74c7759a87a5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.136239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e2a02d9af14c30a5eb74c7759a87a5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.140903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.214849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd28300-a3b6-4aa7-b266-51f5a6b17931 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.221719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3773-116b-4db2-9114-061a1812eb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.222798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3773-116b-4db2-9114-061a1812eb77 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.223259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3773-116b-4db2-9114-061a1812eb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.223736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3773-116b-4db2-9114-061a1812eb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.238006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:25.241848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c3773-116b-4db2-9114-061a1812eb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.245699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c3773-116b-4db2-9114-061a1812eb77 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.251901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'request_id': 'req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:25.272503 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4049/8118] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:25.301318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'request_id': 'req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:25.320391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e2a02d9af14c30a5eb74c7759a87a5', 'request_id': 'req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:25.348560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] The token cache is being invalidate because project d2e2a02d9af14c30a5eb74c7759a87a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:25.349765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:25.350527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-29d6ca99-613d-4e6a-a8c7-aed3c54936c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:25.353632 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4070/8119] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:24 2022] DELETE /identity/v3/projects/d2e2a02d9af14c30a5eb74c7759a87a5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:25.367742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056a846-b6f7-4258-814f-e8c2b545bba7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.368323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056a846-b6f7-4258-814f-e8c2b545bba7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.368890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056a846-b6f7-4258-814f-e8c2b545bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.402385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a056a846-b6f7-4258-814f-e8c2b545bba7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:25.404628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a056a846-b6f7-4258-814f-e8c2b545bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:25.527648 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4050/8120] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:25.541595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd15b-1cca-4068-b299-60118da88339 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.542505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd15b-1cca-4068-b299-60118da88339 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.543820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd15b-1cca-4068-b299-60118da88339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.581471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8cfbd15b-1cca-4068-b299-60118da88339 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:25.582764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cfbd15b-1cca-4068-b299-60118da88339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:25.597503 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4071/8121] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:25.604152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056a846-b6f7-4258-814f-e8c2b545bba7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.621004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056a846-b6f7-4258-814f-e8c2b545bba7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.629466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.630936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.631843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.632341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.634687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:25.635299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.639795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.663384 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4051/8122] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:25.667972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd15b-1cca-4068-b299-60118da88339 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.682049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd15b-1cca-4068-b299-60118da88339 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.687914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.688597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.688887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.690282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.690282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.691817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.732592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.734744 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4072/8123] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:25 2022] POST /identity/v3/projects => generated 397 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:25.735520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:25.737359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.760342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a134bd2-6872-497c-8711-96b3e0bcf70f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.813127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:25.839741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69444376-6a32-4369-b8af-87bfd5d97c0c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.845577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.846288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.846571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.846850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.847667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.850277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.859059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.860461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.860850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.861333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] PATH_INFO: `/v3/projects/cbee186d05444090893bc24a54cc6d1e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.863633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbee186d05444090893bc24a54cc6d1e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.868715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.887335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4073/8124] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:25 2022] POST /identity/v3/users => generated 305 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:25.889997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.904114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495ecd1-5ec9-49c9-baef-072019349ac5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.911424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.913163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.913687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.914168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.915506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.918520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.941242 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4074/8125] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:25.943190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.961586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7266-529c-49bb-b847-c3da720d6b42 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.969114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbee186d05444090893bc24a54cc6d1e', 'request_id': 'req-6aa982f8-32b8-49de-bfa9-0e7bca8120df'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:25.981595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbee186d05444090893bc24a54cc6d1e', 'request_id': 'req-6aa982f8-32b8-49de-bfa9-0e7bca8120df'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:25.994176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbee186d05444090893bc24a54cc6d1e', 'request_id': 'req-6aa982f8-32b8-49de-bfa9-0e7bca8120df'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:26.011616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] The token cache is being invalidate because project cbee186d05444090893bc24a54cc6d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:26.012031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:26.012694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6aa982f8-32b8-49de-bfa9-0e7bca8120df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:26.018540 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4052/8126] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:25 2022] DELETE /identity/v3/projects/cbee186d05444090893bc24a54cc6d1e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:26.020168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fb8a-5ab9-4d2b-9126-042a47bd2683 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.020461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fb8a-5ab9-4d2b-9126-042a47bd2683 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.020746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fb8a-5ab9-4d2b-9126-042a47bd2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.046123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4900fb8a-5ab9-4d2b-9126-042a47bd2683 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:26.047725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4900fb8a-5ab9-4d2b-9126-042a47bd2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:26.076229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.077621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.084527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.084527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] PATH_INFO: `/v3/projects/3074aef3c56744c2954e02851c8b292f/users/6f70c10d223a4cfea41a02c4879bca61/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.101968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3074aef3c56744c2954e02851c8b292f, user_id=6f70c10d223a4cfea41a02c4879bca61, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.105626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.127130 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4075/8127] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:25 2022] PUT /identity/v3/projects/3074aef3c56744c2954e02851c8b292f/users/6f70c10d223a4cfea41a02c4879bca61/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:26.131952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.133994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:26.141160 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4053/8128] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:26.152866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.155900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2bb6-ef2a-41d2-a5af-c308c655f658 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.156422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2bb6-ef2a-41d2-a5af-c308c655f658 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.157011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2bb6-ef2a-41d2-a5af-c308c655f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.185055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c31c2bb6-ef2a-41d2-a5af-c308c655f658 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:26.186413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c31c2bb6-ef2a-41d2-a5af-c308c655f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:26.272099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a3f-6d9e-4ad2-8d53-397e611a0780 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.278144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.279475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.279837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.280140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.281648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.283499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.298123 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4076/8129] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:26.299982 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4054/8130] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:26.305706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.307845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c2bb6-ef2a-41d2-a5af-c308c655f658 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.327716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84ae8a-fd0b-435a-9ed7-c733efde8f13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.333093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c2bb6-ef2a-41d2-a5af-c308c655f658 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.337960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.339606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.340103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.340652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] PATH_INFO: `/v3/projects/3074aef3c56744c2954e02851c8b292f/users/6f70c10d223a4cfea41a02c4879bca61/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.344656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3074aef3c56744c2954e02851c8b292f, user_id=6f70c10d223a4cfea41a02c4879bca61, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.345108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757c09a-bfd4-4183-b185-da4b129d9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.347020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c09a-bfd4-4183-b185-da4b129d9bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.348115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c09a-bfd4-4183-b185-da4b129d9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.348793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c09a-bfd4-4183-b185-da4b129d9bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.350586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.351175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757c09a-bfd4-4183-b185-da4b129d9bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:26.352260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757c09a-bfd4-4183-b185-da4b129d9bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.357076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757c09a-bfd4-4183-b185-da4b129d9bb6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.362435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.385415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4077/8131] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:26 2022] PUT /identity/v3/projects/3074aef3c56744c2954e02851c8b292f/users/6f70c10d223a4cfea41a02c4879bca61/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:26.389152 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4055/8132] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:26.398005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.402325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dfba3-b250-487d-89d8-c3f673a21735 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.403298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dfba3-b250-487d-89d8-c3f673a21735 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.404109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dfba3-b250-487d-89d8-c3f673a21735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.450755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-737dfba3-b250-487d-89d8-c3f673a21735 None None] MFA Rules not processed for user `6f70c10d223a4cfea41a02c4879bca61`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:26.453135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-737dfba3-b250-487d-89d8-c3f673a21735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:26.514053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426514-ebb2-48a6-b8be-c07ebe20b2c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.527319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.528646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.529261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.529840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.531206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.535232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.584661 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4078/8133] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:26.588934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.620940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4056/8134] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:26.622823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dfba3-b250-487d-89d8-c3f673a21735 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.644407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dfba3-b250-487d-89d8-c3f673a21735 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.692695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f224b44-766e-4138-bc7c-33d013e8dd17 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.703304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.704215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.704645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.704988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.705778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.708074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.745013 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4079/8135] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:26.748319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.754734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.760988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f976ca-39a8-4263-b274-42581292445e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.767433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.768530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.768734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.769110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.769626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.771538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.771976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.772268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.773200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.774460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.776306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.776638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.808616 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4080/8136] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:26.809849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.821189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4effe8-f275-4d6a-96a6-5a753a1b3b9e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.827940 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4057/8137] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/projects => generated 397 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:26.829771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.902487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.903191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.903511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.903792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.904536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.906188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.917688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e642e33-a5fd-473e-8696-c1183de955c5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.918803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4081/8138] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:26.922977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.925919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.926620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.926917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.927972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.928722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.930900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.935172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a7b6e-60ee-47ff-b298-745162e60902 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.942014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899d821-f620-4e3e-affd-54b20dc86f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.942717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.943236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d821-f620-4e3e-affd-54b20dc86f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.943414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d821-f620-4e3e-affd-54b20dc86f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.943873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d821-f620-4e3e-affd-54b20dc86f0b admin admin] PATH_INFO: `/v3/projects/0f63009e284c4b2e9f6ceceb7f31eef1/users/546ff01bfa8b43748c2fb973d196c159/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.964179 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4058/8139] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:26.964731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899d821-f620-4e3e-affd-54b20dc86f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f63009e284c4b2e9f6ceceb7f31eef1, user_id=546ff01bfa8b43748c2fb973d196c159, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.965088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.967618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899d821-f620-4e3e-affd-54b20dc86f0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.981737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63275015-edd7-49c8-a0ac-20ed5752c095 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.992421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4082/8140] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:26 2022] PUT /identity/v3/projects/0f63009e284c4b2e9f6ceceb7f31eef1/users/546ff01bfa8b43748c2fb973d196c159/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:27.011540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921400-8823-4e8a-9f27-2e419dc5e3d4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.012037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921400-8823-4e8a-9f27-2e419dc5e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.012530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5921400-8823-4e8a-9f27-2e419dc5e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.052617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.053218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.053508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.053797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.054526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.056734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.069041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5921400-8823-4e8a-9f27-2e419dc5e3d4 None None] MFA Rules not processed for user `546ff01bfa8b43748c2fb973d196c159`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:27.071141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5921400-8823-4e8a-9f27-2e419dc5e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.075058 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4059/8141] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:27.081191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.099802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfc502-cd4a-4154-9a44-e3f391adb42f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.108327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.109342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.109658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.109967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.111229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.114461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.143360 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4060/8142] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:27.149330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.162784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e66b5-14ba-4811-8544-31108f2d07ff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.170610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ccd63-589b-4798-b475-bfa816bc3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.171826 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ccd63-589b-4798-b475-bfa816bc3857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.172118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ccd63-589b-4798-b475-bfa816bc3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.172395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ccd63-589b-4798-b475-bfa816bc3857 admin admin] PATH_INFO: `/v3/projects/448e5bee09d44287ac138f251b715453/users/a9222df6dcd14cd5b8d63aafc27a7968/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.193881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ccd63-589b-4798-b475-bfa816bc3857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e5bee09d44287ac138f251b715453, user_id=a9222df6dcd14cd5b8d63aafc27a7968, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.196896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ccd63-589b-4798-b475-bfa816bc3857 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.218877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4083/8143] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:27.219831 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4061/8144] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:27 2022] PUT /identity/v3/projects/448e5bee09d44287ac138f251b715453/users/a9222df6dcd14cd5b8d63aafc27a7968/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:27.224980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5921400-8823-4e8a-9f27-2e419dc5e3d4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.237093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.237562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.237905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.247898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5921400-8823-4e8a-9f27-2e419dc5e3d4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.277577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] MFA Rules not processed for user `a9222df6dcd14cd5b8d63aafc27a7968`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:27.279191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.359855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:27.377082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.378531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.379014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.379364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.381020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.384851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.387339 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4062/8145] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:27.399802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.401430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.453258 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4084/8146] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:27.455309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.493191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:27.534546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8073f-676d-474f-af69-46ae0ca95999 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.539922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.540740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.541102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.541486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.542244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.543462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd15af9-5511-4336-acd1-c5d7256b3dba None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.544626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.581737 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4085/8147] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:27.584311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.599560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2993-32ca-4fae-8fd7-06bcb89f1b4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.605349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.606221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.606416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.606641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.607415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.609179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.614401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.615690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.616568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.616858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.623318 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4086/8148] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:27.626570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.639052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec769-e25a-4fdb-9969-33eb49bf6df8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.645475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.647571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.648157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.648728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] PATH_INFO: `/v3/projects/75fb80ac721944f7858ac5e3b65c1ef0/users/0832aec6d00e44258a78a5922104dd75/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.671290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fb80ac721944f7858ac5e3b65c1ef0, user_id=0832aec6d00e44258a78a5922104dd75, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.677037 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.693160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.694834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.698319 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4087/8149] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:27 2022] PUT /identity/v3/projects/75fb80ac721944f7858ac5e3b65c1ef0/users/0832aec6d00e44258a78a5922104dd75/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:27.703882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.707202 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4063/8150] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:27.800485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20f81-7877-4eab-8e15-607252af2bec admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.807419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435fdf4-3660-495e-aad6-d51180cf3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.808131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435fdf4-3660-495e-aad6-d51180cf3277 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.808415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435fdf4-3660-495e-aad6-d51180cf3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.808695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435fdf4-3660-495e-aad6-d51180cf3277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.809450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435fdf4-3660-495e-aad6-d51180cf3277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.811106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435fdf4-3660-495e-aad6-d51180cf3277 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.824130 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4088/8151] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:27.830877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.846174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4007b6-37ba-4353-9d9f-02ede68d02b3 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.853070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.854129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.854509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.854738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] PATH_INFO: `/v3/projects/75fb80ac721944f7858ac5e3b65c1ef0/users/0832aec6d00e44258a78a5922104dd75/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.857393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fb80ac721944f7858ac5e3b65c1ef0, user_id=0832aec6d00e44258a78a5922104dd75, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.860617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.873786 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4064/8152] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:27 2022] PUT /identity/v3/projects/75fb80ac721944f7858ac5e3b65c1ef0/users/0832aec6d00e44258a78a5922104dd75/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:27.884456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea060e-85e6-4302-94e5-cf8750591825 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.884757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea060e-85e6-4302-94e5-cf8750591825 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.885044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea060e-85e6-4302-94e5-cf8750591825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.918824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0cea060e-85e6-4302-94e5-cf8750591825 None None] MFA Rules not processed for user `0832aec6d00e44258a78a5922104dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:27.920377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0cea060e-85e6-4302-94e5-cf8750591825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.941873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.018591 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4089/8153] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:28.032589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.035526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:28.149777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113aa3-a2dc-4ad3-9655-98068e513010 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.154799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e6e0-a6bf-44c9-a6b7-3a4b7f973afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.155544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e6e0-a6bf-44c9-a6b7-3a4b7f973afa service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.155837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e6e0-a6bf-44c9-a6b7-3a4b7f973afa service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.156152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e6e0-a6bf-44c9-a6b7-3a4b7f973afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.196072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea060e-85e6-4302-94e5-cf8750591825 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.233995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.250014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e6e0-a6bf-44c9-a6b7-3a4b7f973afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.251950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e6e0-a6bf-44c9-a6b7-3a4b7f973afa service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.275845 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4065/8154] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:28.327149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea060e-85e6-4302-94e5-cf8750591825 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.335997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.336918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.337220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.337512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] PATH_INFO: `/v3/users/6f70c10d223a4cfea41a02c4879bca61` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.339692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f70c10d223a4cfea41a02c4879bca61)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.343771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.444109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f70c10d223a4cfea41a02c4879bca61'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:28.476422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f70c10d223a4cfea41a02c4879bca61'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:28.489660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f70c10d223a4cfea41a02c4879bca61'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:28.493918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f70c10d223a4cfea41a02c4879bca61'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:28.506199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f70c10d223a4cfea41a02c4879bca61'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:28.524676 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4090/8155] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:28 2022] DELETE /identity/v3/users/6f70c10d223a4cfea41a02c4879bca61 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:28.526575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.526902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.527212 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.554254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:28.556334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:28.723334 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4066/8156] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:28.743485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.745760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:28.809605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.871595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af701ee-5af1-4b53-886e-2da61fd60680 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.878656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.880083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.881153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.881685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.902576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.907445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.926192 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4091/8157] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:29.396419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.399197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:29.420729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad7d7f-19f4-4bd8-b703-56a5c1cd1c5a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.431880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.433643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.435046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.435939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] PATH_INFO: `/v3/projects/3074aef3c56744c2954e02851c8b292f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.438782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3074aef3c56744c2954e02851c8b292f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.445401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.632976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3074aef3c56744c2954e02851c8b292f', 'request_id': 'req-13be09fd-ed30-4602-a309-0b52cff73b7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:29.648780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3074aef3c56744c2954e02851c8b292f', 'request_id': 'req-13be09fd-ed30-4602-a309-0b52cff73b7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:29.671646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3074aef3c56744c2954e02851c8b292f', 'request_id': 'req-13be09fd-ed30-4602-a309-0b52cff73b7d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:29.709490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] The token cache is being invalidate because project 3074aef3c56744c2954e02851c8b292f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:29.710491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:29.711971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:29.716009 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4067/8158] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:29 2022] DELETE /identity/v3/projects/3074aef3c56744c2954e02851c8b292f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:29.720340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.732714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385fec-6eab-4b74-a869-1bf461e8d11d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.885146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.886088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.886372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.886841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] PATH_INFO: `/v3/users/a9222df6dcd14cd5b8d63aafc27a7968` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.890667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9222df6dcd14cd5b8d63aafc27a7968)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.894416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.993846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9222df6dcd14cd5b8d63aafc27a7968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.011292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9222df6dcd14cd5b8d63aafc27a7968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.022800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9222df6dcd14cd5b8d63aafc27a7968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.023713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9222df6dcd14cd5b8d63aafc27a7968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.034306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9222df6dcd14cd5b8d63aafc27a7968'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.045636 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4092/8159] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:29 2022] DELETE /identity/v3/users/a9222df6dcd14cd5b8d63aafc27a7968 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:30.358789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.361324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:30.444012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.446559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:30.497721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.540034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be09fd-ed30-4602-a309-0b52cff73b7d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.556588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.563088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d57be-8d69-4927-b453-4090e8ec3c51 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.571100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.572287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.572586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.572884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] PATH_INFO: `/v3/projects/448e5bee09d44287ac138f251b715453` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.574219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] RBAC: Authorizing `identity:delete_project(project_id=448e5bee09d44287ac138f251b715453)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.577187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.648442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448e5bee09d44287ac138f251b715453', 'request_id': 'req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.651496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cf199-3066-4db6-bf93-f677cfb400d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.652178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf199-3066-4db6-bf93-f677cfb400d4 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.652468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf199-3066-4db6-bf93-f677cfb400d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.652751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf199-3066-4db6-bf93-f677cfb400d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.654698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-648cf199-3066-4db6-bf93-f677cfb400d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:30.659049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448e5bee09d44287ac138f251b715453', 'request_id': 'req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.669087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448e5bee09d44287ac138f251b715453', 'request_id': 'req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.670611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cf199-3066-4db6-bf93-f677cfb400d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.672340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cf199-3066-4db6-bf93-f677cfb400d4 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.703723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] The token cache is being invalidate because project 448e5bee09d44287ac138f251b715453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:30.703723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.704212 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4068/8160] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:30.706059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf4fcb54-9cd4-4a8a-b17e-da008ed558af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:30.710275 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4093/8161] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:30 2022] DELETE /identity/v3/projects/448e5bee09d44287ac138f251b715453 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:30.716548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfdd97-bca8-47f0-960e-14de9a1f64d9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.717821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfdd97-bca8-47f0-960e-14de9a1f64d9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.717821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfdd97-bca8-47f0-960e-14de9a1f64d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.742298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-05dfdd97-bca8-47f0-960e-14de9a1f64d9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:30.743668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05dfdd97-bca8-47f0-960e-14de9a1f64d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:30.821478 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4069/8162] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:30.829173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c0a9a-e009-4caa-9aa6-b6ca08b1252f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.829466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c0a9a-e009-4caa-9aa6-b6ca08b1252f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.829760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c0a9a-e009-4caa-9aa6-b6ca08b1252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.852924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7b7c0a9a-e009-4caa-9aa6-b6ca08b1252f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:30.854168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b7c0a9a-e009-4caa-9aa6-b6ca08b1252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:30.863001 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4094/8163] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:30.867859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfdd97-bca8-47f0-960e-14de9a1f64d9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.878441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfdd97-bca8-47f0-960e-14de9a1f64d9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.884257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.885617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.885975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.886300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.887117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:30.887517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.889315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.903667 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4070/8164] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.908594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c0a9a-e009-4caa-9aa6-b6ca08b1252f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.926642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c0a9a-e009-4caa-9aa6-b6ca08b1252f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.936425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.937611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.938062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.938586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.939969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.943605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.001954 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4095/8165] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:30 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:31.012585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.065440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad53286-80a4-418e-b280-d6796c90b0a5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.202116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.203615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.204123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.204615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.207761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.213467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.238540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.252969 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4071/8166] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:31 2022] POST /identity/v3/users => generated 303 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:31.256849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.299324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39df37-f6c5-489a-b6c0-6b44d4e925a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.317683 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.321039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.322482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.322914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.324251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.330223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.368081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.368998 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4096/8167] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:31.390566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e8cf-03c9-4c7f-b118-ea1bd3b78959 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.396668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.397744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.398044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.398335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] PATH_INFO: `/v3/projects/225c70c50b16468e97d7924abe15341d/users/07d2f32aa24f41ac9a299d79158ba5cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.419080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] RBAC: Authorizing `identity:create_grant(project_id=225c70c50b16468e97d7924abe15341d, user_id=07d2f32aa24f41ac9a299d79158ba5cb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.422290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.442704 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4072/8168] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:31 2022] PUT /identity/v3/projects/225c70c50b16468e97d7924abe15341d/users/07d2f32aa24f41ac9a299d79158ba5cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:31.446669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.463371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82a174-b9b1-4de4-b081-73de90e99752 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.543056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.545354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.545723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.545917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.546707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.548500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.566419 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4097/8169] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:31.568791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.589892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07ad56-fa4a-483d-9fcd-4fd34016ffef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.604817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2816d5-83fb-486a-a5e8-37873738c297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.606914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2816d5-83fb-486a-a5e8-37873738c297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.609097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2816d5-83fb-486a-a5e8-37873738c297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.609097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2816d5-83fb-486a-a5e8-37873738c297 admin admin] PATH_INFO: `/v3/projects/225c70c50b16468e97d7924abe15341d/users/07d2f32aa24f41ac9a299d79158ba5cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.627243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2816d5-83fb-486a-a5e8-37873738c297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225c70c50b16468e97d7924abe15341d, user_id=07d2f32aa24f41ac9a299d79158ba5cb, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.634180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2816d5-83fb-486a-a5e8-37873738c297 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.661297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.663780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:31.692019 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4073/8170] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:31 2022] PUT /identity/v3/projects/225c70c50b16468e97d7924abe15341d/users/07d2f32aa24f41ac9a299d79158ba5cb/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:31.703905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cd41-43ba-4fa4-a989-e0e14c37a2de None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.704276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cd41-43ba-4fa4-a989-e0e14c37a2de None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.704670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cd41-43ba-4fa4-a989-e0e14c37a2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.760094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.764671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8322cd41-43ba-4fa4-a989-e0e14c37a2de None None] MFA Rules not processed for user `07d2f32aa24f41ac9a299d79158ba5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:31.766058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8322cd41-43ba-4fa4-a989-e0e14c37a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:31.857501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb327-2060-4668-b79f-fe8ac8151282 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.893270 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4074/8171] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:31.898447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322cd41-43ba-4fa4-a989-e0e14c37a2de None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.937132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.937993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.938295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.938587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.940784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:32.014536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.016265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.033985 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4098/8172] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:23:32.047064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322cd41-43ba-4fa4-a989-e0e14c37a2de None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.053064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.053929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.054227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.054514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.055234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.057241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.100364 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4075/8173] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:31 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:32.104505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.117813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56d9e4-3982-4736-b3b7-1708abc44cda service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.197964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.198831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.199231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.199670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.200505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.202830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.221164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.259729 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4099/8174] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:32 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:32.261172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.285514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9b53b-5506-4bda-88e1-033c9a5c2cd2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.294501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.295747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.296261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.296773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.298214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.304414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.326695 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4076/8175] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:32.330255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.352706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277c28e-1700-4694-a9ab-723760bf5718 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.364031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d75e5-78b2-4436-bc02-83c0ace9f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.365506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d75e5-78b2-4436-bc02-83c0ace9f78f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.366033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d75e5-78b2-4436-bc02-83c0ace9f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.366540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d75e5-78b2-4436-bc02-83c0ace9f78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.368817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d75e5-78b2-4436-bc02-83c0ace9f78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.372758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d75e5-78b2-4436-bc02-83c0ace9f78f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.403374 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4100/8176] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:32.410728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.424112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a93c29-ae51-4086-be5e-84f98406cef4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.430523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.432130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.432559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.432987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] PATH_INFO: `/v3/projects/32da5de440ee407d9b01a2e3ba1d2dd4/users/9cd106449deb49e3a99925104486ef4d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.455730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da5de440ee407d9b01a2e3ba1d2dd4, user_id=9cd106449deb49e3a99925104486ef4d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.460381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.465734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.492429 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4077/8177] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:32 2022] PUT /identity/v3/projects/32da5de440ee407d9b01a2e3ba1d2dd4/users/9cd106449deb49e3a99925104486ef4d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:32.508462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5d70-fd7d-42da-99ea-5e3765bc9cf7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.508903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5d70-fd7d-42da-99ea-5e3765bc9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.509517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5d70-fd7d-42da-99ea-5e3765bc9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.555146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e54c5d70-fd7d-42da-99ea-5e3765bc9cf7 None None] MFA Rules not processed for user `9cd106449deb49e3a99925104486ef4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:32.557401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e54c5d70-fd7d-42da-99ea-5e3765bc9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:32.673220 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4101/8178] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:32.685310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.688539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:32.825348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112882a-6c1a-4640-8bda-c035ab0938b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.832237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa1487-30d5-431e-ab9c-86edd5f3d1d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.834079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1487-30d5-431e-ab9c-86edd5f3d1d3 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.834640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1487-30d5-431e-ab9c-86edd5f3d1d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.835148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1487-30d5-431e-ab9c-86edd5f3d1d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.925131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa1487-30d5-431e-ab9c-86edd5f3d1d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.926631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa1487-30d5-431e-ab9c-86edd5f3d1d3 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.939069 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4078/8179] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:33.917387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5d70-fd7d-42da-99ea-5e3765bc9cf7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.998631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5d70-fd7d-42da-99ea-5e3765bc9cf7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.004106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.005546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.005904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.006149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] PATH_INFO: `/v3/users/07d2f32aa24f41ac9a299d79158ba5cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.007692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d2f32aa24f41ac9a299d79158ba5cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.009714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.079297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d2f32aa24f41ac9a299d79158ba5cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.104122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d2f32aa24f41ac9a299d79158ba5cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.127742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d2f32aa24f41ac9a299d79158ba5cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.129271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d2f32aa24f41ac9a299d79158ba5cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.147635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.154571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b65ab7-8d42-47bb-b883-d3344e0c36e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d2f32aa24f41ac9a299d79158ba5cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.179094 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4102/8180] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:33 2022] DELETE /identity/v3/users/07d2f32aa24f41ac9a299d79158ba5cb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:34.184698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.185545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.185962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.241063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:34.242383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:34.277046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6d2d9-a9b9-4160-a520-90979a00bb39 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.277611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6d2d9-a9b9-4160-a520-90979a00bb39 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.278124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6d2d9-a9b9-4160-a520-90979a00bb39 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.281692 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4103/8181] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:23:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:34.290239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.290850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.291967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.357955 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4079/8182] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:34.367617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.371066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:34.372040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:34.373526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:34.507673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4104/8183] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:34.539475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.546517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33116-6155-4843-a14a-966d1ec83ecd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.553860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.553860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.554198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.554334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.564516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.565506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.567047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.569023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:34.580093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4080/8184] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:34.600983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff3f77-e1a6-4e59-a61d-708e11cea66d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.610574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90ed60-ba13-4f83-8042-03966b0af291 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.614292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90ed60-ba13-4f83-8042-03966b0af291 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.614973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90ed60-ba13-4f83-8042-03966b0af291 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.615507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90ed60-ba13-4f83-8042-03966b0af291 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.629105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90ed60-ba13-4f83-8042-03966b0af291 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.632134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90ed60-ba13-4f83-8042-03966b0af291 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.647323 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4105/8185] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:34.647797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.649322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:34.677987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6089-591a-4b01-b6a5-9b0485e9b343 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.689921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.692088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.693381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.693681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] PATH_INFO: `/v3/users/546ff01bfa8b43748c2fb973d196c159` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.696732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] RBAC: Authorizing `identity:delete_user(user_id=546ff01bfa8b43748c2fb973d196c159)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.702843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.825725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546ff01bfa8b43748c2fb973d196c159'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.859038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546ff01bfa8b43748c2fb973d196c159'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.861133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546ff01bfa8b43748c2fb973d196c159'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.878171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546ff01bfa8b43748c2fb973d196c159'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.879428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546ff01bfa8b43748c2fb973d196c159'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:34.907107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4081/8186] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:34 2022] DELETE /identity/v3/users/546ff01bfa8b43748c2fb973d196c159 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:34.913671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.914120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.914278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.967912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:34.969251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.122482 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4106/8187] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:35.131200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.132775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.162123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.165330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.375150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826f2e7-f627-4738-8fc8-813e7836379b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.398451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcc07b-8114-4f18-9633-286f69e7401b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.400616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc07b-8114-4f18-9633-286f69e7401b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.401059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc07b-8114-4f18-9633-286f69e7401b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.401464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc07b-8114-4f18-9633-286f69e7401b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.409467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61dcc07b-8114-4f18-9633-286f69e7401b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.419329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff23e-4c14-4be0-970b-7e60b86df021 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.433097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.433943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.434364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.434760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.456098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.457880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.464430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcc07b-8114-4f18-9633-286f69e7401b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.467174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcc07b-8114-4f18-9633-286f69e7401b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.480603 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4107/8188] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:35.481644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.485720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.495561 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4082/8189] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:35.519197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707bb6-177d-4727-a4c8-d75dbeeec09d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.533407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.534466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.534861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.535251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] PATH_INFO: `/v3/projects/225c70c50b16468e97d7924abe15341d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.540845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225c70c50b16468e97d7924abe15341d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.542834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.545024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.648942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e77f-38f0-4935-9922-85fae6f29121 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.649380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e77f-38f0-4935-9922-85fae6f29121 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.649919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e77f-38f0-4935-9922-85fae6f29121 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.651550 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4083/8190] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:35.659135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.659603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.659995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.661816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225c70c50b16468e97d7924abe15341d', 'request_id': 'req-7eb8d55b-ecc6-4c64-ae82-a8d042431868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:35.688656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225c70c50b16468e97d7924abe15341d', 'request_id': 'req-7eb8d55b-ecc6-4c64-ae82-a8d042431868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:35.699609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:35.700793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225c70c50b16468e97d7924abe15341d', 'request_id': 'req-7eb8d55b-ecc6-4c64-ae82-a8d042431868'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:35.715546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.751945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] The token cache is being invalidate because project 225c70c50b16468e97d7924abe15341d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:35.752554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:35.753471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:35.756663 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4108/8191] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:35 2022] DELETE /identity/v3/projects/225c70c50b16468e97d7924abe15341d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:35.762843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.766343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.888117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.913606 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4084/8192] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 14 15:23:35.961485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.964623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.985578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d55b-ecc6-4c64-ae82-a8d042431868 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.992056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.993094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.993454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.993811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] PATH_INFO: `/v3/users/9cd106449deb49e3a99925104486ef4d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.995942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd106449deb49e3a99925104486ef4d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.998590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.080982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81145c21-d928-44db-ab61-127c81b90c12 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.105851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.107167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.109346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.111833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.156540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd106449deb49e3a99925104486ef4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.169239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.174021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.192474 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4085/8193] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:36.231217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.251886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:36.284427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf2788-71df-416e-bc39-9fe216e6da0f service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.298665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.300166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.300564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.300956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd106449deb49e3a99925104486ef4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.301152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] PATH_INFO: `/v3/projects/0f63009e284c4b2e9f6ceceb7f31eef1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.303154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f63009e284c4b2e9f6ceceb7f31eef1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.305210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.345101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd106449deb49e3a99925104486ef4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.345908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd106449deb49e3a99925104486ef4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.376315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd106449deb49e3a99925104486ef4d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.387869 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4109/8194] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:35 2022] DELETE /identity/v3/users/9cd106449deb49e3a99925104486ef4d => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:36.440210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f63009e284c4b2e9f6ceceb7f31eef1', 'request_id': 'req-a8d6d94b-98ab-411d-b002-495c277abe62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.450673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f63009e284c4b2e9f6ceceb7f31eef1', 'request_id': 'req-a8d6d94b-98ab-411d-b002-495c277abe62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.470510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f63009e284c4b2e9f6ceceb7f31eef1', 'request_id': 'req-a8d6d94b-98ab-411d-b002-495c277abe62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.502958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] The token cache is being invalidate because project 0f63009e284c4b2e9f6ceceb7f31eef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:36.505977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.509844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:36.516119 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4086/8195] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:36 2022] DELETE /identity/v3/projects/0f63009e284c4b2e9f6ceceb7f31eef1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:36.521321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.524147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:36.546910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.600548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.601941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:36.715296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6d3de-bd94-400e-8f68-64fb350544c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.802907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d94b-98ab-411d-b002-495c277abe62 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.813237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.813946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.814240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.814531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.819078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:36.893311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.895164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.895682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.897280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] PATH_INFO: `/v3/users/0832aec6d00e44258a78a5922104dd75` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.898908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0832aec6d00e44258a78a5922104dd75)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.902358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.026352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0832aec6d00e44258a78a5922104dd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.045152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0832aec6d00e44258a78a5922104dd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.056249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.057939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.071611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0832aec6d00e44258a78a5922104dd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.072703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0832aec6d00e44258a78a5922104dd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.093704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-02c9296c-bc63-4ed3-80c8-8af938af1d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0832aec6d00e44258a78a5922104dd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.105446 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4110/8196] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:36 2022] DELETE /identity/v3/users/0832aec6d00e44258a78a5922104dd75 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:37.108956 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4087/8197] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:37.284481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.284790 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.286207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.319002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:37.320611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.376465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.378047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.383651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.393084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.408249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406220-8187-4dfd-a831-dd20db86c209 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.461002 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4111/8198] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:37.478510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.480046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.501331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b74b8-e132-4180-9af1-5c9bb095ceba None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.519841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e7e5c-7f74-4d45-b5dc-9cd39360d11e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.521852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e7e5c-7f74-4d45-b5dc-9cd39360d11e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.522759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e7e5c-7f74-4d45-b5dc-9cd39360d11e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.523436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e7e5c-7f74-4d45-b5dc-9cd39360d11e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.525456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.527334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.527855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.528321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] PATH_INFO: `/v3/projects/32da5de440ee407d9b01a2e3ba1d2dd4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.530193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32da5de440ee407d9b01a2e3ba1d2dd4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.532979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.549864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e7e5c-7f74-4d45-b5dc-9cd39360d11e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.553161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e7e5c-7f74-4d45-b5dc-9cd39360d11e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.567108 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4112/8199] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:37.648797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32da5de440ee407d9b01a2e3ba1d2dd4', 'request_id': 'req-1f3d79a6-c8cb-4f15-9a02-573440652817'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.665855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32da5de440ee407d9b01a2e3ba1d2dd4', 'request_id': 'req-1f3d79a6-c8cb-4f15-9a02-573440652817'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.676317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32da5de440ee407d9b01a2e3ba1d2dd4', 'request_id': 'req-1f3d79a6-c8cb-4f15-9a02-573440652817'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.690414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] The token cache is being invalidate because project 32da5de440ee407d9b01a2e3ba1d2dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:37.690814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.691721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:37.696440 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4088/8200] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:37 2022] DELETE /identity/v3/projects/32da5de440ee407d9b01a2e3ba1d2dd4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:37.703218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d8690-50db-4411-a531-e797f0ba18a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.703802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d8690-50db-4411-a531-e797f0ba18a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.704329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d8690-50db-4411-a531-e797f0ba18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.715815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.721390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.767325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c06d8690-50db-4411-a531-e797f0ba18a9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:37.768964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c06d8690-50db-4411-a531-e797f0ba18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.907914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d79a6-c8cb-4f15-9a02-573440652817 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.926234 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4113/8201] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:37.929024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.930104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.930544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.930993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] PATH_INFO: `/v3/projects/75fb80ac721944f7858ac5e3b65c1ef0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.932465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fb80ac721944f7858ac5e3b65c1ef0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.934617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.938457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41cca-e347-4c17-9161-c020b51ddfb0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.938980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41cca-e347-4c17-9161-c020b51ddfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.939965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41cca-e347-4c17-9161-c020b51ddfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.997865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.013654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fb80ac721944f7858ac5e3b65c1ef0', 'request_id': 'req-8a2c6be6-24d9-467a-8754-cad997cdd470'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:38.018485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1ee41cca-e347-4c17-9161-c020b51ddfb0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:38.021402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ee41cca-e347-4c17-9161-c020b51ddfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:38.039384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fb80ac721944f7858ac5e3b65c1ef0', 'request_id': 'req-8a2c6be6-24d9-467a-8754-cad997cdd470'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:38.065168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fb80ac721944f7858ac5e3b65c1ef0', 'request_id': 'req-8a2c6be6-24d9-467a-8754-cad997cdd470'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:38.084083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] The token cache is being invalidate because project 75fb80ac721944f7858ac5e3b65c1ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:38.084083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:38.085186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8a2c6be6-24d9-467a-8754-cad997cdd470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:38.088606 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4089/8202] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:37 2022] DELETE /identity/v3/projects/75fb80ac721944f7858ac5e3b65c1ef0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:38.093756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6023a88-5a20-415f-8586-9f1b162ac3e2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.094039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6023a88-5a20-415f-8586-9f1b162ac3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.094319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6023a88-5a20-415f-8586-9f1b162ac3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.141583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a6023a88-5a20-415f-8586-9f1b162ac3e2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:38.143064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a6023a88-5a20-415f-8586-9f1b162ac3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:38.235895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4114/8203] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:38.242933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee41cca-e347-4c17-9161-c020b51ddfb0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.268889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee41cca-e347-4c17-9161-c020b51ddfb0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.282546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.283355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.286444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.286779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.287647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:38.287958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.289636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.318021 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4115/8204] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.321021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.339656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a113d1-03b2-47d1-b200-b03c957bbf02 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.346294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.347047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.347396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.347817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.348584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.349842 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4090/8205] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:38.352788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.360125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6a08-aa99-40fe-99b9-307b154ee892 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.360805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6a08-aa99-40fe-99b9-307b154ee892 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.361305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6a08-aa99-40fe-99b9-307b154ee892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.395690 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4116/8206] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:38 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:38.403685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.413019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ef0c6a08-aa99-40fe-99b9-307b154ee892 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:38.416292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ef0c6a08-aa99-40fe-99b9-307b154ee892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:38.444758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.501984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68cd97-f7ba-4046-babb-ea6acadc6bda admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.509814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.510783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.511176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.511460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.512160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.514376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.554407 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4117/8207] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:38 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:38.559403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.574422 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4091/8208] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:38.576169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5a22a-4a5f-46e8-8673-010948b108b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.579689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c6a08-aa99-40fe-99b9-307b154ee892 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.585439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.586758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.587416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.588237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.589818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.593498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.593938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c6a08-aa99-40fe-99b9-307b154ee892 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.602902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.603867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.604170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.604608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.605398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:38.605772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.608850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.618120 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4118/8209] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:38.625072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.632619 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4092/8210] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.637176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.646090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec696aae-c9e7-44f1-b78c-bf62868ee554 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.651166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7918-91cc-4253-ba47-0d1269909027 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.654902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.656570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.657050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.657599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] PATH_INFO: `/v3/projects/6dfc3dcb6a5f4b7db9e2a97d3436db86/users/2d4e0c92d5f847b796057b2d7d287905/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.658674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.663532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.665344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.665892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.666934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.669363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.692045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfc3dcb6a5f4b7db9e2a97d3436db86, user_id=2d4e0c92d5f847b796057b2d7d287905, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.698477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.720263 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4093/8211] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:38 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:38.721355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.736373 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4119/8212] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:38 2022] PUT /identity/v3/projects/6dfc3dcb6a5f4b7db9e2a97d3436db86/users/2d4e0c92d5f847b796057b2d7d287905/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:38.742429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.770030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.822133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afb78d-e1c0-40e0-b185-072dd745ef59 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.911736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.912460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.912754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.913194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.913932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.916953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.940724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d4c6e-b160-4253-9ed8-fd9bf2456226 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.949038 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4094/8213] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:38 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:38.950167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.951655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.952307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.952882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.953732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.954449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.957698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.969608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b965-c31b-4e23-9ac3-31193abcb875 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.976661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.977538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.977837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.978282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.978637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4120/8214] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:38.979568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.981737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.997334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.001710 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4095/8215] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:39.002921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.013699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb38a1-32f3-403e-aac5-b9b44d26da9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.018512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3fa62-7321-4563-991d-322e2f01da25 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.021932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9a2a4-ae69-4071-8f27-daff6eb0972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.023484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a2a4-ae69-4071-8f27-daff6eb0972a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.024009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a2a4-ae69-4071-8f27-daff6eb0972a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.024638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a2a4-ae69-4071-8f27-daff6eb0972a admin admin] PATH_INFO: `/v3/projects/6dfc3dcb6a5f4b7db9e2a97d3436db86/users/2d4e0c92d5f847b796057b2d7d287905/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.025581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.027102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.027606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.028164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9a2a4-ae69-4071-8f27-daff6eb0972a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfc3dcb6a5f4b7db9e2a97d3436db86, user_id=2d4e0c92d5f847b796057b2d7d287905, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.028355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.029359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.031388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.033721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9a2a4-ae69-4071-8f27-daff6eb0972a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.055570 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4096/8216] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:39.058616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.059031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4121/8217] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:38 2022] PUT /identity/v3/projects/6dfc3dcb6a5f4b7db9e2a97d3436db86/users/2d4e0c92d5f847b796057b2d7d287905/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:39.071704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b42de1-ca2b-48d8-809a-6273c12e5367 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.072280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b42de1-ca2b-48d8-809a-6273c12e5367 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.072768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b42de1-ca2b-48d8-809a-6273c12e5367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.080589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13451940-90de-4bf8-a1d0-cbc0dc5c8a51 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.119569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a0b42de1-ca2b-48d8-809a-6273c12e5367 None None] MFA Rules not processed for user `2d4e0c92d5f847b796057b2d7d287905`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:39.121800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a0b42de1-ca2b-48d8-809a-6273c12e5367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:39.237715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44930b4-8622-4c7e-81a3-605d0879cafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.257871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44930b4-8622-4c7e-81a3-605d0879cafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.258502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44930b4-8622-4c7e-81a3-605d0879cafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.259125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44930b4-8622-4c7e-81a3-605d0879cafb admin admin] PATH_INFO: `/v3/projects/71d1bad91b404fbcad07156014b35580/users/07ab8e1f979244c1bc6ad0d9e76ea918/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.280754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.305686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44930b4-8622-4c7e-81a3-605d0879cafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d1bad91b404fbcad07156014b35580, user_id=07ab8e1f979244c1bc6ad0d9e76ea918, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.307991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44930b4-8622-4c7e-81a3-605d0879cafb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.323224 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4122/8218] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:39.324594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b42de1-ca2b-48d8-809a-6273c12e5367 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.347160 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4097/8219] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:39 2022] PUT /identity/v3/projects/71d1bad91b404fbcad07156014b35580/users/07ab8e1f979244c1bc6ad0d9e76ea918/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:39.355310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc829aa-8b53-471a-9364-19d286330200 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.355310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc829aa-8b53-471a-9364-19d286330200 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.355310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc829aa-8b53-471a-9364-19d286330200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.374555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b42de1-ca2b-48d8-809a-6273c12e5367 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.400840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fcc829aa-8b53-471a-9364-19d286330200 None None] MFA Rules not processed for user `07ab8e1f979244c1bc6ad0d9e76ea918`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:39.402320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fcc829aa-8b53-471a-9364-19d286330200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:39.420993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.504598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.505709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.506310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.507114 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4098/8220] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:39.507317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.507969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc829aa-8b53-471a-9364-19d286330200 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.508338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.511328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.529336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc829aa-8b53-471a-9364-19d286330200 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.536957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.537675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.537993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.538401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.539252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.541345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.587101 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4123/8221] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:39.590980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.595373 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4099/8222] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:39.597092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.734837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4b83a-5cf1-4267-95a0-683075b80fef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.836577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.837960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.838604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.839048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.839994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.841534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b5a2b-371e-437a-bc07-cff776b85b9a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.842972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.849927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.851027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.851434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.851791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.852637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.855002 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.877812 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4124/8223] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:39.884536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.888325 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4100/8224] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:39.889433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.904470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c444-d71c-4200-b17d-ec42dfe33856 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.910138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.910897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.911763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.912047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.912887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.913471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b577-716f-4488-b32f-837245e473c1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.915129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.918423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.935096 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4125/8225] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:39.935319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.936119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.936391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.936563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.937350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.939495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.942131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.957672 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4101/8226] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:39.965922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.972169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047f184-89fd-4205-b327-052546675cf4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.986266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfea633-8791-4f36-8962-95c3ed7ff6d9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.987923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.989234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.989783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.990303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.993392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.994478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.995043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.995393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.996756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.999543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.011595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.015311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.022645 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4102/8227] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:40.023833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.072524 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4126/8228] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:40.073821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6753a-1e97-4e04-a291-161a67f5c448 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.081881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.093997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3535f1c-5291-4ca8-b499-aec9c7d9f52b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.102436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e18bb-a73f-4b8a-b2f7-7ef31853dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.106423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e18bb-a73f-4b8a-b2f7-7ef31853dfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.107003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e18bb-a73f-4b8a-b2f7-7ef31853dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.107584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e18bb-a73f-4b8a-b2f7-7ef31853dfb5 admin admin] PATH_INFO: `/v3/projects/9765688d2712470d8bb190b65a9c1caa/users/af8db422526e48bc8805c83139a5d4b0/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.138264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ff040-485e-4e9e-b85f-ade8eff44741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.139053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e18bb-a73f-4b8a-b2f7-7ef31853dfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9765688d2712470d8bb190b65a9c1caa, user_id=af8db422526e48bc8805c83139a5d4b0, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.143776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ff040-485e-4e9e-b85f-ade8eff44741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.144181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ff040-485e-4e9e-b85f-ade8eff44741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.144852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ff040-485e-4e9e-b85f-ade8eff44741 admin admin] PATH_INFO: `/v3/projects/d4afd3c9f632496b8833f5e96115b415/users/9b0ad0698cdc45edbcef04e1a0d1b100/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.145365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e18bb-a73f-4b8a-b2f7-7ef31853dfb5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.203124 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4103/8229] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:40 2022] PUT /identity/v3/projects/9765688d2712470d8bb190b65a9c1caa/users/af8db422526e48bc8805c83139a5d4b0/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:40.205922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ff040-485e-4e9e-b85f-ade8eff44741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4afd3c9f632496b8833f5e96115b415, user_id=9b0ad0698cdc45edbcef04e1a0d1b100, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.212394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ff040-485e-4e9e-b85f-ade8eff44741 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.226523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.226967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.227513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.286818 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4127/8230] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:40 2022] PUT /identity/v3/projects/d4afd3c9f632496b8833f5e96115b415/users/9b0ad0698cdc45edbcef04e1a0d1b100/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:40.307914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] MFA Rules not processed for user `af8db422526e48bc8805c83139a5d4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:40.309799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caedf6-620d-4316-baf9-4111e24e9971 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.310169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caedf6-620d-4316-baf9-4111e24e9971 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.310533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caedf6-620d-4316-baf9-4111e24e9971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.310838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:40.369641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-06caedf6-620d-4316-baf9-4111e24e9971 None None] MFA Rules not processed for user `9b0ad0698cdc45edbcef04e1a0d1b100`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:40.371328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06caedf6-620d-4316-baf9-4111e24e9971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:40.406228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.473339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4128/8231] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:40.496335 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4104/8232] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:40.501003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caedf6-620d-4316-baf9-4111e24e9971 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.502978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.505332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:40.613308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d6848-729e-4bf1-b83a-6c3f2358f167 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.620525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.621597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.622066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.622535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.644768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caedf6-620d-4316-baf9-4111e24e9971 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.653616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.655177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.655692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.656164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.657424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.661746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.750698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4129/8233] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:40 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:40.760917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.803787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.808742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.850980 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4105/8234] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:40.862464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.920454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729969-f13a-49ee-bd6b-cde03364ced0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.931607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.932695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.933179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.933903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.934922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.937522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.993610 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4130/8235] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:40 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:40.997758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.013027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367d41-cc7e-4bdb-8064-79988421a43e service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.020304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.021981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.022465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.022830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.024520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.027324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.041161 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4106/8236] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:41.045468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.058887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb3d83-242b-40e2-be19-be071692f363 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.066407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.068007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.068502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.069108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] PATH_INFO: `/v3/projects/66c001291ea540a8a1f74ccec507238e/users/6f7173856c754de7856d7e8dd38d4434/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.099099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c001291ea540a8a1f74ccec507238e, user_id=6f7173856c754de7856d7e8dd38d4434, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.102538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.153645 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4131/8237] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:41 2022] PUT /identity/v3/projects/66c001291ea540a8a1f74ccec507238e/users/6f7173856c754de7856d7e8dd38d4434/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:41.157664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.171235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c931-4695-4902-b355-d094bd4bce40 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.271428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.277056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:41.357904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.360257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.360715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.361446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.363138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.368639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.405780 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4107/8238] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:41.413036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.428083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:41.438288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661ffc-dd07-4312-8a75-429d45f9a5e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.438537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e031a-2b4c-44ac-9c38-522ef5ec5967 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.444573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efffc3e-f82e-4fd6-8b11-baa5aa26927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.445660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efffc3e-f82e-4fd6-8b11-baa5aa26927b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.446027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efffc3e-f82e-4fd6-8b11-baa5aa26927b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.446381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efffc3e-f82e-4fd6-8b11-baa5aa26927b admin admin] PATH_INFO: `/v3/projects/66c001291ea540a8a1f74ccec507238e/users/6f7173856c754de7856d7e8dd38d4434/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.449570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efffc3e-f82e-4fd6-8b11-baa5aa26927b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c001291ea540a8a1f74ccec507238e, user_id=6f7173856c754de7856d7e8dd38d4434, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.452796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efffc3e-f82e-4fd6-8b11-baa5aa26927b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.457506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df690768-25af-4684-b9a1-2282426b7fbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.458747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df690768-25af-4684-b9a1-2282426b7fbf service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.459251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df690768-25af-4684-b9a1-2282426b7fbf service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.459798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df690768-25af-4684-b9a1-2282426b7fbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.464588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df690768-25af-4684-b9a1-2282426b7fbf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:41.470063 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4108/8239] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:41 2022] PUT /identity/v3/projects/66c001291ea540a8a1f74ccec507238e/users/6f7173856c754de7856d7e8dd38d4434/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:41.482658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8722-3027-4157-a99a-5b4bcecd319b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.483060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8722-3027-4157-a99a-5b4bcecd319b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.483381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8722-3027-4157-a99a-5b4bcecd319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.521400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-019c8722-3027-4157-a99a-5b4bcecd319b None None] MFA Rules not processed for user `6f7173856c754de7856d7e8dd38d4434`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:41.523476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-019c8722-3027-4157-a99a-5b4bcecd319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:41.614012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df690768-25af-4684-b9a1-2282426b7fbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.617823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df690768-25af-4684-b9a1-2282426b7fbf service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.663708 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4132/8240] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:23:41.670269 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4109/8241] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:41.686775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cff0-3821-4ea7-8700-89eb8688c217 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.688580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cff0-3821-4ea7-8700-89eb8688c217 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.689200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cff0-3821-4ea7-8700-89eb8688c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.819215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6b83cff0-3821-4ea7-8700-89eb8688c217 None None] MFA Rules not processed for user `3db64ff447674dd2a2f15b005696075b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:41.820567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b83cff0-3821-4ea7-8700-89eb8688c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:41.872970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:41.972251 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4133/8242] 10.222.0.98 () {58 vars in 1060 bytes} [Thu Jul 14 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:41.979260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c8722-3027-4157-a99a-5b4bcecd319b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.995333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c8722-3027-4157-a99a-5b4bcecd319b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.003962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885cf8-5a81-4749-873c-9315915bd1f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.007419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885cf8-5a81-4749-873c-9315915bd1f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.007876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885cf8-5a81-4749-873c-9315915bd1f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.008229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885cf8-5a81-4749-873c-9315915bd1f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.035958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83cff0-3821-4ea7-8700-89eb8688c217 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.127618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82885cf8-5a81-4749-873c-9315915bd1f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.131800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82885cf8-5a81-4749-873c-9315915bd1f0 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.144560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4110/8243] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:42.163950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83cff0-3821-4ea7-8700-89eb8688c217 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.172233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.173440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.173735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.174034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] PATH_INFO: `/v3/users/2d4e0c92d5f847b796057b2d7d287905` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.176757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4e0c92d5f847b796057b2d7d287905)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.180036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.291883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4e0c92d5f847b796057b2d7d287905'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:42.308119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4e0c92d5f847b796057b2d7d287905'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:42.319377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4e0c92d5f847b796057b2d7d287905'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:42.320436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4e0c92d5f847b796057b2d7d287905'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:42.336920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4e0c92d5f847b796057b2d7d287905'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:42.350031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4134/8244] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:42 2022] DELETE /identity/v3/users/2d4e0c92d5f847b796057b2d7d287905 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:42.351767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.352082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.352366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.424384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:42.433708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:42.570221 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4111/8245] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:42.578193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.579903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:42.717746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041852-db42-4f33-b16a-2e9f5a6850b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.728228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.729436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.732671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.734348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.744426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.760382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.762769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.782485 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4135/8246] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:44.164183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.166402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:44.195887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d2123-aa5b-4125-90fc-81aa434d90f2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.201120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.201882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.202170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.202449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] PATH_INFO: `/v3/projects/6dfc3dcb6a5f4b7db9e2a97d3436db86` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.203798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dfc3dcb6a5f4b7db9e2a97d3436db86)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:44.206554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:44.208998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:44.295261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dfc3dcb6a5f4b7db9e2a97d3436db86', 'request_id': 'req-90acf914-989b-4bde-a8e4-4473adf074da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.307662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dfc3dcb6a5f4b7db9e2a97d3436db86', 'request_id': 'req-90acf914-989b-4bde-a8e4-4473adf074da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.319080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dfc3dcb6a5f4b7db9e2a97d3436db86', 'request_id': 'req-90acf914-989b-4bde-a8e4-4473adf074da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.335575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] The token cache is being invalidate because project 6dfc3dcb6a5f4b7db9e2a97d3436db86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:44.335901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.336645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.338460 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4112/8247] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:44 2022] DELETE /identity/v3/projects/6dfc3dcb6a5f4b7db9e2a97d3436db86 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:44.343964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.378629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b5d04-b763-494e-999d-270cb851285c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.492059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.493571 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.494135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.494540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] PATH_INFO: `/v3/users/9b0ad0698cdc45edbcef04e1a0d1b100` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.497050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0ad0698cdc45edbcef04e1a0d1b100)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:44.501241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:44.601546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0ad0698cdc45edbcef04e1a0d1b100'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.626704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0ad0698cdc45edbcef04e1a0d1b100'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.643610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0ad0698cdc45edbcef04e1a0d1b100'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.645552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0ad0698cdc45edbcef04e1a0d1b100'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.664588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0ad0698cdc45edbcef04e1a0d1b100'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:44.680354 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4136/8248] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:44 2022] DELETE /identity/v3/users/9b0ad0698cdc45edbcef04e1a0d1b100 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:45.274377 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.282915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.333758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf914-989b-4bde-a8e4-4473adf074da admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.495056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17096432-11b4-4495-a103-34128234b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.495056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096432-11b4-4495-a103-34128234b92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.495056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096432-11b4-4495-a103-34128234b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.495056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096432-11b4-4495-a103-34128234b92c admin admin] PATH_INFO: `/v3/projects/d4afd3c9f632496b8833f5e96115b415` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.496179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17096432-11b4-4495-a103-34128234b92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4afd3c9f632496b8833f5e96115b415)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.498942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17096432-11b4-4495-a103-34128234b92c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.502988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.506032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.630357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17096432-11b4-4495-a103-34128234b92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4afd3c9f632496b8833f5e96115b415', 'request_id': 'req-17096432-11b4-4495-a103-34128234b92c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:45.653179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17096432-11b4-4495-a103-34128234b92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4afd3c9f632496b8833f5e96115b415', 'request_id': 'req-17096432-11b4-4495-a103-34128234b92c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:45.669258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17096432-11b4-4495-a103-34128234b92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4afd3c9f632496b8833f5e96115b415', 'request_id': 'req-17096432-11b4-4495-a103-34128234b92c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:45.676348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc62c2-6e0c-4f05-83c6-9cbbddbbf35e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.693084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17096432-11b4-4495-a103-34128234b92c admin admin] The token cache is being invalidate because project d4afd3c9f632496b8833f5e96115b415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:45.693556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17096432-11b4-4495-a103-34128234b92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:45.694757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-17096432-11b4-4495-a103-34128234b92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:45.697710 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4113/8249] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:45 2022] DELETE /identity/v3/projects/d4afd3c9f632496b8833f5e96115b415 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:45.704969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b662-49ca-4979-9c49-df32fdcd95cd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.705247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b662-49ca-4979-9c49-df32fdcd95cd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.705538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b662-49ca-4979-9c49-df32fdcd95cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.727741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:45.741263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c4d2b662-49ca-4979-9c49-df32fdcd95cd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:45.743772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c4d2b662-49ca-4979-9c49-df32fdcd95cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.775334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:45.796466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.797257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.797641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.798079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.801120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.874947 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4114/8250] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:45.888403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f30cb-276d-4312-bfb8-c045f8cb9d71 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.888994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f30cb-276d-4312-bfb8-c045f8cb9d71 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.889331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f30cb-276d-4312-bfb8-c045f8cb9d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.912890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c95f30cb-276d-4312-bfb8-c045f8cb9d71 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:45.914432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c95f30cb-276d-4312-bfb8-c045f8cb9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.934559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.938482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.940127 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4115/8251] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:45.940974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f30cb-276d-4312-bfb8-c045f8cb9d71 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.959167 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4137/8252] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:45.966017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f30cb-276d-4312-bfb8-c045f8cb9d71 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.984446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.984842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.985135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.985416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.986173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:45.986493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.988234 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.007858 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4116/8253] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:46.009182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.046648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8adbd-c974-4972-8a69-e38a8f4bf90b service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.052944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.054679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.055215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.055752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.056777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.060159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.138268 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4138/8254] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:46 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:46.141601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.185625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1661-57ee-4583-a051-619d7d1c02c2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.354660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.355925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.356550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.357692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.358477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.363390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.408824 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4117/8255] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:46 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:46.410936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.436588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf7691-d0cf-4f4f-b582-c79f061a59ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.452766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.453605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.453909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.454274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.455151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.457361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.476987 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4139/8256] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:46.481733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.518504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5cdbc-423c-4c02-b359-34dd468a0cb3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.536893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4b134-0699-4370-baa7-e5a3e66cf270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.538801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4b134-0699-4370-baa7-e5a3e66cf270 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.540770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4b134-0699-4370-baa7-e5a3e66cf270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.543595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4b134-0699-4370-baa7-e5a3e66cf270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.546121 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4b134-0699-4370-baa7-e5a3e66cf270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.561832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4b134-0699-4370-baa7-e5a3e66cf270 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.595992 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4118/8257] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:46.601155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.622033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13775d3-d4d5-41b3-8cf9-fad8f9d41dfb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.631742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.633357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.634082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.634826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] PATH_INFO: `/v3/projects/ddd0253084af4b5ebe3b70f765f47b7e/users/4ccdf923185444879a15a6033b4873c3/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.673167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd0253084af4b5ebe3b70f765f47b7e, user_id=4ccdf923185444879a15a6033b4873c3, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.679990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.740285 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4140/8258] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:46 2022] PUT /identity/v3/projects/ddd0253084af4b5ebe3b70f765f47b7e/users/4ccdf923185444879a15a6033b4873c3/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:46.762031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.762547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.763117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.828504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] MFA Rules not processed for user `4ccdf923185444879a15a6033b4873c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:46.830585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:47.004624 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4119/8259] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:47.011262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.185646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad262d-69ac-479e-b4df-5c7699a9a851 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.191694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.194098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:47.198304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.201685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.205534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.206304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.208451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.211098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.220810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.254948 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4141/8260] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:47 2022] POST /identity/v3/projects => generated 383 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:47.260807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.298779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69106fcb-c9e2-400e-8d74-6ee8e0a7f573 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.301497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.364580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.366020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.366521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.366803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.371602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:47.428580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a72e0-738b-4146-aa9f-d0baf6dd9251 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.435690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.436774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.437196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.437692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.438578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.441265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.471198 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4142/8261] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:47 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:47.476656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.489536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06629fe1-2aef-4afc-9a23-f67a5069bcf8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.501929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.504149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.505330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.506198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.507429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.509552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.517199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.521487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.530391 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4143/8262] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:47.535589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.546282 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4120/8263] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:47.555874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4a43-66bb-4a4b-9ae5-01265d8e6217 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.565650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0194fd0-e732-4a0a-a631-4649cc269a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.566834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0194fd0-e732-4a0a-a631-4649cc269a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.567895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0194fd0-e732-4a0a-a631-4649cc269a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.568340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0194fd0-e732-4a0a-a631-4649cc269a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.569950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0194fd0-e732-4a0a-a631-4649cc269a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.573188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0194fd0-e732-4a0a-a631-4649cc269a92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.596981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4144/8264] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:23:47.602556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.636413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97013e-22cf-4550-acc4-305d86072d6d service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.660515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e68461-ca87-4592-b580-f9844f4081ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.660515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68461-ca87-4592-b580-f9844f4081ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.660515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68461-ca87-4592-b580-f9844f4081ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.660515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68461-ca87-4592-b580-f9844f4081ee admin admin] PATH_INFO: `/v3/projects/9ff57411e35e4ecb817e6ef924113ec1/users/7c203a3ba26e422db59e4f1bcddf995c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.735494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e68461-ca87-4592-b580-f9844f4081ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff57411e35e4ecb817e6ef924113ec1, user_id=7c203a3ba26e422db59e4f1bcddf995c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.743997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e68461-ca87-4592-b580-f9844f4081ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.779767 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4121/8265] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:47 2022] PUT /identity/v3/projects/9ff57411e35e4ecb817e6ef924113ec1/users/7c203a3ba26e422db59e4f1bcddf995c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:47.920461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499aadd-0b22-4474-9017-5d92b62e85f1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.921795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499aadd-0b22-4474-9017-5d92b62e85f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.922638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499aadd-0b22-4474-9017-5d92b62e85f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.997218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d499aadd-0b22-4474-9017-5d92b62e85f1 None None] MFA Rules not processed for user `7c203a3ba26e422db59e4f1bcddf995c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:47.999401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d499aadd-0b22-4474-9017-5d92b62e85f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:48.207779 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4145/8266] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:48.222599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab8c5-68e1-4c63-adb2-c74d78182e1d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.223796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab8c5-68e1-4c63-adb2-c74d78182e1d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.225385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab8c5-68e1-4c63-adb2-c74d78182e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.279986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-35bab8c5-68e1-4c63-adb2-c74d78182e1d None None] MFA Rules not processed for user `0ded1996761b4d7d8ec89534d2103dea`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:48.281235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-35bab8c5-68e1-4c63-adb2-c74d78182e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:48.334728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.375799 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4122/8267] 10.222.0.98 () {58 vars in 1059 bytes} [Thu Jul 14 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:48.378967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499aadd-0b22-4474-9017-5d92b62e85f1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.407689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499aadd-0b22-4474-9017-5d92b62e85f1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.418685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.419418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.419714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.420021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.537179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.538818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.561403 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4146/8268] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:48.752723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab8c5-68e1-4c63-adb2-c74d78182e1d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.773263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab8c5-68e1-4c63-adb2-c74d78182e1d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.792577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06ca70-7002-4559-abfc-86dd9e01275d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.793279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ca70-7002-4559-abfc-86dd9e01275d service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.793565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ca70-7002-4559-abfc-86dd9e01275d service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.793846 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ca70-7002-4559-abfc-86dd9e01275d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.840695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06ca70-7002-4559-abfc-86dd9e01275d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.842198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06ca70-7002-4559-abfc-86dd9e01275d service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.871107 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4123/8269] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:49.479676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.491397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.632993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2442-e962-48bd-ad9c-27c00c627d3d service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.675997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.677953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.678388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.678905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] PATH_INFO: `/v3/users/4ccdf923185444879a15a6033b4873c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.692669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccdf923185444879a15a6033b4873c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.694735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.805058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccdf923185444879a15a6033b4873c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:49.854390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccdf923185444879a15a6033b4873c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:49.899491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccdf923185444879a15a6033b4873c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:49.900550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccdf923185444879a15a6033b4873c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:49.922452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccdf923185444879a15a6033b4873c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:49.941355 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4147/8270] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:49 2022] DELETE /identity/v3/users/4ccdf923185444879a15a6033b4873c3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:49.943412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.944336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.945014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.992966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:49.994842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:50.127306 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4124/8271] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:50.138715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.140176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:50.342614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4cc48-7715-440e-9a77-ff3dd1ad0c0c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.346865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.347869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.348665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.349041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.361096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.363618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.381505 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4148/8272] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:50.937834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.941472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:50.994857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280865b4-bd7d-46a8-9a58-596465ebf5fd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.035743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.037223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.040364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.040659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] PATH_INFO: `/v3/projects/ddd0253084af4b5ebe3b70f765f47b7e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.044739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd0253084af4b5ebe3b70f765f47b7e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.047133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.130979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd0253084af4b5ebe3b70f765f47b7e', 'request_id': 'req-1c9483c0-7a73-478b-9346-9ff0552a444e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.162032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd0253084af4b5ebe3b70f765f47b7e', 'request_id': 'req-1c9483c0-7a73-478b-9346-9ff0552a444e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.171663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd0253084af4b5ebe3b70f765f47b7e', 'request_id': 'req-1c9483c0-7a73-478b-9346-9ff0552a444e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.188277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] The token cache is being invalidate because project ddd0253084af4b5ebe3b70f765f47b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:51.188642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.189335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.192628 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4125/8273] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:50 2022] DELETE /identity/v3/projects/ddd0253084af4b5ebe3b70f765f47b7e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:51.198227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.226888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0a87-1c98-49b3-bf68-5c6dc2f67480 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.283166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.415811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.417497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.418339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.419866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] PATH_INFO: `/v3/users/7c203a3ba26e422db59e4f1bcddf995c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.421851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c203a3ba26e422db59e4f1bcddf995c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.427302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.560386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c203a3ba26e422db59e4f1bcddf995c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.616475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c203a3ba26e422db59e4f1bcddf995c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.641376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c203a3ba26e422db59e4f1bcddf995c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.646278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c203a3ba26e422db59e4f1bcddf995c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.696713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699440f9-a62f-42a0-ab70-5811a301c5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c203a3ba26e422db59e4f1bcddf995c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:51.711725 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4149/8274] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:51 2022] DELETE /identity/v3/users/7c203a3ba26e422db59e4f1bcddf995c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:52.314781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.317293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:52.346696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9483c0-7a73-478b-9346-9ff0552a444e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.486018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.501175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.503049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.504384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.505360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] PATH_INFO: `/v3/projects/9ff57411e35e4ecb817e6ef924113ec1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.508688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff57411e35e4ecb817e6ef924113ec1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.524145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.707917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff57411e35e4ecb817e6ef924113ec1', 'request_id': 'req-39501763-9b43-4867-924d-06160b48a986'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:52.732356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff57411e35e4ecb817e6ef924113ec1', 'request_id': 'req-39501763-9b43-4867-924d-06160b48a986'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:52.753373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff57411e35e4ecb817e6ef924113ec1', 'request_id': 'req-39501763-9b43-4867-924d-06160b48a986'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:52.768046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] The token cache is being invalidate because project 9ff57411e35e4ecb817e6ef924113ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:52.768351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:52.769055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-39501763-9b43-4867-924d-06160b48a986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:52.775833 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4126/8275] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:52 2022] DELETE /identity/v3/projects/9ff57411e35e4ecb817e6ef924113ec1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:52.777222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276f30-fa62-49cb-a132-6eeaf4a8d791 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.777711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276f30-fa62-49cb-a132-6eeaf4a8d791 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.777810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276f30-fa62-49cb-a132-6eeaf4a8d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.813796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cc276f30-fa62-49cb-a132-6eeaf4a8d791 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:52.815045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc276f30-fa62-49cb-a132-6eeaf4a8d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:53.059312 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4150/8276] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:53.069257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27592-fb31-49cf-a303-2aa62cc5c215 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.069257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27592-fb31-49cf-a303-2aa62cc5c215 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.069257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27592-fb31-49cf-a303-2aa62cc5c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.110008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-46f27592-fb31-49cf-a303-2aa62cc5c215 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:53.110008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46f27592-fb31-49cf-a303-2aa62cc5c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:53.170673 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4127/8277] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:53.174157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc276f30-fa62-49cb-a132-6eeaf4a8d791 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.194484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc276f30-fa62-49cb-a132-6eeaf4a8d791 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.208550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.209430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.209830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.210248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.211190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:53.211657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.213701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.250485 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4151/8278] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:53.250695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27592-fb31-49cf-a303-2aa62cc5c215 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.273844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27592-fb31-49cf-a303-2aa62cc5c215 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.286778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.287992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.288526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.289140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.290323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.294244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.354965 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4128/8279] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:53 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:53.359581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.373217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e197f5-7604-491e-becd-3d68e7c4ed34 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.417003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.526449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.527180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.527572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.527935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.528733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.530828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.558367 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4152/8280] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:53 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:53.560047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.572985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba44d6-edf1-46a9-ae2e-80098062f408 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.579430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.580903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.581650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.582098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.583155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.585103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.613847 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4129/8281] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:53.619904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.635827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ab181-c561-49e2-a5c2-d3e1471566de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.641637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177cce8-cb5b-4354-905e-61a8a69d4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.642485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177cce8-cb5b-4354-905e-61a8a69d4f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.643573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177cce8-cb5b-4354-905e-61a8a69d4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.644010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177cce8-cb5b-4354-905e-61a8a69d4f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.644813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177cce8-cb5b-4354-905e-61a8a69d4f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.647322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177cce8-cb5b-4354-905e-61a8a69d4f7a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.660637 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4153/8282] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:53.665679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.684887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794b16-85f6-40c4-8270-a24c3c863dff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.694040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.695663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.696106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.696397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] PATH_INFO: `/v3/projects/227cbaa8892546a68b2ec65cdacbcff0/users/3b5cb1638cef49279d725e0f8f0d8be1/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.732584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227cbaa8892546a68b2ec65cdacbcff0, user_id=3b5cb1638cef49279d725e0f8f0d8be1, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.736599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.760210 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4130/8283] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:53 2022] PUT /identity/v3/projects/227cbaa8892546a68b2ec65cdacbcff0/users/3b5cb1638cef49279d725e0f8f0d8be1/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:53.773562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235add-809a-4e03-bf21-3bcb5a4dc1fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.773846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235add-809a-4e03-bf21-3bcb5a4dc1fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.774124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235add-809a-4e03-bf21-3bcb5a4dc1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.812339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-53235add-809a-4e03-bf21-3bcb5a4dc1fe None None] MFA Rules not processed for user `3b5cb1638cef49279d725e0f8f0d8be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:53.813936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53235add-809a-4e03-bf21-3bcb5a4dc1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:53.914527 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4154/8284] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:53.928043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.932602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:54.019582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32736dff-d16c-4ff6-81f9-6381f37121b0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.024648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e96438-4b4e-43a6-b1a4-a0aa5fcbc44d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.025719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96438-4b4e-43a6-b1a4-a0aa5fcbc44d service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.026120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96438-4b4e-43a6-b1a4-a0aa5fcbc44d service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.026500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96438-4b4e-43a6-b1a4-a0aa5fcbc44d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.049682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e96438-4b4e-43a6-b1a4-a0aa5fcbc44d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.053436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e96438-4b4e-43a6-b1a4-a0aa5fcbc44d service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.073511 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4131/8285] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:23:55.191039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53235add-809a-4e03-bf21-3bcb5a4dc1fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.304005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53235add-809a-4e03-bf21-3bcb5a4dc1fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.309167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.310959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.311488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.311942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] PATH_INFO: `/v3/users/3b5cb1638cef49279d725e0f8f0d8be1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.313808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5cb1638cef49279d725e0f8f0d8be1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.316263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.368148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.400669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5cb1638cef49279d725e0f8f0d8be1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:55.422947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5cb1638cef49279d725e0f8f0d8be1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:55.433882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5cb1638cef49279d725e0f8f0d8be1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:55.435060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5cb1638cef49279d725e0f8f0d8be1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:55.445828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5cb1638cef49279d725e0f8f0d8be1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:55.453872 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4155/8286] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:55 2022] DELETE /identity/v3/users/3b5cb1638cef49279d725e0f8f0d8be1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:55.459458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.460343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.460795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.496034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:55.497673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:55.561267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.653622 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4132/8287] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:55.664780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.666291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:55.758230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f26657-1746-4197-a55b-dc178f841ce1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.766245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537f36a-6560-4140-8f32-a39fbf1ffe6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.766959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537f36a-6560-4140-8f32-a39fbf1ffe6f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.767250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537f36a-6560-4140-8f32-a39fbf1ffe6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.767643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537f36a-6560-4140-8f32-a39fbf1ffe6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.781299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537f36a-6560-4140-8f32-a39fbf1ffe6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.783640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537f36a-6560-4140-8f32-a39fbf1ffe6f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.798009 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4156/8288] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:56.431486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.433355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:56.450457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd391664-f992-4579-a0bc-5263295eb7e6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.457710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.458753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.459049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.459373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] PATH_INFO: `/v3/projects/227cbaa8892546a68b2ec65cdacbcff0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.460748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=227cbaa8892546a68b2ec65cdacbcff0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.463509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.559673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227cbaa8892546a68b2ec65cdacbcff0', 'request_id': 'req-b1f0d751-82de-4cac-a5b4-57a53cacd5de'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:56.576207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227cbaa8892546a68b2ec65cdacbcff0', 'request_id': 'req-b1f0d751-82de-4cac-a5b4-57a53cacd5de'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:56.602084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227cbaa8892546a68b2ec65cdacbcff0', 'request_id': 'req-b1f0d751-82de-4cac-a5b4-57a53cacd5de'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:56.632882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] The token cache is being invalidate because project 227cbaa8892546a68b2ec65cdacbcff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:56.633485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:56.634439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b1f0d751-82de-4cac-a5b4-57a53cacd5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:56.636588 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4133/8289] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:56 2022] DELETE /identity/v3/projects/227cbaa8892546a68b2ec65cdacbcff0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:56.643135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b43b0-071f-42a4-b35e-e4df625e3a4b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.644005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b43b0-071f-42a4-b35e-e4df625e3a4b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.644442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b43b0-071f-42a4-b35e-e4df625e3a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.670965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb9b43b0-071f-42a4-b35e-e4df625e3a4b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:56.673078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb9b43b0-071f-42a4-b35e-e4df625e3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:56.770680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd072a-0643-4573-bb64-3f1d2b66dc95 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.771418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd072a-0643-4573-bb64-3f1d2b66dc95 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.771667 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4157/8290] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:56.772039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd072a-0643-4573-bb64-3f1d2b66dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.800727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-31bd072a-0643-4573-bb64-3f1d2b66dc95 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:56.802753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31bd072a-0643-4573-bb64-3f1d2b66dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:56.811683 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4134/8291] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:23:56.816174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b43b0-071f-42a4-b35e-e4df625e3a4b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.827977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b43b0-071f-42a4-b35e-e4df625e3a4b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.833550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.834268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.834550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.834847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.835802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:56.836779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.840821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.882877 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4158/8292] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:56.888456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd072a-0643-4573-bb64-3f1d2b66dc95 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.900495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd072a-0643-4573-bb64-3f1d2b66dc95 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.905578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.906269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.906557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.906913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.907802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.909885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.951550 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4135/8293] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:56 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:56.957163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.970978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b54a3-4753-4d7b-8a8e-9242733afed6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.053389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.131668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.132611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.133187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.133187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.133956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.136076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.179351 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4159/8294] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:56 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:57.185228 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.218851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a79d-b531-4d30-a8d1-e3d2d6fa75c7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.234040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.235461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.235931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.236365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.237516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.250925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.270934 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4136/8295] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:57.273142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.288288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd48ab5-0ff5-4a14-ac00-824cbb53b25a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.296079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70cdf4-bcb6-4915-bd20-45faa456455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.296973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70cdf4-bcb6-4915-bd20-45faa456455d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.297326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70cdf4-bcb6-4915-bd20-45faa456455d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.297713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70cdf4-bcb6-4915-bd20-45faa456455d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.298956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70cdf4-bcb6-4915-bd20-45faa456455d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.301495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70cdf4-bcb6-4915-bd20-45faa456455d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.319767 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4160/8296] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:57.325487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.338570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7a222-3073-4627-8c0a-80633875bc12 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.352363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.355768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.356301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.357011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] PATH_INFO: `/v3/projects/3c0d68cec87849d683e38a38640d1fc7/users/b3b1d585a3084d95b1e4353abe8b9763/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.390877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0d68cec87849d683e38a38640d1fc7, user_id=b3b1d585a3084d95b1e4353abe8b9763, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.397417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.447613 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4137/8297] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:57 2022] PUT /identity/v3/projects/3c0d68cec87849d683e38a38640d1fc7/users/b3b1d585a3084d95b1e4353abe8b9763/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:57.452360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278643cf-2950-4037-acb0-4f11e3d91da1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.452656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278643cf-2950-4037-acb0-4f11e3d91da1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.452943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278643cf-2950-4037-acb0-4f11e3d91da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.483441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-278643cf-2950-4037-acb0-4f11e3d91da1 None None] MFA Rules not processed for user `b3b1d585a3084d95b1e4353abe8b9763`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:57.484586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-278643cf-2950-4037-acb0-4f11e3d91da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:57.577219 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4161/8298] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:57.581423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.639855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.662373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeda40-ecb9-4051-8253-0cbd5dd71d43 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.677240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.677948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.678238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.678538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.679251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.684818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.735826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278643cf-2950-4037-acb0-4f11e3d91da1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.744125 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4138/8299] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:23:57 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:57.753758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278643cf-2950-4037-acb0-4f11e3d91da1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.858938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.860230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.860958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.861839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.864589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.869281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.925100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.928144 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4162/8300] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:23:57 2022] POST /identity/v3/users => generated 308 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:57.961479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f09f-4394-454c-b381-371313f20c1c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.971733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.972625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.973575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.973923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.974768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.976823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.997621 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4139/8301] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:58.002438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.031328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d58118-0c92-42f0-b6e2-67a8ba7bd415 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.043610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.045386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.046193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.047646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] PATH_INFO: `/v3/projects/08f8a28553304afaa9284dc2d77de08d/users/df8dd58259bd4c80a0b935dc79f36f4b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.048084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.051055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:58.099373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f8a28553304afaa9284dc2d77de08d, user_id=df8dd58259bd4c80a0b935dc79f36f4b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.100598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.103250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad07ca7-9c0b-47f7-8834-9d1376c9893d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.126007 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4163/8302] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:58 2022] PUT /identity/v3/projects/08f8a28553304afaa9284dc2d77de08d/users/df8dd58259bd4c80a0b935dc79f36f4b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:58.127083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.141784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.143412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.143752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.144173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] PATH_INFO: `/v3/users/07ab8e1f979244c1bc6ad0d9e76ea918` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.145789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ab8e1f979244c1bc6ad0d9e76ea918)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.147875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.154338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.275177 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ab8e1f979244c1bc6ad0d9e76ea918'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:58.293102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9fd9-8ad0-4208-a006-efe8b69fc1db admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.319606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.321455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.322518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ab8e1f979244c1bc6ad0d9e76ea918'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:58.322655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.323909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ab8e1f979244c1bc6ad0d9e76ea918'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:58.324048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.324914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.330296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.344427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ab8e1f979244c1bc6ad0d9e76ea918'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:58.346299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8f0e6839-7181-4ec6-926c-1f8211d277c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ab8e1f979244c1bc6ad0d9e76ea918'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:58.384114 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4164/8303] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:23:58.387989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.393227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:58.411059 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4140/8304] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:58 2022] DELETE /identity/v3/users/07ab8e1f979244c1bc6ad0d9e76ea918 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:58.429877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.433047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.434130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.440876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24a91-a763-4b67-9a7e-f387d35b4f81 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.470673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:58.474800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:58.597241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffea1b-5626-4764-9b2c-f0c318890e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.598889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffea1b-5626-4764-9b2c-f0c318890e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.599471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffea1b-5626-4764-9b2c-f0c318890e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.599838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffea1b-5626-4764-9b2c-f0c318890e86 admin admin] PATH_INFO: `/v3/projects/08f8a28553304afaa9284dc2d77de08d/users/df8dd58259bd4c80a0b935dc79f36f4b/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.602371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffea1b-5626-4764-9b2c-f0c318890e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f8a28553304afaa9284dc2d77de08d, user_id=df8dd58259bd4c80a0b935dc79f36f4b, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.605837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffea1b-5626-4764-9b2c-f0c318890e86 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.660428 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4165/8305] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:23:58 2022] PUT /identity/v3/projects/08f8a28553304afaa9284dc2d77de08d/users/df8dd58259bd4c80a0b935dc79f36f4b/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:58.660958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83975dd-ebf3-4a9c-b376-48f097827f1e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.661320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83975dd-ebf3-4a9c-b376-48f097827f1e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.661696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83975dd-ebf3-4a9c-b376-48f097827f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.679126 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4141/8306] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:58.701264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.702749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:58.720810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f83975dd-ebf3-4a9c-b376-48f097827f1e None None] MFA Rules not processed for user `df8dd58259bd4c80a0b935dc79f36f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:58.725780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f83975dd-ebf3-4a9c-b376-48f097827f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:58.778143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.834046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae83c3-a1c1-44fa-a46c-6d2bed73ef59 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.931328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.932473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.932979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.933448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.994450 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4166/8307] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:23:59.017619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83975dd-ebf3-4a9c-b376-48f097827f1e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.047262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83975dd-ebf3-4a9c-b376-48f097827f1e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.053737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.055229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.055379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.056441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.057460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.057857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.060981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:59.074542 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4142/8308] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:59.131623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.193989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.197259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.218499 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4167/8309] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:23:59.583618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.589222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:59.625591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bf52a-f76f-4141-af22-ba059bdf310a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.644879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.645880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.646165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.650018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] PATH_INFO: `/v3/projects/71d1bad91b404fbcad07156014b35580` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.652900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d1bad91b404fbcad07156014b35580)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.674178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.779036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d1bad91b404fbcad07156014b35580', 'request_id': 'req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:59.798244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d1bad91b404fbcad07156014b35580', 'request_id': 'req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:59.807975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d1bad91b404fbcad07156014b35580', 'request_id': 'req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:59.821445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] The token cache is being invalidate because project 71d1bad91b404fbcad07156014b35580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:23:59.822266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:59.822779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:23:59.824832 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4143/8310] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:23:59 2022] DELETE /identity/v3/projects/71d1bad91b404fbcad07156014b35580 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:59.830462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.873353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758a368-6fd8-409c-af76-2df82e85751b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.961588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.963240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:00.027180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.075993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.077186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.077556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.078443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] PATH_INFO: `/v3/users/af8db422526e48bc8805c83139a5d4b0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.080340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8db422526e48bc8805c83139a5d4b0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.082409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.192091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8db422526e48bc8805c83139a5d4b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:00.205448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36671a-69f7-4fb0-aa72-7dc84bd9e807 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.219746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.222439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8db422526e48bc8805c83139a5d4b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:00.223709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.224082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.224437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.230892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:00.236275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8db422526e48bc8805c83139a5d4b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:00.243238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8db422526e48bc8805c83139a5d4b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:00.258711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8db422526e48bc8805c83139a5d4b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:00.271494 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4168/8311] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:23:59 2022] DELETE /identity/v3/users/af8db422526e48bc8805c83139a5d4b0 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:00.362151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.364208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.378897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4144/8312] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:01.601329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.604531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:01.771309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.804208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae71c2-e770-4a3b-831b-32decace85b1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.809849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.810792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.811090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.811415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] PATH_INFO: `/v3/projects/9765688d2712470d8bb190b65a9c1caa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.812738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9765688d2712470d8bb190b65a9c1caa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.814732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.889941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9765688d2712470d8bb190b65a9c1caa', 'request_id': 'req-88873a50-d829-42c2-9bdc-cd2fc17a9264'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:01.898109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9765688d2712470d8bb190b65a9c1caa', 'request_id': 'req-88873a50-d829-42c2-9bdc-cd2fc17a9264'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:01.907906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9765688d2712470d8bb190b65a9c1caa', 'request_id': 'req-88873a50-d829-42c2-9bdc-cd2fc17a9264'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:01.930158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] The token cache is being invalidate because project 9765688d2712470d8bb190b65a9c1caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:24:01.930856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:01.933085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:01.940188 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4169/8313] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:24:01 2022] DELETE /identity/v3/projects/9765688d2712470d8bb190b65a9c1caa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:01.942387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.947016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:02.001757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e068d-97fb-4504-9072-31400acc4e1c service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.119455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.120473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.120763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.121428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] PATH_INFO: `/v3/users/6f7173856c754de7856d7e8dd38d4434` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.126957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7173856c754de7856d7e8dd38d4434)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.129860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.238125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7173856c754de7856d7e8dd38d4434'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:02.257193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.266914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7173856c754de7856d7e8dd38d4434'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:02.268244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7173856c754de7856d7e8dd38d4434'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:02.285157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7173856c754de7856d7e8dd38d4434'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:02.291810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e2905f8-f2a1-4901-be01-f59bd9315ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7173856c754de7856d7e8dd38d4434'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:02.354506 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4145/8314] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:24:01 2022] DELETE /identity/v3/users/6f7173856c754de7856d7e8dd38d4434 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:03.145598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.147114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:03.198931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873a50-d829-42c2-9bdc-cd2fc17a9264 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.438033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.440555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.444073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.444821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] PATH_INFO: `/v3/projects/66c001291ea540a8a1f74ccec507238e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.451211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c001291ea540a8a1f74ccec507238e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.465768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.723063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c001291ea540a8a1f74ccec507238e', 'request_id': 'req-019889eb-c137-411b-ac4b-fe2b472ce135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:03.741626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c001291ea540a8a1f74ccec507238e', 'request_id': 'req-019889eb-c137-411b-ac4b-fe2b472ce135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:03.760189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c001291ea540a8a1f74ccec507238e', 'request_id': 'req-019889eb-c137-411b-ac4b-fe2b472ce135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:03.802965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] The token cache is being invalidate because project 66c001291ea540a8a1f74ccec507238e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:24:03.810010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:03.811121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-019889eb-c137-411b-ac4b-fe2b472ce135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:03.815938 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4170/8315] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:24:03 2022] DELETE /identity/v3/projects/66c001291ea540a8a1f74ccec507238e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:03.822981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6008a-08a2-4192-8029-caa94066ff78 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.823560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6008a-08a2-4192-8029-caa94066ff78 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.823974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6008a-08a2-4192-8029-caa94066ff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.889015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-75c6008a-08a2-4192-8029-caa94066ff78 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:03.895311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75c6008a-08a2-4192-8029-caa94066ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:04.133569 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4146/8316] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:04.155468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc46b7-39b5-49a8-8809-61cd05a98701 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.156750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc46b7-39b5-49a8-8809-61cd05a98701 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.157190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc46b7-39b5-49a8-8809-61cd05a98701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.302720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4bdc46b7-39b5-49a8-8809-61cd05a98701 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:04.305996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4bdc46b7-39b5-49a8-8809-61cd05a98701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:04.333913 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4171/8317] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:04.337973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6008a-08a2-4192-8029-caa94066ff78 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.364905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6008a-08a2-4192-8029-caa94066ff78 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.398636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.400087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.400788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.402112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.403898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:04.406675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.416186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.500929 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4147/8318] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.508979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc46b7-39b5-49a8-8809-61cd05a98701 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.533924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.547099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc46b7-39b5-49a8-8809-61cd05a98701 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.569120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.570115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.570402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.570906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.571795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.573926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.638495 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4172/8319] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:24:04 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:04.649155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.684884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31525f3e-ef95-47a4-bfcb-805516f45484 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.840071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.840965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.841259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.841543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.842290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.844330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.921271 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4148/8320] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:24:04 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:04.924297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.948353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1406-c53a-469f-9f78-ccdc1269f2fc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.963799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.964616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.965017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.965405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.966268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.969503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.006506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.020848 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4173/8321] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:05.023520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62c9c7-c0a8-46c7-be5a-c62bf71b846c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.037437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a760cf-3f0c-4be2-8c35-f84876f8aac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.037967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a760cf-3f0c-4be2-8c35-f84876f8aac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.038356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a760cf-3f0c-4be2-8c35-f84876f8aac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.038537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a760cf-3f0c-4be2-8c35-f84876f8aac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.039298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a760cf-3f0c-4be2-8c35-f84876f8aac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.054166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a760cf-3f0c-4be2-8c35-f84876f8aac0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.099006 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4149/8322] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:24:05.101890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.118100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff03d7-9fcc-43f3-91aa-e71e19414070 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.141150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.150782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.151099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.152030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] PATH_INFO: `/v3/projects/3f904975785548548bc1330c0f790593/users/6e9982f3d8764884b8b736e04b132fd2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.205136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f904975785548548bc1330c0f790593, user_id=6e9982f3d8764884b8b736e04b132fd2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.214751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.265151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4174/8323] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:24:05 2022] PUT /identity/v3/projects/3f904975785548548bc1330c0f790593/users/6e9982f3d8764884b8b736e04b132fd2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:05.276876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be335910-6af1-421a-9878-a111907ed8dd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.277421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be335910-6af1-421a-9878-a111907ed8dd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.277843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be335910-6af1-421a-9878-a111907ed8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.363043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-be335910-6af1-421a-9878-a111907ed8dd None None] MFA Rules not processed for user `6e9982f3d8764884b8b736e04b132fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:05.364580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be335910-6af1-421a-9878-a111907ed8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:05.443687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.509989 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4150/8324] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:05.521176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.522908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:05.639038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbf80e-e247-4d4a-aaad-bdc64f16b71f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.644147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.645428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.645728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.646017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.656690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.658578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.672647 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4175/8325] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:07.709739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be335910-6af1-421a-9878-a111907ed8dd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.712476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be335910-6af1-421a-9878-a111907ed8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:07.901332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be335910-6af1-421a-9878-a111907ed8dd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.932003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.933225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.933712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.934146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.936980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:07.961112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.963220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.994662 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4151/8326] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:10.342287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.359055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad74bb8-1ac0-4df0-86a2-2eb8ccbb8b37 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.365674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ee73-bdd5-4023-8cb8-c5a8431d2681 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.367177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ee73-bdd5-4023-8cb8-c5a8431d2681 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.368018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ee73-bdd5-4023-8cb8-c5a8431d2681 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.368746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ee73-bdd5-4023-8cb8-c5a8431d2681 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.372269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e85ee73-bdd5-4023-8cb8-c5a8431d2681 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:10.400202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85ee73-bdd5-4023-8cb8-c5a8431d2681 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.403499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85ee73-bdd5-4023-8cb8-c5a8431d2681 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:10.430271 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4176/8327] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:10.456609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.460382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:10.575868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60eb6b-445a-4994-8922-ec5ee3e59b4e service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.582527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.583677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.583908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.584370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] PATH_INFO: `/v3/users/b3b1d585a3084d95b1e4353abe8b9763` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.585924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b1d585a3084d95b1e4353abe8b9763)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.588239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:10.698474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b1d585a3084d95b1e4353abe8b9763'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:10.713843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.720184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b1d585a3084d95b1e4353abe8b9763'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:10.721191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b1d585a3084d95b1e4353abe8b9763'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:10.737905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b1d585a3084d95b1e4353abe8b9763'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:10.739430 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b1d585a3084d95b1e4353abe8b9763'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:10.804573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4152/8328] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:24:10 2022] DELETE /identity/v3/users/b3b1d585a3084d95b1e4353abe8b9763 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:10.804915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.805288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.805639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.833966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:10.835574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:10.954075 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4177/8329] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:10.969412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.973578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:11.127194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0dfdd-ba53-4b14-97f3-abdfb94df466 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.131326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.132049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.132587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.132941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.145564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.147516 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.160236 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4153/8330] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:11.400847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.402310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:11.416720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b2b7-d366-4e99-b9f3-20e538c9184a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.423810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.424777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.425077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.425368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] PATH_INFO: `/v3/projects/3c0d68cec87849d683e38a38640d1fc7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.427810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c0d68cec87849d683e38a38640d1fc7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.429952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.484809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.504676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c0d68cec87849d683e38a38640d1fc7', 'request_id': 'req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.512282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c0d68cec87849d683e38a38640d1fc7', 'request_id': 'req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.520243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c0d68cec87849d683e38a38640d1fc7', 'request_id': 'req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.544425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] The token cache is being invalidate because project 3c0d68cec87849d683e38a38640d1fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:24:11.545103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.546594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.556345 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4178/8331] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:24:11 2022] DELETE /identity/v3/projects/3c0d68cec87849d683e38a38640d1fc7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:11.560508 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.577974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d65d-f994-4a1f-91f0-4bd72b478125 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.704226 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.707682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.721231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.722163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] PATH_INFO: `/v3/users/df8dd58259bd4c80a0b935dc79f36f4b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.726162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8dd58259bd4c80a0b935dc79f36f4b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.733551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.851454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8dd58259bd4c80a0b935dc79f36f4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.902527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8dd58259bd4c80a0b935dc79f36f4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.903844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8dd58259bd4c80a0b935dc79f36f4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.922811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8dd58259bd4c80a0b935dc79f36f4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.923742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-fbac5cf5-1698-4dfc-a742-9b9fb0615d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8dd58259bd4c80a0b935dc79f36f4b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:11.936308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.953159 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4154/8332] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:24:11 2022] DELETE /identity/v3/users/df8dd58259bd4c80a0b935dc79f36f4b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:24:12.260656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.272636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:12.296874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afa6e8-a8dd-43be-9cb4-98039a4a88ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.405285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.407150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.407708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.408138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] PATH_INFO: `/v3/projects/08f8a28553304afaa9284dc2d77de08d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.410533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f8a28553304afaa9284dc2d77de08d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.412707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.487012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f8a28553304afaa9284dc2d77de08d', 'request_id': 'req-799437da-d059-4987-a4f7-d4b91ebfb3a3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:12.495370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f8a28553304afaa9284dc2d77de08d', 'request_id': 'req-799437da-d059-4987-a4f7-d4b91ebfb3a3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:12.502915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f8a28553304afaa9284dc2d77de08d', 'request_id': 'req-799437da-d059-4987-a4f7-d4b91ebfb3a3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:12.566310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] The token cache is being invalidate because project 08f8a28553304afaa9284dc2d77de08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:24:12.567419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:12.568930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-799437da-d059-4987-a4f7-d4b91ebfb3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:12.575977 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4179/8333] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:24:12 2022] DELETE /identity/v3/projects/08f8a28553304afaa9284dc2d77de08d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:24:12.581043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612356dd-b239-40f1-92cb-a4c91ee50df5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.582350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612356dd-b239-40f1-92cb-a4c91ee50df5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.582350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612356dd-b239-40f1-92cb-a4c91ee50df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.602641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-612356dd-b239-40f1-92cb-a4c91ee50df5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:12.604442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-612356dd-b239-40f1-92cb-a4c91ee50df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:12.692858 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4155/8334] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:12.701386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af748d-f539-4490-8319-60e35700862e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.702968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af748d-f539-4490-8319-60e35700862e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.703543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af748d-f539-4490-8319-60e35700862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.731156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3af748d-f539-4490-8319-60e35700862e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:12.732929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3af748d-f539-4490-8319-60e35700862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:12.747624 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4180/8335] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:12.751602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612356dd-b239-40f1-92cb-a4c91ee50df5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.765800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612356dd-b239-40f1-92cb-a4c91ee50df5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.774659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.775953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.778242 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.778915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.780712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:12.783785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.786130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.805056 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4156/8336] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:12.809777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af748d-f539-4490-8319-60e35700862e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.824475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af748d-f539-4490-8319-60e35700862e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.830664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.832082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.832566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.833047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.834501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.838315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.889014 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4181/8337] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:24:12 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:12.889780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.908730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeb7db-ef54-4b6d-839f-38173ca5938f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.033538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.034217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.034502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.035330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.036473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.038997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.067469 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4157/8338] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:24:12 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:13.069989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.085645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854e4f-30a6-4959-bcd8-f451c436b50a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.093389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.094397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.094915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.095366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.096354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.098908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.125431 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4182/8339] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:13.127303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.162861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e195d2-f63c-4daa-81a6-2e535fcf880d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.168615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd109a0-c50d-4619-b1f1-1fa915798f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.169334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd109a0-c50d-4619-b1f1-1fa915798f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.169627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd109a0-c50d-4619-b1f1-1fa915798f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.169915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd109a0-c50d-4619-b1f1-1fa915798f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.170681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd109a0-c50d-4619-b1f1-1fa915798f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.172773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd109a0-c50d-4619-b1f1-1fa915798f86 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.185553 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4158/8340] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:13.191660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.203195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdbca6-9d3a-4416-870c-791775f7caa9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.209187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.210410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.210800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.211208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] PATH_INFO: `/v3/projects/147e379072af46deb833451b75db5e26/users/22a41b9bbb6242e9a6be1a0a2e3a7b14/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.215316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.235335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=147e379072af46deb833451b75db5e26, user_id=22a41b9bbb6242e9a6be1a0a2e3a7b14, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.238822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.284297 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4183/8341] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:24:13 2022] PUT /identity/v3/projects/147e379072af46deb833451b75db5e26/users/22a41b9bbb6242e9a6be1a0a2e3a7b14/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:13.298490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d851-7e9d-4e70-9595-5a64cef611d2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.299088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d851-7e9d-4e70-9595-5a64cef611d2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.299595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d851-7e9d-4e70-9595-5a64cef611d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.339965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-14b4d851-7e9d-4e70-9595-5a64cef611d2 None None] MFA Rules not processed for user `22a41b9bbb6242e9a6be1a0a2e3a7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:13.341494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-14b4d851-7e9d-4e70-9595-5a64cef611d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:13.422358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.444231 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4159/8342] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:13.455448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.458221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:13.590993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6030-fb8d-458b-856a-4bf6c088af2a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.596741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.598590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.599235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.599894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.622578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.624367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.638145 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4184/8343] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:18.537657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.538224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.538224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.593401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] MFA Rules not processed for user `e4c56829e4af4b609ab6c986b745a4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:18.595196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:18.770777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.789544 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4160/8344] 10.222.0.98 () {58 vars in 1039 bytes} [Thu Jul 14 15:24:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:18.794756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52ae2d-e3fe-4a1e-9fbe-8c4bf5cd4714 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.804016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.805681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.806185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.806624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.813669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:18.968047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.977890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.993512 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4185/8345] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:24:25.866919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.868419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:25.988674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6a03d-0c5d-4faf-abd1-34a98e061563 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.993143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882a461-a993-40a1-8669-466aa1cfe391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.993873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a461-a993-40a1-8669-466aa1cfe391 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.994164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a461-a993-40a1-8669-466aa1cfe391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.994566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a461-a993-40a1-8669-466aa1cfe391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.997434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5882a461-a993-40a1-8669-466aa1cfe391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:26.102040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882a461-a993-40a1-8669-466aa1cfe391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.104253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882a461-a993-40a1-8669-466aa1cfe391 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.132007 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4161/8346] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:24:28.987062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.660997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.838624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb6460-fe8a-4ae5-a949-ec8aba8f0ff8 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.844046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.845209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.845666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.846106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] PATH_INFO: `/v3/users/22a41b9bbb6242e9a6be1a0a2e3a7b14` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.848053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a41b9bbb6242e9a6be1a0a2e3a7b14)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.850241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.918921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a41b9bbb6242e9a6be1a0a2e3a7b14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:31.934997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a41b9bbb6242e9a6be1a0a2e3a7b14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:31.945273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a41b9bbb6242e9a6be1a0a2e3a7b14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:31.946340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a41b9bbb6242e9a6be1a0a2e3a7b14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:31.956376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a41b9bbb6242e9a6be1a0a2e3a7b14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:31.968693 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4186/8347] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:24:31 2022] DELETE /identity/v3/users/22a41b9bbb6242e9a6be1a0a2e3a7b14 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:31.972380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.973748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.974606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.006031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:32.011975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:32.038617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.150461 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4162/8348] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:32.165223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.167063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:32.293897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0de9a-62f0-4bd7-9ff0-845da60ff680 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.299391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585a15e-fbea-492e-a8f9-71da5682a7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.300235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a15e-fbea-492e-a8f9-71da5682a7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.300636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a15e-fbea-492e-a8f9-71da5682a7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.301378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a15e-fbea-492e-a8f9-71da5682a7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.321708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585a15e-fbea-492e-a8f9-71da5682a7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.324649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585a15e-fbea-492e-a8f9-71da5682a7d7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.348894 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4187/8349] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:32.769289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.771165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:32.786022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c045-952f-45a2-a3a0-27191c912ac9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.807627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.807627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.807627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.807627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] PATH_INFO: `/v3/projects/147e379072af46deb833451b75db5e26` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.811092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147e379072af46deb833451b75db5e26)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.813662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.963064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147e379072af46deb833451b75db5e26', 'request_id': 'req-bab8c348-787c-45e4-8b83-aaaec14ee267'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:32.973770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147e379072af46deb833451b75db5e26', 'request_id': 'req-bab8c348-787c-45e4-8b83-aaaec14ee267'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:32.982312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147e379072af46deb833451b75db5e26', 'request_id': 'req-bab8c348-787c-45e4-8b83-aaaec14ee267'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:32.994665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] The token cache is being invalidate because project 147e379072af46deb833451b75db5e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:24:32.995464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:32.996413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bab8c348-787c-45e4-8b83-aaaec14ee267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:32.998416 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4163/8350] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:24:32 2022] DELETE /identity/v3/projects/147e379072af46deb833451b75db5e26 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:33.003693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9ddd-9f64-4534-b80e-463a867c32a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.004659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9ddd-9f64-4534-b80e-463a867c32a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.005113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9ddd-9f64-4534-b80e-463a867c32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.026442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ab5b9ddd-9f64-4534-b80e-463a867c32a9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:33.027967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab5b9ddd-9f64-4534-b80e-463a867c32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:33.052362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.114006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4188/8351] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:33.121447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22d2a-6470-46d1-a82a-11f9c68d5930 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.121743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22d2a-6470-46d1-a82a-11f9c68d5930 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.122033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22d2a-6470-46d1-a82a-11f9c68d5930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.171035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-41b22d2a-6470-46d1-a82a-11f9c68d5930 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:33.179484 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-41b22d2a-6470-46d1-a82a-11f9c68d5930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:33.189200 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4164/8352] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:33.193737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b9ddd-9f64-4534-b80e-463a867c32a9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.204968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b9ddd-9f64-4534-b80e-463a867c32a9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.222718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.223916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.224424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.224854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.225764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.226238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.228254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.254969 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4189/8353] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:33.259423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b22d2a-6470-46d1-a82a-11f9c68d5930 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.289021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b22d2a-6470-46d1-a82a-11f9c68d5930 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.301122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.301952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.302295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.302587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.303521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.305481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.347858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.356310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4165/8354] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:33.361692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121984-80b0-49b6-b34c-b9b4234b3d2d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.492996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.495331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.502112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.523828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.525091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.529979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.560603 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4190/8355] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:33.564521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.577301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1877-b3ad-412b-a01c-0d4de1c9d100 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.583123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.583875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.584160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.584450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.585367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.587148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.603987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4166/8356] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:33.605212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.627324 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2b6bc-135e-4cf7-8682-63477eb78666 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.653513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08176a4-b9e1-49b5-bc66-9eba14cc5aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.657698 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08176a4-b9e1-49b5-bc66-9eba14cc5aed admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.658075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08176a4-b9e1-49b5-bc66-9eba14cc5aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.659563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08176a4-b9e1-49b5-bc66-9eba14cc5aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.660706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08176a4-b9e1-49b5-bc66-9eba14cc5aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.662768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08176a4-b9e1-49b5-bc66-9eba14cc5aed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.677872 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4191/8357] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:24:33.679759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.692998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3b5fe-e455-4cf9-a8f6-dfd957bd4e26 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.701809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.703081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.704657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.705062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] PATH_INFO: `/v3/projects/5030ae68ceb94a92909e4c487e769164/users/c8f1659abd09463ebca1f99886776611/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.729446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5030ae68ceb94a92909e4c487e769164, user_id=c8f1659abd09463ebca1f99886776611, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.733842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.755358 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4167/8358] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:24:33 2022] PUT /identity/v3/projects/5030ae68ceb94a92909e4c487e769164/users/c8f1659abd09463ebca1f99886776611/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:24:33.765202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09660f-39fa-4b34-936c-02ebe8832e14 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.765510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09660f-39fa-4b34-936c-02ebe8832e14 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.765923 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09660f-39fa-4b34-936c-02ebe8832e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.810275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-af09660f-39fa-4b34-936c-02ebe8832e14 None None] MFA Rules not processed for user `c8f1659abd09463ebca1f99886776611`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:33.811557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af09660f-39fa-4b34-936c-02ebe8832e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:33.911335 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4192/8359] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:33.926332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.929572 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:34.005724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.031287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c2f4-a669-4700-b2b3-8a463ffca89d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.036167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b954d9-2b40-42e9-b40d-b353e2f2c160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.037130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b954d9-2b40-42e9-b40d-b353e2f2c160 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.037427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b954d9-2b40-42e9-b40d-b353e2f2c160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.037708 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b954d9-2b40-42e9-b40d-b353e2f2c160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.049227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b954d9-2b40-42e9-b40d-b353e2f2c160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.052097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b954d9-2b40-42e9-b40d-b353e2f2c160 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.064728 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4168/8360] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:24:43.916130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:44.058766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:44.793100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09660f-39fa-4b34-936c-02ebe8832e14 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.961437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09660f-39fa-4b34-936c-02ebe8832e14 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.966640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.967592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.967904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.968184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] PATH_INFO: `/v3/users/c8f1659abd09463ebca1f99886776611` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.969474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f1659abd09463ebca1f99886776611)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.972759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.092879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f1659abd09463ebca1f99886776611'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:45.134483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f1659abd09463ebca1f99886776611'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:45.169317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f1659abd09463ebca1f99886776611'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:45.170963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f1659abd09463ebca1f99886776611'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:45.184951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f1659abd09463ebca1f99886776611'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:45.194603 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4193/8361] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:24:44 2022] DELETE /identity/v3/users/c8f1659abd09463ebca1f99886776611 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:24:45.200918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.201843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.202286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.267896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:45.272090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:45.423752 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4169/8362] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:45.435843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.438768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:45.609275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeffc5-4f20-40d5-b5cb-41bea040e604 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.620605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64192a-c72d-4171-953b-e1a770e53fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.621468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64192a-c72d-4171-953b-e1a770e53fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.621867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64192a-c72d-4171-953b-e1a770e53fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.622041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64192a-c72d-4171-953b-e1a770e53fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.645196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64192a-c72d-4171-953b-e1a770e53fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.647104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64192a-c72d-4171-953b-e1a770e53fdd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.672215 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4194/8363] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:46.522780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.526439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:46.590621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16c0d6-cfbf-4d5f-9b11-696ab2afccea None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.629058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.635618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.638676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.639061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] PATH_INFO: `/v3/projects/5030ae68ceb94a92909e4c487e769164` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.644961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5030ae68ceb94a92909e4c487e769164)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.654636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.852087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5030ae68ceb94a92909e4c487e769164', 'request_id': 'req-bc3607c4-d868-402d-89f9-ea98636c4cb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:46.889678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5030ae68ceb94a92909e4c487e769164', 'request_id': 'req-bc3607c4-d868-402d-89f9-ea98636c4cb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:46.912593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5030ae68ceb94a92909e4c487e769164', 'request_id': 'req-bc3607c4-d868-402d-89f9-ea98636c4cb2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:46.953868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] The token cache is being invalidate because project 5030ae68ceb94a92909e4c487e769164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:24:46.953868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:46.958124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc3607c4-d868-402d-89f9-ea98636c4cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:24:46.974732 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4170/8364] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:24:46 2022] DELETE /identity/v3/projects/5030ae68ceb94a92909e4c487e769164 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:46.977228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f4e8-6b64-4aa5-a3a4-cd163d0dee3d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.977781 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f4e8-6b64-4aa5-a3a4-cd163d0dee3d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.978379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f4e8-6b64-4aa5-a3a4-cd163d0dee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.044675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b7f8f4e8-6b64-4aa5-a3a4-cd163d0dee3d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:47.046496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7f8f4e8-6b64-4aa5-a3a4-cd163d0dee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:47.124363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.291126 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4195/8365] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:47.291638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b924e07-be04-4cfa-8d5b-4db216532b9c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.291638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b924e07-be04-4cfa-8d5b-4db216532b9c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.291638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b924e07-be04-4cfa-8d5b-4db216532b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.337650 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0b924e07-be04-4cfa-8d5b-4db216532b9c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:47.341825 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b924e07-be04-4cfa-8d5b-4db216532b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:47.353144 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4171/8366] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:24:47.357085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8f4e8-6b64-4aa5-a3a4-cd163d0dee3d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.394616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8f4e8-6b64-4aa5-a3a4-cd163d0dee3d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.415873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.426815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.431878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.432196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.433363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:47.433363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.435009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.472199 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4196/8367] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:47.473520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b924e07-be04-4cfa-8d5b-4db216532b9c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.486086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b924e07-be04-4cfa-8d5b-4db216532b9c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.501958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.502903 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.503199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.503549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.504302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.508169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.549644 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4172/8368] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:24:47 2022] POST /identity/v3/projects => generated 361 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:47.553998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.570377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f001b14-2551-4b31-bc16-6a034b2496b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.737962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.739186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.739707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.740250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.741200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.744120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.779346 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4197/8369] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:24:47 2022] POST /identity/v3/users => generated 281 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:47.784440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.799853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2f6e8-b7cf-4c4a-8b9f-006125b43e5d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.806249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.807254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.808014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.808772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.809745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.812021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.831108 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4173/8370] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:47.836554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.851948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d7276-6ce8-42ed-857c-6193e20fdd97 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.864442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677911c-f465-4341-9ff1-7b94d71337f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.870302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677911c-f465-4341-9ff1-7b94d71337f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.871180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677911c-f465-4341-9ff1-7b94d71337f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.871694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677911c-f465-4341-9ff1-7b94d71337f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.873011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677911c-f465-4341-9ff1-7b94d71337f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.875327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677911c-f465-4341-9ff1-7b94d71337f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.891546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4198/8371] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:47.896464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.909620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32bc7f-96c6-4b4c-97df-7528d973492d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.916605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.917843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.918473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.918993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] PATH_INFO: `/v3/projects/ae7c9d5ad620433fa473faaa8a3b0467/users/1737b209ee6540eda39c0047cd702bd8/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.950781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7c9d5ad620433fa473faaa8a3b0467, user_id=1737b209ee6540eda39c0047cd702bd8, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.958073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.997102 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4174/8372] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:24:47 2022] PUT /identity/v3/projects/ae7c9d5ad620433fa473faaa8a3b0467/users/1737b209ee6540eda39c0047cd702bd8/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:48.009404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27fb1-3dff-40f4-9e5e-793037bc8453 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.010977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27fb1-3dff-40f4-9e5e-793037bc8453 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.011708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27fb1-3dff-40f4-9e5e-793037bc8453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.123963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45f27fb1-3dff-40f4-9e5e-793037bc8453 None None] MFA Rules not processed for user `1737b209ee6540eda39c0047cd702bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:48.125639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45f27fb1-3dff-40f4-9e5e-793037bc8453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:48.282771 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4199/8373] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:24:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:24:48.294861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.298806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:48.397318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.449858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861b38-faf1-4858-8409-bf19c97c53ec admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.457304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b3b98-5f96-4d1e-9fcd-108f098533f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.458277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3b98-5f96-4d1e-9fcd-108f098533f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.458958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3b98-5f96-4d1e-9fcd-108f098533f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.459474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3b98-5f96-4d1e-9fcd-108f098533f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.490601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b3b98-5f96-4d1e-9fcd-108f098533f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.492247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b3b98-5f96-4d1e-9fcd-108f098533f3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.504860 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4175/8374] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:24:58.276048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.498704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=17 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:06.952791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.953368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.954003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.043721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] MFA Rules not processed for user `db9dcb86f53e466392563a143ee4654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:07.051197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:07.227116 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4200/8375] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:10.629044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.629965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.630511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.695578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:10.697821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:11.107623 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4176/8376] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:25:11.119473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.123457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:11.156582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ef8f6-6b55-46ec-b508-9f29813acc63 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.177199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.178035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.178509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.178997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.210354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.212972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.256588 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4201/8377] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:25:19.723163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.724670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:19.879182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ff4b2-a89f-4b82-b6dc-1ab3065aa51d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:19.886041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c5c0-a8ec-4566-8c76-7faaa7e64490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:19.887150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c5c0-a8ec-4566-8c76-7faaa7e64490 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.887734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c5c0-a8ec-4566-8c76-7faaa7e64490 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.888237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c5c0-a8ec-4566-8c76-7faaa7e64490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.891483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02e9c5c0-a8ec-4566-8c76-7faaa7e64490 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:20.061260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c5c0-a8ec-4566-8c76-7faaa7e64490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:20.065152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c5c0-a8ec-4566-8c76-7faaa7e64490 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:20.084907 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4177/8378] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:25:21.236262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=35 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.075183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.503141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.627112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4f0c-f0ad-44d3-954d-99b5bb7e40c4 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.633061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.634418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.634796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.635156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] PATH_INFO: `/v3/users/1737b209ee6540eda39c0047cd702bd8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.636856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1737b209ee6540eda39c0047cd702bd8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.639038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.752249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1737b209ee6540eda39c0047cd702bd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:34.783603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1737b209ee6540eda39c0047cd702bd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:34.799854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1737b209ee6540eda39c0047cd702bd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:34.800804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1737b209ee6540eda39c0047cd702bd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:34.825226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1737b209ee6540eda39c0047cd702bd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:34.850342 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4202/8379] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:25:34 2022] DELETE /identity/v3/users/1737b209ee6540eda39c0047cd702bd8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:34.855784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.856541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.856541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.876620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:34.877889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:34.982092 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4178/8380] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:35.005099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.008132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:35.128647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac5343-4eb2-4b18-99d0-fc4db63f6940 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.133921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fd856-eba3-49d4-b9a8-fb471b704192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.135342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd856-eba3-49d4-b9a8-fb471b704192 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.135849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd856-eba3-49d4-b9a8-fb471b704192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.136357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd856-eba3-49d4-b9a8-fb471b704192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.175516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fd856-eba3-49d4-b9a8-fb471b704192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.179931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fd856-eba3-49d4-b9a8-fb471b704192 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.209548 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4203/8381] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:25:35.550931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.553077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:35.570694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753158cf-b082-425e-a5bc-fbffe3a630d0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.576858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.579206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.579838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.580568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] PATH_INFO: `/v3/projects/ae7c9d5ad620433fa473faaa8a3b0467` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.582770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7c9d5ad620433fa473faaa8a3b0467)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.586160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.714055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7c9d5ad620433fa473faaa8a3b0467', 'request_id': 'req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:35.734386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7c9d5ad620433fa473faaa8a3b0467', 'request_id': 'req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:35.754591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7c9d5ad620433fa473faaa8a3b0467', 'request_id': 'req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:35.777203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] The token cache is being invalidate because project ae7c9d5ad620433fa473faaa8a3b0467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:25:35.777203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:35.778025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a45ab79a-9cd1-4b1b-a57c-60c7e42b31e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:35.786423 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4179/8382] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:25:35 2022] DELETE /identity/v3/projects/ae7c9d5ad620433fa473faaa8a3b0467 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:25:35.789190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cc58-49ae-40ff-bcc1-d71cf6594538 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.791047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cc58-49ae-40ff-bcc1-d71cf6594538 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.792199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cc58-49ae-40ff-bcc1-d71cf6594538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.893313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:35.908836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c959cc58-49ae-40ff-bcc1-d71cf6594538 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:35.910157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c959cc58-49ae-40ff-bcc1-d71cf6594538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:36.033710 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4204/8383] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:25:36.037891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52180-8c56-4965-9ae1-fe32ffe5645c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.038559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52180-8c56-4965-9ae1-fe32ffe5645c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.038559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52180-8c56-4965-9ae1-fe32ffe5645c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.073726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f7f52180-8c56-4965-9ae1-fe32ffe5645c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:36.075499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7f52180-8c56-4965-9ae1-fe32ffe5645c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:36.090390 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4180/8384] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:36.095178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959cc58-49ae-40ff-bcc1-d71cf6594538 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.108619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959cc58-49ae-40ff-bcc1-d71cf6594538 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.117107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.121977 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.122506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.123204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.124280 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:36.124952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.128761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.152537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4205/8385] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:36.154261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52180-8c56-4965-9ae1-fe32ffe5645c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.167108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52180-8c56-4965-9ae1-fe32ffe5645c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.184976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.186279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.186741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.187181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.189463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.192858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.282650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4181/8386] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:25:36 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:36.287761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.327502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec712-0267-4a65-a33a-e1cfe9a5586c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.430057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.432092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.432736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.433404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.435876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.442105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.481530 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4206/8387] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:25:36 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:36.486931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.513333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc02c49-7c3d-47cc-9568-0e28a26390d4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.519646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.520721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.521091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.521442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.522962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.524929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.545756 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4182/8388] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:36.551795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.566355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3772-1cc4-48e5-a361-81f2dddf7f99 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.572688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d6a8a-b866-42b1-9114-40bc39f289b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.573404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6a8a-b866-42b1-9114-40bc39f289b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.573692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6a8a-b866-42b1-9114-40bc39f289b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.573976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6a8a-b866-42b1-9114-40bc39f289b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.574761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d6a8a-b866-42b1-9114-40bc39f289b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.576497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d6a8a-b866-42b1-9114-40bc39f289b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.595226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4207/8389] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:25:36.603142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.619433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eb3c6-c631-4c11-8f23-7ed74eb3e04f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.626368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.627537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.627937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.628329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] PATH_INFO: `/v3/projects/e8b552d1808f4c3ba6b15afb2d86cf75/users/ddc672c697904020a781fd9e8927c36e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.660202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b552d1808f4c3ba6b15afb2d86cf75, user_id=ddc672c697904020a781fd9e8927c36e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.663161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.686828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4183/8390] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:25:36 2022] PUT /identity/v3/projects/e8b552d1808f4c3ba6b15afb2d86cf75/users/ddc672c697904020a781fd9e8927c36e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:36.697134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bba30-e156-47a7-be63-9623b904c237 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.697439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bba30-e156-47a7-be63-9623b904c237 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.697731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bba30-e156-47a7-be63-9623b904c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.732666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-321bba30-e156-47a7-be63-9623b904c237 None None] MFA Rules not processed for user `ddc672c697904020a781fd9e8927c36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:36.734233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-321bba30-e156-47a7-be63-9623b904c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:36.866451 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4208/8391] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:36.878630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.880737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:36.904628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:37.012837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15936749-f443-4851-9938-e5f8d05c16b5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:37.018035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8e9b-f9e3-4e2f-a44d-c499405178a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:37.019163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8e9b-f9e3-4e2f-a44d-c499405178a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:37.019657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8e9b-f9e3-4e2f-a44d-c499405178a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:37.020440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8e9b-f9e3-4e2f-a44d-c499405178a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:37.037261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8e9b-f9e3-4e2f-a44d-c499405178a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:37.038806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8e9b-f9e3-4e2f-a44d-c499405178a2 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:37.055001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4184/8392] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:25:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:25:42.618217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bba30-e156-47a7-be63-9623b904c237 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:42.620476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-321bba30-e156-47a7-be63-9623b904c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:42.626801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:42.714834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bba30-e156-47a7-be63-9623b904c237 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:42.722573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:42.724131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:42.725302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:42.725872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] PATH_INFO: `/v3/users/6e9982f3d8764884b8b736e04b132fd2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:42.727895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9982f3d8764884b8b736e04b132fd2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:42.731180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:42.910579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9982f3d8764884b8b736e04b132fd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:42.934742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9982f3d8764884b8b736e04b132fd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:42.947660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9982f3d8764884b8b736e04b132fd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:42.948878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9982f3d8764884b8b736e04b132fd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:42.965487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9982f3d8764884b8b736e04b132fd2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:43.010277 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4209/8393] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:25:42 2022] DELETE /identity/v3/users/6e9982f3d8764884b8b736e04b132fd2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:43.011801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:43.012301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:43.012401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:43.035263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:43.050222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:43.170078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4185/8394] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:43.170784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:43.172658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:43.284912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e61a-0991-40ed-bdef-08d824d2e1cf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:43.290154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00873b-0a63-46a9-aba1-b3a2643ed545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:43.290859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00873b-0a63-46a9-aba1-b3a2643ed545 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:43.291159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00873b-0a63-46a9-aba1-b3a2643ed545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:43.291850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00873b-0a63-46a9-aba1-b3a2643ed545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:43.304665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00873b-0a63-46a9-aba1-b3a2643ed545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:43.307350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00873b-0a63-46a9-aba1-b3a2643ed545 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:43.319839 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4210/8395] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:25:44.148051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:44.149548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:44.176855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcdb25-879d-4cc4-b95f-e7761a29e70d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:44.212448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:44.214304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:44.221692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:44.222297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] PATH_INFO: `/v3/projects/3f904975785548548bc1330c0f790593` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:44.229208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f904975785548548bc1330c0f790593)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:44.231521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:44.384046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f904975785548548bc1330c0f790593', 'request_id': 'req-06bee559-cbc1-4176-be63-090d55300c18'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:44.398740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f904975785548548bc1330c0f790593', 'request_id': 'req-06bee559-cbc1-4176-be63-090d55300c18'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:44.418765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f904975785548548bc1330c0f790593', 'request_id': 'req-06bee559-cbc1-4176-be63-090d55300c18'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:44.455143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] The token cache is being invalidate because project 3f904975785548548bc1330c0f790593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:25:44.455510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:44.456395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-06bee559-cbc1-4176-be63-090d55300c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:44.458979 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4186/8396] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:25:44 2022] DELETE /identity/v3/projects/3f904975785548548bc1330c0f790593 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:44.465706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f311-0570-45ba-987f-27995da4a17d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:44.466692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f311-0570-45ba-987f-27995da4a17d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:44.467315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f311-0570-45ba-987f-27995da4a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:44.517497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0d26f311-0570-45ba-987f-27995da4a17d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:44.521135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d26f311-0570-45ba-987f-27995da4a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:44.574048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:44.710662 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4211/8397] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:25:44.718699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2cd53-cb87-4757-9c51-3debb9858087 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:44.719201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2cd53-cb87-4757-9c51-3debb9858087 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:44.720595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2cd53-cb87-4757-9c51-3debb9858087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:44.749600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-36b2cd53-cb87-4757-9c51-3debb9858087 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:44.751704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-36b2cd53-cb87-4757-9c51-3debb9858087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:44.761851 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4187/8398] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:44.766785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26f311-0570-45ba-987f-27995da4a17d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:44.786624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26f311-0570-45ba-987f-27995da4a17d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:44.793145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:44.794282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:44.794795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:44.795311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:44.796226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:44.796745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:44.800312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:44.817398 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4212/8399] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:44.821790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2cd53-cb87-4757-9c51-3debb9858087 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:44.834375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2cd53-cb87-4757-9c51-3debb9858087 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:44.840306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:44.840996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:44.841339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:44.841621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:44.842321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:44.844614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:44.879794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4188/8400] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:25:44 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:44.884012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:44.896477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61a92c-fecb-4ec2-9cfa-6d0ba04abe8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:44.979550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:44.980268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:44.980557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:44.980978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:44.981731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:44.985314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:45.018852 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4213/8401] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:25:44 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:45.023310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:45.037644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6cc11-b769-42e1-a58a-5d9a7c64c08f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:45.044217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:45.056090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:45.056090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:45.056090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:45.056090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:45.056090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:45.056090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:45.073216 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4189/8402] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:45.077334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:45.088984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc900-fcb9-4499-92cb-f190ac7be24f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:45.101692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56cba1-d586-45e9-b269-08a936120d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:45.102714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56cba1-d586-45e9-b269-08a936120d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:45.103119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56cba1-d586-45e9-b269-08a936120d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:45.103575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56cba1-d586-45e9-b269-08a936120d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:45.104428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56cba1-d586-45e9-b269-08a936120d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:45.106519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56cba1-d586-45e9-b269-08a936120d76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:45.120852 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4214/8403] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:45.126000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:45.141888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ad705-6385-4700-aea3-15e38a64b08e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:45.147383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:45.149361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:45.149931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:45.150216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] PATH_INFO: `/v3/projects/cd5ec168ea1b4514a510f4d6e75a169e/users/73c41e3a934149ec94f36b3c3e1cb999/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:45.172282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5ec168ea1b4514a510f4d6e75a169e, user_id=73c41e3a934149ec94f36b3c3e1cb999, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:45.177263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:45.197280 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4190/8404] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:25:45 2022] PUT /identity/v3/projects/cd5ec168ea1b4514a510f4d6e75a169e/users/73c41e3a934149ec94f36b3c3e1cb999/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:45.202831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:45.203129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:45.203682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:45.231943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:45.233456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:45.358287 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4215/8405] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:25:45.367026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:45.369384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:45.478821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d31f3-6041-4a0f-977a-0ed51c64590e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:45.488513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f62c5-402f-4fa9-828f-bb361bd6dc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:45.489881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f62c5-402f-4fa9-828f-bb361bd6dc45 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:45.490509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f62c5-402f-4fa9-828f-bb361bd6dc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:45.492460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f62c5-402f-4fa9-828f-bb361bd6dc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:45.514698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f62c5-402f-4fa9-828f-bb361bd6dc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:45.517253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f62c5-402f-4fa9-828f-bb361bd6dc45 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:45.566257 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4191/8406] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:25:49.895603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:49.897156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:49.934991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca327-ae5d-4ad3-bde0-bb2ba3cae66f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:49.953713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:49.954938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:49.955733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:49.956161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] PATH_INFO: `/v3/users/ddc672c697904020a781fd9e8927c36e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:49.960124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc672c697904020a781fd9e8927c36e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:49.966142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:50.038380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:50.082257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc672c697904020a781fd9e8927c36e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:50.103843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc672c697904020a781fd9e8927c36e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:50.121920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc672c697904020a781fd9e8927c36e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:50.122796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc672c697904020a781fd9e8927c36e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:50.155629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc672c697904020a781fd9e8927c36e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:50.164906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4216/8407] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:25:49 2022] DELETE /identity/v3/users/ddc672c697904020a781fd9e8927c36e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:50.170786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:50.171296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:50.171738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:50.269699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:50.273238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:50.447654 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4192/8408] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:50.456712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:50.458725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:50.598620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b6400-2a67-49b8-8098-c5d8d8267971 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:50.608134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0dce3-405b-46a6-b30b-c97763299de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:50.610487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0dce3-405b-46a6-b30b-c97763299de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:50.610888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0dce3-405b-46a6-b30b-c97763299de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:50.611256 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0dce3-405b-46a6-b30b-c97763299de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:50.624221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0dce3-405b-46a6-b30b-c97763299de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:50.631316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0dce3-405b-46a6-b30b-c97763299de8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:50.644640 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4217/8409] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:25:51.018435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:51.020031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:51.073761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589c33d-efd6-4f7c-a577-afe84d972782 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:51.087405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:51.088539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.088926 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.089095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] PATH_INFO: `/v3/projects/e8b552d1808f4c3ba6b15afb2d86cf75` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.091347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b552d1808f4c3ba6b15afb2d86cf75)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:51.094556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:51.293568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b552d1808f4c3ba6b15afb2d86cf75', 'request_id': 'req-1703f302-2abb-47e5-9d0b-f80b41dd97b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:51.305470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b552d1808f4c3ba6b15afb2d86cf75', 'request_id': 'req-1703f302-2abb-47e5-9d0b-f80b41dd97b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:51.317001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b552d1808f4c3ba6b15afb2d86cf75', 'request_id': 'req-1703f302-2abb-47e5-9d0b-f80b41dd97b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:51.340550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:51.347144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] The token cache is being invalidate because project e8b552d1808f4c3ba6b15afb2d86cf75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:25:51.349554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:51.351325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1703f302-2abb-47e5-9d0b-f80b41dd97b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:25:51.355525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4193/8410] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:25:51 2022] DELETE /identity/v3/projects/e8b552d1808f4c3ba6b15afb2d86cf75 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:51.361236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df124f9-ce65-40c0-b938-0bfcea9381f4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.361770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df124f9-ce65-40c0-b938-0bfcea9381f4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.361856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df124f9-ce65-40c0-b938-0bfcea9381f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.412538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2df124f9-ce65-40c0-b938-0bfcea9381f4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:51.413913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2df124f9-ce65-40c0-b938-0bfcea9381f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:51.543208 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4218/8411] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:51.553601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3aff9-d38a-490c-9bed-ac94b48fc6ac None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.553922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3aff9-d38a-490c-9bed-ac94b48fc6ac None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.554218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3aff9-d38a-490c-9bed-ac94b48fc6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.618214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-22b3aff9-d38a-490c-9bed-ac94b48fc6ac None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:51.619505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-22b3aff9-d38a-490c-9bed-ac94b48fc6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:51.635969 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4194/8412] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:51.646836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df124f9-ce65-40c0-b938-0bfcea9381f4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:51.682611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df124f9-ce65-40c0-b938-0bfcea9381f4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:51.697664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:51.699363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.699786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.700194 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.701309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:51.701682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:51.703605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:51.739416 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4219/8413] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:51.746738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3aff9-d38a-490c-9bed-ac94b48fc6ac None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:51.801882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3aff9-d38a-490c-9bed-ac94b48fc6ac None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:51.810368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:51.811440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.811855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.812264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.813464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:51.820317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:51.880257 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4195/8414] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:25:51 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:51.885023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:51.897655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56159-bed7-429d-a45f-7278e3b354da admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:51.953067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:52.033490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:52.034359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:52.034773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:52.035169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:52.036070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:52.038253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:52.095410 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4220/8415] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:25:51 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:52.099998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:52.135355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b586e-dc61-4b4e-9975-9397cb208622 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:52.145458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:52.146710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:52.147261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:52.147821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:52.149307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:52.153605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:52.201443 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4196/8416] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:52.207851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:52.235582 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f34434-f77b-4b07-9a2e-c1ad6570c67e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:52.264920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44111e36-9c39-42c8-87b4-10412a2c219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:52.267317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44111e36-9c39-42c8-87b4-10412a2c219d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:52.267317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44111e36-9c39-42c8-87b4-10412a2c219d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:52.267638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44111e36-9c39-42c8-87b4-10412a2c219d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:52.271748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44111e36-9c39-42c8-87b4-10412a2c219d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:52.279669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44111e36-9c39-42c8-87b4-10412a2c219d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:52.308214 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4221/8417] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:52.313456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:52.335066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae374fba-ae4e-4bae-b515-0b683ee18bc3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:52.346400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:52.348564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:52.349998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:52.350765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] PATH_INFO: `/v3/projects/77e45c0cc88b4b40b6167d76bc213f40/users/50d18e8cb2344a37ade53abfce8aed3b/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:52.385337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e45c0cc88b4b40b6167d76bc213f40, user_id=50d18e8cb2344a37ade53abfce8aed3b, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:52.395598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:52.426197 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4197/8418] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:25:52 2022] PUT /identity/v3/projects/77e45c0cc88b4b40b6167d76bc213f40/users/50d18e8cb2344a37ade53abfce8aed3b/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:52.439925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6f9c-9fad-4fb6-8882-aaed37e9a938 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:52.441572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6f9c-9fad-4fb6-8882-aaed37e9a938 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:52.442314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6f9c-9fad-4fb6-8882-aaed37e9a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:52.534418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0b3d6f9c-9fad-4fb6-8882-aaed37e9a938 None None] MFA Rules not processed for user `50d18e8cb2344a37ade53abfce8aed3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:52.535876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b3d6f9c-9fad-4fb6-8882-aaed37e9a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:52.735415 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4222/8419] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:52.761191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:52.769148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:52.865614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e536-4c8e-4530-94a7-28c32cd4b66a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:52.874200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:52.875952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:52.876375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:52.876735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:52.890551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:52.892801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:52.906909 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4198/8420] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:25:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:25:54.626431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ae48-0835-48ea-9e2c-0ac9e6adf487 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:54.627258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ae48-0835-48ea-9e2c-0ac9e6adf487 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:54.627258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ae48-0835-48ea-9e2c-0ac9e6adf487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:54.701600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5365ae48-0835-48ea-9e2c-0ac9e6adf487 None None] MFA Rules not processed for user `73c41e3a934149ec94f36b3c3e1cb999`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:54.704889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5365ae48-0835-48ea-9e2c-0ac9e6adf487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:54.913867 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4223/8421] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:25:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:25:54.915970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:54.917767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:55.110705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51622436-9f66-48ef-b5cb-8d492d38449c service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.123205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.123936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.124229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.124517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.125316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.127455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.188691 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4199/8422] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:25:54 2022] POST /identity/v3/projects => generated 379 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:55.194063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365ae48-0835-48ea-9e2c-0ac9e6adf487 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.227251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365ae48-0835-48ea-9e2c-0ac9e6adf487 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.295319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:55.367497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.369344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.369888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.370370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.371328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.375770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.409371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4224/8423] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:25:55 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:55.414806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.429447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a7756-f308-47fc-8336-6f14d673dd8b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.434875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.435646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.435934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.436216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.437152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.439741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.482701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.499221 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4200/8424] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:55.539173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646e08-4897-48ff-beae-db8ebdbe915f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.552807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.554269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.554602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.554952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] PATH_INFO: `/v3/projects/d8c852705382477b920a13682a7c8bb8/users/579cdab3d4e349ca88f757406724d5b0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.587102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c852705382477b920a13682a7c8bb8, user_id=579cdab3d4e349ca88f757406724d5b0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.590291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.615031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4225/8425] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:25:55 2022] PUT /identity/v3/projects/d8c852705382477b920a13682a7c8bb8/users/579cdab3d4e349ca88f757406724d5b0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:25:55.621793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.642797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431506-eb4c-4fda-91be-9cccf7d8b748 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.659456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:55.814744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.817285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.818015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.818983 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.821797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.833277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.867339 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4201/8426] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:55.876982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.936322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b2d6c-4d26-4469-85dd-c2d7fae59b31 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.942634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.944048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.944613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.952205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] PATH_INFO: `/v3/projects/d8c852705382477b920a13682a7c8bb8/users/579cdab3d4e349ca88f757406724d5b0/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.955467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c852705382477b920a13682a7c8bb8, user_id=579cdab3d4e349ca88f757406724d5b0, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.958457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.991591 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4226/8427] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:25:55 2022] PUT /identity/v3/projects/d8c852705382477b920a13682a7c8bb8/users/579cdab3d4e349ca88f757406724d5b0/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:01.816641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:02.071820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8cfc-600e-48fb-b025-60f650942046 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:02.295452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:02.297432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:02.298056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:02.298609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:02.302886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:02.502737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:02.589389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:02.591203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:02.618404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4202/8428] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:02.992046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:02.994610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:03.045133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2cb9-3916-4fa5-af96-e08c86fe7c51 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:03.092615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:03.093023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:03.093850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:03.100507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:03.115193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:03.175962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:03.191786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:03.258177 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4227/8429] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:04.316845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:04.336017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad280d-9bc7-43dd-aee6-c90f77960c8e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:04.348750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:04.350822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:04.351301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:04.351739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:04.356546 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:04.375503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:04.377342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:04.408638 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4203/8430] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:04.551228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:04.553056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:04.594494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:04.780622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c973-5229-4d3c-8e57-3419d4d4c4b0 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:04.783892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd51233-55c0-479b-b487-90ad05854a12 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:04.791897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d02b5-c7a8-4b04-a0b3-c6b6cfad8990 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:04.793623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d02b5-c7a8-4b04-a0b3-c6b6cfad8990 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:04.794121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d02b5-c7a8-4b04-a0b3-c6b6cfad8990 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:04.796829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d02b5-c7a8-4b04-a0b3-c6b6cfad8990 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:04.799900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a66d02b5-c7a8-4b04-a0b3-c6b6cfad8990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:04.806138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:04.807142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:04.807537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:04.807899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] PATH_INFO: `/v3/users/50d18e8cb2344a37ade53abfce8aed3b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:04.809499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d18e8cb2344a37ade53abfce8aed3b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:04.812045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:04.830303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d02b5-c7a8-4b04-a0b3-c6b6cfad8990 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:04.832789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d02b5-c7a8-4b04-a0b3-c6b6cfad8990 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:04.881708 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4228/8431] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:04.911193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d18e8cb2344a37ade53abfce8aed3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:04.966691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d18e8cb2344a37ade53abfce8aed3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:04.968775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d18e8cb2344a37ade53abfce8aed3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:04.996930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d18e8cb2344a37ade53abfce8aed3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:04.999689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d18e8cb2344a37ade53abfce8aed3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:05.047208 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4204/8432] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:04 2022] DELETE /identity/v3/users/50d18e8cb2344a37ade53abfce8aed3b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:05.054036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f67a-a3c3-4699-b194-a84c6d3c32ff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:05.054588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f67a-a3c3-4699-b194-a84c6d3c32ff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:05.055224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f67a-a3c3-4699-b194-a84c6d3c32ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:05.079712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e9a6f67a-a3c3-4699-b194-a84c6d3c32ff None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:05.082322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9a6f67a-a3c3-4699-b194-a84c6d3c32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:05.183511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:05.207906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4229/8433] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:05.217761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:05.220606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:05.345892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e2ddf-67ab-40c2-aadd-81b7e19decaf None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:05.346661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e2ddf-67ab-40c2-aadd-81b7e19decaf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:05.347257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e2ddf-67ab-40c2-aadd-81b7e19decaf None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:05.350356 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4230/8434] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:26:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:05.357297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:05.357897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:05.358408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:05.391423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec323f-169b-4085-a1c6-2a8c289056b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:05.411042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:05.412067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:05.412446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:05.412808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:05.418536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:05.422495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:05.473017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:05.483104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:05.505467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:05.527373 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4205/8435] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:05.638169 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4231/8436] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:05.675481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:05.677192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:05.746502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e93f9-27c0-46c0-a5a4-c72c92cf1ab9 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:05.774920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567c147-fa3c-4812-9670-dc3166b3f1b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:05.776154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567c147-fa3c-4812-9670-dc3166b3f1b1 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:05.776855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567c147-fa3c-4812-9670-dc3166b3f1b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:05.778330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567c147-fa3c-4812-9670-dc3166b3f1b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:05.820858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567c147-fa3c-4812-9670-dc3166b3f1b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:05.826790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567c147-fa3c-4812-9670-dc3166b3f1b1 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:05.853608 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4206/8437] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:05.883656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:05.885905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:05.925082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ce8a3-8963-4463-8edc-ae59b5d59a49 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:05.942886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:05.943979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:05.944275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:05.944557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] PATH_INFO: `/v3/projects/77e45c0cc88b4b40b6167d76bc213f40` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:05.948050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e45c0cc88b4b40b6167d76bc213f40)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:05.950863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:06.113348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e45c0cc88b4b40b6167d76bc213f40', 'request_id': 'req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:06.150986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e45c0cc88b4b40b6167d76bc213f40', 'request_id': 'req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:06.164278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e45c0cc88b4b40b6167d76bc213f40', 'request_id': 'req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:06.205853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] The token cache is being invalidate because project 77e45c0cc88b4b40b6167d76bc213f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:06.209427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:06.211419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ecb184d-e050-4a9b-b37b-17a65bbafc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:06.221309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4232/8438] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:05 2022] DELETE /identity/v3/projects/77e45c0cc88b4b40b6167d76bc213f40 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:06.226728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92c2ae-5844-4038-9e5e-e766c3546a77 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:06.227440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92c2ae-5844-4038-9e5e-e766c3546a77 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:06.227805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92c2ae-5844-4038-9e5e-e766c3546a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:06.282955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ea92c2ae-5844-4038-9e5e-e766c3546a77 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:06.285574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ea92c2ae-5844-4038-9e5e-e766c3546a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:06.469327 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4207/8439] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:06.478505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03680-7468-4fe0-9988-83b159c0c18b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:06.478918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03680-7468-4fe0-9988-83b159c0c18b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:06.479350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03680-7468-4fe0-9988-83b159c0c18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:06.510418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-51b03680-7468-4fe0-9988-83b159c0c18b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:06.512202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51b03680-7468-4fe0-9988-83b159c0c18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:06.531440 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4233/8440] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:26:06.533653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92c2ae-5844-4038-9e5e-e766c3546a77 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:06.564753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:06.565490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:06.567432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:06.568955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92c2ae-5844-4038-9e5e-e766c3546a77 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:06.585331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:06.586291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:06.586723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:06.587145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:06.588151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:06.588744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:06.594707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:06.635530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] MFA Rules not processed for user `579cdab3d4e349ca88f757406724d5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:06.637101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:06.652692 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4208/8441] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:06.658931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:06.706858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7344ed7-5f5b-4807-844c-1468e75ecad7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:06.730303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:06.731001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:06.731308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:06.731582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:06.732283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:06.744609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:06.801811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:06.818286 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4234/8442] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:06.832868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:06.834641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:06.835911 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4209/8443] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:06 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:06.839841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:06.968657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3ebc-d612-4bb5-89ef-3765281316ad admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:06.974920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:06.977041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:06.977563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:06.978011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:06.978934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:06.981208 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:07.010313 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4210/8444] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:06 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:07.016295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:07.054438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636076-6483-479f-a5e5-23f8e328f8d5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:07.067469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:07.068322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.068510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.068717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.069468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:07.073012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:07.092878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707fa1d-964b-48d6-a7fa-6a50a5016b51 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:07.227880 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4211/8445] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:07.232024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:07.256550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:07.257664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.258265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.258768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.295503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc03b-ead3-4cce-a11e-8aafef8779a1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:07.306942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:07.308447 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.309271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.309958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.311355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:07.315420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:07.337853 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4212/8446] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:07.353005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:07.391112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46252-a06a-48d8-96f0-70e1c18a3cf8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:07.409289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473e55a-b2b7-4476-b685-aa4d4e446e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:07.410356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e55a-b2b7-4476-b685-aa4d4e446e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.410648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e55a-b2b7-4476-b685-aa4d4e446e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.411132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e55a-b2b7-4476-b685-aa4d4e446e6a admin admin] PATH_INFO: `/v3/projects/6acb1a9ef22745ec8d8e79a04bf32d93/users/fce968e8626c44a6aea1c224fb6e1e1d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.433784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473e55a-b2b7-4476-b685-aa4d4e446e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acb1a9ef22745ec8d8e79a04bf32d93, user_id=fce968e8626c44a6aea1c224fb6e1e1d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:07.436648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473e55a-b2b7-4476-b685-aa4d4e446e6a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:07.440906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:07.461674 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4213/8447] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:07 2022] PUT /identity/v3/projects/6acb1a9ef22745ec8d8e79a04bf32d93/users/fce968e8626c44a6aea1c224fb6e1e1d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:07.478023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.478975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.478975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.506243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:07.514249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:07.533608 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4235/8448] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:07.558992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] MFA Rules not processed for user `fce968e8626c44a6aea1c224fb6e1e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:07.560322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:07.711985 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4214/8449] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:26:07.712900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:07.728562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb7f36-85b6-4513-8e36-2b8e728cfab2 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:07.790486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:07.892306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:07.893857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.905869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.906160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.909195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:07.919722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:07.935522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:07.939176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:07.988694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4236/8450] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:07 2022] POST /identity/v3/projects => generated 369 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:07.989708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:08.159181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffd2d1-0459-42aa-b350-81616182c75c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:08.194295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49661f-afea-4c27-8ea1-39aa901e65f4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:08.208701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:08.209402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:08.209691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:08.209972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:08.210682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:08.212707 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:08.284150 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4237/8451] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:07 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:08.288351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:08.314570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eacbaf-52c8-4405-81f9-d1361a90decb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:08.330107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:08.331051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:08.332346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:08.335804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:08.337884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:08.345890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:08.376337 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4238/8452] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:08.376838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:08.399349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d810bb-56d2-4349-a69c-117b0c706f75 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:08.419782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:08.420763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:08.421200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:08.421387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] PATH_INFO: `/v3/projects/afae67f5a6ea4be0b6ef18e8290ac33d/users/c3ec5b3cd0734081a8268cfe347fea14/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:08.518765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:08.519972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:08.520506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:08.521015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:08.532778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:08.537894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afae67f5a6ea4be0b6ef18e8290ac33d, user_id=c3ec5b3cd0734081a8268cfe347fea14, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:08.551020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:08.601974 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4239/8453] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:08 2022] PUT /identity/v3/projects/afae67f5a6ea4be0b6ef18e8290ac33d/users/c3ec5b3cd0734081a8268cfe347fea14/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:08.604240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:08.614308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:08.622927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:08.679534 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4215/8454] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:08.842467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483afc-b146-4d71-8820-7db8150916f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:08.860587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49825a0a-1477-432a-88a0-c7b862935a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:08.862201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49825a0a-1477-432a-88a0-c7b862935a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:08.862500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49825a0a-1477-432a-88a0-c7b862935a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:08.863379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49825a0a-1477-432a-88a0-c7b862935a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:08.864281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49825a0a-1477-432a-88a0-c7b862935a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:08.870045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49825a0a-1477-432a-88a0-c7b862935a80 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:08.881321 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4240/8455] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:08.892782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:08.924164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f747-cf58-4499-af44-8daa3f17a974 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:08.945145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:08.946980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:08.948901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:08.949367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] PATH_INFO: `/v3/projects/afae67f5a6ea4be0b6ef18e8290ac33d/users/c3ec5b3cd0734081a8268cfe347fea14/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:08.968197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afae67f5a6ea4be0b6ef18e8290ac33d, user_id=c3ec5b3cd0734081a8268cfe347fea14, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:08.984090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:09.022136 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4216/8456] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:08 2022] PUT /identity/v3/projects/afae67f5a6ea4be0b6ef18e8290ac33d/users/c3ec5b3cd0734081a8268cfe347fea14/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:09.034984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:09.035657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:09.035657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:09.043888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:09.118815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] MFA Rules not processed for user `c3ec5b3cd0734081a8268cfe347fea14`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:09.120117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:09.202233 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:09.205736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:09.213875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:09.303015 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4241/8457] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:09.321467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:09.322854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:09.372184 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a323e-14e9-48f4-88d5-d01cb4f908c4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:09.395387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:09.396103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:09.396395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:09.396682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:09.402980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:09.435616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:09.438084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:09.453869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48015ef6-380b-400f-be43-0ad7a54b4aee None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:09.457673 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4217/8458] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:09.471149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23b208-8b7f-4ec9-b9f9-e359912dcae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:09.472743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23b208-8b7f-4ec9-b9f9-e359912dcae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:09.491763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23b208-8b7f-4ec9-b9f9-e359912dcae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:09.492564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23b208-8b7f-4ec9-b9f9-e359912dcae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:09.558254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23b208-8b7f-4ec9-b9f9-e359912dcae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:09.569757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23b208-8b7f-4ec9-b9f9-e359912dcae3 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:09.603352 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4242/8459] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:12.821025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:12.970794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca79b61-57b5-49d4-b544-487e56e735cd service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:12.989006 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:12.990306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:12.990730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:12.991153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] PATH_INFO: `/v3/users/fce968e8626c44a6aea1c224fb6e1e1d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:12.993822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce968e8626c44a6aea1c224fb6e1e1d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:12.998426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:13.099513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce968e8626c44a6aea1c224fb6e1e1d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:13.131790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce968e8626c44a6aea1c224fb6e1e1d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:13.132749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce968e8626c44a6aea1c224fb6e1e1d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:13.145802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce968e8626c44a6aea1c224fb6e1e1d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:13.146577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce968e8626c44a6aea1c224fb6e1e1d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:13.168964 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4218/8460] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:12 2022] DELETE /identity/v3/users/fce968e8626c44a6aea1c224fb6e1e1d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:13.174255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:13.174769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:13.174854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:13.238109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:13.253038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:13.410832 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4243/8461] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:13.422702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:13.426229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:13.497015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:13.666610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1383-43ec-4e3d-a23c-76586a34d3f1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:13.673344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:13.674488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:13.674780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:13.675066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:13.710982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:13.712551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:13.750157 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4219/8462] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:14.589776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:14.591306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:14.615668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661886-fcc9-4a64-9ac4-79abfaf74ccf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:14.626901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:14.631351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:14.631780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:14.632069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] PATH_INFO: `/v3/projects/6acb1a9ef22745ec8d8e79a04bf32d93` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:14.636285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6acb1a9ef22745ec8d8e79a04bf32d93)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:14.641259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:14.760825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:14.841542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6acb1a9ef22745ec8d8e79a04bf32d93', 'request_id': 'req-0a46294e-1c92-4220-9017-5ad67acbe0ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:14.850599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6acb1a9ef22745ec8d8e79a04bf32d93', 'request_id': 'req-0a46294e-1c92-4220-9017-5ad67acbe0ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:14.874765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6acb1a9ef22745ec8d8e79a04bf32d93', 'request_id': 'req-0a46294e-1c92-4220-9017-5ad67acbe0ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:14.928702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] The token cache is being invalidate because project 6acb1a9ef22745ec8d8e79a04bf32d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:14.929003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:14.939304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:14.950289 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4244/8463] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:14 2022] DELETE /identity/v3/projects/6acb1a9ef22745ec8d8e79a04bf32d93 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:14.964417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:15.005651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e4fd-71ce-4fe8-87da-0aae98582511 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:15.128912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:15.130125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:15.130584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:15.131019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] PATH_INFO: `/v3/users/c3ec5b3cd0734081a8268cfe347fea14` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:15.132510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ec5b3cd0734081a8268cfe347fea14)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:15.138035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:15.303736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ec5b3cd0734081a8268cfe347fea14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:15.340505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ec5b3cd0734081a8268cfe347fea14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:15.342221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ec5b3cd0734081a8268cfe347fea14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:15.364180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ec5b3cd0734081a8268cfe347fea14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:15.367616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4dc4c28c-5435-443a-82cd-5ebaa1c3a7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ec5b3cd0734081a8268cfe347fea14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:15.408047 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4220/8464] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:14 2022] DELETE /identity/v3/users/c3ec5b3cd0734081a8268cfe347fea14 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:16.106799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:16.115633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:16.151675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46294e-1c92-4220-9017-5ad67acbe0ff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:16.303085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:16.304240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:16.304697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:16.305322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] PATH_INFO: `/v3/projects/afae67f5a6ea4be0b6ef18e8290ac33d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:16.309414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=afae67f5a6ea4be0b6ef18e8290ac33d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:16.313541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:16.567012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afae67f5a6ea4be0b6ef18e8290ac33d', 'request_id': 'req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:16.583392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afae67f5a6ea4be0b6ef18e8290ac33d', 'request_id': 'req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:16.604117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afae67f5a6ea4be0b6ef18e8290ac33d', 'request_id': 'req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:16.624643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] The token cache is being invalidate because project afae67f5a6ea4be0b6ef18e8290ac33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:16.624946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:16.626128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:16.629216 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4245/8465] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:16 2022] DELETE /identity/v3/projects/afae67f5a6ea4be0b6ef18e8290ac33d => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:16.636076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889759-4ff4-4fe0-beba-f47c6b0b0d49 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:16.636673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889759-4ff4-4fe0-beba-f47c6b0b0d49 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:16.637505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889759-4ff4-4fe0-beba-f47c6b0b0d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:16.741007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-92889759-4ff4-4fe0-beba-f47c6b0b0d49 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:16.749956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-92889759-4ff4-4fe0-beba-f47c6b0b0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:16.792535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:16.794300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:16.964801 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:17.013418 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4221/8466] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:17.022027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c32ab-ccc2-44b0-bc8c-e0034e3a8f75 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.022247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c32ab-ccc2-44b0-bc8c-e0034e3a8f75 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.022598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c32ab-ccc2-44b0-bc8c-e0034e3a8f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.054252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:17.080505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8e1c32ab-ccc2-44b0-bc8c-e0034e3a8f75 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:17.086669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8e1c32ab-ccc2-44b0-bc8c-e0034e3a8f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:17.104925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f239-4f14-42f7-8cd7-2f837b9dc4fa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.106449 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4222/8467] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:17.111998 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.113078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.113329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c32ab-ccc2-44b0-bc8c-e0034e3a8f75 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:17.113473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.113686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] PATH_INFO: `/v3/users/3d6431ad47224fc384a9110b02b5b6bb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.120020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6431ad47224fc384a9110b02b5b6bb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.122624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.123696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c32ab-ccc2-44b0-bc8c-e0034e3a8f75 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.142001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.142700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.142985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.143281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.144046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:17.147693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.150045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.171892 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4223/8468] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:17.182711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:17.203315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abd1f-7aff-42c8-bcc3-197532ff7e4c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.210070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.211065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.211595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.212050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.212917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.215422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.218447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6431ad47224fc384a9110b02b5b6bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:17.256570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6431ad47224fc384a9110b02b5b6bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:17.274203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6431ad47224fc384a9110b02b5b6bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:17.275864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6431ad47224fc384a9110b02b5b6bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:17.282753 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4224/8469] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:17 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:17.296637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:17.308142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b8c6784-9fbe-4264-9b9c-95a96316b61a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6431ad47224fc384a9110b02b5b6bb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:17.326349 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4246/8470] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:16 2022] DELETE /identity/v3/users/3d6431ad47224fc384a9110b02b5b6bb => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:17.339597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.352665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.353057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.394363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:17.395532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:17.500078 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4247/8471] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:17.520432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:17.522595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:17.554887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ca508-cf79-42cf-9b0c-4df71dfae606 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.568328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.569617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.570262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.570741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.572252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.578224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.617388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803eda09-9a04-49fb-89b2-d1f875b5d08b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.622884 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4225/8472] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:17 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:17.623298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.624130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.624431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.624701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.625441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:17.628614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:17.644066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.645958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dcee6-a3ca-4ccb-807b-fb78d929ca18 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.646485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.652411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.653619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.654159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.654653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.656608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.658802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.669773 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4248/8473] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:17.685442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:17.692801 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4226/8474] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:17.700385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71772b8-e71d-4806-bea8-67566746c783 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.717127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d5518-5c36-43a5-8d60-282d44f69fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.721226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d5518-5c36-43a5-8d60-282d44f69fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.722121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d5518-5c36-43a5-8d60-282d44f69fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.722645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d5518-5c36-43a5-8d60-282d44f69fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.724015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d5518-5c36-43a5-8d60-282d44f69fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.728289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d5518-5c36-43a5-8d60-282d44f69fa3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.734078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:17.761842 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4249/8475] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:26:17.767854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:17.783087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66aee2-b0b5-4ea4-8b95-a404dd95afb3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:17.790828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:17.792131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.793040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.793458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] PATH_INFO: `/v3/projects/8ed0e5c11ed5445e965cdc99dc4ad645/users/b93940137bdd42ac9c1ad182cc9903d5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.820781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed0e5c11ed5445e965cdc99dc4ad645, user_id=b93940137bdd42ac9c1ad182cc9903d5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:17.826211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:17.850887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4227/8476] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:17 2022] PUT /identity/v3/projects/8ed0e5c11ed5445e965cdc99dc4ad645/users/b93940137bdd42ac9c1ad182cc9903d5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:17.863312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.863312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.863662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.942375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] MFA Rules not processed for user `b93940137bdd42ac9c1ad182cc9903d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:17.946566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:18.178581 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4250/8477] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:18.179588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.282365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.285097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:18.314520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:18.336355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a19a7-9968-4c49-96a3-12044689d83b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.351203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.352930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.353418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.354095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.355698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.358830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.412399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016148f-f249-4d2e-aaf6-4ad82af191ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.418555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.419726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.420122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.420510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] PATH_INFO: `/v3/projects/e077c5a4c14941f28b107c91952a0de8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.422585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e077c5a4c14941f28b107c91952a0de8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.425697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.494276 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4228/8478] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:18 2022] POST /identity/v3/projects => generated 387 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:18.495727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.522384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e077c5a4c14941f28b107c91952a0de8', 'request_id': 'req-85ac0811-d33b-4eb5-bba3-3533a1e24951'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:18.534150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e077c5a4c14941f28b107c91952a0de8', 'request_id': 'req-85ac0811-d33b-4eb5-bba3-3533a1e24951'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:18.547417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e077c5a4c14941f28b107c91952a0de8', 'request_id': 'req-85ac0811-d33b-4eb5-bba3-3533a1e24951'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:18.574175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] The token cache is being invalidate because project e077c5a4c14941f28b107c91952a0de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:18.574457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:18.575659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85ac0811-d33b-4eb5-bba3-3533a1e24951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:18.577628 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4251/8479] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:18 2022] DELETE /identity/v3/projects/e077c5a4c14941f28b107c91952a0de8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:18.583019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cff02-5bd8-45a9-bee8-925467d7e664 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.585057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cff02-5bd8-45a9-bee8-925467d7e664 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.585438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cff02-5bd8-45a9-bee8-925467d7e664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.629988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-280cff02-5bd8-45a9-bee8-925467d7e664 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:18.631257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-280cff02-5bd8-45a9-bee8-925467d7e664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:18.634236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692aaef-b204-4300-9868-2b94ed0a38d0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.644011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.644858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.645139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.645418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.646136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.648359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.660178 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4252/8480] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:18.662623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca68d5-cdfd-40ec-9800-09f4652da52b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.662823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca68d5-cdfd-40ec-9800-09f4652da52b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.663349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca68d5-cdfd-40ec-9800-09f4652da52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.688100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ddca68d5-cdfd-40ec-9800-09f4652da52b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:18.691327 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4229/8481] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:18 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:18.691517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ddca68d5-cdfd-40ec-9800-09f4652da52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:18.694047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.698619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:18.714614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4253/8482] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:18.715620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca68d5-cdfd-40ec-9800-09f4652da52b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.722820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231abb95-52f5-4306-b82b-8abe3e32f14c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.729222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.730101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.730633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.731492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.732256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.732840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:18.735108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.737678 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca68d5-cdfd-40ec-9800-09f4652da52b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.753352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.753352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.753352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.753352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.754467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:18.755544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.757353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.772778 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4230/8483] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:26:18.775126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.792414 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4254/8484] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:18.794152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.805582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d6406-2777-4838-b4f1-43a00d120249 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.812105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7380-3260-4f03-a150-8a13902693ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.812781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.815257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.815598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.815909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] PATH_INFO: `/v3/projects/35f2c8f6ed6a495c81961139a48367f7/users/ad244977f1634344b79a72b55666fbfe/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.823568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.824526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.824968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.825432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.826293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.828842 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.839923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f2c8f6ed6a495c81961139a48367f7, user_id=ad244977f1634344b79a72b55666fbfe, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.845133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.868874 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4255/8485] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:18 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:18.870221 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.872301 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4231/8486] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:18 2022] PUT /identity/v3/projects/35f2c8f6ed6a495c81961139a48367f7/users/ad244977f1634344b79a72b55666fbfe/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:18.876720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.970040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533cf-184a-4701-9261-9c1bd4b8a69e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.973501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef5bc2-1c73-4570-a065-15847aca8466 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.980042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.980758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.981356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.981825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.981950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.982303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.982590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.982738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.984001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.984408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.986403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.987485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:19.002341 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4232/8487] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:19.006765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:19.024789 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4256/8488] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:18 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:19.033112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:19.033506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3103a7-86f4-49e1-817c-377ed35e557c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:19.041580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250729-3c60-4875-a868-aa0a4447a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:19.043693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250729-3c60-4875-a868-aa0a4447a9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.044150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250729-3c60-4875-a868-aa0a4447a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.044542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250729-3c60-4875-a868-aa0a4447a9af admin admin] PATH_INFO: `/v3/projects/35f2c8f6ed6a495c81961139a48367f7/users/ad244977f1634344b79a72b55666fbfe/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.048600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250729-3c60-4875-a868-aa0a4447a9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f2c8f6ed6a495c81961139a48367f7, user_id=ad244977f1634344b79a72b55666fbfe, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:19.049999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86badbf8-9dfe-4b8c-8072-87eacb1c25a9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:19.052321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250729-3c60-4875-a868-aa0a4447a9af admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:19.056586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:19.057611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.057946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.058339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.059068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:19.062523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:19.078618 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4233/8489] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:19 2022] PUT /identity/v3/projects/35f2c8f6ed6a495c81961139a48367f7/users/ad244977f1634344b79a72b55666fbfe/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:19.087175 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4257/8490] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:19.088458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:19.089001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.089236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.089761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.102895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa07dc-83a9-4bb3-9cbf-e3dd8c1bdd00 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:19.137441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:19.154207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] MFA Rules not processed for user `ad244977f1634344b79a72b55666fbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:19.156241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:19.251204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:19.252396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.252892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.253345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.254943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:19.257766 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:19.302965 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4258/8491] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:19.305028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:19.332510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cfaf8-14e4-4dfa-ba64-64c68c745807 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:19.333692 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4234/8492] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:19.344693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:19.350387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:19.356310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff41f3-59da-4fb6-8720-f2c0fc6ecc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:19.357468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff41f3-59da-4fb6-8720-f2c0fc6ecc8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.357777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff41f3-59da-4fb6-8720-f2c0fc6ecc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.358719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff41f3-59da-4fb6-8720-f2c0fc6ecc8a admin admin] PATH_INFO: `/v3/projects/98d18462259a4a73a6eb4a0635405151/users/3c9dbe90558d4b3bbe6a0ebd87ca0724/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.381440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff41f3-59da-4fb6-8720-f2c0fc6ecc8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d18462259a4a73a6eb4a0635405151, user_id=3c9dbe90558d4b3bbe6a0ebd87ca0724, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:19.385030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff41f3-59da-4fb6-8720-f2c0fc6ecc8a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:19.406490 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4259/8493] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:19 2022] PUT /identity/v3/projects/98d18462259a4a73a6eb4a0635405151/users/3c9dbe90558d4b3bbe6a0ebd87ca0724/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:19.422839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.423220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.423611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.466605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] MFA Rules not processed for user `3c9dbe90558d4b3bbe6a0ebd87ca0724`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:19.468068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:19.478695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:19.603172 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4260/8494] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:19.641670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:19.643944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:19.660915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834616fa-ed5c-4f2c-863d-622117824001 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:19.819468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b799-0968-4f96-bfa6-d5118547b57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:19.820805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b799-0968-4f96-bfa6-d5118547b57d service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.820805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b799-0968-4f96-bfa6-d5118547b57d service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.820805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b799-0968-4f96-bfa6-d5118547b57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.823321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb230f-ea3c-40b8-8950-ceae724ad8ee None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:19.831147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:19.832954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:19.833826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:19.835469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:19.851687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:19.853354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:19.868005 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4261/8495] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:20.003182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b799-0968-4f96-bfa6-d5118547b57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:20.013217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b799-0968-4f96-bfa6-d5118547b57d service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:20.025592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:20.038180 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4235/8496] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:20.260816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:20.437754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f780b8-216c-49c5-b6cc-f13b334099b9 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:20.462300 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:20.464757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:20.464757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:20.464986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] PATH_INFO: `/v3/users/b93940137bdd42ac9c1ad182cc9903d5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:20.466647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93940137bdd42ac9c1ad182cc9903d5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:20.469085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:20.581186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93940137bdd42ac9c1ad182cc9903d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:20.592295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:20.614006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93940137bdd42ac9c1ad182cc9903d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:20.626724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93940137bdd42ac9c1ad182cc9903d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:20.627505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93940137bdd42ac9c1ad182cc9903d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:20.659015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93940137bdd42ac9c1ad182cc9903d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:20.691784 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4262/8497] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:20 2022] DELETE /identity/v3/users/b93940137bdd42ac9c1ad182cc9903d5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:20.696467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:20.697015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:20.697015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:20.730882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:20.732219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:20.886443 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4236/8498] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:20.891914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:20.898867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:21.054262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773397fb-60f2-4a33-abd4-28851e32c629 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:21.060255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:21.063770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:21.066199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:21.066579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:21.082371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:21.084230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:21.098360 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4263/8499] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:21.836550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:21.838835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:21.866316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caff806-0538-4c6e-a9fc-782192e8fa94 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:21.880525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:21.891811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:21.894982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:21.900085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] PATH_INFO: `/v3/projects/8ed0e5c11ed5445e965cdc99dc4ad645` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:21.904816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed0e5c11ed5445e965cdc99dc4ad645)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:21.908582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:22.013455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed0e5c11ed5445e965cdc99dc4ad645', 'request_id': 'req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.026931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed0e5c11ed5445e965cdc99dc4ad645', 'request_id': 'req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.044533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed0e5c11ed5445e965cdc99dc4ad645', 'request_id': 'req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.067479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] The token cache is being invalidate because project 8ed0e5c11ed5445e965cdc99dc4ad645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:22.067795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.069115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.089761 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4237/8500] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:21 2022] DELETE /identity/v3/projects/8ed0e5c11ed5445e965cdc99dc4ad645 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:22.090899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:22.113868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316497-a0f3-47ea-9a83-3d4a6efdfd07 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:22.374938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:22.376462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:22.377108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:22.377504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] PATH_INFO: `/v3/users/ad244977f1634344b79a72b55666fbfe` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:22.384696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad244977f1634344b79a72b55666fbfe)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:22.390955 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:22.511810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad244977f1634344b79a72b55666fbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.534463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad244977f1634344b79a72b55666fbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.549988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad244977f1634344b79a72b55666fbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.550911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad244977f1634344b79a72b55666fbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.559799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:22.569609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad244977f1634344b79a72b55666fbfe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:22.601631 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4264/8501] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:22 2022] DELETE /identity/v3/users/ad244977f1634344b79a72b55666fbfe => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:23.217602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:23.219948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:23.271812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8bb18-9f9a-4a62-81f4-df85f72e7d69 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:23.391769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:23.392791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:23.393080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:23.393632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] PATH_INFO: `/v3/projects/35f2c8f6ed6a495c81961139a48367f7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:23.395168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f2c8f6ed6a495c81961139a48367f7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:23.398522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:23.454388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:23.455203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:23.459650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:23.503401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f2c8f6ed6a495c81961139a48367f7', 'request_id': 'req-cb43821d-7bb9-45aa-af06-14de65b305d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.503598 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d54b7-32d0-40c1-b20b-512680fade0b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:23.521733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f2c8f6ed6a495c81961139a48367f7', 'request_id': 'req-cb43821d-7bb9-45aa-af06-14de65b305d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.538938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f2c8f6ed6a495c81961139a48367f7', 'request_id': 'req-cb43821d-7bb9-45aa-af06-14de65b305d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.569466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] The token cache is being invalidate because project 35f2c8f6ed6a495c81961139a48367f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:23.575709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.578759 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb43821d-7bb9-45aa-af06-14de65b305d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.584861 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4238/8502] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:23 2022] DELETE /identity/v3/projects/35f2c8f6ed6a495c81961139a48367f7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:23.598288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:23.598688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e134-7042-4cd3-8e88-241cd5ac049d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:23.599344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:23.599470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e134-7042-4cd3-8e88-241cd5ac049d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:23.599638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:23.599920 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] PATH_INFO: `/v3/users/73c41e3a934149ec94f36b3c3e1cb999` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:23.600625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e134-7042-4cd3-8e88-241cd5ac049d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:23.601148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c41e3a934149ec94f36b3c3e1cb999)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:23.603112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:23.639900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4d83e134-7042-4cd3-8e88-241cd5ac049d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:23.642340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d83e134-7042-4cd3-8e88-241cd5ac049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:23.670027 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4239/8503] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:23.670265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c41e3a934149ec94f36b3c3e1cb999'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.674339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84621-965f-4c06-b18c-db299ffdb340 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:23.675488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84621-965f-4c06-b18c-db299ffdb340 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:23.676104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84621-965f-4c06-b18c-db299ffdb340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:23.686360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c41e3a934149ec94f36b3c3e1cb999'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.698097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c41e3a934149ec94f36b3c3e1cb999'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.699022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c41e3a934149ec94f36b3c3e1cb999'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.706168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7bb84621-965f-4c06-b18c-db299ffdb340 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:23.707416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7bb84621-965f-4c06-b18c-db299ffdb340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:23.709831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c41e3a934149ec94f36b3c3e1cb999'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:23.716310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4240/8504] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:23.718226 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4265/8505] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:23 2022] DELETE /identity/v3/users/73c41e3a934149ec94f36b3c3e1cb999 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:23.722381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84621-965f-4c06-b18c-db299ffdb340 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:23.733740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84621-965f-4c06-b18c-db299ffdb340 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:23.844382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:23.844988 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:23.845278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:23.845561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:23.846311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:23.847414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:23.849561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:23.866181 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4241/8506] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:23.877080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:23.894094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09330418-2398-493f-b17c-1835b7ba0f6d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:23.907608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:23.909060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:23.909722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:23.911315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:23.913186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:23.919618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:23.998435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.001330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:24.027741 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4266/8507] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:23 2022] POST /identity/v3/projects => generated 407 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:24.035493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.051758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbd9c-49ae-48d8-820c-36686f758362 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:24.166640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:24.168439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.168730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.169161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] PATH_INFO: `/v3/projects/cd5ec168ea1b4514a510f4d6e75a169e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.170676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5ec168ea1b4514a510f4d6e75a169e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:24.173916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:24.180558 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:24.211484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d493a-0f82-4aee-9e6e-1f48c2393b5e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:24.236486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:24.237343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.237745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.238135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.244832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:24.244832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:24.252445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:24.280278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5ec168ea1b4514a510f4d6e75a169e', 'request_id': 'req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.293499 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4267/8508] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:24 2022] POST /identity/v3/users => generated 304 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:24.298960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.299127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5ec168ea1b4514a510f4d6e75a169e', 'request_id': 'req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.324970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2a4f-4ae5-4eca-b2c5-45605d9189c5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:24.328270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5ec168ea1b4514a510f4d6e75a169e', 'request_id': 'req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.340868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] The token cache is being invalidate because project cd5ec168ea1b4514a510f4d6e75a169e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:24.341152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.341946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.347379 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4242/8509] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:23 2022] DELETE /identity/v3/projects/cd5ec168ea1b4514a510f4d6e75a169e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:24.348473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.350021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:24.414826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:24.416029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.416540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.416827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.417730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:24.419584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:24.435809 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4268/8510] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:24.443052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.445049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:24.459554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8a6f-e068-4768-92ce-1d31cd92d764 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:24.465335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:24.466061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.466481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.466872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.468343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:24.470259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:24.483630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e386ac-1ef2-46dd-8ac2-8ff8ab1b45eb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:24.484317 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4269/8511] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:24.488481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.493948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:24.495380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.495889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.496391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] PATH_INFO: `/v3/users/579cdab3d4e349ca88f757406724d5b0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.498217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579cdab3d4e349ca88f757406724d5b0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:24.500604 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ebad2-104e-4be0-a1ae-93faba262b75 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:24.502394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:24.506314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34a329-ba62-409e-8721-07a424c6b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:24.507463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a329-ba62-409e-8721-07a424c6b17a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.507764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a329-ba62-409e-8721-07a424c6b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.508161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a329-ba62-409e-8721-07a424c6b17a admin admin] PATH_INFO: `/v3/projects/85a5b44950c14fb58ed6f5740b65e78b/users/cad462b83b2e4488880aaeb3fe1b0f0f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.527758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a329-ba62-409e-8721-07a424c6b17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a5b44950c14fb58ed6f5740b65e78b, user_id=cad462b83b2e4488880aaeb3fe1b0f0f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:24.531414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a329-ba62-409e-8721-07a424c6b17a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:24.565829 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4270/8512] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:24 2022] PUT /identity/v3/projects/85a5b44950c14fb58ed6f5740b65e78b/users/cad462b83b2e4488880aaeb3fe1b0f0f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:24.568961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.569390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.569674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.580110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579cdab3d4e349ca88f757406724d5b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.604266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579cdab3d4e349ca88f757406724d5b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.609500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579cdab3d4e349ca88f757406724d5b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.619994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] MFA Rules not processed for user `cad462b83b2e4488880aaeb3fe1b0f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:24.621894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:24.622713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579cdab3d4e349ca88f757406724d5b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.627043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579cdab3d4e349ca88f757406724d5b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:24.650533 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4243/8513] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:24 2022] DELETE /identity/v3/users/579cdab3d4e349ca88f757406724d5b0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:24.729675 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4271/8514] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:24.736129 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.738165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:24.799882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:24.830843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b667-9d72-415c-a47b-c43e2dd23732 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:24.837534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:24.838191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:24.838489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:24.838787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:24.839565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:24.841762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:24.895407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.896878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:24.901629 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4244/8515] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:24 2022] POST /identity/v3/projects => generated 407 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:24.913345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:24.954514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:24.997597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5da4-9afa-4670-bb8b-52d832c29996 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.057853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa95fa1-2d37-4ef7-8889-3d7d5d322880 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.064160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.065218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.065660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.066153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.067012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.069845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.082393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.083499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.083844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.084199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] PATH_INFO: `/v3/projects/d8c852705382477b920a13682a7c8bb8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.086094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c852705382477b920a13682a7c8bb8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.088540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.097055 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4245/8516] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:24 2022] POST /identity/v3/users => generated 310 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:25.101365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.119240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cefac-088d-459f-bbb9-29e437643ba9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.128889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.129920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.130518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.131383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.132728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.135194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.155928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4246/8517] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:25.156444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c852705382477b920a13682a7c8bb8', 'request_id': 'req-f5b05414-5c03-43c8-9537-bb232cc8ecf9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:25.159304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.163349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c852705382477b920a13682a7c8bb8', 'request_id': 'req-f5b05414-5c03-43c8-9537-bb232cc8ecf9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:25.174316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c852705382477b920a13682a7c8bb8', 'request_id': 'req-f5b05414-5c03-43c8-9537-bb232cc8ecf9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:25.175681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac9f5b-2e35-4e42-a9db-8d5fd59e09e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.191195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] The token cache is being invalidate because project d8c852705382477b920a13682a7c8bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:25.191723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:25.193253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5b05414-5c03-43c8-9537-bb232cc8ecf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:25.199465 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4272/8518] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:24 2022] DELETE /identity/v3/projects/d8c852705382477b920a13682a7c8bb8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:25.203245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855925e-1bd5-494e-b74d-0c07cbbecd8f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.203815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855925e-1bd5-494e-b74d-0c07cbbecd8f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.204263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855925e-1bd5-494e-b74d-0c07cbbecd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.234299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1855925e-1bd5-494e-b74d-0c07cbbecd8f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:25.236721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1855925e-1bd5-494e-b74d-0c07cbbecd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:25.263574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.265211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.265992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.266414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] PATH_INFO: `/v3/projects/bb3bf3321b16433087a1da8cbedbdff5/users/f6a8e52bcff548bc82dbb575624b9709/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.294460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3bf3321b16433087a1da8cbedbdff5, user_id=f6a8e52bcff548bc82dbb575624b9709, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.298199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.320113 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4247/8519] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:25 2022] PUT /identity/v3/projects/bb3bf3321b16433087a1da8cbedbdff5/users/f6a8e52bcff548bc82dbb575624b9709/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:25.326460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.329752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:25.347816 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4273/8520] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:25.357609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbaac-1f22-4497-9461-e43b7b2a8ae7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.358257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbaac-1f22-4497-9461-e43b7b2a8ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.358549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbaac-1f22-4497-9461-e43b7b2a8ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.390460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ee6fbaac-1f22-4497-9461-e43b7b2a8ae7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:25.391787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ee6fbaac-1f22-4497-9461-e43b7b2a8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:25.397357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:25.402651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:25.491318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915391-d0e3-4821-82b7-d4b3fbb4b289 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.503025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5155591-0766-4b53-8573-082695908778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.503751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5155591-0766-4b53-8573-082695908778 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.504037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5155591-0766-4b53-8573-082695908778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.504315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5155591-0766-4b53-8573-082695908778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.505064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5155591-0766-4b53-8573-082695908778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.506727 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4274/8521] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:25.507223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5155591-0766-4b53-8573-082695908778 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.512560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbaac-1f22-4497-9461-e43b7b2a8ae7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.524917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbaac-1f22-4497-9461-e43b7b2a8ae7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.532450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.533401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.533853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.534285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.535175 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:25.535671 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.537471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.540736 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4248/8522] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:25.541703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5155591-0766-4b53-8573-082695908778 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.554807 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4275/8523] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:25.560393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.560610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5155591-0766-4b53-8573-082695908778 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.573068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582de4-d786-4cde-999a-9e018c2856bd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.577915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab083be-b725-4452-91ac-f1c1427e8c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.578834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab083be-b725-4452-91ac-f1c1427e8c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.579119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab083be-b725-4452-91ac-f1c1427e8c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.579423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab083be-b725-4452-91ac-f1c1427e8c37 admin admin] PATH_INFO: `/v3/projects/bb3bf3321b16433087a1da8cbedbdff5/users/f6a8e52bcff548bc82dbb575624b9709/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.584170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab083be-b725-4452-91ac-f1c1427e8c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3bf3321b16433087a1da8cbedbdff5, user_id=f6a8e52bcff548bc82dbb575624b9709, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.586898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab083be-b725-4452-91ac-f1c1427e8c37 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.601762 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4249/8524] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:25 2022] PUT /identity/v3/projects/bb3bf3321b16433087a1da8cbedbdff5/users/f6a8e52bcff548bc82dbb575624b9709/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:25.608583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.609293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.609581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.612201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.613033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.613408 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.613599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.613819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.617265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.660846 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4276/8525] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:25 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:25.665122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.668621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] MFA Rules not processed for user `f6a8e52bcff548bc82dbb575624b9709`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:25.670481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:25.757848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae2fd-b3bf-4638-aa06-a85b75426b83 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.763835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4250/8526] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:26:25.766605 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.767351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.767646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.768273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.768993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.771321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.776266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.777974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:25.803481 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4277/8527] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:25 2022] POST /identity/v3/users => generated 282 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:25.807552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.823310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef51df-ac7f-40d1-8e81-941d91728eee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.828838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.829709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.830006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.830417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.831050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.832964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.848838 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4278/8528] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:25.853290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.868826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a93d6-2e42-40fb-b2e4-a82e58eafed1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.875726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.876431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.876723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.877070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.877814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38728c-dd89-4b1b-9474-77df326a5c8b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.877933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.884535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.885210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b9db9-3b32-4402-accc-4a3582663591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.886601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b9db9-3b32-4402-accc-4a3582663591 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.887458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b9db9-3b32-4402-accc-4a3582663591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.887732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b9db9-3b32-4402-accc-4a3582663591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.899466 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4279/8529] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:26:25.904949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:25.907471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b9db9-3b32-4402-accc-4a3582663591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.909436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b9db9-3b32-4402-accc-4a3582663591 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.918928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776222a6-4794-44ee-89b3-b1ff1c4e74a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:25.924589 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4251/8530] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:25.930362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:25.931651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.932101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.932243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] PATH_INFO: `/v3/projects/155909168e234da5b6a846c22cc6abe4/users/d80b34d83a1b40b6ae901f46ad3a318d/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:25.956426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155909168e234da5b6a846c22cc6abe4, user_id=d80b34d83a1b40b6ae901f46ad3a318d, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:25.959850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:25.976537 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4280/8531] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:25 2022] PUT /identity/v3/projects/155909168e234da5b6a846c22cc6abe4/users/d80b34d83a1b40b6ae901f46ad3a318d/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:25.982187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295e03-df4c-4ac2-a214-c2c533b758b1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:25.982478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295e03-df4c-4ac2-a214-c2c533b758b1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:25.982860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295e03-df4c-4ac2-a214-c2c533b758b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:26.008658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f7295e03-df4c-4ac2-a214-c2c533b758b1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:26.010183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7295e03-df4c-4ac2-a214-c2c533b758b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:26.063790 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:26.097409 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4252/8532] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:26.108525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:26.110334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:26.133780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:26.153994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295e03-df4c-4ac2-a214-c2c533b758b1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:26.205140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3e43-9fc8-4740-8f4a-f51c1dd70dd8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:26.210749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:26.211985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:26.212609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:26.213154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:26.225180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:26.226884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:26.233893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295e03-df4c-4ac2-a214-c2c533b758b1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:26.238952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea54a6-93b0-4321-b6f3-f3c98d3452fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:26.243403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea54a6-93b0-4321-b6f3-f3c98d3452fa service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:26.243403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea54a6-93b0-4321-b6f3-f3c98d3452fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:26.243403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea54a6-93b0-4321-b6f3-f3c98d3452fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:26.245195 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4281/8533] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:26.257966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aaea54a6-93b0-4321-b6f3-f3c98d3452fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:26.353929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea54a6-93b0-4321-b6f3-f3c98d3452fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:26.356136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea54a6-93b0-4321-b6f3-f3c98d3452fa service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:26.383873 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4253/8534] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:26.487076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:26.489827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:26.507057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a230b-195d-442f-b40f-517b4008e9a9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:26.512836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:26.513904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:26.514346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:26.516589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] PATH_INFO: `/v3/users/3c9dbe90558d4b3bbe6a0ebd87ca0724` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:26.519883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9dbe90558d4b3bbe6a0ebd87ca0724)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:26.522001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:26.638304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9dbe90558d4b3bbe6a0ebd87ca0724'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:26.662096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9dbe90558d4b3bbe6a0ebd87ca0724'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:26.672882 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9dbe90558d4b3bbe6a0ebd87ca0724'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:26.673770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9dbe90558d4b3bbe6a0ebd87ca0724'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:26.688085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9dbe90558d4b3bbe6a0ebd87ca0724'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:26.699296 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4282/8535] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:26 2022] DELETE /identity/v3/users/3c9dbe90558d4b3bbe6a0ebd87ca0724 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:26.710435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:26.711043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:26.715354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:26.827582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:26.828891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:26.996793 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4254/8536] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:27.012057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:27.018094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:27.151937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9a48-5119-47c8-917d-514811270b58 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:27.160156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:27.161784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:27.162432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:27.163021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:27.179408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:27.181549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:27.198673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4283/8537] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:27.718350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:27.720843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:27.754120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3923-fb19-4ddc-90d3-4cf9429589ae None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:27.766271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358101-a18c-4c24-92c3-8fda6aa602a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:27.767179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358101-a18c-4c24-92c3-8fda6aa602a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:27.767590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358101-a18c-4c24-92c3-8fda6aa602a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:27.768024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358101-a18c-4c24-92c3-8fda6aa602a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:27.774138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:27.775774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:27.785710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b358101-a18c-4c24-92c3-8fda6aa602a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:27.820299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17de420-d86b-444c-a0de-b4803d885aba service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:27.831346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358101-a18c-4c24-92c3-8fda6aa602a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:27.832258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:27.836463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:27.837227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:27.838124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358101-a18c-4c24-92c3-8fda6aa602a4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:27.838447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] PATH_INFO: `/v3/projects/98d18462259a4a73a6eb4a0635405151` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:27.844123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d18462259a4a73a6eb4a0635405151)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:27.852792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:27.879844 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4255/8538] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:27.937965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:27.983414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d18462259a4a73a6eb4a0635405151', 'request_id': 'req-23840f2f-202f-4753-9c88-625e91db7e14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:28.011962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d18462259a4a73a6eb4a0635405151', 'request_id': 'req-23840f2f-202f-4753-9c88-625e91db7e14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:28.023756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d18462259a4a73a6eb4a0635405151', 'request_id': 'req-23840f2f-202f-4753-9c88-625e91db7e14'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:28.045185 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] The token cache is being invalidate because project 98d18462259a4a73a6eb4a0635405151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:28.046148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:28.047931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23840f2f-202f-4753-9c88-625e91db7e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:28.054847 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4284/8539] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:27 2022] DELETE /identity/v3/projects/98d18462259a4a73a6eb4a0635405151 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:28.057824 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df68ad-1fcb-4895-8f38-1cb56cf1bce9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.058131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df68ad-1fcb-4895-8f38-1cb56cf1bce9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.058412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df68ad-1fcb-4895-8f38-1cb56cf1bce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.091909 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d1df68ad-1fcb-4895-8f38-1cb56cf1bce9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:28.095847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d1df68ad-1fcb-4895-8f38-1cb56cf1bce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:28.147348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:28.279617 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4256/8540] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:28.289557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4165e-c7ed-489c-8b8e-aa5d2f192d0e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.289557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4165e-c7ed-489c-8b8e-aa5d2f192d0e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.289557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4165e-c7ed-489c-8b8e-aa5d2f192d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.333003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-54b4165e-c7ed-489c-8b8e-aa5d2f192d0e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:28.337830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-54b4165e-c7ed-489c-8b8e-aa5d2f192d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:28.362538 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4285/8541] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:26:28.363840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df68ad-1fcb-4895-8f38-1cb56cf1bce9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:28.377565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df68ad-1fcb-4895-8f38-1cb56cf1bce9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:28.391118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:28.392185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.392694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.393986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.394929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:28.395468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:28.402136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:28.441661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4165e-c7ed-489c-8b8e-aa5d2f192d0e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:28.444987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4257/8542] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:28.455562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4165e-c7ed-489c-8b8e-aa5d2f192d0e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:28.466449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:28.469366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.469746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.470275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.471445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:28.479634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:28.541099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:28.541933 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4286/8543] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:28 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:28.586254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fde2d-07aa-4253-b675-5e46975fd73a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:28.762881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:28.763799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.763978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.765628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.766474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:28.769519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:28.813579 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4258/8544] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:28 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:28.818198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:28.837345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b8d58-a6b8-4a97-918f-d97bc8371f46 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:28.845546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:28.846323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.846614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.846894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.847693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:28.850198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:28.870954 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4287/8545] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:28.872229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:28.892552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478ab9-a4d3-4ec9-848e-c11db8b90094 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:28.899335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee61fc-492a-4bed-a0cb-23fcb2745fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:28.900267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee61fc-492a-4bed-a0cb-23fcb2745fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.900664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee61fc-492a-4bed-a0cb-23fcb2745fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.901031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee61fc-492a-4bed-a0cb-23fcb2745fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.902359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee61fc-492a-4bed-a0cb-23fcb2745fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:28.907052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee61fc-492a-4bed-a0cb-23fcb2745fd5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:28.923693 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4259/8546] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:28.928212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:28.947200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763543d-97d4-4159-912c-2b11ab9db31a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:28.958083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:28.959339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:28.959880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:28.960254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] PATH_INFO: `/v3/projects/d2740fe35e3d4118a1739a32423d8017/users/1d56f59fd60f44ad91cdb223288e28d5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:28.983159 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2740fe35e3d4118a1739a32423d8017, user_id=1d56f59fd60f44ad91cdb223288e28d5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:28.986418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:29.018803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4288/8547] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:28 2022] PUT /identity/v3/projects/d2740fe35e3d4118a1739a32423d8017/users/1d56f59fd60f44ad91cdb223288e28d5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:29.031865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7771-fb5c-4554-ba8e-2d56479d2262 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:29.031865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7771-fb5c-4554-ba8e-2d56479d2262 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:29.031865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7771-fb5c-4554-ba8e-2d56479d2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:29.084598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3e0b7771-fb5c-4554-ba8e-2d56479d2262 None None] MFA Rules not processed for user `1d56f59fd60f44ad91cdb223288e28d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:29.085944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3e0b7771-fb5c-4554-ba8e-2d56479d2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:29.224443 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4260/8548] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:29.235975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:29.238235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:29.404189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64256fc-0649-472e-ab95-2ba2087e5b4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:29.413748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:29.414450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:29.414737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:29.415016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:29.429461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:29.431074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:29.447236 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4289/8549] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:35.317405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eddc5-4167-43c4-b189-fe0da62a91cd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:35.317938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eddc5-4167-43c4-b189-fe0da62a91cd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:35.318059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eddc5-4167-43c4-b189-fe0da62a91cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:35.365556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-272eddc5-4167-43c4-b189-fe0da62a91cd None None] MFA Rules not processed for user `d80b34d83a1b40b6ae901f46ad3a318d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:35.367217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-272eddc5-4167-43c4-b189-fe0da62a91cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:35.382847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:35.515137 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4261/8550] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:35.519407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:35.521555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:35.669269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:35.689207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ef9c-ab76-4079-957e-67d0fcddc95b service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:35.703921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:35.705214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:35.705521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:35.705805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:35.706547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:35.712771 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:35.763797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eddc5-4167-43c4-b189-fe0da62a91cd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:35.765010 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4290/8551] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:35 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:35.784495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eddc5-4167-43c4-b189-fe0da62a91cd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:35.793135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc543f3d-43eb-4ce2-8531-7dc816368dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:35.797652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc543f3d-43eb-4ce2-8531-7dc816368dce admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:35.797885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc543f3d-43eb-4ce2-8531-7dc816368dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:35.798178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc543f3d-43eb-4ce2-8531-7dc816368dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:35.800497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc543f3d-43eb-4ce2-8531-7dc816368dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:35.802192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc543f3d-43eb-4ce2-8531-7dc816368dce admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:35.839093 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4262/8552] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:35.840565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:35.853837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a81f9-7f0f-4670-a525-4044513eaa63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:35.872508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:35.874627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:35.874847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:35.875242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] PATH_INFO: `/v3/system/users/10866163e0574bd1bc90367a4d449c4c/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:35.916338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10866163e0574bd1bc90367a4d449c4c, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:35.927457 n-d-768852-23 devstack@keystone.service[80581]: WARNING py.warnings [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:35.927457 n-d-768852-23 devstack@keystone.service[80581]: warnings.warn(msg) Jul 14 15:26:35.927457 n-d-768852-23 devstack@keystone.service[80581]: Jul 14 15:26:35.927457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:35.968868 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4291/8553] 10.222.0.98 () {60 vars in 1377 bytes} [Thu Jul 14 15:26:35 2022] PUT /identity/v3/system/users/10866163e0574bd1bc90367a4d449c4c/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:35.981106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db38b9-76b8-4315-a78b-00a10d35ef24 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:35.981386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db38b9-76b8-4315-a78b-00a10d35ef24 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:35.981792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db38b9-76b8-4315-a78b-00a10d35ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:36.060620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-89db38b9-76b8-4315-a78b-00a10d35ef24 None None] MFA Rules not processed for user `10866163e0574bd1bc90367a4d449c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:36.070517 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-89db38b9-76b8-4315-a78b-00a10d35ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:36.494288 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4263/8554] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:35 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:36.495174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:36.899811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72db3f4-e12e-4b57-a0bb-d68ca74d6e75 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:37.010339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10866163e0574bd1bc90367a4d449c4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:37.011054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:37.011542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:37.011757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:37.015251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:37.017320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:37.039861 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4292/8555] 10.222.0.98 () {58 vars in 1109 bytes} [Thu Jul 14 15:26:36 2022] GET /identity/v3/services => generated 2191 bytes in 546 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:26:37.041403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db38b9-76b8-4315-a78b-00a10d35ef24 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:37.309809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:37.453134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db38b9-76b8-4315-a78b-00a10d35ef24 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:37.551961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10866163e0574bd1bc90367a4d449c4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:37.553032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:37.553032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:37.553318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] PATH_INFO: `/v3/limits` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:37.554045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:37.555452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 14 15:26:37.634366 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 14 15:26:37.635738 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:26:37.636760 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4264/8556] 10.222.0.98 () {60 vars in 1125 bytes} [Thu Jul 14 15:26:37 2022] POST /identity/v3/limits => generated 124 bytes in 596 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 14 15:26:37.644741 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:37.789705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:38.105586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c5145-5c65-4d1c-8d79-b101cd76c5f3 None tempest-ImageQuotaTest-770168260-system-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:38.269942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10866163e0574bd1bc90367a4d449c4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:38.274076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:38.274076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:38.274525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:38.278067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:38.280201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:38.329580 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4293/8557] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 15:26:37 2022] GET /identity/v3/registered_limits => generated 129 bytes in 686 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:38.336879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:38.722717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6411c0a-8c5d-4cfd-9ebc-fa0052e620f6 None tempest-ImageQuotaTest-770168260-system-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:38.791664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:38.847338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10866163e0574bd1bc90367a4d449c4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:38.848064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:38.848356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:38.848656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:38.849372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:38.850527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:38.877650 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4265/8558] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 15:26:38 2022] GET /identity/v3/registered_limits => generated 129 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:42.403034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:42.405330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:42.543885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c3e0-eef2-4a28-bed5-e7c1564c35c6 None tempest-ImageQuotaTest-770168260-system-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:42.551539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205909c-4425-49b6-921f-354aae86bc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:42.552429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205909c-4425-49b6-921f-354aae86bc08 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:42.552799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205909c-4425-49b6-921f-354aae86bc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:42.553267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205909c-4425-49b6-921f-354aae86bc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:42.556640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2205909c-4425-49b6-921f-354aae86bc08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:42.576086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205909c-4425-49b6-921f-354aae86bc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:42.580559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205909c-4425-49b6-921f-354aae86bc08 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:42.606800 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4294/8559] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:42.706550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:42.716578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:42.752101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646468-cf9b-4ca7-a0be-539b272fa294 None tempest-ImageQuotaTest-770168260-system-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:42.769771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:42.770696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:42.770986 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:42.771285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] PATH_INFO: `/v3/users/cad462b83b2e4488880aaeb3fe1b0f0f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:42.772699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad462b83b2e4488880aaeb3fe1b0f0f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:42.774788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:42.882721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad462b83b2e4488880aaeb3fe1b0f0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:42.940264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad462b83b2e4488880aaeb3fe1b0f0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:42.941054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad462b83b2e4488880aaeb3fe1b0f0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:42.958678 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad462b83b2e4488880aaeb3fe1b0f0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:42.959670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad462b83b2e4488880aaeb3fe1b0f0f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:43.018438 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4266/8560] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:42 2022] DELETE /identity/v3/users/cad462b83b2e4488880aaeb3fe1b0f0f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:43.023016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:43.023631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:43.024102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:43.080191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:43.081459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:43.202880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:43.248174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4295/8561] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:43.291657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:43.295861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:43.445586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6072a-9e33-4733-bc29-5afdfbae269d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:43.456049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:43.459837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:43.460352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:43.460752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:43.491448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:43.493131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:43.529912 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4267/8562] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:44.984304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:44.986690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:45.065943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52f973-9df4-441c-9258-2d49b01b057c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:45.084036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:45.084974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:45.085266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:45.085552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] PATH_INFO: `/v3/projects/85a5b44950c14fb58ed6f5740b65e78b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:45.093262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a5b44950c14fb58ed6f5740b65e78b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:45.102782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:45.309327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a5b44950c14fb58ed6f5740b65e78b', 'request_id': 'req-f07ab62e-514e-4748-b43f-b556e6f6afef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.323251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a5b44950c14fb58ed6f5740b65e78b', 'request_id': 'req-f07ab62e-514e-4748-b43f-b556e6f6afef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.337824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a5b44950c14fb58ed6f5740b65e78b', 'request_id': 'req-f07ab62e-514e-4748-b43f-b556e6f6afef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.392239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] The token cache is being invalidate because project 85a5b44950c14fb58ed6f5740b65e78b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:45.394491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.406110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.406110 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4296/8563] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:44 2022] DELETE /identity/v3/projects/85a5b44950c14fb58ed6f5740b65e78b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:45.410473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:45.463576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e656f-d60f-4b2a-b17e-4de694414a1a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:45.732413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:45.748034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:45.751613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:45.751785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:45.752807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] PATH_INFO: `/v3/users/f6a8e52bcff548bc82dbb575624b9709` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:45.756008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a8e52bcff548bc82dbb575624b9709)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:45.759160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:45.880071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a8e52bcff548bc82dbb575624b9709'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.917120 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a8e52bcff548bc82dbb575624b9709'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.922004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a8e52bcff548bc82dbb575624b9709'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.942953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a8e52bcff548bc82dbb575624b9709'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.945730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a8e52bcff548bc82dbb575624b9709'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:45.969115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4268/8564] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:45 2022] DELETE /identity/v3/users/f6a8e52bcff548bc82dbb575624b9709 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:48.026600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.028713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:48.090732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab62e-514e-4748-b43f-b556e6f6afef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.304175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.307153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:48.318918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.321155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.321921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.322494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] PATH_INFO: `/v3/projects/bb3bf3321b16433087a1da8cbedbdff5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.329968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3bf3321b16433087a1da8cbedbdff5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.333972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:48.418396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3bf3321b16433087a1da8cbedbdff5', 'request_id': 'req-64ceaaa6-8f27-4940-917b-adbe9b3890b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.439587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3bf3321b16433087a1da8cbedbdff5', 'request_id': 'req-64ceaaa6-8f27-4940-917b-adbe9b3890b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.445699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d064c-1474-4553-a38c-8851d8caf21e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.471400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3bf3321b16433087a1da8cbedbdff5', 'request_id': 'req-64ceaaa6-8f27-4940-917b-adbe9b3890b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.519397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] The token cache is being invalidate because project bb3bf3321b16433087a1da8cbedbdff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:48.519902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.524147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64ceaaa6-8f27-4940-917b-adbe9b3890b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.527551 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4297/8565] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:48 2022] DELETE /identity/v3/projects/bb3bf3321b16433087a1da8cbedbdff5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:48.539201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767d80-5248-4f00-ae7e-b5e7583eb939 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.539713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767d80-5248-4f00-ae7e-b5e7583eb939 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.559359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767d80-5248-4f00-ae7e-b5e7583eb939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.570610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.573088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.574809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.575785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:48.578029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] PATH_INFO: `/v3/users/d80b34d83a1b40b6ae901f46ad3a318d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.581379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80b34d83a1b40b6ae901f46ad3a318d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.590453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:48.599851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b4767d80-5248-4f00-ae7e-b5e7583eb939 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:48.601640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4767d80-5248-4f00-ae7e-b5e7583eb939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:48.619467 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4298/8566] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:48.641408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66d451-fcf4-4f63-a26f-deedfd2f0c3d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.642500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66d451-fcf4-4f63-a26f-deedfd2f0c3d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.643798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66d451-fcf4-4f63-a26f-deedfd2f0c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.659691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:48.691366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bc66d451-fcf4-4f63-a26f-deedfd2f0c3d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:48.702061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc66d451-fcf4-4f63-a26f-deedfd2f0c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:48.704813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80b34d83a1b40b6ae901f46ad3a318d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.718697 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4299/8567] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:48.724425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66d451-fcf4-4f63-a26f-deedfd2f0c3d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.744761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66d451-fcf4-4f63-a26f-deedfd2f0c3d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.750137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80b34d83a1b40b6ae901f46ad3a318d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.752237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80b34d83a1b40b6ae901f46ad3a318d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.756215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.757422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.757966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.758429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.759905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:48.760445 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.764284 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:48.774822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80b34d83a1b40b6ae901f46ad3a318d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.775795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80b34d83a1b40b6ae901f46ad3a318d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:48.793093 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4300/8568] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:26:48.800684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.804676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:48.813454 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4269/8569] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:48 2022] DELETE /identity/v3/users/d80b34d83a1b40b6ae901f46ad3a318d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:48.864286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eeb0c-03b8-4e52-8265-aa0c27c7449a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.974291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.975519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.976002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.977461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.978394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.980791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:49.033216 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4301/8570] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:48 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:49.039020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:49.050997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b23f3-0be6-427b-9592-386e52fd84d5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:49.150838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:49.152631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:49.153465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:49.155982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:49.157814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:49.162101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:49.171309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:49.173840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:49.193495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95071-6c52-43f4-9ddb-1bf616261b3e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:49.201845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:49.202913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:49.203623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:49.204205 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] PATH_INFO: `/v3/projects/155909168e234da5b6a846c22cc6abe4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:49.206382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] RBAC: Authorizing `identity:delete_project(project_id=155909168e234da5b6a846c22cc6abe4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:49.209118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:49.221470 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4270/8571] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:49 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:49.226301 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:49.250375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b0b51-b1e4-4c40-b794-41edbe726dcc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:49.258670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:49.259913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:49.260425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:49.260862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:49.261959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:49.265204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:49.284861 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4271/8572] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:49.286339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:49.286991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155909168e234da5b6a846c22cc6abe4', 'request_id': 'req-5c3c08cd-9c74-44a8-b805-2f2477de893d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.295778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155909168e234da5b6a846c22cc6abe4', 'request_id': 'req-5c3c08cd-9c74-44a8-b805-2f2477de893d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.301067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5c17-6dbc-4938-920c-f80990646de8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:49.306183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155909168e234da5b6a846c22cc6abe4', 'request_id': 'req-5c3c08cd-9c74-44a8-b805-2f2477de893d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.326986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] The token cache is being invalidate because project 155909168e234da5b6a846c22cc6abe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:49.327586 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.329212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.334961 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4302/8573] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:49 2022] DELETE /identity/v3/projects/155909168e234da5b6a846c22cc6abe4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:26:49.337107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:49.340471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:49.417253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:49.418093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:49.418390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:49.418674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:49.421108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:49.425499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:49.434392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:49.457861 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4272/8574] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:26:49.460630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:49.462625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:49.466020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c08cd-9c74-44a8-b805-2f2477de893d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:49.478085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d602-6415-4a52-8620-994264218725 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:49.481615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:49.482669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:49.482976 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:49.484695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab89ccd-5a10-4cf7-b224-f63693b889ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:49.486291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89ccd-5a10-4cf7-b224-f63693b889ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:49.486744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] PATH_INFO: `/v3/users/10866163e0574bd1bc90367a4d449c4c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:49.487159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89ccd-5a10-4cf7-b224-f63693b889ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:49.487718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89ccd-5a10-4cf7-b224-f63693b889ea admin admin] PATH_INFO: `/v3/projects/12d6f7f027f644c29f59ffac2041c052/users/c87d2a8949c342a9bba93f7aca23c89a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:49.489460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10866163e0574bd1bc90367a4d449c4c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:49.494822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:49.555817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab89ccd-5a10-4cf7-b224-f63693b889ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d6f7f027f644c29f59ffac2041c052, user_id=c87d2a8949c342a9bba93f7aca23c89a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:49.564566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab89ccd-5a10-4cf7-b224-f63693b889ea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:49.569605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:49.610181 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4273/8575] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:26:49 2022] PUT /identity/v3/projects/12d6f7f027f644c29f59ffac2041c052/users/c87d2a8949c342a9bba93f7aca23c89a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:49.620573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:49.620864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:49.621145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:49.669953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10866163e0574bd1bc90367a4d449c4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.695949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10866163e0574bd1bc90367a4d449c4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.713983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10866163e0574bd1bc90367a4d449c4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.715411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] MFA Rules not processed for user `c87d2a8949c342a9bba93f7aca23c89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:49.715927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10866163e0574bd1bc90367a4d449c4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.721724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:49.730792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10866163e0574bd1bc90367a4d449c4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:49.744179 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4303/8576] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:49 2022] DELETE /identity/v3/users/10866163e0574bd1bc90367a4d449c4c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:49.949665 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4274/8577] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:26:49.959646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:49.961533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:50.134533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5df62-d28d-4db8-916a-e7cf88034a3d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:50.144745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:50.147541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:50.148489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:50.149699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:50.314378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:50.317560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:50.365382 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4304/8578] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:50.865095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:50.867615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:51.231874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9ae2-c61a-47c5-9c03-0525d6d9ad3f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:51.457083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894519b2-1e8d-4d43-a9a0-7177ab4eda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:51.458155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894519b2-1e8d-4d43-a9a0-7177ab4eda49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:51.465865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894519b2-1e8d-4d43-a9a0-7177ab4eda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:51.466331 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894519b2-1e8d-4d43-a9a0-7177ab4eda49 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:51.490118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894519b2-1e8d-4d43-a9a0-7177ab4eda49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:51.492318 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894519b2-1e8d-4d43-a9a0-7177ab4eda49 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-894519b2-1e8d-4d43-a9a0-7177ab4eda49 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:51.518438 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 14 15:26:51.519955 n-d-768852-23 devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 14 15:26:51.533111 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4275/8579] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 15:26:50 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 669 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:57.790600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:57.792403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:57.843539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf751118-5000-41cb-91b4-1a50b3a42c3c service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:57.849336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:57.850496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:57.850954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:57.851471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] PATH_INFO: `/v3/users/c87d2a8949c342a9bba93f7aca23c89a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:57.853186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87d2a8949c342a9bba93f7aca23c89a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:57.855939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:57.859909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:57.957225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87d2a8949c342a9bba93f7aca23c89a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:57.986829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87d2a8949c342a9bba93f7aca23c89a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.003073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87d2a8949c342a9bba93f7aca23c89a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.004711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87d2a8949c342a9bba93f7aca23c89a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.022166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87d2a8949c342a9bba93f7aca23c89a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.036162 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4305/8580] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:57 2022] DELETE /identity/v3/users/c87d2a8949c342a9bba93f7aca23c89a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:58.041510 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.042474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.042900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.090393 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:58.092769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:58.120660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:58.180831 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4276/8581] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:58.193264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:58.196133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:58.219211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:58.221388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:58.238221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d41e-69a8-4103-9bc7-27f4d4a2054a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:58.246360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:58.247795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.248496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.248883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] PATH_INFO: `/v3/users/1d56f59fd60f44ad91cdb223288e28d5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.250646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d56f59fd60f44ad91cdb223288e28d5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:58.253435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:58.337808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d56f59fd60f44ad91cdb223288e28d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.361358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d56f59fd60f44ad91cdb223288e28d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.363105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d56f59fd60f44ad91cdb223288e28d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.368527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ae1c-7e29-4006-839c-7367fa467b85 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:58.374090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d56f59fd60f44ad91cdb223288e28d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.375312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66a4f2c4-2b7d-468c-8b34-59373378e8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d56f59fd60f44ad91cdb223288e28d5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:58.376334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:58.377848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.378727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.379446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.384033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:58.399287 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4277/8582] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:26:58 2022] DELETE /identity/v3/users/1d56f59fd60f44ad91cdb223288e28d5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:58.401166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.401571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.402095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.411435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:58.415121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:58.429317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:58.431683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:58.438547 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4306/8583] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:26:58.589340 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4278/8584] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:58.607351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:58.610130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:58.626942 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7469-3118-4ff3-ae19-01ef89e95abe service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:58.695427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:58.696313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.696618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.696905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.711852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:58.713504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:58.744184 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4307/8585] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:26:59.043933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:59.046959 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:59.076291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3cc3-8f73-41b0-9b39-a14a2a229f3e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:59.115618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:59.116628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:59.116951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:59.117354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] PATH_INFO: `/v3/projects/12d6f7f027f644c29f59ffac2041c052` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:59.120277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d6f7f027f644c29f59ffac2041c052)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:59.124562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:59.205609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:59.241673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d6f7f027f644c29f59ffac2041c052', 'request_id': 'req-601443d8-4fe9-4426-b967-6eadb9fe7e3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.258687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d6f7f027f644c29f59ffac2041c052', 'request_id': 'req-601443d8-4fe9-4426-b967-6eadb9fe7e3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.277941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d6f7f027f644c29f59ffac2041c052', 'request_id': 'req-601443d8-4fe9-4426-b967-6eadb9fe7e3b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.318285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] The token cache is being invalidate because project 12d6f7f027f644c29f59ffac2041c052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:59.318285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.320019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-601443d8-4fe9-4426-b967-6eadb9fe7e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.321536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:59.327840 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4279/8586] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:59 2022] DELETE /identity/v3/projects/12d6f7f027f644c29f59ffac2041c052 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:59.328348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:59.330074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba837b-3a7f-4d5d-adaf-9bccf310bae1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:59.330361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba837b-3a7f-4d5d-adaf-9bccf310bae1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:59.330882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba837b-3a7f-4d5d-adaf-9bccf310bae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:59.366455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67154f00-9d6e-4324-a852-919f967e1e02 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:59.370536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-73ba837b-3a7f-4d5d-adaf-9bccf310bae1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:59.371858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-73ba837b-3a7f-4d5d-adaf-9bccf310bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:59.427085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:59.479769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:59.481076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:59.481668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:59.482584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] PATH_INFO: `/v3/projects/d2740fe35e3d4118a1739a32423d8017` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:59.484434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2740fe35e3d4118a1739a32423d8017)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:59.486922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:59.487896 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4280/8587] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:59.498571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0372f-43af-4f27-9d6c-62c11e1e7307 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:59.499783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0372f-43af-4f27-9d6c-62c11e1e7307 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:59.500303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0372f-43af-4f27-9d6c-62c11e1e7307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:59.529762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b6a0372f-43af-4f27-9d6c-62c11e1e7307 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:59.533127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b6a0372f-43af-4f27-9d6c-62c11e1e7307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:59.547626 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4281/8588] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:26:59.549175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0372f-43af-4f27-9d6c-62c11e1e7307 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:59.563836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0372f-43af-4f27-9d6c-62c11e1e7307 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:59.588191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2740fe35e3d4118a1739a32423d8017', 'request_id': 'req-aa2196c1-51ee-4303-bbd6-f387e90be62a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.600751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2740fe35e3d4118a1739a32423d8017', 'request_id': 'req-aa2196c1-51ee-4303-bbd6-f387e90be62a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.613762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2740fe35e3d4118a1739a32423d8017', 'request_id': 'req-aa2196c1-51ee-4303-bbd6-f387e90be62a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.636659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] The token cache is being invalidate because project d2740fe35e3d4118a1739a32423d8017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:26:59.637333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.638982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:26:59.641323 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4308/8589] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:26:59 2022] DELETE /identity/v3/projects/d2740fe35e3d4118a1739a32423d8017 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:59.675616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:59.677404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:59.677404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:59.678449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:59.679065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:59.679552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:59.682691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:59.716082 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4282/8590] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:59.721887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:59.723752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:59.741968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2196c1-51ee-4303-bbd6-f387e90be62a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:59.752349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:59.754868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:59.756053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:59.756646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:59.758747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:59.763733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:59.858050 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4309/8591] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:26:59 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:59.865267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:59.882410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fe063-d0b4-40e2-b690-d3d0d701dff8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.014679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.017018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:00.021844 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:00.054834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.056285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.056285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.056666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.057704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.061418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.096252 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4283/8592] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:26:59 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:00.101856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.120063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092f60-65bd-42a7-a219-32aca7c9e4dc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.129497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.130490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.131059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.131312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.133657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.136584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.162385 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4284/8593] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:27:00.164912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.184537 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2b9c9-b54b-4825-86b2-3a88f0d7ab1f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.193224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.193463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.193937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.194427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.195412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.195602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bc86f-013d-4483-abb6-175bedb95f67 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.197502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.205316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.206334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.206696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.206981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] PATH_INFO: `/v3/users/8d69d4379e344879bba99e1f1d065ca2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.209541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d69d4379e344879bba99e1f1d065ca2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.212408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.214990 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4285/8594] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:00.220998 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.233664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9245-6727-4e9c-9ec8-06f460430fa2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.251640 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a1e7-a053-452d-8c11-a4025952eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.253119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a1e7-a053-452d-8c11-a4025952eb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.254278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a1e7-a053-452d-8c11-a4025952eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.254574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a1e7-a053-452d-8c11-a4025952eb0e admin admin] PATH_INFO: `/v3/projects/f6adb0fee95b42cfaf64826cad196bf0/users/1f6b1118c0544aa7a263d78fd14c3552/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.286645 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a1e7-a053-452d-8c11-a4025952eb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6adb0fee95b42cfaf64826cad196bf0, user_id=1f6b1118c0544aa7a263d78fd14c3552, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.290487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a1e7-a053-452d-8c11-a4025952eb0e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.300452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:00.311531 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4286/8595] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:27:00 2022] PUT /identity/v3/projects/f6adb0fee95b42cfaf64826cad196bf0/users/1f6b1118c0544aa7a263d78fd14c3552/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:27:00.316173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d69d4379e344879bba99e1f1d065ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:00.342057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d69d4379e344879bba99e1f1d065ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:00.353074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d69d4379e344879bba99e1f1d065ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:00.353830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d69d4379e344879bba99e1f1d065ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:00.368820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b5d4dca-455a-4ece-a1ac-168f57e9ac86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d69d4379e344879bba99e1f1d065ca2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:00.378510 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4310/8596] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:27:00 2022] DELETE /identity/v3/users/8d69d4379e344879bba99e1f1d065ca2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:27:00.384505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.384833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.385118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.413379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:00.415074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:00.446792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.447053 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.447408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.484178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] MFA Rules not processed for user `1f6b1118c0544aa7a263d78fd14c3552`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:00.485102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:00.527355 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4287/8597] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:27:00.539425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.542101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:00.627027 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4311/8598] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:27:00.632429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.634440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:00.653254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb2232-8c8d-4775-9d5b-e750485d441c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.663512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.664632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.664945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.665235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.665768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dce4-3676-4154-a2f3-4c7a3e450aa7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.666724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.671447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.673979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.674659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.675088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.675407 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.691330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.693925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.712371 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4312/8599] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:27:00 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:27:00.712568 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4288/8600] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:27:00.715459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.838306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adb2b7-d209-44c8-bcc2-33b141de7a0b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.849971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.851275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.852010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.852760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.853931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.859295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.904314 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4313/8601] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:27:00 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:00.908666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.928197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c5c44-434d-42a0-a398-b1d38ae1ddb1 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.937145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.938343 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.938849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.939211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.940255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.944185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.975652 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4289/8602] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:00.977893 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.993600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930754-bf29-41af-b99e-74e690809b27 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.002122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.003097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.011627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.012180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] PATH_INFO: `/v3/projects/9bfc706061e345c6b97f05564754aa18/users/5c343e5e45de4b82a64615a95531c9a7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.030176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.044815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfc706061e345c6b97f05564754aa18, user_id=5c343e5e45de4b82a64615a95531c9a7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.050439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.075059 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4314/8603] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:27:00 2022] PUT /identity/v3/projects/9bfc706061e345c6b97f05564754aa18/users/5c343e5e45de4b82a64615a95531c9a7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:01.080427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.093552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f52ee1-39c5-4d84-82a7-9523ff8b2cdf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.149070 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.176089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.186539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:01.220272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.221832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.222126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.222589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.223374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.225075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.256289 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4290/8604] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:01.262305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.278531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2a0b7-d0f5-412c-9c63-f8ecd4f49dfb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.285791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63abbb-77fe-46b6-9ccb-fa9ee6ab2f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.286703 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63abbb-77fe-46b6-9ccb-fa9ee6ab2f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.286984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63abbb-77fe-46b6-9ccb-fa9ee6ab2f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.287298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63abbb-77fe-46b6-9ccb-fa9ee6ab2f75 admin admin] PATH_INFO: `/v3/projects/9bfc706061e345c6b97f05564754aa18/users/5c343e5e45de4b82a64615a95531c9a7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.289335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63abbb-77fe-46b6-9ccb-fa9ee6ab2f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfc706061e345c6b97f05564754aa18, user_id=5c343e5e45de4b82a64615a95531c9a7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.292084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63abbb-77fe-46b6-9ccb-fa9ee6ab2f75 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.311110 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4291/8605] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:27:01 2022] PUT /identity/v3/projects/9bfc706061e345c6b97f05564754aa18/users/5c343e5e45de4b82a64615a95531c9a7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:27:01.321657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2ab2-7f13-4c4d-a153-a17271a7ecd6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.321944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2ab2-7f13-4c4d-a153-a17271a7ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.322237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2ab2-7f13-4c4d-a153-a17271a7ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.326178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0727b-9590-4952-ab6e-195c158ed461 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.361401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-15cc2ab2-7f13-4c4d-a153-a17271a7ecd6 None None] MFA Rules not processed for user `5c343e5e45de4b82a64615a95531c9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:01.362466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-15cc2ab2-7f13-4c4d-a153-a17271a7ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:01.398784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.399876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.400171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.400448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] PATH_INFO: `/v3/projects/8ed4aaeff60347a8bae29889ef0a0fb7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.401699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed4aaeff60347a8bae29889ef0a0fb7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.403779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.462887 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4292/8606] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:27:01.477211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2ab2-7f13-4c4d-a153-a17271a7ecd6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.485100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed4aaeff60347a8bae29889ef0a0fb7', 'request_id': 'req-c1a6852f-b787-4c74-ba02-94ee6313c584'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.493938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed4aaeff60347a8bae29889ef0a0fb7', 'request_id': 'req-c1a6852f-b787-4c74-ba02-94ee6313c584'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.504982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed4aaeff60347a8bae29889ef0a0fb7', 'request_id': 'req-c1a6852f-b787-4c74-ba02-94ee6313c584'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.529890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] The token cache is being invalidate because project 8ed4aaeff60347a8bae29889ef0a0fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:27:01.530344 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.531455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.533896 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4315/8607] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:27:01 2022] DELETE /identity/v3/projects/8ed4aaeff60347a8bae29889ef0a0fb7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:27:01.539691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.546940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:01.571399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc2ab2-7f13-4c4d-a153-a17271a7ecd6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.584808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.632838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.638804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.639579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.640038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.640847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.644104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:01.654027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6852f-b787-4c74-ba02-94ee6313c584 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.662029 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.663494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.664003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.664508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] PATH_INFO: `/v3/users/180ddc500301491abf0661aa0bfaed29` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.666774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=180ddc500301491abf0661aa0bfaed29)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.670722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.715793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.717371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.727963 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4293/8608] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:27:01.741218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180ddc500301491abf0661aa0bfaed29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.758193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180ddc500301491abf0661aa0bfaed29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.769664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180ddc500301491abf0661aa0bfaed29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.771468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180ddc500301491abf0661aa0bfaed29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.781495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44304c6-0ebc-467d-a3b3-c3fd226d82b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180ddc500301491abf0661aa0bfaed29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:01.789864 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4316/8609] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:27:01 2022] DELETE /identity/v3/users/180ddc500301491abf0661aa0bfaed29 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:27:02.195589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.225636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a053e-0900-45f4-9e52-c01626f359de service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.338617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.340094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.340582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.340872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] PATH_INFO: `/v3/projects/8f817a550a49472abf9868226ebf8dad` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.343236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f817a550a49472abf9868226ebf8dad)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.345235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.411260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f817a550a49472abf9868226ebf8dad', 'request_id': 'req-c725942d-2da3-4511-a114-55bf0624c720'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:02.420720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f817a550a49472abf9868226ebf8dad', 'request_id': 'req-c725942d-2da3-4511-a114-55bf0624c720'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:02.428457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f817a550a49472abf9868226ebf8dad', 'request_id': 'req-c725942d-2da3-4511-a114-55bf0624c720'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:02.443471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] The token cache is being invalidate because project 8f817a550a49472abf9868226ebf8dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:27:02.443767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:02.444472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c725942d-2da3-4511-a114-55bf0624c720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:02.446571 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4294/8610] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:27:02 2022] DELETE /identity/v3/projects/8f817a550a49472abf9868226ebf8dad => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:02.453031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0850a7-dad3-4e0b-b6ba-ed10bab8bf2a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.453566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0850a7-dad3-4e0b-b6ba-ed10bab8bf2a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.453974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0850a7-dad3-4e0b-b6ba-ed10bab8bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.478310 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e0850a7-dad3-4e0b-b6ba-ed10bab8bf2a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:02.479566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e0850a7-dad3-4e0b-b6ba-ed10bab8bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:02.569556 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4317/8611] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:27:02.577807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048c5f-b33e-4796-b5df-45f6f820673f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.578096 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048c5f-b33e-4796-b5df-45f6f820673f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.578378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048c5f-b33e-4796-b5df-45f6f820673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.600057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c6048c5f-b33e-4796-b5df-45f6f820673f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:02.601337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c6048c5f-b33e-4796-b5df-45f6f820673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:02.613060 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4295/8612] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:27:02.616982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0850a7-dad3-4e0b-b6ba-ed10bab8bf2a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.630639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0850a7-dad3-4e0b-b6ba-ed10bab8bf2a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.637789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.639346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.639661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.639951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.640724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:02.641042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.642763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.661919 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4318/8613] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:02.668027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048c5f-b33e-4796-b5df-45f6f820673f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.680225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048c5f-b33e-4796-b5df-45f6f820673f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.685798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.686633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.687098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.688194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.688501 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.692027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.734615 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4296/8614] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:27:02 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:02.740169 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.759918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9932ed3-6bc2-42b2-849a-df13da626ac3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.807320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:02.863993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.865076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.865414 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.865712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.866894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.869902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.911428 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4319/8615] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:27:02 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:02.913191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.924462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:02.929366 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ad5e0-017a-4b3b-9327-5f8b9b6980c0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.938246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.939095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.939365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.939719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.940618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.942912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.960171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4297/8616] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:02.961531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.973556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31391324-c5e3-4468-b9ce-d3c4a886cee3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.980219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bf2ca-aa52-422d-b4b6-e9635b2a10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.981426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bf2ca-aa52-422d-b4b6-e9635b2a10dc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.981966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bf2ca-aa52-422d-b4b6-e9635b2a10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.982489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bf2ca-aa52-422d-b4b6-e9635b2a10dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.983599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bf2ca-aa52-422d-b4b6-e9635b2a10dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.986872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bf2ca-aa52-422d-b4b6-e9635b2a10dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:03.005406 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4320/8617] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:27:03.011784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:03.026850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b55b1-528f-47ca-8176-a3dab6caedd6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:03.034540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:03.036073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:03.036549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:03.037067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] PATH_INFO: `/v3/projects/e16c66936fa8420882bd502a90e1f477/users/9a772872b9b142dd81af27ff3481d1e2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:03.065469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16c66936fa8420882bd502a90e1f477, user_id=9a772872b9b142dd81af27ff3481d1e2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:03.069412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:03.089535 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4298/8618] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:27:03 2022] PUT /identity/v3/projects/e16c66936fa8420882bd502a90e1f477/users/9a772872b9b142dd81af27ff3481d1e2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:27:03.100884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce8439-5f15-4b53-8cb7-7694d849f99f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:03.101163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce8439-5f15-4b53-8cb7-7694d849f99f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:03.101474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce8439-5f15-4b53-8cb7-7694d849f99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:03.135144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4ce8439-5f15-4b53-8cb7-7694d849f99f None None] MFA Rules not processed for user `9a772872b9b142dd81af27ff3481d1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:03.136796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4ce8439-5f15-4b53-8cb7-7694d849f99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:03.230362 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4321/8619] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:27:03.243243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:03.249119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:03.330901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e62e8-b792-4d9f-8408-35d21f650363 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:03.334979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb94a-cbdc-4e15-8611-6039d79a33c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:03.335685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb94a-cbdc-4e15-8611-6039d79a33c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:03.335973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb94a-cbdc-4e15-8611-6039d79a33c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:03.336258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb94a-cbdc-4e15-8611-6039d79a33c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:03.347833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb94a-cbdc-4e15-8611-6039d79a33c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:03.349852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb94a-cbdc-4e15-8611-6039d79a33c0 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:03.369204 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4299/8620] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:27:03.392201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce8439-5f15-4b53-8cb7-7694d849f99f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:03.483551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce8439-5f15-4b53-8cb7-7694d849f99f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:03.489016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:03.489925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:03.490215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:03.490512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] PATH_INFO: `/v3/users/9a772872b9b142dd81af27ff3481d1e2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:03.491858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a772872b9b142dd81af27ff3481d1e2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:03.493848 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:03.565341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:03.573860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a772872b9b142dd81af27ff3481d1e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:03.598226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a772872b9b142dd81af27ff3481d1e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:03.609840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a772872b9b142dd81af27ff3481d1e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:03.610984 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a772872b9b142dd81af27ff3481d1e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:03.621628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a772872b9b142dd81af27ff3481d1e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:03.629510 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4322/8621] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:27:03 2022] DELETE /identity/v3/users/9a772872b9b142dd81af27ff3481d1e2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:03.634582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:03.634954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:03.635382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:03.656555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:03.657914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:03.727157 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4300/8622] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:27:03.761570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:03.763599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:03.844124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269957-249b-45a8-b533-b890efd20e2f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:03.848333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:03.849172 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:03.849471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:03.849756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:03.861585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:03.863131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:03.875298 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4323/8623] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:27:04.323785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:04.325786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:04.342460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00570d-10b2-49aa-94a8-b728104a56c9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:04.348325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5b0fb-8dd2-4405-a975-de1cf7da38d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:04.349538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5b0fb-8dd2-4405-a975-de1cf7da38d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:04.350061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5b0fb-8dd2-4405-a975-de1cf7da38d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:04.350592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5b0fb-8dd2-4405-a975-de1cf7da38d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:04.352906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d1e5b0fb-8dd2-4405-a975-de1cf7da38d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:04.436862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5b0fb-8dd2-4405-a975-de1cf7da38d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:04.438465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5b0fb-8dd2-4405-a975-de1cf7da38d4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:04.451365 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4301/8624] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:27:04.818532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:04.820928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:04.838916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3591-f88c-4aec-94aa-1ef9f209c1eb service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:04.844971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:04.845928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:04.846339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:04.846800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] PATH_INFO: `/v3/projects/e16c66936fa8420882bd502a90e1f477` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:04.848733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16c66936fa8420882bd502a90e1f477)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:04.850877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:04.931650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16c66936fa8420882bd502a90e1f477', 'request_id': 'req-ace0daaf-c992-48a7-a241-813bb3dba290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:04.940180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16c66936fa8420882bd502a90e1f477', 'request_id': 'req-ace0daaf-c992-48a7-a241-813bb3dba290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:04.953028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16c66936fa8420882bd502a90e1f477', 'request_id': 'req-ace0daaf-c992-48a7-a241-813bb3dba290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:04.975763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] The token cache is being invalidate because project e16c66936fa8420882bd502a90e1f477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:27:04.976681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:04.978543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ace0daaf-c992-48a7-a241-813bb3dba290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:04.982475 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4324/8625] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:27:04 2022] DELETE /identity/v3/projects/e16c66936fa8420882bd502a90e1f477 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:04.988808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63e0d2-54ee-41d5-9bfb-d98e8d481b4d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:04.990131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63e0d2-54ee-41d5-9bfb-d98e8d481b4d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:04.990977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63e0d2-54ee-41d5-9bfb-d98e8d481b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.030570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:05.048997 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a63e0d2-54ee-41d5-9bfb-d98e8d481b4d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:05.052946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a63e0d2-54ee-41d5-9bfb-d98e8d481b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:05.173360 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4302/8626] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:27:05.181276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196998f5-d2a0-4eab-8710-25bf8f4b5f0a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.181564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196998f5-d2a0-4eab-8710-25bf8f4b5f0a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.181846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196998f5-d2a0-4eab-8710-25bf8f4b5f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.203294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-196998f5-d2a0-4eab-8710-25bf8f4b5f0a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:05.205038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-196998f5-d2a0-4eab-8710-25bf8f4b5f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:05.219339 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4325/8627] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:27:05.221795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63e0d2-54ee-41d5-9bfb-d98e8d481b4d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.234545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63e0d2-54ee-41d5-9bfb-d98e8d481b4d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.246683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.247857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.248194 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.248493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.249227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:05.249599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.251214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.270316 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4303/8628] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:27:05.271672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196998f5-d2a0-4eab-8710-25bf8f4b5f0a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.283870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196998f5-d2a0-4eab-8710-25bf8f4b5f0a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.291541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.292410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.292729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.293016 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.293939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.299030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.354927 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4326/8629] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:27:05 2022] POST /identity/v3/projects => generated 361 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:27:05.357947 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.377225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828eb9a-17b6-4870-bfc1-ca596aa42c11 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.475425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.476207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.476599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.476987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.477971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.480100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.504980 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4304/8630] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:27:05 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:05.510080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.523950 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb77b2-9105-4ab8-9e92-a38b03ed301e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.529423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.531116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.531116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.531116 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.537638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.537638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.552217 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4327/8631] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:05.556105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.574541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e9fe-d877-4faf-925a-9c84231aa1df admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.583173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8cadd-6365-4743-80e6-1b1b2dfa3f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.584519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8cadd-6365-4743-80e6-1b1b2dfa3f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.585114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8cadd-6365-4743-80e6-1b1b2dfa3f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.585732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8cadd-6365-4743-80e6-1b1b2dfa3f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.587560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8cadd-6365-4743-80e6-1b1b2dfa3f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.590732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8cadd-6365-4743-80e6-1b1b2dfa3f02 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.612549 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4305/8632] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:05.616964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.631008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:05.637572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13730c-aa3e-4c24-9d7b-539ecd3d093b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.651021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.652520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.652970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.653664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] PATH_INFO: `/v3/projects/5d71c5e74f004292a5434c898cf52550/users/a327d2ddc26744c08d248f6ea48f6d0c/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.682199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d71c5e74f004292a5434c898cf52550, user_id=a327d2ddc26744c08d248f6ea48f6d0c, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.686408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.720999 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4328/8633] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:27:05 2022] PUT /identity/v3/projects/5d71c5e74f004292a5434c898cf52550/users/a327d2ddc26744c08d248f6ea48f6d0c/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:05.735101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9a3c-c4e1-4a88-8ad4-82afb3ba0280 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.735468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9a3c-c4e1-4a88-8ad4-82afb3ba0280 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.735635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9a3c-c4e1-4a88-8ad4-82afb3ba0280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.800139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-acee9a3c-c4e1-4a88-8ad4-82afb3ba0280 None None] MFA Rules not processed for user `a327d2ddc26744c08d248f6ea48f6d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:05.808419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-acee9a3c-c4e1-4a88-8ad4-82afb3ba0280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:05.974688 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4306/8634] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:27:06.014370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:06.019833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:06.114264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0ea6b-d45f-4bcc-ac27-995b8e47b23d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:06.119807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6637b-1212-4b74-aa90-25d2670b79ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:06.120633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6637b-1212-4b74-aa90-25d2670b79ef service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.121108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6637b-1212-4b74-aa90-25d2670b79ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.122216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6637b-1212-4b74-aa90-25d2670b79ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.134196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6637b-1212-4b74-aa90-25d2670b79ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.136255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6637b-1212-4b74-aa90-25d2670b79ef service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.151424 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4329/8635] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:27:06.173459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9a3c-c4e1-4a88-8ad4-82afb3ba0280 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:06.178367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:06.333694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9a3c-c4e1-4a88-8ad4-82afb3ba0280 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:06.348280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:06.349690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.350138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.351994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] PATH_INFO: `/v3/users/a327d2ddc26744c08d248f6ea48f6d0c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.353784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a327d2ddc26744c08d248f6ea48f6d0c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.358088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.443859 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a327d2ddc26744c08d248f6ea48f6d0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:06.466142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a327d2ddc26744c08d248f6ea48f6d0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:06.467037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a327d2ddc26744c08d248f6ea48f6d0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:06.477636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a327d2ddc26744c08d248f6ea48f6d0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:06.478721 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a327d2ddc26744c08d248f6ea48f6d0c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:06.514067 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4307/8636] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:27:06 2022] DELETE /identity/v3/users/a327d2ddc26744c08d248f6ea48f6d0c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:06.517540 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.518260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.518785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.558426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:06.563884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:06.715770 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4330/8637] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:27:06.723064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:06.725102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:06.820631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b95df-b453-4ac7-8b9a-cf6373b4d6e7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:06.831802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaa4bc-b167-452c-9159-d9a87026c706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:06.832658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa4bc-b167-452c-9159-d9a87026c706 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.832952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa4bc-b167-452c-9159-d9a87026c706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.833238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa4bc-b167-452c-9159-d9a87026c706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.855843 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaa4bc-b167-452c-9159-d9a87026c706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.859683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaa4bc-b167-452c-9159-d9a87026c706 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.885214 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4308/8638] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:27:07.490775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:07.499625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:07.530518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa1580-3b92-4d76-b3ab-fe10579e0c2c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:07.538652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:07.541168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:07.541714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:07.542334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] PATH_INFO: `/v3/projects/5d71c5e74f004292a5434c898cf52550` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:07.544969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d71c5e74f004292a5434c898cf52550)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:07.547488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:07.632483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d71c5e74f004292a5434c898cf52550', 'request_id': 'req-1fad0f11-1398-429a-bb85-581a98813acd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:07.644437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d71c5e74f004292a5434c898cf52550', 'request_id': 'req-1fad0f11-1398-429a-bb85-581a98813acd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:07.657703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d71c5e74f004292a5434c898cf52550', 'request_id': 'req-1fad0f11-1398-429a-bb85-581a98813acd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:07.680635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] The token cache is being invalidate because project 5d71c5e74f004292a5434c898cf52550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:27:07.680936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:07.681708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:27:07.692035 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4331/8639] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:27:07 2022] DELETE /identity/v3/projects/5d71c5e74f004292a5434c898cf52550 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:27:11.399787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d992d2c-468a-4218-b317-042215349b87 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:11.400765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d992d2c-468a-4218-b317-042215349b87 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:11.400765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d992d2c-468a-4218-b317-042215349b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:11.428441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9d992d2c-468a-4218-b317-042215349b87 None None] MFA Rules not processed for user `1f6b1118c0544aa7a263d78fd14c3552`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:11.430601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d992d2c-468a-4218-b317-042215349b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:11.472777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:11.544960 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4309/8640] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:27:17.675397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:19.229379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:19.230861 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:19.340356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0f11-1398-429a-bb85-581a98813acd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:19.347457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0824e7-301c-4444-bf85-4d64f6dc1e24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:19.348158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0824e7-301c-4444-bf85-4d64f6dc1e24 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:19.348468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0824e7-301c-4444-bf85-4d64f6dc1e24 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:19.348763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0824e7-301c-4444-bf85-4d64f6dc1e24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:19.350764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef0824e7-301c-4444-bf85-4d64f6dc1e24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:19.423555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0824e7-301c-4444-bf85-4d64f6dc1e24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:19.425432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0824e7-301c-4444-bf85-4d64f6dc1e24 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:19.437006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4332/8641] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:27:21.536005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=14 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:25.756083 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d992d2c-468a-4218-b317-042215349b87 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:25.759165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9d992d2c-468a-4218-b317-042215349b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:25.783990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d992d2c-468a-4218-b317-042215349b87 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:25.790255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:25.790964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:25.791214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:25.791576 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:25.793631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:25.896676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:25.898352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:25.925869 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4310/8642] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:27:29.431115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=56 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:35.922558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=34 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:42.665891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c7a4-8980-4646-b775-d52886c70af0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:42.666442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c7a4-8980-4646-b775-d52886c70af0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:42.666442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c7a4-8980-4646-b775-d52886c70af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:42.691003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e60c7a4-8980-4646-b775-d52886c70af0 None None] MFA Rules not processed for user `db9dcb86f53e466392563a143ee4654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:42.692626 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e60c7a4-8980-4646-b775-d52886c70af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:42.702522 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4333/8643] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:27:47.035421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:47.054851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ccab-9d78-4d8e-a4d0-9235cf040926 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:47.062472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:47.063500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:47.063808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:47.064081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:47.066125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:47.085091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:47.087140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:47.103506 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4311/8644] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:27:52.683806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:54.404295 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c7a4-8980-4646-b775-d52886c70af0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:54.432113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c7a4-8980-4646-b775-d52886c70af0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:54.439207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c7717-3edd-4644-a12a-2853eb3d892e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:54.439919 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c7717-3edd-4644-a12a-2853eb3d892e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:54.440209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c7717-3edd-4644-a12a-2853eb3d892e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:54.440493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c7717-3edd-4644-a12a-2853eb3d892e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:54.442339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-464c7717-3edd-4644-a12a-2853eb3d892e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:54.458621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c7717-3edd-4644-a12a-2853eb3d892e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:54.460555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c7717-3edd-4644-a12a-2853eb3d892e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:54.474619 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4334/8645] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:27:57.096897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:58.994890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:59.010186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36b244-e200-473f-ba37-cf9395cd6230 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:59.017222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:59.017934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:59.018487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:59.018837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:59.020698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:59.036495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:59.038135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:59.056189 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4312/8646] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:04.467398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:08.061309 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a535bf-95be-4203-a4ec-e33efc9d789e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:08.062408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a535bf-95be-4203-a4ec-e33efc9d789e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:08.062694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a535bf-95be-4203-a4ec-e33efc9d789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:08.082265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e0a535bf-95be-4203-a4ec-e33efc9d789e None None] MFA Rules not processed for user `1f6b1118c0544aa7a263d78fd14c3552`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:08.083603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0a535bf-95be-4203-a4ec-e33efc9d789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:08.091359 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4335/8647] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:08.469743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:08.471505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:08.573197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380392-678a-4207-b83a-33c8d1deb4d9 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:08.577056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c533d85-e4b0-4c5d-88ce-76059635eb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:08.577736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533d85-e4b0-4c5d-88ce-76059635eb26 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:08.578025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533d85-e4b0-4c5d-88ce-76059635eb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:08.578305 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533d85-e4b0-4c5d-88ce-76059635eb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:08.580356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c533d85-e4b0-4c5d-88ce-76059635eb26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:08.595104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c533d85-e4b0-4c5d-88ce-76059635eb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:08.598382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c533d85-e4b0-4c5d-88ce-76059635eb26 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:08.616835 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4313/8648] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:28:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:28:18.076252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:18.606082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=32 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:32.786151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ff8a-06b8-45e2-b611-ea316c74a83d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:32.786782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ff8a-06b8-45e2-b611-ea316c74a83d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:32.786916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ff8a-06b8-45e2-b611-ea316c74a83d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:32.788563 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4336/8649] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:28:32.795828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50c1c-80fa-4c18-a2bf-09595436d48c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:32.796651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50c1c-80fa-4c18-a2bf-09595436d48c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:32.797045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50c1c-80fa-4c18-a2bf-09595436d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:32.847422 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c3d50c1c-80fa-4c18-a2bf-09595436d48c None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:32.849473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c3d50c1c-80fa-4c18-a2bf-09595436d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:32.953560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4314/8650] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:32.974469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108ff8a-06b8-45e2-b611-ea316c74a83d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:32.976365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4108ff8a-06b8-45e2-b611-ea316c74a83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:32.997868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108ff8a-06b8-45e2-b611-ea316c74a83d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:33.003139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:33.003883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:33.004173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:33.004459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:33.015112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:33.016989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:33.032929 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4337/8651] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:34.278552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50c1c-80fa-4c18-a2bf-09595436d48c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:34.306004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50c1c-80fa-4c18-a2bf-09595436d48c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:34.316217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d20174-ce34-4d50-8a53-48cba13c7fc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:34.317284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d20174-ce34-4d50-8a53-48cba13c7fc8 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:34.317802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d20174-ce34-4d50-8a53-48cba13c7fc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:34.318618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d20174-ce34-4d50-8a53-48cba13c7fc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:34.324014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c3d20174-ce34-4d50-8a53-48cba13c7fc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:34.349670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d20174-ce34-4d50-8a53-48cba13c7fc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:34.352925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d20174-ce34-4d50-8a53-48cba13c7fc8 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:34.378867 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4315/8652] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:43.023577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:44.366806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=39 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:54.758191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:54.760452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:54.778822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212af0-8d33-4fef-8a51-afc2e057d977 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:54.784423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7097d9-502d-4621-9aea-616d4278add5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:54.785226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7097d9-502d-4621-9aea-616d4278add5 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:54.785588 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7097d9-502d-4621-9aea-616d4278add5 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:54.785936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7097d9-502d-4621-9aea-616d4278add5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:54.787779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b7097d9-502d-4621-9aea-616d4278add5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:54.803802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7097d9-502d-4621-9aea-616d4278add5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:54.805430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7097d9-502d-4621-9aea-616d4278add5 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:54.818928 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4338/8653] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:59.606512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb9ea-aab1-480f-921a-5f0d814ba0ce None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:59.608424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb9ea-aab1-480f-921a-5f0d814ba0ce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:59.609205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb9ea-aab1-480f-921a-5f0d814ba0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:59.638530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a42eb9ea-aab1-480f-921a-5f0d814ba0ce None None] MFA Rules not processed for user `db9dcb86f53e466392563a143ee4654f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:59.639938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a42eb9ea-aab1-480f-921a-5f0d814ba0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:59.647933 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4316/8654] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:29:04.811824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:09.633396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:13.563539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e3fa-9b74-4e5a-9da4-6540227f535c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:13.564572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e3fa-9b74-4e5a-9da4-6540227f535c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:13.564911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e3fa-9b74-4e5a-9da4-6540227f535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:13.584640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da89e3fa-9b74-4e5a-9da4-6540227f535c None None] MFA Rules not processed for user `1f6b1118c0544aa7a263d78fd14c3552`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:13.586246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da89e3fa-9b74-4e5a-9da4-6540227f535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:13.599710 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4339/8655] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:29:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:14.444364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb9ea-aab1-480f-921a-5f0d814ba0ce None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:14.460777 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb9ea-aab1-480f-921a-5f0d814ba0ce None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:14.467308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:14.468381 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:14.469529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:14.470057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:14.472312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:14.486695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:14.489540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:14.515604 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4317/8656] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:15.140323 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89e3fa-9b74-4e5a-9da4-6540227f535c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:15.160649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89e3fa-9b74-4e5a-9da4-6540227f535c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:15.169798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138985f7-bddc-43f2-a18c-aea9cd06a3e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:15.171210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138985f7-bddc-43f2-a18c-aea9cd06a3e7 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:15.171767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138985f7-bddc-43f2-a18c-aea9cd06a3e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:15.172291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138985f7-bddc-43f2-a18c-aea9cd06a3e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:15.175643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-138985f7-bddc-43f2-a18c-aea9cd06a3e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:15.192654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138985f7-bddc-43f2-a18c-aea9cd06a3e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:15.195428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138985f7-bddc-43f2-a18c-aea9cd06a3e7 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:15.213434 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4340/8657] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:24.509149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:25.203252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:12.803150 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:12.805414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:12.922573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf4a7-4bf9-4f5a-9d53-6b97a60f2a16 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:12.928921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:12.929159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.929756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.930005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] PATH_INFO: `/v3/users/1f6b1118c0544aa7a263d78fd14c3552` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.931574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6b1118c0544aa7a263d78fd14c3552)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:12.933662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:12.989567 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6b1118c0544aa7a263d78fd14c3552'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.002848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6b1118c0544aa7a263d78fd14c3552'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.003616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6b1118c0544aa7a263d78fd14c3552'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.011887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6b1118c0544aa7a263d78fd14c3552'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.012609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6b1118c0544aa7a263d78fd14c3552'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.027193 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4318/8658] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:30:12 2022] DELETE /identity/v3/users/1f6b1118c0544aa7a263d78fd14c3552 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:13.032030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:13.032578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:13.032726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:13.050926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:13.052176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:13.118360 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4341/8659] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:13.129637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:13.131074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:13.197748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e822ebd-2a84-43ca-8af8-2a1807eec943 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:13.201485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:13.202153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:13.202442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:13.202725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:13.213399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:13.215681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:13.220796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:13.231897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4319/8660] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:13.426902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:13.428457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:13.445012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607934f2-b1ed-410a-ad8a-637fb6b03740 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:13.451574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:13.452339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:13.452640 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:13.452895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] PATH_INFO: `/v3/projects/f6adb0fee95b42cfaf64826cad196bf0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:13.454088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6adb0fee95b42cfaf64826cad196bf0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:13.456079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:13.505005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6adb0fee95b42cfaf64826cad196bf0', 'request_id': 'req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.510877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6adb0fee95b42cfaf64826cad196bf0', 'request_id': 'req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.517217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6adb0fee95b42cfaf64826cad196bf0', 'request_id': 'req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.532108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] The token cache is being invalidate because project f6adb0fee95b42cfaf64826cad196bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:30:13.532551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.533350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.535190 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4342/8661] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:30:13 2022] DELETE /identity/v3/projects/f6adb0fee95b42cfaf64826cad196bf0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:13.540583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:13.552016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f9cf-9586-471d-9f40-8b9f400d9a78 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:13.634753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:13.635791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:13.636057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:13.636389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] PATH_INFO: `/v3/users/5c343e5e45de4b82a64615a95531c9a7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:13.637936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c343e5e45de4b82a64615a95531c9a7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:13.640241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:13.699046 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c343e5e45de4b82a64615a95531c9a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.711613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c343e5e45de4b82a64615a95531c9a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.712264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c343e5e45de4b82a64615a95531c9a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.720073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c343e5e45de4b82a64615a95531c9a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.720950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3a51f59b-7ad4-4983-8483-9fae50f10d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c343e5e45de4b82a64615a95531c9a7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:13.738363 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4320/8662] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:30:13 2022] DELETE /identity/v3/users/5c343e5e45de4b82a64615a95531c9a7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:14.038814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.043603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:14.060831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8da9a-6f05-4e2e-bcd8-92a57a7ad2f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.133793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.134815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.135242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.135713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] PATH_INFO: `/v3/projects/9bfc706061e345c6b97f05564754aa18` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.137301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfc706061e345c6b97f05564754aa18)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.139637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.177897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:14.199796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfc706061e345c6b97f05564754aa18', 'request_id': 'req-e2bc6190-3080-4562-8fd5-0f44ff5c1765'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:14.205479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfc706061e345c6b97f05564754aa18', 'request_id': 'req-e2bc6190-3080-4562-8fd5-0f44ff5c1765'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:14.212902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfc706061e345c6b97f05564754aa18', 'request_id': 'req-e2bc6190-3080-4562-8fd5-0f44ff5c1765'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:14.227541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] The token cache is being invalidate because project 9bfc706061e345c6b97f05564754aa18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:30:14.227831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:14.228470 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2bc6190-3080-4562-8fd5-0f44ff5c1765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:14.230065 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4343/8663] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:30:14 2022] DELETE /identity/v3/projects/9bfc706061e345c6b97f05564754aa18 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:30:14.235605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0012e5-705f-451b-9c82-7090c5fa0ff8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.236115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0012e5-705f-451b-9c82-7090c5fa0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.236227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0012e5-705f-451b-9c82-7090c5fa0ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.255140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7f0012e5-705f-451b-9c82-7090c5fa0ff8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:14.257085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7f0012e5-705f-451b-9c82-7090c5fa0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:14.320548 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4321/8664] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:14.328967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ffde6-38d1-4acc-b062-c3ece27dfa9e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.329266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ffde6-38d1-4acc-b062-c3ece27dfa9e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.329557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ffde6-38d1-4acc-b062-c3ece27dfa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.348537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-280ffde6-38d1-4acc-b062-c3ece27dfa9e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:14.349750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-280ffde6-38d1-4acc-b062-c3ece27dfa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:14.357862 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4344/8665] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:14.362236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0012e5-705f-451b-9c82-7090c5fa0ff8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.372296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0012e5-705f-451b-9c82-7090c5fa0ff8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.376972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.377632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.377919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.378201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.378932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:30:14.379243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.380899 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.393208 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4322/8666] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:30:14.398832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ffde6-38d1-4acc-b062-c3ece27dfa9e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.408358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ffde6-38d1-4acc-b062-c3ece27dfa9e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.413911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.414576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.414864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.415149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.415883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.417851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.445470 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4345/8667] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:30:14.449832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.456289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:14.460830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991351ad-d980-4069-9e4d-d1e1544663d8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.521278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.521869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.522660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.522946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.523668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.525596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.547115 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4323/8668] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:30:14.552840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.564052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fcfca-b0c5-4354-a436-c8ca35d25796 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.568817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.569523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.569808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.570088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.570823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.572489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.585283 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4346/8669] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:14.589562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.602808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef44ada-075b-41e8-82d4-ea00b8c34e3c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.607630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27371c-44e7-4b5a-b7fe-e1001016082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.608312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27371c-44e7-4b5a-b7fe-e1001016082f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.608596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27371c-44e7-4b5a-b7fe-e1001016082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.608878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27371c-44e7-4b5a-b7fe-e1001016082f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.609609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27371c-44e7-4b5a-b7fe-e1001016082f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.611347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27371c-44e7-4b5a-b7fe-e1001016082f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.622426 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4324/8670] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:14.626685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.637949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccd32b-c274-4784-a1bc-9c63326de7d0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.643199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.644134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.644418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.644695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] PATH_INFO: `/v3/projects/08b5350c62be4829b0b7a8807d35daed/users/fe98bedc23e84fe4b25bd4790e983611/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.664123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b5350c62be4829b0b7a8807d35daed, user_id=fe98bedc23e84fe4b25bd4790e983611, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.666936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.682688 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4347/8671] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:30:14 2022] PUT /identity/v3/projects/08b5350c62be4829b0b7a8807d35daed/users/fe98bedc23e84fe4b25bd4790e983611/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:14.693418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d928cc-0471-4795-b905-b9b7feaa8603 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.693716 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d928cc-0471-4795-b905-b9b7feaa8603 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.694052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d928cc-0471-4795-b905-b9b7feaa8603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.721610 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-27d928cc-0471-4795-b905-b9b7feaa8603 None None] MFA Rules not processed for user `fe98bedc23e84fe4b25bd4790e983611`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:14.722842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27d928cc-0471-4795-b905-b9b7feaa8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:14.794938 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4325/8672] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:14.799887 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.870259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde02d8-46c4-4744-9712-bbf95ad76fc2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.875059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.875768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.876061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.876338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.877258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.879179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.906554 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4348/8673] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:30:14.910556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d928cc-0471-4795-b905-b9b7feaa8603 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.923813 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d928cc-0471-4795-b905-b9b7feaa8603 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.993142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.993860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.994151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.994439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.995141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.997143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.019338 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4326/8674] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:30:15.027409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.038603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b39d3a-bba2-48f9-bceb-bb67d233cdcc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.044130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.045186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.045352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.045664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.046456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.048109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.059262 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4349/8675] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:15.064225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.071197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:15.077948 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b912b-0834-4d3c-88a7-db0bbe7bbe8c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.083199 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078f26c-a716-4bd2-b929-e920881684c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.083940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f26c-a716-4bd2-b929-e920881684c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.084231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f26c-a716-4bd2-b929-e920881684c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.084641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f26c-a716-4bd2-b929-e920881684c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.085931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078f26c-a716-4bd2-b929-e920881684c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.087609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078f26c-a716-4bd2-b929-e920881684c0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.098278 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4327/8676] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:15.102562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.112803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097addd8-27e7-4ac9-b3fa-bc9be2fa2815 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.117974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.118878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.119170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.119480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] PATH_INFO: `/v3/projects/eff913915e0a49c2a391b22990ddd59a/users/75a46bc5cf42453380a14fd6d74e8d74/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.138162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff913915e0a49c2a391b22990ddd59a, user_id=75a46bc5cf42453380a14fd6d74e8d74, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.140951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.151204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:15.156451 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4350/8677] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:30:15 2022] PUT /identity/v3/projects/eff913915e0a49c2a391b22990ddd59a/users/75a46bc5cf42453380a14fd6d74e8d74/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:15.166856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea863-63ce-4a4d-9321-93d6cb899529 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.167149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea863-63ce-4a4d-9321-93d6cb899529 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.167465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea863-63ce-4a4d-9321-93d6cb899529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.195077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-47aea863-63ce-4a4d-9321-93d6cb899529 None None] MFA Rules not processed for user `75a46bc5cf42453380a14fd6d74e8d74`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:15.196328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47aea863-63ce-4a4d-9321-93d6cb899529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:15.270656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4328/8678] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:15.275932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.348684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bbd4b-745e-4269-8c47-aa9e80319253 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.354234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.354910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.355196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.355508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.356214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.358153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.387668 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4351/8679] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:30:15 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:30:15.391765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea863-63ce-4a4d-9321-93d6cb899529 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.403786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea863-63ce-4a4d-9321-93d6cb899529 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.464697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.465385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.465672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.465954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.466660 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.468685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.493950 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4329/8680] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:30:15 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:30:15.497901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.509570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6257bc-bf2c-49b4-870b-d7707aa1acbd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.525342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.526027 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.526321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.526616 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.527397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.529151 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.541302 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4352/8681] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:15.545699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.557060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2829fc-d3c6-400f-b4af-34ac41316493 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.561924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.562856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.563146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.563469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] PATH_INFO: `/v3/projects/5b8748dc4d1f4673b81e8379cfdde5ba/users/f2f68c960e404640b2113752a7fdb0c4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.584293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8748dc4d1f4673b81e8379cfdde5ba, user_id=f2f68c960e404640b2113752a7fdb0c4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.587216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.603177 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4330/8682] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:30:15 2022] PUT /identity/v3/projects/5b8748dc4d1f4673b81e8379cfdde5ba/users/f2f68c960e404640b2113752a7fdb0c4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:15.607667 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.619331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f01c-87e3-424b-80db-b615ec76d2db admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.677294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aac53-0ae9-4511-bf15-00855feb4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.678235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aac53-0ae9-4511-bf15-00855feb4a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.679107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aac53-0ae9-4511-bf15-00855feb4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.679430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aac53-0ae9-4511-bf15-00855feb4a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.680235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aac53-0ae9-4511-bf15-00855feb4a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.681850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aac53-0ae9-4511-bf15-00855feb4a4e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.692376 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4353/8683] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:15.696410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.707502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825388-4195-4277-88c4-384d3b67e16a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.712309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.713733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.714014 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.714345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] PATH_INFO: `/v3/projects/5b8748dc4d1f4673b81e8379cfdde5ba/users/f2f68c960e404640b2113752a7fdb0c4/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.716778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8748dc4d1f4673b81e8379cfdde5ba, user_id=f2f68c960e404640b2113752a7fdb0c4, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:15.719653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:15.732238 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4331/8684] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:30:15 2022] PUT /identity/v3/projects/5b8748dc4d1f4673b81e8379cfdde5ba/users/f2f68c960e404640b2113752a7fdb0c4/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:30:15.744513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.744809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.745097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.773761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] MFA Rules not processed for user `f2f68c960e404640b2113752a7fdb0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:15.775097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:15.842603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:15.854263 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4354/8685] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:15.871687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.873473 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:15.910335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:15.956109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1264c9-5e96-4964-bab8-58be8246674c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:15.963019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49cff-6104-4130-a9e1-71ffe8b4ecf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:15.963730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49cff-6104-4130-a9e1-71ffe8b4ecf6 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.964024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49cff-6104-4130-a9e1-71ffe8b4ecf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.964311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49cff-6104-4130-a9e1-71ffe8b4ecf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:16.030514 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49cff-6104-4130-a9e1-71ffe8b4ecf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:16.032187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49cff-6104-4130-a9e1-71ffe8b4ecf6 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:16.045073 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4332/8686] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:30:17.985873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:17.987307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:18.047895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ca09b-c522-442f-ae2e-5350099ce389 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:18.051780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:18.052454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:18.052746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:18.053051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:18.064377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:18.065889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:18.076155 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4355/8687] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:21.707836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:21.708432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:21.708432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:21.741438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] MFA Rules not processed for user `fe98bedc23e84fe4b25bd4790e983611`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:21.742737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:21.760203 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4333/8688] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:22.650474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:22.652080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:22.749748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d04e-9f6c-4030-812e-4c504c60cc25 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:22.756375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dcfb7-e00d-4d0d-9706-034fa7a2987b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:22.757277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dcfb7-e00d-4d0d-9706-034fa7a2987b service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:22.757758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dcfb7-e00d-4d0d-9706-034fa7a2987b service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:22.758143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dcfb7-e00d-4d0d-9706-034fa7a2987b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:22.760584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a53dcfb7-e00d-4d0d-9706-034fa7a2987b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:22.773947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dcfb7-e00d-4d0d-9706-034fa7a2987b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:22.775602 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dcfb7-e00d-4d0d-9706-034fa7a2987b service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:22.786436 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4356/8689] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:31.729632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=44 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:32.782228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=60 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:43.818862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:43.820679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:43.921639 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3187c-6976-479d-9fe6-ea9d3feb3923 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:43.926279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:43.927222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:43.928034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:43.928034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] PATH_INFO: `/v3/users/db9dcb86f53e466392563a143ee4654f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:43.929008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9dcb86f53e466392563a143ee4654f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:43.931044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:43.979341 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9dcb86f53e466392563a143ee4654f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:43.992414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9dcb86f53e466392563a143ee4654f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:43.993126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9dcb86f53e466392563a143ee4654f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.000191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9dcb86f53e466392563a143ee4654f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.000848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9dcb86f53e466392563a143ee4654f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.013811 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4334/8690] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:30:43 2022] DELETE /identity/v3/users/db9dcb86f53e466392563a143ee4654f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:44.018547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:44.019034 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:44.019146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:44.038257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:44.039522 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:44.107916 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4357/8691] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:44.118015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:44.119497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:44.181431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ee036-3fc3-4c26-8bc9-83e346e0722b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:44.186111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:44.186772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:44.187077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:44.187356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:44.197885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:44.199429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:44.209833 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4335/8692] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:44.386294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:44.387793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:44.401400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08b21-76a9-4bb3-a920-2da9c4510fb6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:44.406143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:44.407024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:44.407337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:44.407620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] PATH_INFO: `/v3/projects/e4d5f64edea14cbab1392d17e3be9de9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:44.408871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d5f64edea14cbab1392d17e3be9de9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:44.410835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:44.462565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d5f64edea14cbab1392d17e3be9de9', 'request_id': 'req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.468018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d5f64edea14cbab1392d17e3be9de9', 'request_id': 'req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.474260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d5f64edea14cbab1392d17e3be9de9', 'request_id': 'req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.487987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] The token cache is being invalidate because project e4d5f64edea14cbab1392d17e3be9de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:30:44.488321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.489072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.490908 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4358/8693] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:30:44 2022] DELETE /identity/v3/projects/e4d5f64edea14cbab1392d17e3be9de9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:44.495055 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:44.500333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:44.506736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9027db1-b512-4651-b89d-d130eeaca805 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:44.570588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:44.571506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:44.571793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:44.572075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] PATH_INFO: `/v3/users/8353a4c231db48a9bc9e58c3f33a8cd9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:44.573294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8353a4c231db48a9bc9e58c3f33a8cd9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:44.575300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:44.665732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8353a4c231db48a9bc9e58c3f33a8cd9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.679662 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8353a4c231db48a9bc9e58c3f33a8cd9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.680426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8353a4c231db48a9bc9e58c3f33a8cd9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.687539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8353a4c231db48a9bc9e58c3f33a8cd9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.688182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f1dd409b-59d4-4e25-aac3-e894dfa4adc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8353a4c231db48a9bc9e58c3f33a8cd9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:44.703207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4336/8694] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:30:44 2022] DELETE /identity/v3/users/8353a4c231db48a9bc9e58c3f33a8cd9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:44.882535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:44.884017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:44.897838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398946a-3829-4cb9-b6d7-a4cc8dea53a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:44.963498 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:44.964370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:44.964659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:44.964941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] PATH_INFO: `/v3/projects/6403ba8e6e4743a1a04c575cefcc89ea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:44.966134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6403ba8e6e4743a1a04c575cefcc89ea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:44.968101 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:44.999623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:45.018733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6403ba8e6e4743a1a04c575cefcc89ea', 'request_id': 'req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:45.024370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6403ba8e6e4743a1a04c575cefcc89ea', 'request_id': 'req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:45.030612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6403ba8e6e4743a1a04c575cefcc89ea', 'request_id': 'req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:45.043128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] The token cache is being invalidate because project 6403ba8e6e4743a1a04c575cefcc89ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:30:45.043581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:45.044572 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1adf8e8-30a6-4c3e-a768-4b71a4ee3360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:45.046202 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4359/8695] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:30:44 2022] DELETE /identity/v3/projects/6403ba8e6e4743a1a04c575cefcc89ea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:45.053394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c149f-56ec-4e41-a1ea-fd08a6d1437c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.053923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c149f-56ec-4e41-a1ea-fd08a6d1437c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.053923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c149f-56ec-4e41-a1ea-fd08a6d1437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.072891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e39c149f-56ec-4e41-a1ea-fd08a6d1437c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:45.074107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e39c149f-56ec-4e41-a1ea-fd08a6d1437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:45.133513 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4337/8696] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:45.142635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255e6b-e16e-4c7e-a1d7-57b8993c3922 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.142932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255e6b-e16e-4c7e-a1d7-57b8993c3922 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.143219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255e6b-e16e-4c7e-a1d7-57b8993c3922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.164261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28255e6b-e16e-4c7e-a1d7-57b8993c3922 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:45.165476 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28255e6b-e16e-4c7e-a1d7-57b8993c3922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:45.173771 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4360/8697] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:45.178719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c149f-56ec-4e41-a1ea-fd08a6d1437c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.188840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c149f-56ec-4e41-a1ea-fd08a6d1437c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.193820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.194492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.194778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.195060 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.195823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:30:45.196135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.197776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.209560 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4338/8698] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:30:45.214006 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255e6b-e16e-4c7e-a1d7-57b8993c3922 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.223537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255e6b-e16e-4c7e-a1d7-57b8993c3922 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.228824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.229485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.229773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.230097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.230801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.232764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.267029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4361/8699] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:30:45.268995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.280089 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5305-9b97-47e3-b8d9-5c22dfa6a58d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.285007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:45.340358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.341042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.341332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.341618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.342317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.344317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.365747 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4339/8700] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:30:45.369559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.380107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d920-6d9c-4a39-af82-029704cfc678 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.384749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.385406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.385694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.385969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.386702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.388372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.399927 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4362/8701] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:45.404164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.414938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a800414-efd4-4074-9930-6349e11cd076 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.420031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c567791-0557-4f64-a566-6d05817ffe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.420698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c567791-0557-4f64-a566-6d05817ffe49 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.420989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c567791-0557-4f64-a566-6d05817ffe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.421275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c567791-0557-4f64-a566-6d05817ffe49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.422000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c567791-0557-4f64-a566-6d05817ffe49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.423654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c567791-0557-4f64-a566-6d05817ffe49 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.433771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4340/8702] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:45.438610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.448709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed318ae-ae17-48f8-a707-a3eafab6e6e9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.453523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eb27c-09f6-4ed6-bbaa-1472477f7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.454441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb27c-09f6-4ed6-bbaa-1472477f7dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.454731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb27c-09f6-4ed6-bbaa-1472477f7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.455013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb27c-09f6-4ed6-bbaa-1472477f7dfc admin admin] PATH_INFO: `/v3/projects/1d8369be20984718b458fb52a9fa780d/users/9b49e1046f9f45d48658612933f33da5/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.470620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eb27c-09f6-4ed6-bbaa-1472477f7dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8369be20984718b458fb52a9fa780d, user_id=9b49e1046f9f45d48658612933f33da5, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.473385 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eb27c-09f6-4ed6-bbaa-1472477f7dfc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.488313 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4363/8703] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:30:45 2022] PUT /identity/v3/projects/1d8369be20984718b458fb52a9fa780d/users/9b49e1046f9f45d48658612933f33da5/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:45.500441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.500737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.501028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.508085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d88aaf-0dd0-4611-ade3-58580bb8b5c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.509357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d88aaf-0dd0-4611-ade3-58580bb8b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.509742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d88aaf-0dd0-4611-ade3-58580bb8b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.529113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c6d88aaf-0dd0-4611-ade3-58580bb8b5c4 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:45.530483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c6d88aaf-0dd0-4611-ade3-58580bb8b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:45.531211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] MFA Rules not processed for user `9b49e1046f9f45d48658612933f33da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:45.532423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:45.597183 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4364/8704] 10.222.0.110 () {58 vars in 1016 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:45.601971 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4341/8705] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:45.606860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d88aaf-0dd0-4611-ade3-58580bb8b5c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.615744 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.617345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:45.635885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd74f6-16e5-433a-a44f-9e8834a8f7a4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.641126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.641862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.642061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.642346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.655072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.656729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.657025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:45.667895 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4342/8706] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:45.674357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d88aaf-0dd0-4611-ade3-58580bb8b5c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.679648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.680321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.680613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.680900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.681601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.683556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.711228 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4365/8707] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:30:45.716123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.727656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aee24-d90c-48ed-ba0b-bd15490d778c service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.790143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.790835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.791124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.791442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.792169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.794376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.803398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:45.816974 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4343/8708] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:30:45.821932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.834335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb36336-a6ab-4f43-9c6c-67492d1726d3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.840263 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33c7c1-92fb-4885-ab98-2b9fe7913c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.840959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c7c1-92fb-4885-ab98-2b9fe7913c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.841318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c7c1-92fb-4885-ab98-2b9fe7913c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.841607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c7c1-92fb-4885-ab98-2b9fe7913c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.842352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33c7c1-92fb-4885-ab98-2b9fe7913c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.844032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33c7c1-92fb-4885-ab98-2b9fe7913c5b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.862228 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4366/8709] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:30:45.863668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:45.878319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb940d4-3e0e-4aea-9b6f-c4bc0546c3cb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.883850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.884855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.885193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.885558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] PATH_INFO: `/v3/projects/5d8ba519c2cd4f8283e6afd284e955bb/users/ac8c360d7d594585a3dd6509171a08b2/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.903504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8ba519c2cd4f8283e6afd284e955bb, user_id=ac8c360d7d594585a3dd6509171a08b2, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.912337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.926177 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4344/8710] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:30:45 2022] PUT /identity/v3/projects/5d8ba519c2cd4f8283e6afd284e955bb/users/ac8c360d7d594585a3dd6509171a08b2/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:30:45.936798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bd02-fdb1-4d8c-bdb4-8b4b7f6fd0e6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.937092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bd02-fdb1-4d8c-bdb4-8b4b7f6fd0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.937379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bd02-fdb1-4d8c-bdb4-8b4b7f6fd0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.964632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3dd0bd02-fdb1-4d8c-bdb4-8b4b7f6fd0e6 None None] MFA Rules not processed for user `ac8c360d7d594585a3dd6509171a08b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:45.966182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3dd0bd02-fdb1-4d8c-bdb4-8b4b7f6fd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:46.038132 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4367/8711] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:46.067348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:46.069747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:46.141934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54303-723d-4833-ac9e-8d280654dca9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:46.147914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a883a0-6294-4cee-ad47-27f40d2d14a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:46.148937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a883a0-6294-4cee-ad47-27f40d2d14a9 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:46.149229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a883a0-6294-4cee-ad47-27f40d2d14a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:46.149512 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a883a0-6294-4cee-ad47-27f40d2d14a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:46.157898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a883a0-6294-4cee-ad47-27f40d2d14a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:46.159562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a883a0-6294-4cee-ad47-27f40d2d14a9 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:46.167821 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4345/8712] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:30:46.723328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bd02-fdb1-4d8c-bdb4-8b4b7f6fd0e6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:46.791100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bd02-fdb1-4d8c-bdb4-8b4b7f6fd0e6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:46.796068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:46.796957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:46.797247 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:46.797532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] PATH_INFO: `/v3/users/9b49e1046f9f45d48658612933f33da5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:46.798740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b49e1046f9f45d48658612933f33da5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:46.800720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:46.850450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b49e1046f9f45d48658612933f33da5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:46.855161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:46.864661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b49e1046f9f45d48658612933f33da5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:46.872658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b49e1046f9f45d48658612933f33da5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:46.873432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b49e1046f9f45d48658612933f33da5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:46.881413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b49e1046f9f45d48658612933f33da5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:46.887759 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4368/8713] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:30:46 2022] DELETE /identity/v3/users/9b49e1046f9f45d48658612933f33da5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:46.892334 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94674a78-362b-4081-af85-51138301c65a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:46.892651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94674a78-362b-4081-af85-51138301c65a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:46.892934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94674a78-362b-4081-af85-51138301c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:46.911041 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-94674a78-362b-4081-af85-51138301c65a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:46.912298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94674a78-362b-4081-af85-51138301c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:46.978373 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4346/8714] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:46.988200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:46.990688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:47.050703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e8ba-34fe-450e-9213-8c7bef08bfb4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:47.055544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:47.056242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:47.056534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:47.056862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:47.067196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:47.069289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:47.079313 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4369/8715] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:47.366850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94674a78-362b-4081-af85-51138301c65a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:47.368357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94674a78-362b-4081-af85-51138301c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:47.380865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94674a78-362b-4081-af85-51138301c65a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:47.385673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:47.386555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:47.386845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:47.387124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] PATH_INFO: `/v3/projects/1d8369be20984718b458fb52a9fa780d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:47.388346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8369be20984718b458fb52a9fa780d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:47.390280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:47.438963 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8369be20984718b458fb52a9fa780d', 'request_id': 'req-bc350559-8b26-4bef-9e86-d8fda342fa50'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.442873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:47.446957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8369be20984718b458fb52a9fa780d', 'request_id': 'req-bc350559-8b26-4bef-9e86-d8fda342fa50'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.455136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8369be20984718b458fb52a9fa780d', 'request_id': 'req-bc350559-8b26-4bef-9e86-d8fda342fa50'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.465990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] The token cache is being invalidate because project 1d8369be20984718b458fb52a9fa780d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:30:47.466283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.466953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.468533 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4347/8716] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:30:47 2022] DELETE /identity/v3/projects/1d8369be20984718b458fb52a9fa780d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:47.472428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:47.482613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe30b8-990b-4ebc-bde6-1c9fd4b8eec1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:47.540405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:47.541304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:47.541592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:47.541876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] PATH_INFO: `/v3/users/ac8c360d7d594585a3dd6509171a08b2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:47.543079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8c360d7d594585a3dd6509171a08b2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:47.545301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:47.594360 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8c360d7d594585a3dd6509171a08b2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.606405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8c360d7d594585a3dd6509171a08b2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.614504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8c360d7d594585a3dd6509171a08b2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.615910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8c360d7d594585a3dd6509171a08b2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.618258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:47.625294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76fd8bf0-ddbe-456b-878f-b938483b9506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8c360d7d594585a3dd6509171a08b2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:47.632751 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4370/8717] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:30:47 2022] DELETE /identity/v3/users/ac8c360d7d594585a3dd6509171a08b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:47.908082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:47.909649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:47.924735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350559-8b26-4bef-9e86-d8fda342fa50 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:47.986557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:47.987452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:47.987736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:47.988010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] PATH_INFO: `/v3/projects/5d8ba519c2cd4f8283e6afd284e955bb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:47.989281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8ba519c2cd4f8283e6afd284e955bb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:47.991868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:48.038608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8ba519c2cd4f8283e6afd284e955bb', 'request_id': 'req-d6891062-50e1-4b39-b5b9-41263ff413b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:48.045990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8ba519c2cd4f8283e6afd284e955bb', 'request_id': 'req-d6891062-50e1-4b39-b5b9-41263ff413b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:48.052992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8ba519c2cd4f8283e6afd284e955bb', 'request_id': 'req-d6891062-50e1-4b39-b5b9-41263ff413b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:48.064654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] The token cache is being invalidate because project 5d8ba519c2cd4f8283e6afd284e955bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:30:48.065062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:48.066043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6891062-50e1-4b39-b5b9-41263ff413b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:30:48.068288 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4348/8718] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:30:47 2022] DELETE /identity/v3/projects/5d8ba519c2cd4f8283e6afd284e955bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:30:57.628383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:58.063566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:18.901238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6fbe-c881-4f66-add2-edabae31f050 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:18.901758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6fbe-c881-4f66-add2-edabae31f050 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:18.902814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6fbe-c881-4f66-add2-edabae31f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:18.926770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-59ef6fbe-c881-4f66-add2-edabae31f050 None None] MFA Rules not processed for user `fe98bedc23e84fe4b25bd4790e983611`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:18.928044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59ef6fbe-c881-4f66-add2-edabae31f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:19.014861 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4371/8719] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:19.052630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:19.053174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:19.053174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:19.090015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] MFA Rules not processed for user `0ded1996761b4d7d8ec89534d2103dea`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:19.091602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:19.154633 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4349/8720] 10.222.0.98 () {58 vars in 1059 bytes} [Thu Jul 14 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:19.161746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6fbe-c881-4f66-add2-edabae31f050 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:19.172857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6fbe-c881-4f66-add2-edabae31f050 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:19.177931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfebea-6d52-4f39-8b76-2a0231dd53ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:19.178638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfebea-6d52-4f39-8b76-2a0231dd53ad service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:19.178885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfebea-6d52-4f39-8b76-2a0231dd53ad service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:19.179196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfebea-6d52-4f39-8b76-2a0231dd53ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:19.181758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5bfebea-6d52-4f39-8b76-2a0231dd53ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:19.306147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfebea-6d52-4f39-8b76-2a0231dd53ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:19.308164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfebea-6d52-4f39-8b76-2a0231dd53ad service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:19.332712 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4372/8721] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:20.004684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:20.007858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:20.094739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dae32-a992-49e7-bab1-f915c84bf447 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:20.101147 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe43f87-76b4-45bb-8631-8ad2ee061bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:20.101694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43f87-76b4-45bb-8631-8ad2ee061bcc service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:20.102636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43f87-76b4-45bb-8631-8ad2ee061bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:20.103243 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43f87-76b4-45bb-8631-8ad2ee061bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:20.106979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-abe43f87-76b4-45bb-8631-8ad2ee061bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:20.132823 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe43f87-76b4-45bb-8631-8ad2ee061bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:20.134743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe43f87-76b4-45bb-8631-8ad2ee061bcc service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:20.153374 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4350/8722] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:21.485192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6c9d-bc36-4d4b-a5e6-39da37ebf6eb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.485819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6c9d-bc36-4d4b-a5e6-39da37ebf6eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.485819 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6c9d-bc36-4d4b-a5e6-39da37ebf6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:21.504255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b56a6c9d-bc36-4d4b-a5e6-39da37ebf6eb None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:21.505472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b56a6c9d-bc36-4d4b-a5e6-39da37ebf6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:21.572922 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4373/8723] 10.222.0.104 () {58 vars in 1016 bytes} [Thu Jul 14 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:21.585452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb780e-2577-4c25-9c39-dbdc3d00793c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.586059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb780e-2577-4c25-9c39-dbdc3d00793c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.586487 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb780e-2577-4c25-9c39-dbdc3d00793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:21.612416 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c1cb780e-2577-4c25-9c39-dbdc3d00793c None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:21.613725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c1cb780e-2577-4c25-9c39-dbdc3d00793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:21.623090 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4351/8724] 10.222.0.98 () {58 vars in 1057 bytes} [Thu Jul 14 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:21.630376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a6c9d-bc36-4d4b-a5e6-39da37ebf6eb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:21.642303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a6c9d-bc36-4d4b-a5e6-39da37ebf6eb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:21.649269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:21.649949 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.650239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.650523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:21.661762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:21.663485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:21.675043 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4374/8725] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:29.556327 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb780e-2577-4c25-9c39-dbdc3d00793c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:29.566216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb780e-2577-4c25-9c39-dbdc3d00793c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:29.570606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:29.571287 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:29.571580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:29.571862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:29.573670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:29.587608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:29.589232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:29.600936 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4352/8726] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:31:31.670906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:38.178095 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:38.188726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa64d-c6ee-4a6a-86a5-9b3cb6c7afd0 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:38.194834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89581910-d821-4b99-967e-f1fe848ac267 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:38.195521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581910-d821-4b99-967e-f1fe848ac267 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:38.195808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581910-d821-4b99-967e-f1fe848ac267 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:38.196089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581910-d821-4b99-967e-f1fe848ac267 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:38.197877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89581910-d821-4b99-967e-f1fe848ac267 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:38.213595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89581910-d821-4b99-967e-f1fe848ac267 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:38.215234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89581910-d821-4b99-967e-f1fe848ac267 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:38.230383 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4375/8727] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:39.594424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=63 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:46.720219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:46.721733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:46.788441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3161b2-0d9d-4e08-a62a-d0fa5d8303e4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:46.793696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:46.794628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:46.794861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:46.795141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] PATH_INFO: `/v3/users/fe98bedc23e84fe4b25bd4790e983611` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:46.796369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe98bedc23e84fe4b25bd4790e983611)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:46.798342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:46.850258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe98bedc23e84fe4b25bd4790e983611'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:46.862413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe98bedc23e84fe4b25bd4790e983611'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:46.863586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe98bedc23e84fe4b25bd4790e983611'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:46.870770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe98bedc23e84fe4b25bd4790e983611'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:46.871464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe98bedc23e84fe4b25bd4790e983611'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:46.885136 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4353/8728] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:31:46 2022] DELETE /identity/v3/users/fe98bedc23e84fe4b25bd4790e983611 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:31:46.889966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:46.890465 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:46.890573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:46.911794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:46.913013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:46.977578 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4376/8729] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:46.987551 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:46.989507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:47.049023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61161e58-82f6-4514-ac83-ed7b9aba7546 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:47.053148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:47.053836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:47.054126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:47.054411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:47.063888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:47.065336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:47.076839 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4354/8730] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:47.254206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:47.255798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:47.271491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2546f4-d661-4434-9a9d-0b1494beb187 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:47.276437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:47.277437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:47.278570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:47.279198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] PATH_INFO: `/v3/projects/08b5350c62be4829b0b7a8807d35daed` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:47.280529 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b5350c62be4829b0b7a8807d35daed)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:47.282437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:47.332131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b5350c62be4829b0b7a8807d35daed', 'request_id': 'req-d9073b87-5826-4f21-838c-131ecdabe77f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.337906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b5350c62be4829b0b7a8807d35daed', 'request_id': 'req-d9073b87-5826-4f21-838c-131ecdabe77f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.344315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b5350c62be4829b0b7a8807d35daed', 'request_id': 'req-d9073b87-5826-4f21-838c-131ecdabe77f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.357778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] The token cache is being invalidate because project 08b5350c62be4829b0b7a8807d35daed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:31:47.358096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.358767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.360356 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4377/8731] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:31:47 2022] DELETE /identity/v3/projects/08b5350c62be4829b0b7a8807d35daed => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:47.365087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:47.374987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de8aa-0649-49ca-981d-d2975f0e885d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:47.392930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:47.438597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:47.439696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:47.440031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:47.440338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] PATH_INFO: `/v3/users/75a46bc5cf42453380a14fd6d74e8d74` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:47.441585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a46bc5cf42453380a14fd6d74e8d74)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:47.443691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:47.517029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a46bc5cf42453380a14fd6d74e8d74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.530701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a46bc5cf42453380a14fd6d74e8d74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.531474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a46bc5cf42453380a14fd6d74e8d74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.539292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a46bc5cf42453380a14fd6d74e8d74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.539994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a46bc5cf42453380a14fd6d74e8d74'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.554557 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4355/8732] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:31:47 2022] DELETE /identity/v3/users/75a46bc5cf42453380a14fd6d74e8d74 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:47.840026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:47.841494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:47.855871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9073b87-5826-4f21-838c-131ecdabe77f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:47.917380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:47.918646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:47.919083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:47.919574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] PATH_INFO: `/v3/projects/eff913915e0a49c2a391b22990ddd59a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:47.921015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff913915e0a49c2a391b22990ddd59a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:47.923144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:47.937699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:47.976534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff913915e0a49c2a391b22990ddd59a', 'request_id': 'req-037963ea-8edd-4d05-8eac-a7e1870fedc3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.982418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff913915e0a49c2a391b22990ddd59a', 'request_id': 'req-037963ea-8edd-4d05-8eac-a7e1870fedc3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:47.988753 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff913915e0a49c2a391b22990ddd59a', 'request_id': 'req-037963ea-8edd-4d05-8eac-a7e1870fedc3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.001471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] The token cache is being invalidate because project eff913915e0a49c2a391b22990ddd59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:31:48.001764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.002405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.004502 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4378/8733] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:31:47 2022] DELETE /identity/v3/projects/eff913915e0a49c2a391b22990ddd59a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:48.008670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.010117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:48.024155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a7f57-2ccb-4636-b83a-1cb371594602 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.081428 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.083021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.083339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.083622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] PATH_INFO: `/v3/users/f2f68c960e404640b2113752a7fdb0c4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.084822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f68c960e404640b2113752a7fdb0c4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.086757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.136395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f68c960e404640b2113752a7fdb0c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.139522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:48.152831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f68c960e404640b2113752a7fdb0c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.153565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f68c960e404640b2113752a7fdb0c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.160676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f68c960e404640b2113752a7fdb0c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.161310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd1bbd4e-6d8e-41c6-a84e-8da3d80bf6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f68c960e404640b2113752a7fdb0c4'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.174789 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4356/8734] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:31:48 2022] DELETE /identity/v3/users/f2f68c960e404640b2113752a7fdb0c4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:48.358574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.360130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:48.374096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037963ea-8edd-4d05-8eac-a7e1870fedc3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.432664 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.433450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.433738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.434021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] PATH_INFO: `/v3/projects/5b8748dc4d1f4673b81e8379cfdde5ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.435206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8748dc4d1f4673b81e8379cfdde5ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.437171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.485646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8748dc4d1f4673b81e8379cfdde5ba', 'request_id': 'req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.492989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8748dc4d1f4673b81e8379cfdde5ba', 'request_id': 'req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.499680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8748dc4d1f4673b81e8379cfdde5ba', 'request_id': 'req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.512979 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] The token cache is being invalidate because project 5b8748dc4d1f4673b81e8379cfdde5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:31:48.513270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.513892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38b8ac7f-e00f-4c03-93be-9e7b389e0ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:31:48.515498 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4379/8735] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:31:48 2022] DELETE /identity/v3/projects/5b8748dc4d1f4673b81e8379cfdde5ba => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:48.520532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2ed2-5f22-44b6-ac42-069b5b304972 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.520908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2ed2-5f22-44b6-ac42-069b5b304972 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.521259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2ed2-5f22-44b6-ac42-069b5b304972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.539200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5cef2ed2-5f22-44b6-ac42-069b5b304972 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:48.540424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5cef2ed2-5f22-44b6-ac42-069b5b304972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:48.609168 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4357/8736] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:31:48.617815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc274-ef0f-4b5c-b852-7a8c3ac072fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.618106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc274-ef0f-4b5c-b852-7a8c3ac072fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.618392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc274-ef0f-4b5c-b852-7a8c3ac072fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.639677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f2fc274-ef0f-4b5c-b852-7a8c3ac072fe None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:48.640901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f2fc274-ef0f-4b5c-b852-7a8c3ac072fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:48.650331 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4380/8737] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:31:48.655810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2ed2-5f22-44b6-ac42-069b5b304972 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.666286 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2ed2-5f22-44b6-ac42-069b5b304972 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.671441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.672127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.672410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.672687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.673412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:31:48.673722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.675471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.688460 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4358/8738] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:31:48.693149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fc274-ef0f-4b5c-b852-7a8c3ac072fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.703794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fc274-ef0f-4b5c-b852-7a8c3ac072fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.709259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.709938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.710261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.710549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.711298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.713255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.742964 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4381/8739] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:31:48 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:31:48.747110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.757672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf153f7a-85d7-4347-8a17-85ea6abd84e2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.814673 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.815378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.815670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.815970 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.816656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.818593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.837722 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4359/8740] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:31:48 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:31:48.841874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.847890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:48.854968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf6ff0-9b87-47c5-bce0-34afa11c1632 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.860944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.861618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.861907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.862187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.863564 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.865176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.875990 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4382/8741] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:31:48.880166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.890264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9c2d0-7fa5-4a9c-a3b3-bdae232f5a78 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.894893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13f032-eb34-4ded-8e1f-06206da8832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.895591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13f032-eb34-4ded-8e1f-06206da8832e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.895876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13f032-eb34-4ded-8e1f-06206da8832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.896154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13f032-eb34-4ded-8e1f-06206da8832e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.896873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13f032-eb34-4ded-8e1f-06206da8832e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.898491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13f032-eb34-4ded-8e1f-06206da8832e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.908733 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4360/8742] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:31:48.913311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:48.923924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521473-cc16-43cd-99af-e2ed1110db17 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:48.929268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:48.930165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.930446 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.930722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] PATH_INFO: `/v3/projects/4b9390a34c364bf7a58635f7f3e7fc7b/users/d0ec70daaa7c4babbadcb96a5fe16f44/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.945506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9390a34c364bf7a58635f7f3e7fc7b, user_id=d0ec70daaa7c4babbadcb96a5fe16f44, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:48.948126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:48.961560 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4383/8743] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:31:48 2022] PUT /identity/v3/projects/4b9390a34c364bf7a58635f7f3e7fc7b/users/d0ec70daaa7c4babbadcb96a5fe16f44/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:48.966901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214527-8f1b-4a38-9d63-d6bce8ef2553 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:48.967241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214527-8f1b-4a38-9d63-d6bce8ef2553 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:48.967560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214527-8f1b-4a38-9d63-d6bce8ef2553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:48.986092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c9214527-8f1b-4a38-9d63-d6bce8ef2553 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:48.987575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c9214527-8f1b-4a38-9d63-d6bce8ef2553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:49.008450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:49.050707 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4361/8744] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:49.060329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:49.062042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:49.120804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd35c0-e99f-4847-bb41-b7401f8f911a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:49.124544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:49.125200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:49.125483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:49.125761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:49.136239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:49.137699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:49.148076 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4384/8745] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:49.837751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201245a3-9c8c-4818-af73-2ca99e592cad None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:49.838076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201245a3-9c8c-4818-af73-2ca99e592cad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:49.838418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201245a3-9c8c-4818-af73-2ca99e592cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:49.871550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-201245a3-9c8c-4818-af73-2ca99e592cad None None] MFA Rules not processed for user `d0ec70daaa7c4babbadcb96a5fe16f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:49.874452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-201245a3-9c8c-4818-af73-2ca99e592cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:49.976928 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4362/8746] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:49.978191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:49.988789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb38a3-09b4-4740-8f0f-c374dee286b8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:49.993742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:49.994530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:49.994906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:49.995190 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:49.995925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:49.997932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:50.032455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4385/8747] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:31:49 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:31:50.036459 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201245a3-9c8c-4818-af73-2ca99e592cad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:50.048464 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201245a3-9c8c-4818-af73-2ca99e592cad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:50.113323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:50.114092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:50.114442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:50.114782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:50.115607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:50.117608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:50.139043 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4363/8748] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:31:50 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:31:50.143100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:50.155802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f4aa9-dfee-4898-a07b-1cf79c0d7e70 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:50.163076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:50.163822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:50.164113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:50.164429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:50.165203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:50.167153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:50.181902 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4386/8749] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:31:50.186183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:50.196952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979904e-f421-48a0-ac7a-53789c57fed0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:50.201642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:50.202531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:50.202817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:50.203095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] PATH_INFO: `/v3/projects/a375785baa004a2982db8c1ab2cc0737/users/96fe18e5c9dd436fa3983675a258d453/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:50.218967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a375785baa004a2982db8c1ab2cc0737, user_id=96fe18e5c9dd436fa3983675a258d453, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:50.221687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:50.235294 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4364/8750] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:31:50 2022] PUT /identity/v3/projects/a375785baa004a2982db8c1ab2cc0737/users/96fe18e5c9dd436fa3983675a258d453/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:50.239726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:50.250228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33f53d-15f6-4762-bbb6-b9541ad37c2c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:50.311378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d0609-80f7-490f-a01e-2dab08057f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:50.312057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d0609-80f7-490f-a01e-2dab08057f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:50.312368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d0609-80f7-490f-a01e-2dab08057f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:50.312647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d0609-80f7-490f-a01e-2dab08057f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:50.313370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d0609-80f7-490f-a01e-2dab08057f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:50.314999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d0609-80f7-490f-a01e-2dab08057f5c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:50.324885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4387/8751] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:31:50.329086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:50.339483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002ca88-d0f8-4ed6-a338-a1ec239bf61a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:50.344132 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fe354-9aef-4ef8-a95f-d69c6a06cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:50.345008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe354-9aef-4ef8-a95f-d69c6a06cebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:50.345302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe354-9aef-4ef8-a95f-d69c6a06cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:50.345573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe354-9aef-4ef8-a95f-d69c6a06cebe admin admin] PATH_INFO: `/v3/projects/a375785baa004a2982db8c1ab2cc0737/users/96fe18e5c9dd436fa3983675a258d453/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:50.348097 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fe354-9aef-4ef8-a95f-d69c6a06cebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a375785baa004a2982db8c1ab2cc0737, user_id=96fe18e5c9dd436fa3983675a258d453, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:50.350767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fe354-9aef-4ef8-a95f-d69c6a06cebe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:50.362126 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4365/8752] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:31:50 2022] PUT /identity/v3/projects/a375785baa004a2982db8c1ab2cc0737/users/96fe18e5c9dd436fa3983675a258d453/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:31:50.982945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:50.983633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:50.983633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:51.014017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] MFA Rules not processed for user `96fe18e5c9dd436fa3983675a258d453`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:51.015549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:51.045331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:51.106250 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4388/8753] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:51.116810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:51.117404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:51.117404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:51.136193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] MFA Rules not processed for user `d0ec70daaa7c4babbadcb96a5fe16f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:51.137774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:51.142028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:51.199389 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4366/8754] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:31:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:51.211859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:51.213387 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:51.290890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76807a4-429c-40a6-bad1-812beb8e54d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:51.297289 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:51.298440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:51.298724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:51.299000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:51.308213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:51.309802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:51.319614 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4389/8755] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:53.665976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:53.667460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:53.726519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938898-df4d-406d-862b-5709b3ff9301 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:53.730206 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:53.730869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:53.731152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:53.731457 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:53.733218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:53.746042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:53.747475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:53.758791 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4367/8756] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:01.314784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=53 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:03.751914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=47 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:17.230918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:17.303484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca870c-255b-4f41-9ccb-2e38b3ee1050 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:17.308198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:17.309082 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:17.309367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:17.309653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] PATH_INFO: `/v3/users/d0ec70daaa7c4babbadcb96a5fe16f44` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:17.310883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ec70daaa7c4babbadcb96a5fe16f44)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:17.312851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:17.360729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ec70daaa7c4babbadcb96a5fe16f44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.373086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ec70daaa7c4babbadcb96a5fe16f44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.381870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ec70daaa7c4babbadcb96a5fe16f44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.382995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ec70daaa7c4babbadcb96a5fe16f44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.390252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ec70daaa7c4babbadcb96a5fe16f44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.396211 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4390/8757] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:32:17 2022] DELETE /identity/v3/users/d0ec70daaa7c4babbadcb96a5fe16f44 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:32:17.576298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:17.595404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc09b4-98a0-41d4-b098-87ef7c65f043 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:17.661051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:17.661985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:17.662300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:17.662580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] PATH_INFO: `/v3/projects/4b9390a34c364bf7a58635f7f3e7fc7b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:17.663819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9390a34c364bf7a58635f7f3e7fc7b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:17.665755 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:17.712025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9390a34c364bf7a58635f7f3e7fc7b', 'request_id': 'req-994ee709-9fc5-4c06-8fa4-25ff2963c57f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.719352 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9390a34c364bf7a58635f7f3e7fc7b', 'request_id': 'req-994ee709-9fc5-4c06-8fa4-25ff2963c57f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.726443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9390a34c364bf7a58635f7f3e7fc7b', 'request_id': 'req-994ee709-9fc5-4c06-8fa4-25ff2963c57f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.737232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] The token cache is being invalidate because project 4b9390a34c364bf7a58635f7f3e7fc7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:32:17.737599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.738349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.740234 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4368/8758] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:32:17 2022] DELETE /identity/v3/projects/4b9390a34c364bf7a58635f7f3e7fc7b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:32:17.745041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:17.746458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:17.759603 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc986bd-df06-4aaf-a7e6-6fec1f9079f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:17.819922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:17.820813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:17.821100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:17.821410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] PATH_INFO: `/v3/users/96fe18e5c9dd436fa3983675a258d453` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:17.822607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fe18e5c9dd436fa3983675a258d453)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:17.824580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:17.847826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:17.874668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fe18e5c9dd436fa3983675a258d453'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.886734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fe18e5c9dd436fa3983675a258d453'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.894884 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fe18e5c9dd436fa3983675a258d453'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.895526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fe18e5c9dd436fa3983675a258d453'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.902451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c27a7e-80ce-47db-94d0-9a1e7db55a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fe18e5c9dd436fa3983675a258d453'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:17.908530 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4391/8759] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:32:17 2022] DELETE /identity/v3/users/96fe18e5c9dd436fa3983675a258d453 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:32:18.086892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.088434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:18.101462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee709-9fc5-4c06-8fa4-25ff2963c57f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.163637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.164401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.164693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.165101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] PATH_INFO: `/v3/projects/a375785baa004a2982db8c1ab2cc0737` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.168362 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a375785baa004a2982db8c1ab2cc0737)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.171423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.215316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:18.228982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a375785baa004a2982db8c1ab2cc0737', 'request_id': 'req-c45a2605-3056-43ef-9e7b-543ce06ed712'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:18.236828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a375785baa004a2982db8c1ab2cc0737', 'request_id': 'req-c45a2605-3056-43ef-9e7b-543ce06ed712'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:18.243687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a375785baa004a2982db8c1ab2cc0737', 'request_id': 'req-c45a2605-3056-43ef-9e7b-543ce06ed712'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:18.255423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] The token cache is being invalidate because project a375785baa004a2982db8c1ab2cc0737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:32:18.255756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:18.256431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c45a2605-3056-43ef-9e7b-543ce06ed712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:18.257998 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4369/8760] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:32:18 2022] DELETE /identity/v3/projects/a375785baa004a2982db8c1ab2cc0737 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:32:18.263001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a6b7-f274-48b7-9fda-a8ee29b48e77 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.263553 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a6b7-f274-48b7-9fda-a8ee29b48e77 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.263680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a6b7-f274-48b7-9fda-a8ee29b48e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.283100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aae9a6b7-f274-48b7-9fda-a8ee29b48e77 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:18.284370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aae9a6b7-f274-48b7-9fda-a8ee29b48e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:18.343916 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4392/8761] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:18.352784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61e7ed-093e-4d79-b384-7b96858f530e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.353084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61e7ed-093e-4d79-b384-7b96858f530e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.353370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61e7ed-093e-4d79-b384-7b96858f530e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.372700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5d61e7ed-093e-4d79-b384-7b96858f530e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:18.373911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5d61e7ed-093e-4d79-b384-7b96858f530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:18.382623 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4370/8762] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:18.386956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a6b7-f274-48b7-9fda-a8ee29b48e77 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.396744 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a6b7-f274-48b7-9fda-a8ee29b48e77 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.401356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.402011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.402297 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.402577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.403330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:32:18.403660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.405250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.416831 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4393/8763] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:32:18.423157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61e7ed-093e-4d79-b384-7b96858f530e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.433084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61e7ed-093e-4d79-b384-7b96858f530e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.437724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.438375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.438656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.438933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.439655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.442268 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.466895 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4371/8764] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:32:18 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:32:18.471010 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.482307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af9a61-806e-406b-8fa3-1f7e1b528a50 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.542390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.543390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.543680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.543964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.544659 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.546611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.568400 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4394/8765] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:32:18 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:32:18.572353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.582795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e3ad-8a0e-40d5-9993-95c8e1ae7896 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.587730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.588435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.588725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.589034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.589798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.591526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.604554 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4372/8766] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:32:18.608775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.619758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c376c-da0f-4196-bd34-d75c733371e1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.624806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e36f67-857f-4230-a348-d1760f86f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.625485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e36f67-857f-4230-a348-d1760f86f848 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.625776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e36f67-857f-4230-a348-d1760f86f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.626058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e36f67-857f-4230-a348-d1760f86f848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.626795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e36f67-857f-4230-a348-d1760f86f848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.629104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e36f67-857f-4230-a348-d1760f86f848 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.639862 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4395/8767] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:32:18.644127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.654602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f117c-dd39-4daf-b119-f7ca2f2c2e02 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.659791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.660701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.660984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.661263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] PATH_INFO: `/v3/projects/d85ac76360d3449593bd32c457be768d/users/7f2b8c0c470c4745bb2e05223e4e1bb1/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.678505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85ac76360d3449593bd32c457be768d, user_id=7f2b8c0c470c4745bb2e05223e4e1bb1, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.681130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.695765 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4373/8768] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:32:18 2022] PUT /identity/v3/projects/d85ac76360d3449593bd32c457be768d/users/7f2b8c0c470c4745bb2e05223e4e1bb1/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:32:18.700794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f2277-c3ef-4f0e-988b-6cca9b866f97 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.701118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f2277-c3ef-4f0e-988b-6cca9b866f97 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.701408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f2277-c3ef-4f0e-988b-6cca9b866f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.708627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:18.722685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0b5f2277-c3ef-4f0e-988b-6cca9b866f97 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:18.724192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b5f2277-c3ef-4f0e-988b-6cca9b866f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:18.782806 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4396/8769] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:18.792974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:18.794748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:18.853221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af033a-07fc-4259-9178-c14ec007ca9d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:18.857470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:18.858131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:18.858417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:18.858697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:18.868856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:18.870299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:18.879758 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4374/8770] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:23.006282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9414-3142-4b86-8aa6-ec9db46cd9c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:23.006725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9414-3142-4b86-8aa6-ec9db46cd9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:23.006830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9414-3142-4b86-8aa6-ec9db46cd9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:23.050907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-98fe9414-3142-4b86-8aa6-ec9db46cd9c4 None None] MFA Rules not processed for user `7f2b8c0c470c4745bb2e05223e4e1bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:23.052173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98fe9414-3142-4b86-8aa6-ec9db46cd9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:23.126632 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4397/8771] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:23.131406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:23.146542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d51a9e-7499-41f9-b45d-3efc8f69d012 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:23.151741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:23.152440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:23.152730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:23.153015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:23.153733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:23.155835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:23.187203 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4375/8772] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:32:23 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:32:23.188400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9414-3142-4b86-8aa6-ec9db46cd9c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:23.200394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9414-3142-4b86-8aa6-ec9db46cd9c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:23.271508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:23.272226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:23.272520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:23.272806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:23.273597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:23.275658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:23.299806 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4398/8773] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:32:23 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:32:23.304008 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:23.316336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ca68-b4d6-49a1-84d4-f6977f83896d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:23.321862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:23.322556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:23.322872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:23.323155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:23.323935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:23.325730 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:23.338525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4376/8774] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:32:23.342801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:23.353670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb072fb-f8a4-482d-8685-395774bc2f8d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:23.358532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:23.359482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:23.359772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:23.360055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] PATH_INFO: `/v3/projects/41ea61afe615407c8558fd6e3d2e3b62/users/ebf6e9548bd64ae0802f6700f434b8b6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:23.376302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ea61afe615407c8558fd6e3d2e3b62, user_id=ebf6e9548bd64ae0802f6700f434b8b6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:23.379590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:23.389431 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:23.395796 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4399/8775] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:32:23 2022] PUT /identity/v3/projects/41ea61afe615407c8558fd6e3d2e3b62/users/ebf6e9548bd64ae0802f6700f434b8b6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:32:23.399601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:23.410351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7702e5-4146-42e3-8a59-fc5866a12d2b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:23.436751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:23.475258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d3c03-95ab-4b74-ba2a-4744493456a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:23.475978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3c03-95ab-4b74-ba2a-4744493456a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:23.476276 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3c03-95ab-4b74-ba2a-4744493456a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:23.476748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3c03-95ab-4b74-ba2a-4744493456a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:23.477489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d3c03-95ab-4b74-ba2a-4744493456a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:23.479333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d3c03-95ab-4b74-ba2a-4744493456a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:23.501677 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4377/8776] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:32:23.508821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:23.520286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590e57b-c2a8-4ae4-b97f-86acb1621d39 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:23.524926 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:23.525807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:23.526096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:23.526495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] PATH_INFO: `/v3/projects/41ea61afe615407c8558fd6e3d2e3b62/users/ebf6e9548bd64ae0802f6700f434b8b6/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:23.534368 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ea61afe615407c8558fd6e3d2e3b62, user_id=ebf6e9548bd64ae0802f6700f434b8b6, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:23.537135 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:23.548562 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4400/8777] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:32:23 2022] PUT /identity/v3/projects/41ea61afe615407c8558fd6e3d2e3b62/users/ebf6e9548bd64ae0802f6700f434b8b6/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:32:28.005080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563d6c-cd35-439c-ba9d-d03e993274cf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:28.005590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563d6c-cd35-439c-ba9d-d03e993274cf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:28.005775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563d6c-cd35-439c-ba9d-d03e993274cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:28.035566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-80563d6c-cd35-439c-ba9d-d03e993274cf None None] MFA Rules not processed for user `ebf6e9548bd64ae0802f6700f434b8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:28.036752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80563d6c-cd35-439c-ba9d-d03e993274cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:28.110134 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4378/8778] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:32:28.127036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:28.131377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:28.233366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd41b-f4c9-494f-9395-b0ec97403348 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:28.241066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d5c6-d14f-4c03-8831-4345f07e6839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:28.241278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d5c6-d14f-4c03-8831-4345f07e6839 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:28.241549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d5c6-d14f-4c03-8831-4345f07e6839 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:28.241831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d5c6-d14f-4c03-8831-4345f07e6839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:28.253085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d5c6-d14f-4c03-8831-4345f07e6839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:28.254716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d5c6-d14f-4c03-8831-4345f07e6839 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:28.271493 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4401/8779] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:28.322321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:28.322605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:28.322916 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:28.340811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] MFA Rules not processed for user `7f2b8c0c470c4745bb2e05223e4e1bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:28.342016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:28.400102 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4379/8780] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:38.266497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:38.392919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=76 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:40.009144 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2ef4-eda6-408e-b063-1a44ad4e26c0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:40.009674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2ef4-eda6-408e-b063-1a44ad4e26c0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:40.009779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2ef4-eda6-408e-b063-1a44ad4e26c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:40.027983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8d3b2ef4-eda6-408e-b063-1a44ad4e26c0 None None] MFA Rules not processed for user `7f2b8c0c470c4745bb2e05223e4e1bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:40.029198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d3b2ef4-eda6-408e-b063-1a44ad4e26c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:40.036237 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4402/8781] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:40.305458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:40.306873 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:40.365629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e745a4-6f68-4350-928e-99cafc171a1b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:40.370279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:40.370279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:40.370497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:40.370711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:40.372561 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:40.386158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:40.387667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:40.398829 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4380/8782] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:50.022817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:50.392324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=26 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:53.888902 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b2ef4-eda6-408e-b063-1a44ad4e26c0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:53.918422 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b2ef4-eda6-408e-b063-1a44ad4e26c0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:53.926014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:53.926705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:53.927076 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:53.927419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:53.930326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:53.963866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:53.965717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:53.994860 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4403/8783] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:03.981412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:05.784450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:05.893581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f560c87-c43b-46fb-80c9-8c529a3d5931 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:05.898475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:05.899436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:05.899753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:05.900031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] PATH_INFO: `/v3/users/7f2b8c0c470c4745bb2e05223e4e1bb1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:05.901365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2b8c0c470c4745bb2e05223e4e1bb1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:05.903429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:05.971815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2b8c0c470c4745bb2e05223e4e1bb1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:05.994714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2b8c0c470c4745bb2e05223e4e1bb1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:05.995835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2b8c0c470c4745bb2e05223e4e1bb1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.006094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2b8c0c470c4745bb2e05223e4e1bb1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.006974 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2b8c0c470c4745bb2e05223e4e1bb1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.024518 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4381/8784] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:33:05 2022] DELETE /identity/v3/users/7f2b8c0c470c4745bb2e05223e4e1bb1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:06.255718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:06.270337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60098e07-5629-4bf2-96a6-fdd3e66086fe service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:06.353833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:06.354732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:06.355020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:06.355328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] PATH_INFO: `/v3/projects/d85ac76360d3449593bd32c457be768d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:06.356650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85ac76360d3449593bd32c457be768d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:06.358618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:06.417173 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85ac76360d3449593bd32c457be768d', 'request_id': 'req-1f5c23c8-09a3-497c-88ba-878d07f956c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.429810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85ac76360d3449593bd32c457be768d', 'request_id': 'req-1f5c23c8-09a3-497c-88ba-878d07f956c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.440270 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85ac76360d3449593bd32c457be768d', 'request_id': 'req-1f5c23c8-09a3-497c-88ba-878d07f956c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.461951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] The token cache is being invalidate because project d85ac76360d3449593bd32c457be768d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:33:06.462472 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.463596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.466293 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4404/8785] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:33:06 2022] DELETE /identity/v3/projects/d85ac76360d3449593bd32c457be768d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:33:06.471667 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:06.473831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:06.493448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6178104-de05-427d-a9e5-aba792616190 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:06.563315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:06.564902 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:06.565196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:06.565481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] PATH_INFO: `/v3/users/ebf6e9548bd64ae0802f6700f434b8b6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:06.566810 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf6e9548bd64ae0802f6700f434b8b6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:06.568839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:06.595958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:06.630285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf6e9548bd64ae0802f6700f434b8b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.643952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf6e9548bd64ae0802f6700f434b8b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.644705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf6e9548bd64ae0802f6700f434b8b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.659713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf6e9548bd64ae0802f6700f434b8b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.660545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3325b340-551b-4988-98b0-bb1f6355dc65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf6e9548bd64ae0802f6700f434b8b6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:06.676704 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4382/8786] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:33:06 2022] DELETE /identity/v3/users/ebf6e9548bd64ae0802f6700f434b8b6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:06.873665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:06.875236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:06.889216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c23c8-09a3-497c-88ba-878d07f956c5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:06.955712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:06.956557 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:06.956839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:06.957115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] PATH_INFO: `/v3/projects/41ea61afe615407c8558fd6e3d2e3b62` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:06.958374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ea61afe615407c8558fd6e3d2e3b62)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:06.960403 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.000606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:07.015461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ea61afe615407c8558fd6e3d2e3b62', 'request_id': 'req-3efb26c1-737e-4d6d-b648-bbbef29fb603'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:07.022915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ea61afe615407c8558fd6e3d2e3b62', 'request_id': 'req-3efb26c1-737e-4d6d-b648-bbbef29fb603'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:07.030400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ea61afe615407c8558fd6e3d2e3b62', 'request_id': 'req-3efb26c1-737e-4d6d-b648-bbbef29fb603'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:07.047122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] The token cache is being invalidate because project 41ea61afe615407c8558fd6e3d2e3b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:33:07.047436 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:07.048132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3efb26c1-737e-4d6d-b648-bbbef29fb603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:07.049766 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4405/8787] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:33:06 2022] DELETE /identity/v3/projects/41ea61afe615407c8558fd6e3d2e3b62 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:07.055655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6ba8-cfd0-4d60-b17d-42aebd3176d4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.056274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6ba8-cfd0-4d60-b17d-42aebd3176d4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.056482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6ba8-cfd0-4d60-b17d-42aebd3176d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.077468 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1c9d6ba8-cfd0-4d60-b17d-42aebd3176d4 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:07.078804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c9d6ba8-cfd0-4d60-b17d-42aebd3176d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:07.154181 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4383/8788] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:07.168713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9f9d-8bcc-4d31-b5d1-d2816c6077ca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.169196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9f9d-8bcc-4d31-b5d1-d2816c6077ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.169672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9f9d-8bcc-4d31-b5d1-d2816c6077ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.197729 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e10a9f9d-8bcc-4d31-b5d1-d2816c6077ca None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:07.198978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e10a9f9d-8bcc-4d31-b5d1-d2816c6077ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:07.208092 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4406/8789] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:07.212526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6ba8-cfd0-4d60-b17d-42aebd3176d4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:07.224050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6ba8-cfd0-4d60-b17d-42aebd3176d4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:07.229133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:07.230141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.230434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.230750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.231558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:33:07.231870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:07.233557 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.251437 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4384/8790] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:33:07.256278 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9f9d-8bcc-4d31-b5d1-d2816c6077ca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:07.267171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9f9d-8bcc-4d31-b5d1-d2816c6077ca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:07.272815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:07.273506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.273794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.274073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.274782 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:07.276826 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.308373 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4407/8791] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:33:07 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:33:07.312592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:07.323670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddb277-4d87-473e-804d-6071d000de4c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:07.394807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:07.395544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.395835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.396117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.396832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:07.398830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.422257 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4385/8792] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:33:07 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:33:07.427055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:07.438891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c454d61-7a8c-45a0-a040-b49e7248f878 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:07.443970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:07.444823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.445112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.445393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.446136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:07.447811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.461647 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4408/8793] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:33:07.465552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:07.476411 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b403a9-8289-41f9-8745-d5d956dc4a4f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:07.481278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234a31f-92ba-4e94-b933-a87202c8d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:07.481977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a31f-92ba-4e94-b933-a87202c8d6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.482263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a31f-92ba-4e94-b933-a87202c8d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.482568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a31f-92ba-4e94-b933-a87202c8d6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.483337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234a31f-92ba-4e94-b933-a87202c8d6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:07.484980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234a31f-92ba-4e94-b933-a87202c8d6d1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.496748 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4386/8794] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:33:07.501570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:07.513244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc769-dee2-4ccd-bd99-be0d1bde3872 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:07.518828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:07.519778 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.520062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.520341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] PATH_INFO: `/v3/projects/4165c8dc427140468645e52deac8d496/users/8bb893892edc491d9f3df8f82b3c9952/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.537489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4165c8dc427140468645e52deac8d496, user_id=8bb893892edc491d9f3df8f82b3c9952, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:07.540316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.555761 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4409/8795] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:33:07 2022] PUT /identity/v3/projects/4165c8dc427140468645e52deac8d496/users/8bb893892edc491d9f3df8f82b3c9952/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:07.561250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4de10-2dd9-4a3f-a3ae-81ad0a5d2d8c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.561549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4de10-2dd9-4a3f-a3ae-81ad0a5d2d8c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.561837 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4de10-2dd9-4a3f-a3ae-81ad0a5d2d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.569535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:07.582674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-62e4de10-2dd9-4a3f-a3ae-81ad0a5d2d8c None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:07.584388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-62e4de10-2dd9-4a3f-a3ae-81ad0a5d2d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:07.662893 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4387/8796] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:33:07.673751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:07.675732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:07.762838 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468be70-4706-44ca-aec7-fccc4100b60c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:07.767620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:07.768296 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:07.768585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:07.768867 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:07.778824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:07.780327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:07.791552 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4410/8797] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:12.557908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe470c1c-df54-45e0-ae04-3289e8cb213c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:12.557908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe470c1c-df54-45e0-ae04-3289e8cb213c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:12.557908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe470c1c-df54-45e0-ae04-3289e8cb213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:12.595717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fe470c1c-df54-45e0-ae04-3289e8cb213c None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:12.596991 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe470c1c-df54-45e0-ae04-3289e8cb213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:12.703332 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4388/8798] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:12.708078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:12.719388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42338ae-c888-427f-8abb-7fe05a6235ee service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:12.725050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:12.725751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:12.726040 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:12.726372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:12.727103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:12.729104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:12.767459 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4411/8799] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:33:12 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:33:12.774555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe470c1c-df54-45e0-ae04-3289e8cb213c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:12.790203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe470c1c-df54-45e0-ae04-3289e8cb213c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:12.882651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:12.883719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:12.884106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:12.884435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:12.885187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:12.888140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:12.916026 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4389/8800] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:33:12 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:33:12.921288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:12.938858 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8e696-122b-49cc-b06a-b5b7f152227f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:12.944134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:12.944981 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:12.945372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:12.945723 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:12.946541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:12.948304 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:12.960851 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4412/8801] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:33:12.965084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:12.976122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179f1d-c418-4fe3-84ef-4379434cb414 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:12.981105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:12.982022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:12.982312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:12.982596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] PATH_INFO: `/v3/projects/96f177aac80e4dcba26c0162efc50f2e/users/68ec8d957a404fe690136e973bdd1225/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:12.999599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f177aac80e4dcba26c0162efc50f2e, user_id=68ec8d957a404fe690136e973bdd1225, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:13.002906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:13.014391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:13.021578 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4390/8802] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:33:12 2022] PUT /identity/v3/projects/96f177aac80e4dcba26c0162efc50f2e/users/68ec8d957a404fe690136e973bdd1225/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:13.025565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:13.036951 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d4cc8-fe7e-4fe4-9a4a-e129f204911a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:13.046560 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:13.105094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951ad9c-96e6-4d5f-9edf-af6a35ee22d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:13.105803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ad9c-96e6-4d5f-9edf-af6a35ee22d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:13.106091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ad9c-96e6-4d5f-9edf-af6a35ee22d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:13.106533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ad9c-96e6-4d5f-9edf-af6a35ee22d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:13.107938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951ad9c-96e6-4d5f-9edf-af6a35ee22d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:13.109032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951ad9c-96e6-4d5f-9edf-af6a35ee22d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:13.121240 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4413/8803] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:33:13.127125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:13.138559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3745a5-80e4-49b3-b929-70905d3d41d3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:13.143600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:13.144533 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:13.144822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:13.145109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] PATH_INFO: `/v3/projects/96f177aac80e4dcba26c0162efc50f2e/users/68ec8d957a404fe690136e973bdd1225/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:13.147195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f177aac80e4dcba26c0162efc50f2e, user_id=68ec8d957a404fe690136e973bdd1225, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:13.150079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:13.162190 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4391/8804] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:33:13 2022] PUT /identity/v3/projects/96f177aac80e4dcba26c0162efc50f2e/users/68ec8d957a404fe690136e973bdd1225/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:18.059747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269092-9886-4803-8e92-df24900f8329 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:18.060219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269092-9886-4803-8e92-df24900f8329 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:18.060332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269092-9886-4803-8e92-df24900f8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:18.089059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-30269092-9886-4803-8e92-df24900f8329 None None] MFA Rules not processed for user `68ec8d957a404fe690136e973bdd1225`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:18.090307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30269092-9886-4803-8e92-df24900f8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:18.169114 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4414/8805] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:18.181953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:18.183938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:18.276254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aff99-97fe-4818-a578-f50a2c73056e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:18.280272 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93c2e-dfde-4488-a38e-516546bea9de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:18.280929 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93c2e-dfde-4488-a38e-516546bea9de service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:18.281216 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93c2e-dfde-4488-a38e-516546bea9de service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:18.281956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93c2e-dfde-4488-a38e-516546bea9de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:18.294544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c93c2e-dfde-4488-a38e-516546bea9de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:18.295892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c93c2e-dfde-4488-a38e-516546bea9de service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:18.306509 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4392/8806] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:18.391899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269092-9886-4803-8e92-df24900f8329 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:18.403002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269092-9886-4803-8e92-df24900f8329 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:18.406714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892e0f2-0e24-4c4f-8843-ecd75b661e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:18.407419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e0f2-0e24-4c4f-8843-ecd75b661e11 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:18.407710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e0f2-0e24-4c4f-8843-ecd75b661e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:18.407997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e0f2-0e24-4c4f-8843-ecd75b661e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:18.472195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e0f2-0e24-4c4f-8843-ecd75b661e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:18.473762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e0f2-0e24-4c4f-8843-ecd75b661e11 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:18.486268 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4415/8807] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:20.031680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cbbf5-c75f-4331-926a-99135a8d3d0c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:20.032274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cbbf5-c75f-4331-926a-99135a8d3d0c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:20.032274 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cbbf5-c75f-4331-926a-99135a8d3d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:20.053448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-366cbbf5-c75f-4331-926a-99135a8d3d0c None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:20.054691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-366cbbf5-c75f-4331-926a-99135a8d3d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:20.062030 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4393/8808] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:20.095108 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0bbf3-fd8d-4072-938e-58eaccc0fd43 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:20.095733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0bbf3-fd8d-4072-938e-58eaccc0fd43 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:20.095733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0bbf3-fd8d-4072-938e-58eaccc0fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:20.137802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-23d0bbf3-fd8d-4072-938e-58eaccc0fd43 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:20.139041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23d0bbf3-fd8d-4072-938e-58eaccc0fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:20.152840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:20.221644 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4416/8809] 10.222.0.98 () {58 vars in 1058 bytes} [Thu Jul 14 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:20.227675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b614-ef64-42d1-a5c9-98ebc56a26e6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:20.228200 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b614-ef64-42d1-a5c9-98ebc56a26e6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:20.228490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b614-ef64-42d1-a5c9-98ebc56a26e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:20.254101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9b03b614-ef64-42d1-a5c9-98ebc56a26e6 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:20.255359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b03b614-ef64-42d1-a5c9-98ebc56a26e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:20.264959 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4394/8810] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:20.278519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:20.278876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:20.279098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:20.299776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] MFA Rules not processed for user `3db64ff447674dd2a2f15b005696075b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:20.301004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:20.307857 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4417/8811] 10.222.0.98 () {58 vars in 1060 bytes} [Thu Jul 14 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:20.313932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03b614-ef64-42d1-a5c9-98ebc56a26e6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:20.324169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03b614-ef64-42d1-a5c9-98ebc56a26e6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:20.328047 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afdbe9-2065-4887-acf3-638fc54b06cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:20.328864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdbe9-2065-4887-acf3-638fc54b06cf service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:20.329250 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdbe9-2065-4887-acf3-638fc54b06cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:20.329657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdbe9-2065-4887-acf3-638fc54b06cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:20.341092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afdbe9-2065-4887-acf3-638fc54b06cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:20.342565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afdbe9-2065-4887-acf3-638fc54b06cf service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:20.354974 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4395/8812] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:20.587895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:20.589293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:20.649488 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c36a76-46b0-4338-a0ff-4d2e61d9aa1b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:20.653761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b38d5-3db3-42b2-992c-8e3e1a050f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:20.654430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b38d5-3db3-42b2-992c-8e3e1a050f83 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:20.654728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b38d5-3db3-42b2-992c-8e3e1a050f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:20.655001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b38d5-3db3-42b2-992c-8e3e1a050f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:20.657863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-397b38d5-3db3-42b2-992c-8e3e1a050f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:20.671358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b38d5-3db3-42b2-992c-8e3e1a050f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:20.672704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b38d5-3db3-42b2-992c-8e3e1a050f83 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:20.684174 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4418/8813] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:21.176713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4188dc-6d5b-4ebb-9e18-6c6b1a94d0c9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:21.177302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4188dc-6d5b-4ebb-9e18-6c6b1a94d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:21.177302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4188dc-6d5b-4ebb-9e18-6c6b1a94d0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:21.197875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a4188dc-6d5b-4ebb-9e18-6c6b1a94d0c9 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:21.199605 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a4188dc-6d5b-4ebb-9e18-6c6b1a94d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:21.215066 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4396/8814] 10.222.0.98 () {58 vars in 1058 bytes} [Thu Jul 14 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:21.216837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403c7b-c3ce-4941-9855-24639566fcae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:21.217325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403c7b-c3ce-4941-9855-24639566fcae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:21.217434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403c7b-c3ce-4941-9855-24639566fcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:21.250115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-93403c7b-c3ce-4941-9855-24639566fcae None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:21.252136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93403c7b-c3ce-4941-9855-24639566fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:21.268421 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4419/8815] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:21.279038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4188dc-6d5b-4ebb-9e18-6c6b1a94d0c9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:21.292821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4188dc-6d5b-4ebb-9e18-6c6b1a94d0c9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:21.297088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:21.298412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:21.298587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:21.299313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:21.310796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:21.312495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:21.325730 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4397/8816] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:24.330461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650512b4-1e49-4262-b49c-3b0629087b19 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:24.331468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650512b4-1e49-4262-b49c-3b0629087b19 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:24.332051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650512b4-1e49-4262-b49c-3b0629087b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:24.389589 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-650512b4-1e49-4262-b49c-3b0629087b19 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:24.391938 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-650512b4-1e49-4262-b49c-3b0629087b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:24.415706 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4420/8817] 10.222.0.110 () {58 vars in 1016 bytes} [Thu Jul 14 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:24.428328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:24.462555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724380-f944-462d-966c-38e0a82cdba2 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:24.466700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fae4a2-49ad-4919-a2bb-9e3c6383d430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:24.467427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae4a2-49ad-4919-a2bb-9e3c6383d430 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:24.467720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae4a2-49ad-4919-a2bb-9e3c6383d430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:24.468053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae4a2-49ad-4919-a2bb-9e3c6383d430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:24.479941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fae4a2-49ad-4919-a2bb-9e3c6383d430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:24.481281 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fae4a2-49ad-4919-a2bb-9e3c6383d430 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:24.491859 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4398/8818] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:34.410153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=68 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:34.487323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:37.899231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650512b4-1e49-4262-b49c-3b0629087b19 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:37.927359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650512b4-1e49-4262-b49c-3b0629087b19 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:37.934650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce211ce1-fa69-49e9-bffc-fba3443b0088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:37.934650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211ce1-fa69-49e9-bffc-fba3443b0088 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:37.934953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211ce1-fa69-49e9-bffc-fba3443b0088 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:37.935242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211ce1-fa69-49e9-bffc-fba3443b0088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:37.937237 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce211ce1-fa69-49e9-bffc-fba3443b0088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:37.955714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce211ce1-fa69-49e9-bffc-fba3443b0088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:37.957469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce211ce1-fa69-49e9-bffc-fba3443b0088 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:37.972770 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4421/8819] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:47.964266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:09.581732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f89f-04ae-4381-aea9-0ea1c65b0f71 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:09.582296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f89f-04ae-4381-aea9-0ea1c65b0f71 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:09.582423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f89f-04ae-4381-aea9-0ea1c65b0f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:09.601091 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1911f89f-04ae-4381-aea9-0ea1c65b0f71 None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:09.602345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1911f89f-04ae-4381-aea9-0ea1c65b0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:09.610162 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4399/8820] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:12.757452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf02886-2076-4349-9698-89e2df69c638 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:12.757992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf02886-2076-4349-9698-89e2df69c638 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:12.758191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf02886-2076-4349-9698-89e2df69c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:12.829104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3bf02886-2076-4349-9698-89e2df69c638 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:12.831663 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bf02886-2076-4349-9698-89e2df69c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:12.846893 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4422/8821] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:12.873811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f89f-04ae-4381-aea9-0ea1c65b0f71 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:12.896698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f89f-04ae-4381-aea9-0ea1c65b0f71 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:12.903896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:12.904868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:12.905854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:12.906310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:12.920084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:12.922734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:12.941525 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4400/8822] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:34:22.821837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:22.929808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:36.178776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74812c-f15a-445a-89e8-a7d4813aee2b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:36.179413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74812c-f15a-445a-89e8-a7d4813aee2b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:36.179413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74812c-f15a-445a-89e8-a7d4813aee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:36.200246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4b74812c-f15a-445a-89e8-a7d4813aee2b None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:36.201777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b74812c-f15a-445a-89e8-a7d4813aee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:36.211497 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4423/8823] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:34:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:36.228302 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:36.240278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07736cc-2f94-4159-9de0-c670690f5e5e service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:36.246221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:36.247182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:36.247509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:36.247831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:36.257870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:36.259378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:36.271656 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4401/8824] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:34:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:34:46.194380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:46.266547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:09.603051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070ec57-5094-49a4-bcf7-e682812820c7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:09.603689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070ec57-5094-49a4-bcf7-e682812820c7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:09.603689 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070ec57-5094-49a4-bcf7-e682812820c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:09.623038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f070ec57-5094-49a4-bcf7-e682812820c7 None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:09.624275 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f070ec57-5094-49a4-bcf7-e682812820c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:09.631207 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4424/8825] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:35:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:10.340762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:10.342412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:10.437942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26f8c0-e407-4c83-ace6-1cae56128aa5 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:10.443163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:10.443841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.444136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.444413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.446222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:10.457833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:10.459450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:10.469322 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4402/8826] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:19.617730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:20.465135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=41 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:28.919505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc8ad-352b-44cc-b6e8-50c814e25825 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:28.920122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc8ad-352b-44cc-b6e8-50c814e25825 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:28.920122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bc8ad-352b-44cc-b6e8-50c814e25825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:28.971917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0f2bc8ad-352b-44cc-b6e8-50c814e25825 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:28.973136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f2bc8ad-352b-44cc-b6e8-50c814e25825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:29.041262 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4425/8827] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:35:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:29.091706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:29.093162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:29.189593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b96dd-5999-4c6e-8590-883b326b4272 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:29.194753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161207f4-863e-4d0b-9af4-51ff61452136 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:29.195480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161207f4-863e-4d0b-9af4-51ff61452136 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.195862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161207f4-863e-4d0b-9af4-51ff61452136 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.196020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161207f4-863e-4d0b-9af4-51ff61452136 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.206782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161207f4-863e-4d0b-9af4-51ff61452136 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:29.208706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161207f4-863e-4d0b-9af4-51ff61452136 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:29.218794 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4403/8828] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:35:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:35:30.494068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e029a8-6334-43eb-a787-b19d69decf82 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.494573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e029a8-6334-43eb-a787-b19d69decf82 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.494694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e029a8-6334-43eb-a787-b19d69decf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.512290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-42e029a8-6334-43eb-a787-b19d69decf82 None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:30.513480 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-42e029a8-6334-43eb-a787-b19d69decf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:30.522010 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4426/8829] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:35:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:30.773130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3b3e-ad47-4e8f-8851-8a76b4158a5b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.773697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3b3e-ad47-4e8f-8851-8a76b4158a5b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.773697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3b3e-ad47-4e8f-8851-8a76b4158a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.806530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ebde3b3e-ad47-4e8f-8851-8a76b4158a5b None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:30.807768 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ebde3b3e-ad47-4e8f-8851-8a76b4158a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:30.814937 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4404/8830] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:35:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:30.826830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e029a8-6334-43eb-a787-b19d69decf82 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.837542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e029a8-6334-43eb-a787-b19d69decf82 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.841149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a33e35-e671-45f2-987f-503bf3ea8875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.841794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a33e35-e671-45f2-987f-503bf3ea8875 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.842083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a33e35-e671-45f2-987f-503bf3ea8875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.842366 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a33e35-e671-45f2-987f-503bf3ea8875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.849612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a33e35-e671-45f2-987f-503bf3ea8875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:30.851045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a33e35-e671-45f2-987f-503bf3ea8875 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:30.858854 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4427/8831] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:31.215655 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde3b3e-ad47-4e8f-8851-8a76b4158a5b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:31.228048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde3b3e-ad47-4e8f-8851-8a76b4158a5b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:31.233329 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.233992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.234279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.234560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.236914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:31.256143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.257957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:31.269164 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4405/8832] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:33.060335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622702-c8cc-4e6d-8968-b6151eac15f5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.061281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622702-c8cc-4e6d-8968-b6151eac15f5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.061784 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622702-c8cc-4e6d-8968-b6151eac15f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.087788 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ab622702-c8cc-4e6d-8968-b6151eac15f5 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:33.089651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab622702-c8cc-4e6d-8968-b6151eac15f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:33.100703 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4428/8833] 10.222.0.104 () {58 vars in 1016 bytes} [Thu Jul 14 15:35:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:33.113270 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.123862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f859d0-8c10-4799-afa8-170a6518c4cc service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.127805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.128668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.129057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.129438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.137953 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.139644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.148913 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4406/8834] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:33.841748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f3348-513b-4dba-9201-9b7493ad3626 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.842286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f3348-513b-4dba-9201-9b7493ad3626 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.842764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f3348-513b-4dba-9201-9b7493ad3626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.874735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c43f3348-513b-4dba-9201-9b7493ad3626 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:33.876631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c43f3348-513b-4dba-9201-9b7493ad3626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:33.888155 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4429/8835] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:35:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:33.902106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.920240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9476d5-9315-45ca-8d5b-3e2f85d7f5a3 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.928995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.931191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.931735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.932202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.946251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.948689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.976044 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4407/8836] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:43.867537 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=55 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:43.956864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=67 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:49.525348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3fcf-50f1-466c-867b-76ef40284c26 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.525810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3fcf-50f1-466c-867b-76ef40284c26 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.526188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3fcf-50f1-466c-867b-76ef40284c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.565113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-47eb3fcf-50f1-466c-867b-76ef40284c26 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:49.566316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47eb3fcf-50f1-466c-867b-76ef40284c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:49.575778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4430/8837] 10.222.0.98 () {58 vars in 1057 bytes} [Thu Jul 14 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:49.582595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.594082 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec7af-c739-426f-88bf-ff7628864f26 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.599996 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.600729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.601124 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.601461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.603396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:49.615938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.617580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.628143 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4408/8838] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:59.562750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.623791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.836463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c601f-ccfc-4371-97d2-a50e9fc74845 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.836990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c601f-ccfc-4371-97d2-a50e9fc74845 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.836990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c601f-ccfc-4371-97d2-a50e9fc74845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.854989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8d2c601f-ccfc-4371-97d2-a50e9fc74845 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:23.856251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d2c601f-ccfc-4371-97d2-a50e9fc74845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:23.871075 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4431/8839] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:36:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:23.883939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.895967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4cebd-6242-4086-b83f-40848e48e2bb service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.900938 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae314c-f37e-40e1-ade3-4ba0e2308bfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.901596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae314c-f37e-40e1-ade3-4ba0e2308bfd service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.901913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae314c-f37e-40e1-ade3-4ba0e2308bfd service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.902193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae314c-f37e-40e1-ade3-4ba0e2308bfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.911367 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae314c-f37e-40e1-ade3-4ba0e2308bfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.913029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae314c-f37e-40e1-ade3-4ba0e2308bfd service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.922052 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4409/8840] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:33.865339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:33.918455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.758774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20a61-56c9-445b-ac23-fef9636a5240 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.759353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20a61-56c9-445b-ac23-fef9636a5240 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.759353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20a61-56c9-445b-ac23-fef9636a5240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.778065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e1c20a61-56c9-445b-ac23-fef9636a5240 None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:41.779350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1c20a61-56c9-445b-ac23-fef9636a5240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:41.786242 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4432/8841] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:36:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:42.092414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4b92f-cd73-467a-8129-a7e4f7018d0c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:42.093076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4b92f-cd73-467a-8129-a7e4f7018d0c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:42.093076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4b92f-cd73-467a-8129-a7e4f7018d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:42.111853 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-58d4b92f-cd73-467a-8129-a7e4f7018d0c None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:42.113054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-58d4b92f-cd73-467a-8129-a7e4f7018d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:42.119687 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4410/8842] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:36:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:42.132674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c20a61-56c9-445b-ac23-fef9636a5240 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:42.143815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c20a61-56c9-445b-ac23-fef9636a5240 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:42.147888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:42.148562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:42.148871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:42.149171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:42.156870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:42.158376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:42.166926 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4433/8843] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:36:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:43.078061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4b92f-cd73-467a-8129-a7e4f7018d0c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:43.090486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4b92f-cd73-467a-8129-a7e4f7018d0c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:43.096202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:43.096944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:43.097238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:43.097544 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:43.099368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:43.111642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:43.113306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:43.123193 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4411/8844] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:36:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:52.163158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:53.119137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:58.495717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:58.509423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87389103-db61-47a0-b3de-b120cdb42b54 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:58.515978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:58.515978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:58.515978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:58.515978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:58.526264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:58.527895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:58.537803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4434/8845] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:58.729776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:58.740518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d86d7d-89b3-4926-8e44-fab6dbf4a5bb service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:58.744277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112982c-a862-46b2-a99f-0bce76adf711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:58.744977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112982c-a862-46b2-a99f-0bce76adf711 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:58.745264 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112982c-a862-46b2-a99f-0bce76adf711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:58.745545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112982c-a862-46b2-a99f-0bce76adf711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:58.757889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112982c-a862-46b2-a99f-0bce76adf711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:58.759376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112982c-a862-46b2-a99f-0bce76adf711 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:58.771018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4412/8846] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:59.958213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:59.968156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c14c7-aef6-4c76-be52-8f6a386fc2b1 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:59.972944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:59.973606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:59.973922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:59.974196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:59.985705 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:59.987171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.000248 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4435/8847] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:06.746984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870093-0a9c-49bc-b27c-dadf287b0560 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.747498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870093-0a9c-49bc-b27c-dadf287b0560 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.747625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870093-0a9c-49bc-b27c-dadf287b0560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.766034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-73870093-0a9c-49bc-b27c-dadf287b0560 None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:06.767241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-73870093-0a9c-49bc-b27c-dadf287b0560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:06.774333 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4413/8848] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:09.458813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:09.474438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1bd7-238e-47f8-9b7e-a95778c414ea service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:09.478684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:09.479408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:09.479673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:09.480133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:09.489170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:09.490864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:09.501888 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4436/8849] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:16.760368 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:19.497073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=18 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:26.123062 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870093-0a9c-49bc-b27c-dadf287b0560 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:26.133782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870093-0a9c-49bc-b27c-dadf287b0560 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:26.137450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4912b7-2baf-4e63-b87c-9bef0041266c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:26.138131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4912b7-2baf-4e63-b87c-9bef0041266c service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:26.138419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4912b7-2baf-4e63-b87c-9bef0041266c service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:26.138701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4912b7-2baf-4e63-b87c-9bef0041266c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:26.148569 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4912b7-2baf-4e63-b87c-9bef0041266c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:26.150011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4912b7-2baf-4e63-b87c-9bef0041266c service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:26.159874 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4414/8850] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:36.155437 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:54.551986 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:54.618975 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68a94-fb72-42a3-b3e0-ce909936af5f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:54.626777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:54.627668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:54.628036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:54.628370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:54.639611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:54.641929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:54.653822 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4437/8851] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:04.650213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=17 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:09.146691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde25f7e-6012-4067-b009-733c9961e77d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:09.147221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde25f7e-6012-4067-b009-733c9961e77d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:09.147347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde25f7e-6012-4067-b009-733c9961e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:09.165994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dde25f7e-6012-4067-b009-733c9961e77d None None] MFA Rules not processed for user `8bb893892edc491d9f3df8f82b3c9952`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:09.167240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dde25f7e-6012-4067-b009-733c9961e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:09.175147 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4415/8852] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:10.033121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.044908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88c51-f7ee-4df5-93d8-359ac4dfd34c service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.050202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.050871 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.051160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.051566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.061136 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.062757 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.075551 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4438/8853] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:11.921356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde25f7e-6012-4067-b009-733c9961e77d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:11.932440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde25f7e-6012-4067-b009-733c9961e77d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:11.944378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:11.945252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:11.945638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:11.946019 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:11.956185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:11.957812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:11.968741 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4416/8854] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:12.738674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:12.766875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1165f1d-d9de-4bf3-b762-50fca6a8ab12 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:12.774813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:12.775852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:12.776171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:12.776458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:12.794203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:12.796357 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:12.812071 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4439/8855] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:21.963760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:22.803639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:26.200157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:26.216886 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6f02-ae8a-4da0-91bd-6a7bca6cc4db service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:26.222670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:26.223369 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:26.223663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:26.223950 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:26.234186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:26.235889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:26.257826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4417/8856] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:36.242653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:53.268745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:53.279909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2f47-db7c-42f5-9417-d129ce296d84 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:53.285230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:53.285875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:53.286158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:53.286439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:53.294956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:53.296691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:53.306556 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4440/8857] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:03.302459 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:11.646944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:11.669350 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6af60-3f95-4bac-96b9-d650d32db7e5 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:11.676930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9e352-03db-48bf-8e7a-88ea329777bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:11.677609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e352-03db-48bf-8e7a-88ea329777bd service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:11.677900 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e352-03db-48bf-8e7a-88ea329777bd service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:11.678181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e352-03db-48bf-8e7a-88ea329777bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:11.688029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9e352-03db-48bf-8e7a-88ea329777bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:11.689692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9e352-03db-48bf-8e7a-88ea329777bd service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:11.701344 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4418/8858] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:21.696547 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:35.836791 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:35.838494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:35.936974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81473c9-3abf-4156-9f3d-6b8194529e0f service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:35.942418 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:35.943100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:35.943407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:35.943684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:35.945829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:36.039834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.041249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.060827 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4441/8859] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:38.920586 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d859fb-3f31-4f1c-ad11-422df92193f5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.921069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d859fb-3f31-4f1c-ad11-422df92193f5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.921210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d859fb-3f31-4f1c-ad11-422df92193f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.964868 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e7d859fb-3f31-4f1c-ad11-422df92193f5 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:38.966114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e7d859fb-3f31-4f1c-ad11-422df92193f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:38.977001 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4419/8860] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:38.989968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:39.016665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454db300-5d65-44dc-b22f-249c4140f0b6 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:39.022320 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:39.023000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:39.023321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:39.023614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:39.039544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:39.041177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:39.055293 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4442/8861] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:42.167968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:42.168522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:42.168611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:42.193888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:42.196267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:42.211728 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4420/8862] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:42.226213 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:42.238651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e612c1-b8fc-49f2-9b8c-8acd5d22b3ff service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:42.243735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:42.243735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:42.244308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:42.244971 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:42.245255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:42.245535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:42.255528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:42.257143 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:42.258085 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1135-de9e-4284-a6c1-d608d1127dbe None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:42.262979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:42.267398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:42.267398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:42.267398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] PATH_INFO: `/v3/users/8bb893892edc491d9f3df8f82b3c9952` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:42.270099 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4443/8863] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:42.285718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb893892edc491d9f3df8f82b3c9952)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:42.287800 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:42.335733 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb893892edc491d9f3df8f82b3c9952'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.348133 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb893892edc491d9f3df8f82b3c9952'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.348815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb893892edc491d9f3df8f82b3c9952'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.355906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb893892edc491d9f3df8f82b3c9952'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.356587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb893892edc491d9f3df8f82b3c9952'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.369820 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4421/8864] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:43:42 2022] DELETE /identity/v3/users/8bb893892edc491d9f3df8f82b3c9952 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:42.559874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:42.578343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b432f-6aa7-4aeb-a8c3-7b206cc4c49b service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:42.599899 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:42.645140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:42.646019 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:42.646301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:42.646584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] PATH_INFO: `/v3/projects/4165c8dc427140468645e52deac8d496` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:42.657180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4165c8dc427140468645e52deac8d496)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:42.659477 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:42.705930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4165c8dc427140468645e52deac8d496', 'request_id': 'req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.711412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4165c8dc427140468645e52deac8d496', 'request_id': 'req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.718298 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4165c8dc427140468645e52deac8d496', 'request_id': 'req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.730665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] The token cache is being invalidate because project 4165c8dc427140468645e52deac8d496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:42.730957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.731581 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.733140 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4444/8865] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:43:42 2022] DELETE /identity/v3/projects/4165c8dc427140468645e52deac8d496 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:42.737651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:42.739056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:42.752717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41f057-3ef7-473f-9819-327987f03612 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:42.809069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:42.809957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:42.810246 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:42.810529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] PATH_INFO: `/v3/users/68ec8d957a404fe690136e973bdd1225` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:42.824913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ec8d957a404fe690136e973bdd1225)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:42.826882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:42.860591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:42.877445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ec8d957a404fe690136e973bdd1225'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.890861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ec8d957a404fe690136e973bdd1225'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.891611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ec8d957a404fe690136e973bdd1225'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.898939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ec8d957a404fe690136e973bdd1225'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.899598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-71806662-459b-4b4f-a36e-913b03900a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ec8d957a404fe690136e973bdd1225'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:42.912952 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4422/8866] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:43:42 2022] DELETE /identity/v3/users/68ec8d957a404fe690136e973bdd1225 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:43.094660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:43.096624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:43.115105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60efdd4-c8ee-4468-b35e-8c40915ca7ed admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:43.175294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:43.176187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:43.176471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:43.176752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] PATH_INFO: `/v3/projects/96f177aac80e4dcba26c0162efc50f2e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:43.187314 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f177aac80e4dcba26c0162efc50f2e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:43.189235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:43.226876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:43.238246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f177aac80e4dcba26c0162efc50f2e', 'request_id': 'req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:43.244166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f177aac80e4dcba26c0162efc50f2e', 'request_id': 'req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:43.251155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f177aac80e4dcba26c0162efc50f2e', 'request_id': 'req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:43.263567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] The token cache is being invalidate because project 96f177aac80e4dcba26c0162efc50f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:43.263859 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:43.264501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3a93e75c-e8e0-427c-82b6-adb13cbc5fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:43.266148 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4445/8867] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:43:43 2022] DELETE /identity/v3/projects/96f177aac80e4dcba26c0162efc50f2e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:52.909259 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=18,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:52.937492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53038c7e-13b0-4f9f-9669-a175d922903a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:52.937862 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53038c7e-13b0-4f9f-9669-a175d922903a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:52.938068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53038c7e-13b0-4f9f-9669-a175d922903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:52.985064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-53038c7e-13b0-4f9f-9669-a175d922903a None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:52.986271 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-53038c7e-13b0-4f9f-9669-a175d922903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:53.044664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4423/8868] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:53.054087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900371d-728d-438b-b5f3-fda19c51c1ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.054594 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900371d-728d-438b-b5f3-fda19c51c1ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.054690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900371d-728d-438b-b5f3-fda19c51c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.073632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d900371d-728d-438b-b5f3-fda19c51c1ad None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:53.074946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d900371d-728d-438b-b5f3-fda19c51c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:53.084086 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4446/8869] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:53.088817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53038c7e-13b0-4f9f-9669-a175d922903a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.103550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53038c7e-13b0-4f9f-9669-a175d922903a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.108405 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.109071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.109359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.109638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.110360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:53.111306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.113109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.125018 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4424/8870] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:53.139158 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900371d-728d-438b-b5f3-fda19c51c1ad None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.149114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900371d-728d-438b-b5f3-fda19c51c1ad None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.153922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.154583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.154870 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.155152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.155921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.158508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.194090 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4447/8871] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:43:53 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:53.198356 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.209174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8114-a10b-4243-a22f-8ea9a306cd0c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.265972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.266653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.267465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.267749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.268491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.270449 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.294287 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4425/8872] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:43:53 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:53.295447 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.305886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f49c7-4438-4265-b9da-26e80756168d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.310835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.311550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.311823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.312117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.313062 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.314517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.324717 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4448/8873] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:53.328666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.339149 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c03a-f4a4-4721-b7a5-476fa2985753 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.344161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00332f-c4d9-419e-af7e-473880d26c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.344834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00332f-c4d9-419e-af7e-473880d26c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.345737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00332f-c4d9-419e-af7e-473880d26c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.346021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00332f-c4d9-419e-af7e-473880d26c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.346745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00332f-c4d9-419e-af7e-473880d26c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.348395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00332f-c4d9-419e-af7e-473880d26c40 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.358445 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4426/8874] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:53.362736 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.373141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6026-2645-4257-ad59-62782c48eebf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.377940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.378820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.379098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.379419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] PATH_INFO: `/v3/projects/5df07bd7198c479ca95b593f2a44ca80/users/2becebb58dc94c19ad687577b7a1ec9a/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.395299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df07bd7198c479ca95b593f2a44ca80, user_id=2becebb58dc94c19ad687577b7a1ec9a, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.397988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.412397 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4449/8875] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:43:53 2022] PUT /identity/v3/projects/5df07bd7198c479ca95b593f2a44ca80/users/2becebb58dc94c19ad687577b7a1ec9a/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:53.425550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ccfc9-b852-4a3a-b9d4-aea81d37456a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.425920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ccfc9-b852-4a3a-b9d4-aea81d37456a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.426251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ccfc9-b852-4a3a-b9d4-aea81d37456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.452889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4e2ccfc9-b852-4a3a-b9d4-aea81d37456a None None] MFA Rules not processed for user `2becebb58dc94c19ad687577b7a1ec9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:53.454098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e2ccfc9-b852-4a3a-b9d4-aea81d37456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:53.487888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:53.522515 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4427/8876] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:53.527021 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.589179 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fca34-f80c-43ce-80c0-4f4aafa74340 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.594130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.594815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.595627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.595913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.596628 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.598559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.625031 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4450/8877] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:43:53 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:53.630257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ccfc9-b852-4a3a-b9d4-aea81d37456a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.641353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ccfc9-b852-4a3a-b9d4-aea81d37456a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.717627 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.718317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.718607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.718892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.719648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.722118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.742465 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4428/8878] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:43:53 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:53.746412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.757225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9049ec-d410-417a-91ef-4f09f35f6af9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.761939 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.762600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.762966 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.763250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.764012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.765620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.776936 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4451/8879] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:53.781088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.791566 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f1dd-9784-4060-bc01-114138c5a8fc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.796176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.797056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.797344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.797625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] PATH_INFO: `/v3/projects/9ece3acc922146e197d68067a104d363/users/2ab88548976946e8850cd556c3a5cb94/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.812570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ece3acc922146e197d68067a104d363, user_id=2ab88548976946e8850cd556c3a5cb94, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.815776 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.828620 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4429/8880] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:43:53 2022] PUT /identity/v3/projects/9ece3acc922146e197d68067a104d363/users/2ab88548976946e8850cd556c3a5cb94/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:53.833244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.843208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50237-0775-4b78-bb8d-55199a3087cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.867609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:53.902129 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba56b4-3ebe-49bd-942d-ebea5877a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.902880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba56b4-3ebe-49bd-942d-ebea5877a52a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.903166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba56b4-3ebe-49bd-942d-ebea5877a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.903478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba56b4-3ebe-49bd-942d-ebea5877a52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.904201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba56b4-3ebe-49bd-942d-ebea5877a52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.905807 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba56b4-3ebe-49bd-942d-ebea5877a52a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.916260 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4452/8881] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:53.920521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.930990 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb947-52fa-4e20-b259-85b4abe198ae admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.935787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c3023-0aef-4e8b-b1ef-68b3e19ec58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.936707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3023-0aef-4e8b-b1ef-68b3e19ec58f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.936994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3023-0aef-4e8b-b1ef-68b3e19ec58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.937278 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3023-0aef-4e8b-b1ef-68b3e19ec58f admin admin] PATH_INFO: `/v3/projects/9ece3acc922146e197d68067a104d363/users/2ab88548976946e8850cd556c3a5cb94/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.939258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c3023-0aef-4e8b-b1ef-68b3e19ec58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ece3acc922146e197d68067a104d363, user_id=2ab88548976946e8850cd556c3a5cb94, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.941961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c3023-0aef-4e8b-b1ef-68b3e19ec58f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.952684 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4430/8882] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:43:53 2022] PUT /identity/v3/projects/9ece3acc922146e197d68067a104d363/users/2ab88548976946e8850cd556c3a5cb94/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:53.963363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.963666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.963957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.992353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] MFA Rules not processed for user `2ab88548976946e8850cd556c3a5cb94`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:53.993535 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.061493 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4453/8883] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:54.073592 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:54.073887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:54.074168 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:54.092674 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] MFA Rules not processed for user `2becebb58dc94c19ad687577b7a1ec9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:54.093952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.151229 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4431/8884] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:54.167238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:54.169145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.266226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea909a-0193-4d13-92d3-8b85c1ea483c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:54.273246 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:54.273903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:54.274188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:54.274471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:54.282610 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:54.284579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:54.293815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4454/8885] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:54.757182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:54.758726 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.796659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:54.836296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326f4d-759b-4301-a4e5-b65fee14b42b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:54.841219 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:54.841881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:54.842490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:54.842778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:54.844584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.856059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:54.857654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:54.868254 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4432/8886] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:59.508754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.510378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.525974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:59.575837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa529-1f99-4f7a-aec5-da6a13609355 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.580155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.580825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.581107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.581382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.583141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.597261 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.598713 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.612726 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4455/8887] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:00.789238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.790752 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.803590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34239-2c25-487b-ab19-86d5699df58b service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.807616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b109e76-bc1a-4639-bfa0-494bbf694aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.808310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109e76-bc1a-4639-bfa0-494bbf694aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.808602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109e76-bc1a-4639-bfa0-494bbf694aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.808951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109e76-bc1a-4639-bfa0-494bbf694aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.810912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0b109e76-bc1a-4639-bfa0-494bbf694aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.825241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b109e76-bc1a-4639-bfa0-494bbf694aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.826696 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b109e76-bc1a-4639-bfa0-494bbf694aaa service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.838550 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4433/8888] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:05.944315 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.955448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99568c26-81d6-4e55-b9fd-fa75fb72802c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.960970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.961607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.961896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.962171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.970647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.972251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.981944 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4456/8889] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:05.996042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff285-e31c-405c-8b04-21c9e5f3502e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.996490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff285-e31c-405c-8b04-21c9e5f3502e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.996614 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff285-e31c-405c-8b04-21c9e5f3502e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.998012 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4434/8890] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:44:06.003441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 15:44:06.015881 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:06.024629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c68f4-0afd-4221-a918-13ba3a88f85c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:06.029518 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02775121-e20b-4655-9191-5f190aa34e9b tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab88548976946e8850cd556c3a5cb94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ece3acc922146e197d68067a104d363', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:06.030377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775121-e20b-4655-9191-5f190aa34e9b tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:06.030666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775121-e20b-4655-9191-5f190aa34e9b tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:06.030946 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775121-e20b-4655-9191-5f190aa34e9b tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] PATH_INFO: `/v3/projects/9ece3acc922146e197d68067a104d363` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:06.032189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02775121-e20b-4655-9191-5f190aa34e9b tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] RBAC: Authorizing `identity:get_project(project_id=9ece3acc922146e197d68067a104d363)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:06.034233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02775121-e20b-4655-9191-5f190aa34e9b tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:06.035985 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4457/8891] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 15:44:06 2022] GET /identity/v3/projects/9ece3acc922146e197d68067a104d363 => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:06.186099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff285-e31c-405c-8b04-21c9e5f3502e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:06.198024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff285-e31c-405c-8b04-21c9e5f3502e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:06.203418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:06.204064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:06.204354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:06.204671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:06.206454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:06.216914 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:06.218355 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:06.226867 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4435/8892] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:06.395795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a477042-4a93-4448-b7ee-b0de807fd074 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:06.396109 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a477042-4a93-4448-b7ee-b0de807fd074 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:06.396393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a477042-4a93-4448-b7ee-b0de807fd074 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:06.397795 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4458/8893] 10.222.0.98 () {54 vars in 912 bytes} [Thu Jul 14 15:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:44:06.402461 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] Authenticating service token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 14 15:44:06.403907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:06.420863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:06.430901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c62e-cc0d-41a8-923b-d32f873e1967 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:06.435652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab88548976946e8850cd556c3a5cb94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ece3acc922146e197d68067a104d363', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:06.436720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:06.436952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:06.437235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] PATH_INFO: `/v3/projects/9ece3acc922146e197d68067a104d363` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:06.438427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] RBAC: Authorizing `identity:get_project(project_id=9ece3acc922146e197d68067a104d363)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:06.440297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:06.442021 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4436/8894] 10.222.0.98 () {58 vars in 1443 bytes} [Thu Jul 14 15:44:06 2022] GET /identity/v3/projects/9ece3acc922146e197d68067a104d363 => generated 393 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:06.596622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a477042-4a93-4448-b7ee-b0de807fd074 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:06.608114 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a477042-4a93-4448-b7ee-b0de807fd074 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:06.611751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71c8f-38a3-413d-92a3-04ae2907d92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:06.612426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71c8f-38a3-413d-92a3-04ae2907d92d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:06.612716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71c8f-38a3-413d-92a3-04ae2907d92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:06.612995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71c8f-38a3-413d-92a3-04ae2907d92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:06.614747 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ac71c8f-38a3-413d-92a3-04ae2907d92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:06.624479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71c8f-38a3-413d-92a3-04ae2907d92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:06.625924 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71c8f-38a3-413d-92a3-04ae2907d92d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:06.633903 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4459/8895] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:10.384078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.447779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5aae59-9963-4871-b05c-ad08a5b29b62 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.452429 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.453303 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.453587 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.453864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] PATH_INFO: `/v3/users/2becebb58dc94c19ad687577b7a1ec9a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.455665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2becebb58dc94c19ad687577b7a1ec9a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.457609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.504349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2becebb58dc94c19ad687577b7a1ec9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.516387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2becebb58dc94c19ad687577b7a1ec9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.517065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2becebb58dc94c19ad687577b7a1ec9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.524877 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2becebb58dc94c19ad687577b7a1ec9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.525465 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2becebb58dc94c19ad687577b7a1ec9a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.539782 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4437/8896] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:44:10 2022] DELETE /identity/v3/users/2becebb58dc94c19ad687577b7a1ec9a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:10.544930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.545552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.545772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.563389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:10.564591 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.626673 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4460/8897] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:10.636288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.637787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.644784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:10.699053 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e66de-5fc2-4b49-9051-a6228135baa1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.702789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.703499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.703816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.704095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.714621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.716115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.726721 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4438/8898] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:10.899804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.901245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.913631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa377c60-2fe8-4ed9-bbe3-4d1888fbe7f8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.918448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.919355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.919645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.919925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] PATH_INFO: `/v3/projects/5df07bd7198c479ca95b593f2a44ca80` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.921306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df07bd7198c479ca95b593f2a44ca80)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.923230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.973613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df07bd7198c479ca95b593f2a44ca80', 'request_id': 'req-e2adbf63-a849-4b9b-8835-cc5b013adcd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.979264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df07bd7198c479ca95b593f2a44ca80', 'request_id': 'req-e2adbf63-a849-4b9b-8835-cc5b013adcd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.985561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df07bd7198c479ca95b593f2a44ca80', 'request_id': 'req-e2adbf63-a849-4b9b-8835-cc5b013adcd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.998079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] The token cache is being invalidate because project 5df07bd7198c479ca95b593f2a44ca80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:10.998370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.999005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.000589 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4461/8899] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:44:10 2022] DELETE /identity/v3/projects/5df07bd7198c479ca95b593f2a44ca80 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:11.005339 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.015102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba093b-6897-4b64-9a95-395e1b9cb49e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.072921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.073722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.074011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.074296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] PATH_INFO: `/v3/users/2ab88548976946e8850cd556c3a5cb94` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.075532 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab88548976946e8850cd556c3a5cb94)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.077476 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.130741 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab88548976946e8850cd556c3a5cb94'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.145712 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab88548976946e8850cd556c3a5cb94'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.146431 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab88548976946e8850cd556c3a5cb94'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.153736 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab88548976946e8850cd556c3a5cb94'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.154390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-83e328c4-5936-480c-9492-c412f987efcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab88548976946e8850cd556c3a5cb94'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.167735 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4439/8900] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:44:11 2022] DELETE /identity/v3/users/2ab88548976946e8850cd556c3a5cb94 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:11.444600 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.446502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:11.456479 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:11.461165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adbf63-a849-4b9b-8835-cc5b013adcd6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.532313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.533964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.534250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.534531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] PATH_INFO: `/v3/projects/9ece3acc922146e197d68067a104d363` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.535759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ece3acc922146e197d68067a104d363)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.537681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.583653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ece3acc922146e197d68067a104d363', 'request_id': 'req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.589267 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ece3acc922146e197d68067a104d363', 'request_id': 'req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.596209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ece3acc922146e197d68067a104d363', 'request_id': 'req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.609932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] The token cache is being invalidate because project 9ece3acc922146e197d68067a104d363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:11.610276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.611544 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-77d21097-7f10-49a2-a4a9-3961d9c7e0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:11.613146 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4462/8901] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:44:11 2022] DELETE /identity/v3/projects/9ece3acc922146e197d68067a104d363 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:11.619090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151575a0-73d1-4923-8a47-9a62d6e0b4b2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.619583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151575a0-73d1-4923-8a47-9a62d6e0b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.619715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151575a0-73d1-4923-8a47-9a62d6e0b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.637872 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-151575a0-73d1-4923-8a47-9a62d6e0b4b2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:11.639076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-151575a0-73d1-4923-8a47-9a62d6e0b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:11.660582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:11.708561 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4440/8902] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:11.716910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015638c-3055-40ed-ac4a-fc1ccda1831e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.717203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015638c-3055-40ed-ac4a-fc1ccda1831e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.717489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015638c-3055-40ed-ac4a-fc1ccda1831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.737306 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5015638c-3055-40ed-ac4a-fc1ccda1831e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:11.738503 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5015638c-3055-40ed-ac4a-fc1ccda1831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:11.746686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4463/8903] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:11.750915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151575a0-73d1-4923-8a47-9a62d6e0b4b2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.760906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151575a0-73d1-4923-8a47-9a62d6e0b4b2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.765943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.766620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.766915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.767236 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.768015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:11.768500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.769917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.781723 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4441/8904] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:11.786802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015638c-3055-40ed-ac4a-fc1ccda1831e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.796199 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015638c-3055-40ed-ac4a-fc1ccda1831e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.801536 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.802229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.802520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.803478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.804170 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.806112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.836774 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4464/8905] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:11.840908 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.852354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a542e-d8c4-4455-b487-ca95399cfffb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.910891 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.911591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.911881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.912163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.912866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.914820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.935013 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4442/8906] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:11.939197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.950350 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a73e-f2a8-445c-8ca9-69b599617fcb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.955096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.955812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.956105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.956391 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.957123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.958742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.969938 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4465/8907] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:11.974255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.984500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6e6a5-59fb-478c-8a17-17da534a11a1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.989700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c688cc3-236f-4dc8-9095-06e54ca51d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.990361 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688cc3-236f-4dc8-9095-06e54ca51d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.990651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688cc3-236f-4dc8-9095-06e54ca51d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.990935 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688cc3-236f-4dc8-9095-06e54ca51d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.991701 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c688cc3-236f-4dc8-9095-06e54ca51d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.993307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c688cc3-236f-4dc8-9095-06e54ca51d5d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:12.005866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4443/8908] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:12.010004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:12.020471 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009aac2-934d-4422-9cd1-fde8efdc4f27 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:12.025203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:12.026085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:12.026370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:12.026651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] PATH_INFO: `/v3/projects/cbf3c5a4b2854ac98f3f67ce72a1cdfc/users/62f485345ff14d08b2f7c3608f5b83b1/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:12.042686 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf3c5a4b2854ac98f3f67ce72a1cdfc, user_id=62f485345ff14d08b2f7c3608f5b83b1, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:12.045364 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:12.058726 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4466/8909] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:44:12 2022] PUT /identity/v3/projects/cbf3c5a4b2854ac98f3f67ce72a1cdfc/users/62f485345ff14d08b2f7c3608f5b83b1/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:12.064613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f490dbe-c7d9-4b69-bbdc-ae9cad192e7e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:12.064910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f490dbe-c7d9-4b69-bbdc-ae9cad192e7e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:12.065192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f490dbe-c7d9-4b69-bbdc-ae9cad192e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:12.082668 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8f490dbe-c7d9-4b69-bbdc-ae9cad192e7e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:12.083961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8f490dbe-c7d9-4b69-bbdc-ae9cad192e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:12.149376 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4444/8910] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:12.159483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:12.161219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:12.198287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:12.225165 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a640-9494-42d6-91c0-ab0c84ec015f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:12.228916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb596b3-77c6-4a46-92d2-2348a96b1c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:12.229574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb596b3-77c6-4a46-92d2-2348a96b1c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:12.229863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb596b3-77c6-4a46-92d2-2348a96b1c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:12.230210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb596b3-77c6-4a46-92d2-2348a96b1c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:12.240042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb596b3-77c6-4a46-92d2-2348a96b1c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:12.241511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb596b3-77c6-4a46-92d2-2348a96b1c1a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:12.251801 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4467/8911] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:16.029241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:16.029774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:16.029774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:16.063570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] MFA Rules not processed for user `62f485345ff14d08b2f7c3608f5b83b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:16.065454 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:16.086894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:16.136157 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4445/8912] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:16.149254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9590d9-46aa-4385-ad4d-87a86c6d1a50 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:16.149750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9590d9-46aa-4385-ad4d-87a86c6d1a50 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:16.149845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9590d9-46aa-4385-ad4d-87a86c6d1a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:16.168266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f9590d9-46aa-4385-ad4d-87a86c6d1a50 None None] MFA Rules not processed for user `62f485345ff14d08b2f7c3608f5b83b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:16.169313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f9590d9-46aa-4385-ad4d-87a86c6d1a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:16.180947 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4468/8913] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:16.191493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:16.193054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:16.272932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0d26-3244-4ba3-aa94-6be5894429e2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:16.279337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c6dea-663a-4ce2-bd39-504e06882301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:16.280007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6dea-663a-4ce2-bd39-504e06882301 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:16.280295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6dea-663a-4ce2-bd39-504e06882301 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:16.280583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6dea-663a-4ce2-bd39-504e06882301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:16.289231 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c6dea-663a-4ce2-bd39-504e06882301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:16.290836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c6dea-663a-4ce2-bd39-504e06882301 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:16.300270 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4446/8914] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:18.746806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9590d9-46aa-4385-ad4d-87a86c6d1a50 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:18.758440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9590d9-46aa-4385-ad4d-87a86c6d1a50 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:18.763046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:18.764412 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:18.764911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:18.765410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:18.769007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:18.785495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:18.788590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:18.802085 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4469/8915] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:26.295874 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=51 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:28.106010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cdaa-f174-4a02-bcf7-ff01f05c7a17 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.106631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cdaa-f174-4a02-bcf7-ff01f05c7a17 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.106631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cdaa-f174-4a02-bcf7-ff01f05c7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.155972 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1483cdaa-f174-4a02-bcf7-ff01f05c7a17 None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:28.157295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1483cdaa-f174-4a02-bcf7-ff01f05c7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:28.164267 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4447/8916] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:28.176908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:28.185915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fd705-ecb7-4653-a453-7541347a6483 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:28.192965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0bad7-748c-40e1-917b-db60006eeda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:28.193625 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bad7-748c-40e1-917b-db60006eeda2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.193914 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bad7-748c-40e1-917b-db60006eeda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.194197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bad7-748c-40e1-917b-db60006eeda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.201957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0bad7-748c-40e1-917b-db60006eeda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:28.203449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0bad7-748c-40e1-917b-db60006eeda2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:28.212134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4470/8917] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:28.302907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e864-e5c5-435c-bf26-52bf50aa6ad5 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.303181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e864-e5c5-435c-bf26-52bf50aa6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.303493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e864-e5c5-435c-bf26-52bf50aa6ad5 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.304875 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4448/8918] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:44:28.309646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38a993-e5b7-4ff0-96d2-5649db5c14fa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.309937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38a993-e5b7-4ff0-96d2-5649db5c14fa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.310253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38a993-e5b7-4ff0-96d2-5649db5c14fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.329865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cc38a993-e5b7-4ff0-96d2-5649db5c14fa None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:28.331009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc38a993-e5b7-4ff0-96d2-5649db5c14fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:28.394622 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4471/8919] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:28.415406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e864-e5c5-435c-bf26-52bf50aa6ad5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:28.417093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-06c3e864-e5c5-435c-bf26-52bf50aa6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:28.434580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e864-e5c5-435c-bf26-52bf50aa6ad5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:28.440191 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:28.440834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.441118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.441398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.449817 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:28.451443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:28.461275 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4449/8920] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:28.628373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38a993-e5b7-4ff0-96d2-5649db5c14fa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:28.638149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38a993-e5b7-4ff0-96d2-5649db5c14fa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:28.642063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:28.642750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.643050 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.643363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.645234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:28.661900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:28.663397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:28.677920 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4472/8921] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:38.457151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=19 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:38.669761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=62 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:08.281787 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:08.292889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd59f4d-b7ef-4f67-bcb4-abbec8c6295f service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:08.297534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:08.298415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:08.298706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:08.298989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] PATH_INFO: `/v3/users/62f485345ff14d08b2f7c3608f5b83b1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:08.300214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f485345ff14d08b2f7c3608f5b83b1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:08.302157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:08.350890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f485345ff14d08b2f7c3608f5b83b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.362609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f485345ff14d08b2f7c3608f5b83b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.363313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f485345ff14d08b2f7c3608f5b83b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.370137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f485345ff14d08b2f7c3608f5b83b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.370765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-77f85bb9-5958-41c0-bfaf-2b6b2a15a041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f485345ff14d08b2f7c3608f5b83b1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.387999 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4450/8922] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:45:08 2022] DELETE /identity/v3/users/62f485345ff14d08b2f7c3608f5b83b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:45:08.570127 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:08.588995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b81af5-b701-42a3-b68e-4a3ed163e92f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:08.658878 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:08.659799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:08.660089 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:08.660371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] PATH_INFO: `/v3/projects/cbf3c5a4b2854ac98f3f67ce72a1cdfc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:08.661570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf3c5a4b2854ac98f3f67ce72a1cdfc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:08.663559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:08.715186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'request_id': 'req-4949a787-c6ae-4c23-b355-7a3e11b027fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.720345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'request_id': 'req-4949a787-c6ae-4c23-b355-7a3e11b027fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.726872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'request_id': 'req-4949a787-c6ae-4c23-b355-7a3e11b027fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.739960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] The token cache is being invalidate because project cbf3c5a4b2854ac98f3f67ce72a1cdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:45:08.740249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.740879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4949a787-c6ae-4c23-b355-7a3e11b027fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:08.742458 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4473/8923] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:45:08 2022] DELETE /identity/v3/projects/cbf3c5a4b2854ac98f3f67ce72a1cdfc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:08.747658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741615e-6a7e-4bc7-9b82-d584c8008890 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:08.748025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741615e-6a7e-4bc7-9b82-d584c8008890 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:08.748235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741615e-6a7e-4bc7-9b82-d584c8008890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:08.767550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7741615e-6a7e-4bc7-9b82-d584c8008890 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:08.768784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7741615e-6a7e-4bc7-9b82-d584c8008890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:08.828709 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4451/8924] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:08.836909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14ce1-d84a-48f7-becd-d8bb5b7a5ff7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:08.837204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14ce1-d84a-48f7-becd-d8bb5b7a5ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:08.837520 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14ce1-d84a-48f7-becd-d8bb5b7a5ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:08.857132 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46b14ce1-d84a-48f7-becd-d8bb5b7a5ff7 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:08.858342 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46b14ce1-d84a-48f7-becd-d8bb5b7a5ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:08.866906 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4474/8925] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:08.871392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741615e-6a7e-4bc7-9b82-d584c8008890 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:08.882299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741615e-6a7e-4bc7-9b82-d584c8008890 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:08.887032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:08.887727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:08.888016 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:08.888296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:08.889032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:45:08.889335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:08.890987 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:08.902657 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4452/8926] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:45:08.907120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b14ce1-d84a-48f7-becd-d8bb5b7a5ff7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:08.916901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b14ce1-d84a-48f7-becd-d8bb5b7a5ff7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:08.922209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:08.922860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:08.923147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:08.923462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:08.924147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:08.926052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:08.952047 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4475/8927] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:45:08 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:45:08.956152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:08.967322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb177b-d0d7-4397-85cd-feeeddacce22 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:09.026209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:09.026937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:09.027221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:09.027541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:09.028248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:09.030188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:09.037141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:09.055655 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4453/8928] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:45:08 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:45:09.056814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:09.068236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc470-e649-413f-bf8d-8cb35c1e6e8b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:09.072952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:09.073617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:09.073911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:09.074195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:09.074930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:09.076578 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:09.087390 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4476/8929] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:45:09.091434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:09.101682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6757279-8d36-43c9-b451-36036af6212d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:09.106493 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995c0d-ae98-4a7c-bcde-084374069a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:09.107158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995c0d-ae98-4a7c-bcde-084374069a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:09.107482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995c0d-ae98-4a7c-bcde-084374069a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:09.107770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995c0d-ae98-4a7c-bcde-084374069a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:09.108534 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2995c0d-ae98-4a7c-bcde-084374069a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:09.110738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2995c0d-ae98-4a7c-bcde-084374069a9c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:09.120987 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4454/8930] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:45:09.125968 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:09.136182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a077-58b5-47b0-8d0c-6ef8bfeac27b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:09.141118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:09.142002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:09.142288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:09.142568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] PATH_INFO: `/v3/projects/62c35510a0b94cabbf1faee3ff23a7e2/users/cfc469baf90a43a8b1b47725a2199444/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:09.157420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c35510a0b94cabbf1faee3ff23a7e2, user_id=cfc469baf90a43a8b1b47725a2199444, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:09.160331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:09.176783 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4477/8931] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:45:09 2022] PUT /identity/v3/projects/62c35510a0b94cabbf1faee3ff23a7e2/users/cfc469baf90a43a8b1b47725a2199444/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:09.181869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfc1a-7de9-4fdc-a0d7-69383268a0e1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:09.182161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfc1a-7de9-4fdc-a0d7-69383268a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:09.182446 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfc1a-7de9-4fdc-a0d7-69383268a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:09.200563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3afdfc1a-7de9-4fdc-a0d7-69383268a0e1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:09.201758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3afdfc1a-7de9-4fdc-a0d7-69383268a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:09.260374 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4455/8932] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:09.270434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:09.272191 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:09.304094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:09.332745 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ca74-e95b-4533-b7b2-117d5558933a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:09.336513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8203f-5d5f-4e31-a6f6-8cd0eeea7c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:09.337253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8203f-5d5f-4e31-a6f6-8cd0eeea7c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:09.337549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8203f-5d5f-4e31-a6f6-8cd0eeea7c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:09.337835 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8203f-5d5f-4e31-a6f6-8cd0eeea7c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:09.347499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8203f-5d5f-4e31-a6f6-8cd0eeea7c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:09.348947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8203f-5d5f-4e31-a6f6-8cd0eeea7c39 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:09.359142 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4478/8933] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:13.186131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:13.186642 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:13.186734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:13.215260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] MFA Rules not processed for user `cfc469baf90a43a8b1b47725a2199444`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:13.216541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:13.297861 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4456/8934] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:13.308629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69faa-bc5c-4f22-9dc8-97faa37fc850 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:13.309139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69faa-bc5c-4f22-9dc8-97faa37fc850 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:13.309236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69faa-bc5c-4f22-9dc8-97faa37fc850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:13.327506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f2a69faa-bc5c-4f22-9dc8-97faa37fc850 None None] MFA Rules not processed for user `cfc469baf90a43a8b1b47725a2199444`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:13.329273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2a69faa-bc5c-4f22-9dc8-97faa37fc850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:13.336657 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4479/8935] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:13.349419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:13.350849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:13.429553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c272-b73e-4617-bd20-5894e7b3b14c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:13.435384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd41d-bfd5-4489-80c1-b4a1005d4c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:13.436068 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd41d-bfd5-4489-80c1-b4a1005d4c1f service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:13.436359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd41d-bfd5-4489-80c1-b4a1005d4c1f service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:13.436643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd41d-bfd5-4489-80c1-b4a1005d4c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:13.441781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:13.447729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd41d-bfd5-4489-80c1-b4a1005d4c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:13.449641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd41d-bfd5-4489-80c1-b4a1005d4c1f service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:13.460254 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4457/8936] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:23.321829 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=17 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:23.455797 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:24.686131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a4d7f-a328-4a69-a6ce-00d7e93497a4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:24.686692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a4d7f-a328-4a69-a6ce-00d7e93497a4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:24.686692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a4d7f-a328-4a69-a6ce-00d7e93497a4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:24.688139 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4480/8937] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:45:24.693766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a98ff-9f95-4e40-8286-3734cd56f844 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:24.694244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a98ff-9f95-4e40-8286-3734cd56f844 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:24.694811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a98ff-9f95-4e40-8286-3734cd56f844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:24.731389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c67a98ff-9f95-4e40-8286-3734cd56f844 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:24.731389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c67a98ff-9f95-4e40-8286-3734cd56f844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:24.803769 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4458/8938] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:45:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:24.824765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a4d7f-a328-4a69-a6ce-00d7e93497a4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:24.826460 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c2a4d7f-a328-4a69-a6ce-00d7e93497a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:24.843499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a4d7f-a328-4a69-a6ce-00d7e93497a4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:24.849393 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432dcc0-dd0f-4218-9eae-c1610c51ce2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:24.850048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432dcc0-dd0f-4218-9eae-c1610c51ce2f service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:24.850334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432dcc0-dd0f-4218-9eae-c1610c51ce2f service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:24.850645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432dcc0-dd0f-4218-9eae-c1610c51ce2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:24.859583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432dcc0-dd0f-4218-9eae-c1610c51ce2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:24.861853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432dcc0-dd0f-4218-9eae-c1610c51ce2f service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:24.871963 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4481/8939] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:45:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:34.800769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=38 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:34.867389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:58.577033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a98ff-9f95-4e40-8286-3734cd56f844 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:58.587482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a98ff-9f95-4e40-8286-3734cd56f844 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:58.592670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9fe39-7053-452c-8021-d3cb27f30c8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:58.593398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9fe39-7053-452c-8021-d3cb27f30c8a service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:58.593613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9fe39-7053-452c-8021-d3cb27f30c8a service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:58.593893 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9fe39-7053-452c-8021-d3cb27f30c8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:58.595735 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a8f9fe39-7053-452c-8021-d3cb27f30c8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:58.607822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9fe39-7053-452c-8021-d3cb27f30c8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:58.609469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9fe39-7053-452c-8021-d3cb27f30c8a service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:58.620602 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4459/8940] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:46:02.975519 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac1ed-5b9f-4fa1-9815-2914adc26d33 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:02.976099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac1ed-5b9f-4fa1-9815-2914adc26d33 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:02.976277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac1ed-5b9f-4fa1-9815-2914adc26d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:02.997161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ee0ac1ed-5b9f-4fa1-9815-2914adc26d33 None None] MFA Rules not processed for user `cfc469baf90a43a8b1b47725a2199444`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:46:02.998382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ee0ac1ed-5b9f-4fa1-9815-2914adc26d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:03.006103 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4482/8941] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:46:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:46:08.616015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:12.991953 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:14.539427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bae8-c285-4852-abcd-0319a1fd4379 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:14.540067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bae8-c285-4852-abcd-0319a1fd4379 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:14.540067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bae8-c285-4852-abcd-0319a1fd4379 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:14.541660 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4460/8942] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:46:14.546716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:14.547245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:14.547517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:14.585749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:46:14.586970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:14.595972 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4483/8943] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:46:14.617884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7bae8-c285-4852-abcd-0319a1fd4379 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:14.619692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f2d7bae8-c285-4852-abcd-0319a1fd4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:14.636654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7bae8-c285-4852-abcd-0319a1fd4379 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:14.641651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:14.642298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:14.642584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:14.642866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:14.651930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:14.653531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:14.664240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4461/8944] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:46:24.582954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:24.660524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:43.439524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:43.441623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:43.466691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df00a3f-4450-42e0-a737-c09cb7816905 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:43.470329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:43.470994 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:43.471336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:43.471622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:43.473358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:43.482727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:43.484208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:43.492672 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4484/8945] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:46:49.767306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:49.790114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a8f6e-bbf9-459f-b68a-cf41c0b04b0d service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:49.796204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:49.796883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:49.797173 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:49.797458 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:49.799383 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:49.814330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:49.816602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:49.832643 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4462/8946] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:46:53.154799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:53.170543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b277a5-2e8b-40c6-81e8-fe25ebf64093 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:53.176561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:53.177232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:53.177528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:53.177817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:53.179688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:53.192866 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:53.194500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:53.205778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4485/8947] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:46:57.754930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:57.766205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8e546-b91e-4c58-857a-88d48ff8861d service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:57.771018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:57.771885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:57.772176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:57.772475 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] PATH_INFO: `/v3/users/cfc469baf90a43a8b1b47725a2199444` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:57.773658 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc469baf90a43a8b1b47725a2199444)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:57.775654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:57.822870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc469baf90a43a8b1b47725a2199444'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:57.835238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc469baf90a43a8b1b47725a2199444'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:57.835968 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc469baf90a43a8b1b47725a2199444'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:57.843376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc469baf90a43a8b1b47725a2199444'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:57.844022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-37185616-8088-469e-afa5-0de2687376c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc469baf90a43a8b1b47725a2199444'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:57.858054 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4463/8948] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:46:57 2022] DELETE /identity/v3/users/cfc469baf90a43a8b1b47725a2199444 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:46:58.037432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.048820 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab823ad1-fc7a-4915-be50-f16d3fcc9bb7 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.114928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.115852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.116139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.116424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] PATH_INFO: `/v3/projects/62c35510a0b94cabbf1faee3ff23a7e2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.117654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c35510a0b94cabbf1faee3ff23a7e2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.119629 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.169917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c35510a0b94cabbf1faee3ff23a7e2', 'request_id': 'req-b8652726-3f45-4419-b6f6-79ae46fbc7e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:58.176023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c35510a0b94cabbf1faee3ff23a7e2', 'request_id': 'req-b8652726-3f45-4419-b6f6-79ae46fbc7e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:58.182654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c35510a0b94cabbf1faee3ff23a7e2', 'request_id': 'req-b8652726-3f45-4419-b6f6-79ae46fbc7e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:58.197069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] The token cache is being invalidate because project 62c35510a0b94cabbf1faee3ff23a7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:46:58.197343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:58.197989 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8652726-3f45-4419-b6f6-79ae46fbc7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:46:58.199599 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4486/8949] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:46:58 2022] DELETE /identity/v3/projects/62c35510a0b94cabbf1faee3ff23a7e2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:46:58.205143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f6dce-c6c6-4562-a0de-862a6b5e1416 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.205455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f6dce-c6c6-4562-a0de-862a6b5e1416 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.205737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f6dce-c6c6-4562-a0de-862a6b5e1416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.226326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-553f6dce-c6c6-4562-a0de-862a6b5e1416 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:46:58.227820 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-553f6dce-c6c6-4562-a0de-862a6b5e1416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:58.292006 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4464/8950] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:46:58.300060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cccf0-41e0-40c6-857a-3077913b261d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.300355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cccf0-41e0-40c6-857a-3077913b261d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.300638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cccf0-41e0-40c6-857a-3077913b261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.319233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cc3cccf0-41e0-40c6-857a-3077913b261d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:46:58.320487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc3cccf0-41e0-40c6-857a-3077913b261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:58.328613 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4487/8951] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:46:58.333638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f6dce-c6c6-4562-a0de-862a6b5e1416 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.343919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f6dce-c6c6-4562-a0de-862a6b5e1416 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.349388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.350061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.350348 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.350633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.351467 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:46:58.351775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.353399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.365453 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4465/8952] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:46:58.370122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cccf0-41e0-40c6-857a-3077913b261d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.379852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cccf0-41e0-40c6-857a-3077913b261d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.384834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.385506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.385812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.386098 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.386800 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.388828 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.416963 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4488/8953] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:46:58 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:46:58.421209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.432332 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9604-b329-4406-bc77-aa757e273ca5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.471722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:58.495025 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.495747 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.496056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.496337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.497028 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.499003 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.520503 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4466/8954] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:46:58 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:46:58.525176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.536941 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85a4e-d509-4f7b-addb-300c18e93544 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.541940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.542668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.542904 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.543187 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.543980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.545592 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.556804 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4489/8955] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:46:58.560901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.572139 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5e3a0-6224-408f-af71-16f77633d142 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.577814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad84e-8c63-4786-85c6-2923f7fa8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.578406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad84e-8c63-4786-85c6-2923f7fa8820 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.578686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad84e-8c63-4786-85c6-2923f7fa8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.578969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad84e-8c63-4786-85c6-2923f7fa8820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.579743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad84e-8c63-4786-85c6-2923f7fa8820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.582004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad84e-8c63-4786-85c6-2923f7fa8820 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.593849 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4467/8956] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:46:58.598204 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.608699 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43703527-5003-4517-9586-2b6d9f343a11 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.614220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.615210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.615606 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.615965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] PATH_INFO: `/v3/projects/a15e337c6f4c4e1aac98b22bce2555a2/users/29448f858ed24113b4e90ff1bf3f2b1e/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.628796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:58.634985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15e337c6f4c4e1aac98b22bce2555a2, user_id=29448f858ed24113b4e90ff1bf3f2b1e, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.637932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.653934 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4490/8957] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:46:58 2022] PUT /identity/v3/projects/a15e337c6f4c4e1aac98b22bce2555a2/users/29448f858ed24113b4e90ff1bf3f2b1e/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:46:58.659291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf99a4-ec9d-4f12-84ee-58c9865231c0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.659600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf99a4-ec9d-4f12-84ee-58c9865231c0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.659925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf99a4-ec9d-4f12-84ee-58c9865231c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.679247 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-46bf99a4-ec9d-4f12-84ee-58c9865231c0 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:46:58.680641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-46bf99a4-ec9d-4f12-84ee-58c9865231c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:58.742329 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4468/8958] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:46:58.752182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:58.754450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:58.813983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e586-7460-4653-9e3c-ffdc0609499d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:58.818241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:58.818896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:58.819319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:58.819505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:58.829131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:58.830580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:58.841363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4491/8959] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:47:03.166665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a785e-db90-4c0f-91fe-32d495065922 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:03.167229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a785e-db90-4c0f-91fe-32d495065922 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:03.167471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a785e-db90-4c0f-91fe-32d495065922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:03.197904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ce5a785e-db90-4c0f-91fe-32d495065922 None None] MFA Rules not processed for user `29448f858ed24113b4e90ff1bf3f2b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:03.199357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ce5a785e-db90-4c0f-91fe-32d495065922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:03.274003 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4469/8960] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:47:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:03.288710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:03.290354 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:03.380197 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbbca-c041-4317-8c2d-6b2a3b32f495 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:03.388850 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:03.389549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:03.389931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:03.390153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:03.402210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:03.403992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:03.414762 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4492/8961] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:04.918044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:04.918542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:04.918666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:04.936854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] MFA Rules not processed for user `29448f858ed24113b4e90ff1bf3f2b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:04.938152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:04.946394 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4470/8962] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:05.676761 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:05.680593 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:05.768268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b55d-ec94-4816-9ccc-d3faad5a8def service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:05.774450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36522-cf06-42f9-8f30-447b87b10362 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:05.775068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36522-cf06-42f9-8f30-447b87b10362 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:05.775554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36522-cf06-42f9-8f30-447b87b10362 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:05.775666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36522-cf06-42f9-8f30-447b87b10362 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:05.777507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35c36522-cf06-42f9-8f30-447b87b10362 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:05.792515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36522-cf06-42f9-8f30-447b87b10362 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:05.794153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36522-cf06-42f9-8f30-447b87b10362 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:05.806269 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4493/8963] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:08.441631 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:08.444162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:08.480671 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c174ee7-5027-4934-88cf-210d54b9cc56 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:08.487174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9554b-cd02-412a-870c-8e6545bd0921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:08.488424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9554b-cd02-412a-870c-8e6545bd0921 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:08.489351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9554b-cd02-412a-870c-8e6545bd0921 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:08.489634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9554b-cd02-412a-870c-8e6545bd0921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:08.491722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9f9554b-cd02-412a-870c-8e6545bd0921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:08.508543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9554b-cd02-412a-870c-8e6545bd0921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:08.510504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9554b-cd02-412a-870c-8e6545bd0921 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:08.526692 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4471/8964] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:15.801014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:18.519040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.981725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cb149-e4dc-4699-86a1-0ad6cf8c933c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:51.982322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cb149-e4dc-4699-86a1-0ad6cf8c933c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:51.982322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cb149-e4dc-4699-86a1-0ad6cf8c933c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:51.983707 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4494/8965] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:47:51.988633 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592826ad-587b-471f-8e89-5ce645c11299 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:51.989095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592826ad-587b-471f-8e89-5ce645c11299 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:51.989317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592826ad-587b-471f-8e89-5ce645c11299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:52.009029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-592826ad-587b-471f-8e89-5ce645c11299 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:52.010152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-592826ad-587b-471f-8e89-5ce645c11299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:52.019184 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4472/8966] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:52.040813 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cb149-e4dc-4699-86a1-0ad6cf8c933c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:52.042534 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-311cb149-e4dc-4699-86a1-0ad6cf8c933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:52.060958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cb149-e4dc-4699-86a1-0ad6cf8c933c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:52.066562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:52.067242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:52.067569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:52.067855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:52.077442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:52.079052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:52.089463 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4495/8967] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:52.250951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbb94f-7907-4334-a440-e8b630e62257 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:52.251295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbb94f-7907-4334-a440-e8b630e62257 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:52.251574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbb94f-7907-4334-a440-e8b630e62257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:52.291659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2fbbb94f-7907-4334-a440-e8b630e62257 None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:52.292905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2fbbb94f-7907-4334-a440-e8b630e62257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:52.302622 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4473/8968] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:52.312874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:52.314358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:52.326868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e44cd-636d-4fba-9473-fc29308fa336 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:52.330552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54ed44-dd80-4b2f-995c-91845a99e14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:52.331212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ed44-dd80-4b2f-995c-91845a99e14c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:52.331530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ed44-dd80-4b2f-995c-91845a99e14c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:52.331799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ed44-dd80-4b2f-995c-91845a99e14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:52.343622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54ed44-dd80-4b2f-995c-91845a99e14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:52.345083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54ed44-dd80-4b2f-995c-91845a99e14c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:52.358468 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4496/8969] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:02.288666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=12 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:02.352643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:11.453238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbb94f-7907-4334-a440-e8b630e62257 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:11.465915 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbb94f-7907-4334-a440-e8b630e62257 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:11.471656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:11.472326 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:11.473543 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:11.474021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:11.478463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:11.497210 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:11.499453 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:11.519328 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4474/8970] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:48:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:20.185026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0ca6-36da-497d-b260-386c30375eb8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:20.185563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0ca6-36da-497d-b260-386c30375eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:20.185742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0ca6-36da-497d-b260-386c30375eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:20.205508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1e5a0ca6-36da-497d-b260-386c30375eb8 None None] MFA Rules not processed for user `29448f858ed24113b4e90ff1bf3f2b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:20.206708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e5a0ca6-36da-497d-b260-386c30375eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:20.214106 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4497/8971] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:48:21.513814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:30.200573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.773596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:06.783632 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5b0b-03eb-4819-b7f4-e020f501f750 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:06.787912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ded0-e7e9-47fa-a3bf-bbfe5c484381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:06.788573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ded0-e7e9-47fa-a3bf-bbfe5c484381 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:06.788857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ded0-e7e9-47fa-a3bf-bbfe5c484381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:06.789142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ded0-e7e9-47fa-a3bf-bbfe5c484381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:06.791261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dc70ded0-e7e9-47fa-a3bf-bbfe5c484381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:06.805290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ded0-e7e9-47fa-a3bf-bbfe5c484381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:06.806743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ded0-e7e9-47fa-a3bf-bbfe5c484381 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:06.820399 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4475/8972] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:08.005346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a0ca6-36da-497d-b260-386c30375eb8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:08.015490 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a0ca6-36da-497d-b260-386c30375eb8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:08.019131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6459ae-394d-4a86-995b-b6ff6ef3c8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:08.019874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6459ae-394d-4a86-995b-b6ff6ef3c8ac service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:08.020161 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6459ae-394d-4a86-995b-b6ff6ef3c8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:08.020439 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6459ae-394d-4a86-995b-b6ff6ef3c8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:08.022232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c6459ae-394d-4a86-995b-b6ff6ef3c8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:08.035767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6459ae-394d-4a86-995b-b6ff6ef3c8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:08.037684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6459ae-394d-4a86-995b-b6ff6ef3c8ac service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:08.048385 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4498/8973] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:16.813386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:18.043772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:23.643571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24f30-9fca-4c4a-bc3d-2575551d5977 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.644174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24f30-9fca-4c4a-bc3d-2575551d5977 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.644174 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24f30-9fca-4c4a-bc3d-2575551d5977 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.645553 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4476/8974] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:49:23.651203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d12a-b43b-4d62-b9be-6467823328c3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.651718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d12a-b43b-4d62-b9be-6467823328c3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.651827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d12a-b43b-4d62-b9be-6467823328c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.671122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-38a3d12a-b43b-4d62-b9be-6467823328c3 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:23.672371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38a3d12a-b43b-4d62-b9be-6467823328c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:23.681343 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4499/8975] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:23.703799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d24f30-9fca-4c4a-bc3d-2575551d5977 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:23.718552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d24f30-9fca-4c4a-bc3d-2575551d5977 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:23.723717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:23.724373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.724664 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.724955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.733897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:23.735542 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:23.745357 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4477/8976] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:23.959253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d12a-b43b-4d62-b9be-6467823328c3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:23.970763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d12a-b43b-4d62-b9be-6467823328c3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:23.977285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e467e-1eca-4bb6-85e0-1d0709807a4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:23.978087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e467e-1eca-4bb6-85e0-1d0709807a4c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.978409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e467e-1eca-4bb6-85e0-1d0709807a4c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.978660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e467e-1eca-4bb6-85e0-1d0709807a4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.980692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f79e467e-1eca-4bb6-85e0-1d0709807a4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:23.992907 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e467e-1eca-4bb6-85e0-1d0709807a4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:23.994565 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e467e-1eca-4bb6-85e0-1d0709807a4c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:24.004967 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4500/8977] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:27.950751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:27.960477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3f936-04f9-4a53-9f62-5d4eda2a5441 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:27.964142 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:27.964816 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:27.965106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:27.965388 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:27.967145 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:27.977111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:27.978626 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:27.986795 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4478/8978] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:34.000510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:37.983718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=12 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:40.044851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d8d3-fef6-4672-ab5f-a86afa500351 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:40.045318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d8d3-fef6-4672-ab5f-a86afa500351 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:40.045421 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d8d3-fef6-4672-ab5f-a86afa500351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:40.063220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52d4d8d3-fef6-4672-ab5f-a86afa500351 None None] MFA Rules not processed for user `29448f858ed24113b4e90ff1bf3f2b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:40.064400 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52d4d8d3-fef6-4672-ab5f-a86afa500351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:40.071474 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4501/8979] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:49:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:40.378791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:40.387808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b97fc4-1d1f-4541-ab14-17e3983acdb4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:40.391483 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd831087-dcf9-479a-b466-b8a24212f3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:40.392131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831087-dcf9-479a-b466-b8a24212f3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:40.392425 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831087-dcf9-479a-b466-b8a24212f3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:40.392710 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831087-dcf9-479a-b466-b8a24212f3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:40.394482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cd831087-dcf9-479a-b466-b8a24212f3a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:40.405677 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831087-dcf9-479a-b466-b8a24212f3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:40.407064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831087-dcf9-479a-b466-b8a24212f3a1 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:40.415664 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4479/8980] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:50.058063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:50.411558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.408230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4d8d3-fef6-4672-ab5f-a86afa500351 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:26.419002 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4d8d3-fef6-4672-ab5f-a86afa500351 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:26.422876 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee7911-23ef-4a0e-9735-f9c32a9f7d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:26.423897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7911-23ef-4a0e-9735-f9c32a9f7d0f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:26.424192 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7911-23ef-4a0e-9735-f9c32a9f7d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:26.424478 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7911-23ef-4a0e-9735-f9c32a9f7d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:26.426380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-efee7911-23ef-4a0e-9735-f9c32a9f7d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:26.436584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee7911-23ef-4a0e-9735-f9c32a9f7d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:26.438174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee7911-23ef-4a0e-9735-f9c32a9f7d0f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:26.447216 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4502/8981] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:50:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:26.526519 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201c89-fc11-4bb7-b80c-d1ea66854907 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:26.527015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201c89-fc11-4bb7-b80c-d1ea66854907 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:26.527108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201c89-fc11-4bb7-b80c-d1ea66854907 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:26.528498 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4480/8982] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:50:26.535243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3050ef9-e137-4c23-9bac-2a2df361f9ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:26.535570 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3050ef9-e137-4c23-9bac-2a2df361f9ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:26.535885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3050ef9-e137-4c23-9bac-2a2df361f9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:26.554351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3050ef9-e137-4c23-9bac-2a2df361f9ad None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:26.555676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3050ef9-e137-4c23-9bac-2a2df361f9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:26.565553 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4503/8983] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:50:26.587261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d201c89-fc11-4bb7-b80c-d1ea66854907 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:26.601509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d201c89-fc11-4bb7-b80c-d1ea66854907 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:26.606620 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:26.607291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:26.607613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:26.607897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:26.616767 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:26.618399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:26.628170 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4481/8984] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:50:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:36.549142 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:36.624098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:00.621139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382081-3ae4-48b2-8caa-8b91ba22ca15 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:51:00.622220 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382081-3ae4-48b2-8caa-8b91ba22ca15 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:51:00.622317 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382081-3ae4-48b2-8caa-8b91ba22ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:51:00.641302 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-72382081-3ae4-48b2-8caa-8b91ba22ca15 None None] MFA Rules not processed for user `29448f858ed24113b4e90ff1bf3f2b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:51:00.642546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72382081-3ae4-48b2-8caa-8b91ba22ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:51:00.670116 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4504/8985] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:51:00.990490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:51:01.004209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91113c7-eb3e-4782-b13b-6b7a50110423 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:51:01.007798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e35bd-4a70-4ea6-8b42-de3163701794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:51:01.008441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e35bd-4a70-4ea6-8b42-de3163701794 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:51:01.008728 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e35bd-4a70-4ea6-8b42-de3163701794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:51:01.009007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e35bd-4a70-4ea6-8b42-de3163701794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:51:01.010762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-884e35bd-4a70-4ea6-8b42-de3163701794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:51:01.020354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e35bd-4a70-4ea6-8b42-de3163701794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:51:01.021785 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e35bd-4a70-4ea6-8b42-de3163701794 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:51:01.030199 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4482/8986] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:51:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:51:01.810336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382081-3ae4-48b2-8caa-8b91ba22ca15 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:51:01.829695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382081-3ae4-48b2-8caa-8b91ba22ca15 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:51:01.834743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ff32-7ede-4f6c-bd6d-7457db0edb8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:51:01.835428 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ff32-7ede-4f6c-bd6d-7457db0edb8e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:51:01.835714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ff32-7ede-4f6c-bd6d-7457db0edb8e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:51:01.835993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ff32-7ede-4f6c-bd6d-7457db0edb8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:51:01.837732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6588ff32-7ede-4f6c-bd6d-7457db0edb8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:51:01.849648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ff32-7ede-4f6c-bd6d-7457db0edb8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:51:01.851234 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ff32-7ede-4f6c-bd6d-7457db0edb8e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:51:01.861450 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4505/8987] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:51:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:51:11.026346 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:11.856872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=20 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:01.889298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4eac1-5a4e-49ba-a6c4-1b1a83a3ad59 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:01.890351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4eac1-5a4e-49ba-a6c4-1b1a83a3ad59 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:01.890451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4eac1-5a4e-49ba-a6c4-1b1a83a3ad59 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:01.891860 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4483/8988] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 15:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:52:01.896803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba3c5-a032-4a1b-9751-22d550e88285 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:01.897269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba3c5-a032-4a1b-9751-22d550e88285 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:01.897380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba3c5-a032-4a1b-9751-22d550e88285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:01.917965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fedba3c5-a032-4a1b-9751-22d550e88285 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:52:01.920087 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fedba3c5-a032-4a1b-9751-22d550e88285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:01.929642 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4506/8989] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 15:52:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:52:01.950321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4eac1-5a4e-49ba-a6c4-1b1a83a3ad59 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:01.964238 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4eac1-5a4e-49ba-a6c4-1b1a83a3ad59 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:01.969207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:01.969852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:01.970141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:01.970426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:01.980252 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:01.981849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:01.992260 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4484/8990] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:52:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:02.239303 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba3c5-a032-4a1b-9751-22d550e88285 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:02.252282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba3c5-a032-4a1b-9751-22d550e88285 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:02.259287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:02.259988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:02.260229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:02.260513 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:02.262467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:02.277374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:02.279262 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:02.291375 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4507/8991] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:52:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:03.067530 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:03.078114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec20b2-21a0-4f3c-9104-e192a9058c52 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:03.082049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:03.082698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:03.082985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:03.083300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:03.092666 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:03.094105 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:03.103838 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4485/8992] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 15:52:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:52:12.286264 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:13.099172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=12 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:18.133325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:18.144378 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551c9f2-0554-48a1-9c8d-febfa44a712f service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:18.148079 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:18.148731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:18.149024 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:18.149307 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:18.151083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:18.161547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:18.162982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:18.171302 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4508/8993] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:52:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:28.167575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:35.269213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:35.282799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268b70-3ba9-4702-9af5-d46435105685 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:35.289073 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:35.289802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:35.290125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:35.290439 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:35.292402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:35.306265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:35.307936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:35.319207 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4486/8994] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:38.744273 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:38.758840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b31f1-1416-4d8b-b62a-1bb52dfb049d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:38.764450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:38.765112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:38.765399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:38.765680 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:38.775554 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:38.777145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:38.789134 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4509/8995] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:52:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:45.314279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:48.784504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:05.145146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:05.154629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807f6ad-8030-4211-a2a6-af280736e646 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:05.158659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:05.159321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:05.159608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:05.159889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:05.168851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:05.170290 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:05.180490 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4487/8996] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:53:08.386130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:08.399633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0927ec-1276-42ba-b9e8-a19fbe117acb service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:08.406493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:08.407176 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:08.408287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:08.408679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:08.410733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:08.423521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:08.425380 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:08.438310 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4510/8997] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:08.466410 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:08.480373 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd986e-5e19-4a0c-94ff-c0d8928b995b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:08.485227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:08.486766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:08.487057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:08.487364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] PATH_INFO: `/v3/users/29448f858ed24113b4e90ff1bf3f2b1e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:08.488606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29448f858ed24113b4e90ff1bf3f2b1e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:08.490558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:08.538059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29448f858ed24113b4e90ff1bf3f2b1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.550753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29448f858ed24113b4e90ff1bf3f2b1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.551477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29448f858ed24113b4e90ff1bf3f2b1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.558481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29448f858ed24113b4e90ff1bf3f2b1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.559117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b68554ba-dad0-4471-86ce-e6d60290f129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29448f858ed24113b4e90ff1bf3f2b1e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.571624 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4488/8998] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:53:08 2022] DELETE /identity/v3/users/29448f858ed24113b4e90ff1bf3f2b1e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:53:08.752285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:08.763058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8bdff-933f-47ff-af85-f81be96a4f3e service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:08.836361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:08.837254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:08.837651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:08.837817 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] PATH_INFO: `/v3/projects/a15e337c6f4c4e1aac98b22bce2555a2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:08.839210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15e337c6f4c4e1aac98b22bce2555a2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:08.841223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:08.896312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15e337c6f4c4e1aac98b22bce2555a2', 'request_id': 'req-257c9c8e-ff07-4234-9e6d-efa7f01e421b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.902701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15e337c6f4c4e1aac98b22bce2555a2', 'request_id': 'req-257c9c8e-ff07-4234-9e6d-efa7f01e421b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.911117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15e337c6f4c4e1aac98b22bce2555a2', 'request_id': 'req-257c9c8e-ff07-4234-9e6d-efa7f01e421b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.923865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] The token cache is being invalidate because project a15e337c6f4c4e1aac98b22bce2555a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:53:08.924068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.924692 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-257c9c8e-ff07-4234-9e6d-efa7f01e421b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:08.926330 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4511/8999] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:53:08 2022] DELETE /identity/v3/projects/a15e337c6f4c4e1aac98b22bce2555a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:53:08.931563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd5fd-39b0-4478-8def-e12b42317c1f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:08.931856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd5fd-39b0-4478-8def-e12b42317c1f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:08.932135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd5fd-39b0-4478-8def-e12b42317c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:08.950137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-05cbd5fd-39b0-4478-8def-e12b42317c1f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:08.951372 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05cbd5fd-39b0-4478-8def-e12b42317c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:09.011897 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4489/9000] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:09.020452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8b47-2825-4e92-bbc2-703dac0171c3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.020742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8b47-2825-4e92-bbc2-703dac0171c3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.021025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8b47-2825-4e92-bbc2-703dac0171c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.039473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-827a8b47-2825-4e92-bbc2-703dac0171c3 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:09.040697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-827a8b47-2825-4e92-bbc2-703dac0171c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:09.048590 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4512/9001] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:09.052798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbd5fd-39b0-4478-8def-e12b42317c1f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:09.062724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbd5fd-39b0-4478-8def-e12b42317c1f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:09.067973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:09.068653 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.068941 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.069227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.069989 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:53:09.070288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:09.071964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:09.084946 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4490/9002] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:53:09.089330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8b47-2825-4e92-bbc2-703dac0171c3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:09.099260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8b47-2825-4e92-bbc2-703dac0171c3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:09.104049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:09.104712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.105005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.105322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.106118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:09.108121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:09.134267 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4513/9003] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:53:09 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:53:09.138611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:09.149568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08217a87-ccea-4015-b3ba-d4033cc199ee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:09.196611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:09.212553 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:09.213237 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.213522 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.213803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.214492 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:09.216463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:09.236203 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4491/9004] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:53:09 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:53:09.240245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:09.251081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f8fd-a077-4a01-82fe-85658c0f2377 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:09.256392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:09.257067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.257355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.257639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.258374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:09.260032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:09.271650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4514/9005] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:53:09.276415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:09.287118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbda250-9077-4538-a68e-c468b007b161 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:09.291819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8b469-b70a-42be-9c28-aca353ebb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:09.292482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8b469-b70a-42be-9c28-aca353ebb8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.292770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8b469-b70a-42be-9c28-aca353ebb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.293052 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8b469-b70a-42be-9c28-aca353ebb8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.293775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8b469-b70a-42be-9c28-aca353ebb8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:09.295412 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8b469-b70a-42be-9c28-aca353ebb8a7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:09.305494 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4492/9006] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:53:09.309793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:09.320376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72ffc-b288-4921-b94d-a8bf9bec6cff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:09.325077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:09.325960 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.326243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.326521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] PATH_INFO: `/v3/projects/8336435f94f44bb7bcff8c714c1205d5/users/18d5639da8c34dd3b0cd8a18c1fb84c8/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.341301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8336435f94f44bb7bcff8c714c1205d5, user_id=18d5639da8c34dd3b0cd8a18c1fb84c8, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:09.343987 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:09.356945 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4515/9007] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:53:09 2022] PUT /identity/v3/projects/8336435f94f44bb7bcff8c714c1205d5/users/18d5639da8c34dd3b0cd8a18c1fb84c8/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:53:09.362799 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7fdb3-4279-4034-97a2-7427e4c6ce96 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.363095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7fdb3-4279-4034-97a2-7427e4c6ce96 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.363406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7fdb3-4279-4034-97a2-7427e4c6ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.381590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-18d7fdb3-4279-4034-97a2-7427e4c6ce96 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:09.382969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-18d7fdb3-4279-4034-97a2-7427e4c6ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:09.445679 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4493/9008] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:09.456321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:09.457865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:09.472816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:09.517691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c97abd-b1b0-449f-80cb-e71a531482e3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:09.521430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76bd72-2b52-4c74-818b-dea15533dc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:09.522112 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76bd72-2b52-4c74-818b-dea15533dc97 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:09.522367 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76bd72-2b52-4c74-818b-dea15533dc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:09.522644 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76bd72-2b52-4c74-818b-dea15533dc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:09.532057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76bd72-2b52-4c74-818b-dea15533dc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:09.534125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76bd72-2b52-4c74-818b-dea15533dc97 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:09.543648 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4516/9009] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:13.704993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:13.705488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:13.705585 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:13.735646 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] MFA Rules not processed for user `18d5639da8c34dd3b0cd8a18c1fb84c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:13.739317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:13.813142 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4494/9010] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:13.823255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:13.823834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:13.823834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:13.845257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] MFA Rules not processed for user `18d5639da8c34dd3b0cd8a18c1fb84c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:13.846993 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:13.854086 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4517/9011] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:13.865738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:13.867196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:13.927409 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:13.948981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82844cfb-8ccb-4ed3-8ae6-422ce1639663 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:13.962104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0dab-4d5b-4e44-abe2-52c208e03fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:13.962795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0dab-4d5b-4e44-abe2-52c208e03fab service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:13.963086 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0dab-4d5b-4e44-abe2-52c208e03fab service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:13.963400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0dab-4d5b-4e44-abe2-52c208e03fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:13.973050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee0dab-4d5b-4e44-abe2-52c208e03fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:13.974675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee0dab-4d5b-4e44-abe2-52c208e03fab service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:13.985017 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4495/9012] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:53:14.891808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:14.894751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:14.987340 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fce98-ffbe-4298-b8cb-dfeca399ba0a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:14.992491 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:14.993222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:14.993579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:14.993940 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:14.995895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:15.008292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:15.009991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:15.021397 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4518/9013] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:23.980240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:25.018036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=55 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:25.673995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53694-de89-4b4a-b192-34dde7abc8e9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:25.674518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53694-de89-4b4a-b192-34dde7abc8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:25.674596 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53694-de89-4b4a-b192-34dde7abc8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:25.691845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-69b53694-de89-4b4a-b192-34dde7abc8e9 None None] MFA Rules not processed for user `18d5639da8c34dd3b0cd8a18c1fb84c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:25.693042 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69b53694-de89-4b4a-b192-34dde7abc8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:25.699927 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4496/9014] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:28.604186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:28.605852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:28.630454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff196f-ccda-4ca3-88c3-8e931ae57abf service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:28.636533 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:28.637333 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:28.637617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:28.637896 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:28.640177 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:28.664326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:28.665912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:28.681573 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4519/9015] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:35.686579 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:38.675992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:47.403224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53694-de89-4b4a-b192-34dde7abc8e9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:47.434731 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53694-de89-4b4a-b192-34dde7abc8e9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:47.440023 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:47.440920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:47.441209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:47.441509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] PATH_INFO: `/v3/users/18d5639da8c34dd3b0cd8a18c1fb84c8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:47.442742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d5639da8c34dd3b0cd8a18c1fb84c8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:47.444698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:47.493308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d5639da8c34dd3b0cd8a18c1fb84c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.506110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d5639da8c34dd3b0cd8a18c1fb84c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.506811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d5639da8c34dd3b0cd8a18c1fb84c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.513863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d5639da8c34dd3b0cd8a18c1fb84c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.514452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f2c8685-b162-4987-a31f-d8e620b14fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d5639da8c34dd3b0cd8a18c1fb84c8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.527828 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4497/9016] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:53:47 2022] DELETE /identity/v3/users/18d5639da8c34dd3b0cd8a18c1fb84c8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:53:47.709559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:47.722201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f829f9-d48a-441a-829e-a2cd826a04e2 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:47.780970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:47.781763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:47.782051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:47.782362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] PATH_INFO: `/v3/projects/8336435f94f44bb7bcff8c714c1205d5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:47.783752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8336435f94f44bb7bcff8c714c1205d5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:47.785722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:47.834738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8336435f94f44bb7bcff8c714c1205d5', 'request_id': 'req-d25576a3-bce2-430d-9eb3-177440739a3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.840780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8336435f94f44bb7bcff8c714c1205d5', 'request_id': 'req-d25576a3-bce2-430d-9eb3-177440739a3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.847115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8336435f94f44bb7bcff8c714c1205d5', 'request_id': 'req-d25576a3-bce2-430d-9eb3-177440739a3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.872786 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] The token cache is being invalidate because project 8336435f94f44bb7bcff8c714c1205d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:53:47.873085 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.873725 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d25576a3-bce2-430d-9eb3-177440739a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:47.875326 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4520/9017] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:53:47 2022] DELETE /identity/v3/projects/8336435f94f44bb7bcff8c714c1205d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:53:47.880993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3818-8658-46ad-a1d7-70f6db0bcb1f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:47.881284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3818-8658-46ad-a1d7-70f6db0bcb1f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:47.881575 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3818-8658-46ad-a1d7-70f6db0bcb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:47.910358 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5cee3818-8658-46ad-a1d7-70f6db0bcb1f None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:47.911601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5cee3818-8658-46ad-a1d7-70f6db0bcb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:47.973431 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4498/9018] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:53:47.981084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae486b7-7df7-4ae3-83b5-7923f2c8aab8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:47.981397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae486b7-7df7-4ae3-83b5-7923f2c8aab8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:47.981685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae486b7-7df7-4ae3-83b5-7923f2c8aab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.000316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ae486b7-7df7-4ae3-83b5-7923f2c8aab8 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:48.001523 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ae486b7-7df7-4ae3-83b5-7923f2c8aab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:48.009551 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4521/9019] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:48.013809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3818-8658-46ad-a1d7-70f6db0bcb1f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:48.024275 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3818-8658-46ad-a1d7-70f6db0bcb1f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:48.028889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:48.029550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.029842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.030122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.031163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:53:48.031452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:48.033699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:48.045273 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4499/9020] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:53:48.049677 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae486b7-7df7-4ae3-83b5-7923f2c8aab8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:48.059198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae486b7-7df7-4ae3-83b5-7923f2c8aab8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:48.063988 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:48.064645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.064933 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.065216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.065908 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:48.067880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:48.093999 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4522/9021] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:53:48 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:53:48.098675 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:48.109048 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aebf4-c32a-453d-99f5-923e15ab8c87 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:48.140951 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:48.172434 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:48.173103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.173386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.174154 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.174836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:48.176794 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:48.197573 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4500/9022] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:53:48 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:53:48.202000 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:48.212327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296ce2c-5167-4276-8a03-9215be3ae220 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:48.216883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:48.217538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.217827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.218232 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.218958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:48.220601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:48.230969 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4523/9023] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:53:48.235080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:48.245961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1c044-ae63-49d0-82e6-f85e5cb63a00 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:48.250584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aa452-8c9d-4992-92eb-8aa8ab2da009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:48.251300 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa452-8c9d-4992-92eb-8aa8ab2da009 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.251593 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa452-8c9d-4992-92eb-8aa8ab2da009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.252489 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa452-8c9d-4992-92eb-8aa8ab2da009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.253217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aa452-8c9d-4992-92eb-8aa8ab2da009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:48.254830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aa452-8c9d-4992-92eb-8aa8ab2da009 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:48.265155 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4501/9024] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:53:48.269715 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:48.280157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01bbd-8938-4d3c-8b5a-4ae29b1ac6c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:48.285419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:48.286279 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.286562 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.286839 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] PATH_INFO: `/v3/projects/b3f82082a08e48569017fde6d0df7eaa/users/34ac9358f6b54227be22176102e467bd/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.301898 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f82082a08e48569017fde6d0df7eaa, user_id=34ac9358f6b54227be22176102e467bd, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:48.304612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:48.318551 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4524/9025] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:53:48 2022] PUT /identity/v3/projects/b3f82082a08e48569017fde6d0df7eaa/users/34ac9358f6b54227be22176102e467bd/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:53:48.328807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.329100 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.329380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.355848 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] MFA Rules not processed for user `34ac9358f6b54227be22176102e467bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:48.357078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:48.422502 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4502/9026] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:53:48.433437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:48.435219 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:48.454356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:48.520419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b528-58ac-409e-bdad-7a9196e707af admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:48.524210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:48.524864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:48.525156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:48.525441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:48.534211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:48.535823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:48.544505 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4525/9027] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:57.289981 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:57.291466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:57.386222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f5ef0-7256-4c53-87bb-b22da595329a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:57.396308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be4218-98d5-4969-9133-36d192204050 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:57.397337 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4218-98d5-4969-9133-36d192204050 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:57.397691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4218-98d5-4969-9133-36d192204050 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:57.398043 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4218-98d5-4969-9133-36d192204050 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:57.400625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f1be4218-98d5-4969-9133-36d192204050 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:57.422106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be4218-98d5-4969-9133-36d192204050 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:57.425277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be4218-98d5-4969-9133-36d192204050 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:57.445437 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4503/9028] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:58.540624 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=30 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:59.693061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:59.770341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd59e9-4f6b-4dd9-83d2-33f405cfde10 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:59.775012 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:59.775961 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:59.776245 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:59.776532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] PATH_INFO: `/v3/users/34ac9358f6b54227be22176102e467bd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:59.777776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ac9358f6b54227be22176102e467bd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:59.779780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:59.854916 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ac9358f6b54227be22176102e467bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:59.872208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ac9358f6b54227be22176102e467bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:59.880433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ac9358f6b54227be22176102e467bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:59.881272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ac9358f6b54227be22176102e467bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:59.888623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ac9358f6b54227be22176102e467bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:53:59.895029 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4526/9029] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:53:59 2022] DELETE /identity/v3/users/34ac9358f6b54227be22176102e467bd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:53:59.901384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:59.901384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:59.901384 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:59.937193 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:53:59.938421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:53:59.960954 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:00.004328 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4504/9030] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:00.015450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.018225 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:00.087493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f706-73a1-4650-9dc6-1715f66ef064 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.091293 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2a84a-c669-4591-b424-3b531df5201f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.091972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2a84a-c669-4591-b424-3b531df5201f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.092260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2a84a-c669-4591-b424-3b531df5201f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.092542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2a84a-c669-4591-b424-3b531df5201f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.103959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2a84a-c669-4591-b424-3b531df5201f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.105530 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2a84a-c669-4591-b424-3b531df5201f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.117536 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4527/9031] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:00.309494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.311024 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:00.325644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529aa5b-1e0e-49c7-9557-bdbf38633705 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.334163 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.344375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.344670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.344957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] PATH_INFO: `/v3/projects/b3f82082a08e48569017fde6d0df7eaa` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.346956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f82082a08e48569017fde6d0df7eaa)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.349192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.403746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f82082a08e48569017fde6d0df7eaa', 'request_id': 'req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:00.412402 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f82082a08e48569017fde6d0df7eaa', 'request_id': 'req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:00.419323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f82082a08e48569017fde6d0df7eaa', 'request_id': 'req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:00.430497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] The token cache is being invalidate because project b3f82082a08e48569017fde6d0df7eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:54:00.430819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:00.431495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-780dfe04-a5c1-4b5e-8a96-7c399c7633cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:00.433102 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4505/9032] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:54:00 2022] DELETE /identity/v3/projects/b3f82082a08e48569017fde6d0df7eaa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:00.438811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e019b-a0b8-4bc9-a1e3-6a334cd23dca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.439649 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e019b-a0b8-4bc9-a1e3-6a334cd23dca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.440052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e019b-a0b8-4bc9-a1e3-6a334cd23dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.475353 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:00.481897 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bd9e019b-a0b8-4bc9-a1e3-6a334cd23dca None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:00.483873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd9e019b-a0b8-4bc9-a1e3-6a334cd23dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:00.551285 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4528/9033] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:00.559686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f9e2-480b-4f95-a178-cb3c0a6b108b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.560029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f9e2-480b-4f95-a178-cb3c0a6b108b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.560322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f9e2-480b-4f95-a178-cb3c0a6b108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.582018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3141f9e2-480b-4f95-a178-cb3c0a6b108b None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:00.583240 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3141f9e2-480b-4f95-a178-cb3c0a6b108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:00.591784 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4506/9034] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:54:00.598286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e019b-a0b8-4bc9-a1e3-6a334cd23dca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.609900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e019b-a0b8-4bc9-a1e3-6a334cd23dca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.615009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.615763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.616048 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.616326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.617059 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:54:00.617362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.618980 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.631885 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4529/9035] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:54:00.636359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f9e2-480b-4f95-a178-cb3c0a6b108b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.646570 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f9e2-480b-4f95-a178-cb3c0a6b108b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.651323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.652001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.652001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.652001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.652001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.658535 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.694765 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4507/9036] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:54:00 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:54:00.699084 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.710253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353949-99d1-40af-924a-e7b233678799 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.771211 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.771931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.772218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.772501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.773200 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.775148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.796630 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4530/9037] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:54:00 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:54:00.802628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.815772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713edb8-bb95-4d00-90ab-ec7d896d391b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.820779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.821504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.821791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.822095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.822841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.824523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.835866 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4508/9038] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:54:00.840184 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.858449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64d07-fbba-441d-80d5-4bd9453fea74 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.865852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e22b1-3771-4a23-8768-c9a578642633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.867047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e22b1-3771-4a23-8768-c9a578642633 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.867611 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e22b1-3771-4a23-8768-c9a578642633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.868094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e22b1-3771-4a23-8768-c9a578642633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.869111 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e22b1-3771-4a23-8768-c9a578642633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.870894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e22b1-3771-4a23-8768-c9a578642633 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.883594 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4531/9039] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:54:00.890189 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.901890 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186e78a-898e-4c13-8fb2-a77b1ea5d69a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.907112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.908081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.908370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.908727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] PATH_INFO: `/v3/projects/20cdefe21fe9425a9950de08e0236f39/users/1a62d0be1d614252b8e1cb3fd0f601c7/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.927815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cdefe21fe9425a9950de08e0236f39, user_id=1a62d0be1d614252b8e1cb3fd0f601c7, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.930541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.946630 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4509/9040] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:54:00 2022] PUT /identity/v3/projects/20cdefe21fe9425a9950de08e0236f39/users/1a62d0be1d614252b8e1cb3fd0f601c7/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:00.957635 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adab5-3130-433c-b008-7b26489891b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.957934 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adab5-3130-433c-b008-7b26489891b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.958229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adab5-3130-433c-b008-7b26489891b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.987843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-984adab5-3130-433c-b008-7b26489891b7 None None] MFA Rules not processed for user `1a62d0be1d614252b8e1cb3fd0f601c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:00.989064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-984adab5-3130-433c-b008-7b26489891b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:01.068440 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4532/9041] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:01.079296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:01.081078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:01.131689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:01.162254 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cd2c5-cf4b-451d-b8c5-a00cc3d1ff26 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:01.166521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9757a-fbf6-4e8a-a969-652b68cae10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:01.167298 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9757a-fbf6-4e8a-a969-652b68cae10e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:01.167560 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9757a-fbf6-4e8a-a969-652b68cae10e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:01.167841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9757a-fbf6-4e8a-a969-652b68cae10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:01.178178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9757a-fbf6-4e8a-a969-652b68cae10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:01.179693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9757a-fbf6-4e8a-a969-652b68cae10e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:01.190514 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4510/9042] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:05.381512 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adab5-3130-433c-b008-7b26489891b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:05.386528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:05.463235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adab5-3130-433c-b008-7b26489891b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:05.468853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:05.469963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:05.470647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:05.470647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] PATH_INFO: `/v3/users/1a62d0be1d614252b8e1cb3fd0f601c7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:05.472567 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a62d0be1d614252b8e1cb3fd0f601c7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:05.474762 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:05.532069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a62d0be1d614252b8e1cb3fd0f601c7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:05.549358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a62d0be1d614252b8e1cb3fd0f601c7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:05.564339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a62d0be1d614252b8e1cb3fd0f601c7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:05.565046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a62d0be1d614252b8e1cb3fd0f601c7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:05.573654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a62d0be1d614252b8e1cb3fd0f601c7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:05.581266 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4533/9043] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:54:05 2022] DELETE /identity/v3/users/1a62d0be1d614252b8e1cb3fd0f601c7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:05.586296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:05.587680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:05.587680 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:05.607071 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:05.608480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:05.678851 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4511/9044] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:05.690224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:05.692281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:05.764214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e461c0-3e99-452f-94b9-db09298c63c7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:05.768991 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bbff2-feae-4b0c-b98e-75fd809a6365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:05.769690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bbff2-feae-4b0c-b98e-75fd809a6365 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:05.770013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bbff2-feae-4b0c-b98e-75fd809a6365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:05.770301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bbff2-feae-4b0c-b98e-75fd809a6365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:05.781074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bbff2-feae-4b0c-b98e-75fd809a6365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:05.782575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bbff2-feae-4b0c-b98e-75fd809a6365 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:05.793858 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4534/9045] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:06.012850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.014325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:06.028344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75716d8c-ab83-48bc-8f1e-c84eba601550 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.033583 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.034574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.034751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.035026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] PATH_INFO: `/v3/projects/20cdefe21fe9425a9950de08e0236f39` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.036399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cdefe21fe9425a9950de08e0236f39)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.038398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.094267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cdefe21fe9425a9950de08e0236f39', 'request_id': 'req-016d3628-97c4-455f-b48f-e83b1646410e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:06.102907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cdefe21fe9425a9950de08e0236f39', 'request_id': 'req-016d3628-97c4-455f-b48f-e83b1646410e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:06.112098 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cdefe21fe9425a9950de08e0236f39', 'request_id': 'req-016d3628-97c4-455f-b48f-e83b1646410e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:06.125017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] The token cache is being invalidate because project 20cdefe21fe9425a9950de08e0236f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:54:06.125309 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:06.126011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-016d3628-97c4-455f-b48f-e83b1646410e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:06.128265 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4512/9046] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:54:06 2022] DELETE /identity/v3/projects/20cdefe21fe9425a9950de08e0236f39 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:06.133822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8117a-e82a-49a2-b562-c306b9582ae9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.134140 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8117a-e82a-49a2-b562-c306b9582ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.134430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8117a-e82a-49a2-b562-c306b9582ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.154496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5bd8117a-e82a-49a2-b562-c306b9582ae9 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:06.156022 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bd8117a-e82a-49a2-b562-c306b9582ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:06.177475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:06.229651 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4535/9047] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:06.238769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37548931-7793-4a1c-9fd3-4a05761972d6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.239092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37548931-7793-4a1c-9fd3-4a05761972d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.239426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37548931-7793-4a1c-9fd3-4a05761972d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.260842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-37548931-7793-4a1c-9fd3-4a05761972d6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:06.262090 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-37548931-7793-4a1c-9fd3-4a05761972d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:06.271135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4513/9048] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:06.275962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8117a-e82a-49a2-b562-c306b9582ae9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.287347 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8117a-e82a-49a2-b562-c306b9582ae9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.292704 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.293451 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.293900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.294405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.295362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:54:06.295764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.297485 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.312768 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4536/9049] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:54:06.318386 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37548931-7793-4a1c-9fd3-4a05761972d6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.328573 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37548931-7793-4a1c-9fd3-4a05761972d6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.333842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.334545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.334834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.335113 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.335881 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.337866 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.369434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4514/9050] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:54:06 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:54:06.373890 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.388032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778692ce-99f8-499c-bf4c-a8e220ec57d3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.454505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.455217 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.455541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.455823 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.456539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.458501 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.481765 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4537/9051] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:54:06 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:54:06.485898 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.497280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf9e3e-bf6f-4801-b04b-41bf216b9e4e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.503064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.503812 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.504087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.504363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.505198 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.506863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.520176 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4515/9052] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:54:06.524703 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.536018 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3f97-2477-4821-bd59-446272e6f69c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.541117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f0b2-c5c9-4b47-a4ff-905b4ae6a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.541814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f0b2-c5c9-4b47-a4ff-905b4ae6a047 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.542257 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f0b2-c5c9-4b47-a4ff-905b4ae6a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.542539 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f0b2-c5c9-4b47-a4ff-905b4ae6a047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.543343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0f0b2-c5c9-4b47-a4ff-905b4ae6a047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.545013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0f0b2-c5c9-4b47-a4ff-905b4ae6a047 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.563431 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4538/9053] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:54:06.568143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.579766 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8a23a-93c8-4bbb-a6fa-f63b253ccfa2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.588239 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.589209 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.589751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.589751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] PATH_INFO: `/v3/projects/aa96d9f49b334c48a989638b96012cf4/users/83f5af5fb31042de9ffc151f6c4a7ae6/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.613838 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa96d9f49b334c48a989638b96012cf4, user_id=83f5af5fb31042de9ffc151f6c4a7ae6, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.619389 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.635211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:06.645431 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4516/9054] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:54:06 2022] PUT /identity/v3/projects/aa96d9f49b334c48a989638b96012cf4/users/83f5af5fb31042de9ffc151f6c4a7ae6/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:06.652654 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb508a6-3c99-4909-b5a6-05641ca795a5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.653094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb508a6-3c99-4909-b5a6-05641ca795a5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.653454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb508a6-3c99-4909-b5a6-05641ca795a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.673458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1bb508a6-3c99-4909-b5a6-05641ca795a5 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:06.674697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1bb508a6-3c99-4909-b5a6-05641ca795a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:06.746221 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4539/9055] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:06.757470 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:06.759500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:06.828732 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40124-ca1e-49a4-b02a-d9bd436a8ba9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:06.832795 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:06.833480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:06.833771 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:06.834054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:06.844679 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:06.846245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:06.857357 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4517/9056] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:11.353386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282eca-fa60-4d56-b329-ee0b5e14ce4b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.353872 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282eca-fa60-4d56-b329-ee0b5e14ce4b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.353967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282eca-fa60-4d56-b329-ee0b5e14ce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.380999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-56282eca-fa60-4d56-b329-ee0b5e14ce4b None None] MFA Rules not processed for user `83f5af5fb31042de9ffc151f6c4a7ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:11.382150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56282eca-fa60-4d56-b329-ee0b5e14ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:11.403727 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:11.464870 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4540/9057] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:11.466789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:11.480066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8f612-5e66-4cfe-a1f2-196201ee71a6 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.484920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.485600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.486414 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.486707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.487607 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.489563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.518265 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4518/9058] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:54:11 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:54:11.522416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282eca-fa60-4d56-b329-ee0b5e14ce4b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:11.534709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282eca-fa60-4d56-b329-ee0b5e14ce4b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.592210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.593031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.593390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.593746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.594527 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.597093 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.627322 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4541/9059] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:54:11 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:54:11.638944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:11.653258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757de223-6ac3-4a24-8f54-9014b5dc551c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.658578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.659289 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.659760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.660045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.660779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.662420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.674486 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4519/9060] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:54:11.679648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:11.697044 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934f531-c167-41b9-b7df-9e0a9078d234 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.702371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.703399 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.703685 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.703963 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] PATH_INFO: `/v3/projects/f6473e5865494e769da86719b487c37e/users/6d2bdd4b019f4f208f5d395dc442f1ca/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.723511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6473e5865494e769da86719b487c37e, user_id=6d2bdd4b019f4f208f5d395dc442f1ca, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.726462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.745462 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4542/9061] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:54:11 2022] PUT /identity/v3/projects/f6473e5865494e769da86719b487c37e/users/6d2bdd4b019f4f208f5d395dc442f1ca/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:11.750754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:11.766000 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715aa70-d805-48ac-acd0-431c7ace1203 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.835102 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d878-3331-4884-949a-3f6a76cdb9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.835828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d878-3331-4884-949a-3f6a76cdb9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.836119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d878-3331-4884-949a-3f6a76cdb9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.836404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d878-3331-4884-949a-3f6a76cdb9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.837148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1d878-3331-4884-949a-3f6a76cdb9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.838833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1d878-3331-4884-949a-3f6a76cdb9a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.850310 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4520/9062] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:54:11.854517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:11.865802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce404-fd50-483f-b667-bd0d97226828 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.871118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.872039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.872321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.872620 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] PATH_INFO: `/v3/projects/f6473e5865494e769da86719b487c37e/users/6d2bdd4b019f4f208f5d395dc442f1ca/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.874833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6473e5865494e769da86719b487c37e, user_id=6d2bdd4b019f4f208f5d395dc442f1ca, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.878162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.890023 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4543/9063] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:54:11 2022] PUT /identity/v3/projects/f6473e5865494e769da86719b487c37e/users/6d2bdd4b019f4f208f5d395dc442f1ca/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:16.949507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d01bf-6208-4684-9be5-ce01b08606b4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:16.950435 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d01bf-6208-4684-9be5-ce01b08606b4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:16.951108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d01bf-6208-4684-9be5-ce01b08606b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:16.986279 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-eb6d01bf-6208-4684-9be5-ce01b08606b4 None None] MFA Rules not processed for user `6d2bdd4b019f4f208f5d395dc442f1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:16.987541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb6d01bf-6208-4684-9be5-ce01b08606b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:17.055466 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:17.076736 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4521/9064] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:17.099777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:17.101669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:17.214814 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:17.254483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e7584-7488-4420-8b35-bd7a7af38477 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:17.260825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:17.266464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:17.266464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:17.266464 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:17.367932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:17.369691 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:17.385838 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4544/9065] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:17.494885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:17.494885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:17.494885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:17.513920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] MFA Rules not processed for user `83f5af5fb31042de9ffc151f6c4a7ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:17.515159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:17.527307 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4522/9066] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:17.563927 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:17.565575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:17.657452 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9483-fa7a-448e-853b-bacc72f8e6eb service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:17.666362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:17.667038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:17.667508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:17.667793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:17.669639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:17.684214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:17.685660 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:17.697790 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4545/9067] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:18.302114 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:18.303757 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:18.391127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4803c-8cce-495d-8b4d-65e0a20cfd23 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:18.395798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19021-31f3-47b2-b93a-af83a705069d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:18.396499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19021-31f3-47b2-b93a-af83a705069d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:18.396865 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19021-31f3-47b2-b93a-af83a705069d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:18.397213 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19021-31f3-47b2-b93a-af83a705069d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:18.399505 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-04b19021-31f3-47b2-b93a-af83a705069d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:18.420756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b19021-31f3-47b2-b93a-af83a705069d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:18.422811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b19021-31f3-47b2-b93a-af83a705069d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:18.437826 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4523/9068] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:27.692556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=67 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:28.232595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:28.233913 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:28.312755 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59421-330e-464e-93db-cc4c3859322f service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:28.317003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db64ff447674dd2a2f15b005696075b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:28.317722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:28.318009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:28.318291 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:28.327730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:28.329209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:28.338829 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4546/9069] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:28.431443 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=33 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:38.334655 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=35 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:53.425080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:53.425644 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:53.425750 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:53.444273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] MFA Rules not processed for user `83f5af5fb31042de9ffc151f6c4a7ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:53.445477 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:53.452578 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4524/9070] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:53.702015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:53.712891 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43828-0001-47ce-be5e-0a4453b63e4b service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:53.716733 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:53.717577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:53.717865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:53.718147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:53.720156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:53.731469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:53.732930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:53.741040 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4547/9071] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:54.061818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:54.063363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:54.137841 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebb05-40f7-4df9-afb9-b870cc2a1b6c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:54.143656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:54.144317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:54.144602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:54.144880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:54.146663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:54.158651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:54.160265 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:54.170433 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4525/9072] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:55.971030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:55.980398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263e29e-6afd-4f09-8595-1a336e56c5bd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:55.984193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:55.984846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:55.985160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:55.985441 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:55.987830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:55.998051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:55.999549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:56.009126 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4548/9073] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:55:04.166118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=35 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:06.005134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:36.112099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:36.176879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c39f3-9496-40c7-88a0-c3267e8b364c service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:36.181481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:36.182364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:36.182649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:36.182930 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] PATH_INFO: `/v3/users/83f5af5fb31042de9ffc151f6c4a7ae6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:36.184162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f5af5fb31042de9ffc151f6c4a7ae6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:36.186186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:36.234836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f5af5fb31042de9ffc151f6c4a7ae6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.246789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f5af5fb31042de9ffc151f6c4a7ae6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.247713 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f5af5fb31042de9ffc151f6c4a7ae6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.255122 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f5af5fb31042de9ffc151f6c4a7ae6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.255779 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f5af5fb31042de9ffc151f6c4a7ae6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.269975 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4526/9074] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:55:36 2022] DELETE /identity/v3/users/83f5af5fb31042de9ffc151f6c4a7ae6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:55:36.459382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:36.471193 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90561-e77d-47c8-9597-c7c9ce301fc8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:36.530709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:36.531886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:36.532182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:36.532487 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] PATH_INFO: `/v3/projects/aa96d9f49b334c48a989638b96012cf4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:36.533665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa96d9f49b334c48a989638b96012cf4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:36.535623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:36.581641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa96d9f49b334c48a989638b96012cf4', 'request_id': 'req-363ca31a-8473-4916-80b4-47ecff3d7fa4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.587131 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa96d9f49b334c48a989638b96012cf4', 'request_id': 'req-363ca31a-8473-4916-80b4-47ecff3d7fa4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.593348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa96d9f49b334c48a989638b96012cf4', 'request_id': 'req-363ca31a-8473-4916-80b4-47ecff3d7fa4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.606276 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] The token cache is being invalidate because project aa96d9f49b334c48a989638b96012cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:55:36.606865 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.607576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.612994 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4549/9075] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:55:36 2022] DELETE /identity/v3/projects/aa96d9f49b334c48a989638b96012cf4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:55:36.614764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:36.616172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:36.630690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ac08f-71e7-4392-b0d4-1d3be84cf7f5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:36.687571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:36.688456 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:36.688742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:36.689061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] PATH_INFO: `/v3/users/6d2bdd4b019f4f208f5d395dc442f1ca` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:36.691077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2bdd4b019f4f208f5d395dc442f1ca)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:36.693130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:36.714625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:36.744363 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2bdd4b019f4f208f5d395dc442f1ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.757913 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2bdd4b019f4f208f5d395dc442f1ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.758636 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2bdd4b019f4f208f5d395dc442f1ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.765613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2bdd4b019f4f208f5d395dc442f1ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.766262 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-16d5f51b-b0b7-49a2-ae01-f39012719b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2bdd4b019f4f208f5d395dc442f1ca'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:36.779751 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4527/9076] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 15:55:36 2022] DELETE /identity/v3/users/6d2bdd4b019f4f208f5d395dc442f1ca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:55:36.967432 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:36.969120 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:36.983909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ca31a-8473-4916-80b4-47ecff3d7fa4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.046038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.046915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.047206 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.047525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] PATH_INFO: `/v3/projects/f6473e5865494e769da86719b487c37e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.048716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6473e5865494e769da86719b487c37e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.051260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.086630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:37.101496 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6473e5865494e769da86719b487c37e', 'request_id': 'req-ff839e63-94f0-4b29-b424-b853ad2a6a4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:37.107155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6473e5865494e769da86719b487c37e', 'request_id': 'req-ff839e63-94f0-4b29-b424-b853ad2a6a4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:37.113461 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6473e5865494e769da86719b487c37e', 'request_id': 'req-ff839e63-94f0-4b29-b424-b853ad2a6a4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:37.125229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] The token cache is being invalidate because project f6473e5865494e769da86719b487c37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:55:37.125652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:37.126287 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff839e63-94f0-4b29-b424-b853ad2a6a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:55:37.127886 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4550/9077] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 15:55:36 2022] DELETE /identity/v3/projects/f6473e5865494e769da86719b487c37e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:55:37.133037 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de594f-6825-4710-9d82-be09b5f4e5fd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.133634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de594f-6825-4710-9d82-be09b5f4e5fd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.133634 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de594f-6825-4710-9d82-be09b5f4e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.163918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e8de594f-6825-4710-9d82-be09b5f4e5fd None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:37.165119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8de594f-6825-4710-9d82-be09b5f4e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:37.226074 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4528/9078] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:55:37.233937 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e49b-23b6-4a6f-b40f-7ae44dc950b2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.234228 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e49b-23b6-4a6f-b40f-7ae44dc950b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.234511 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e49b-23b6-4a6f-b40f-7ae44dc950b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.255776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-68d7e49b-23b6-4a6f-b40f-7ae44dc950b2 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:37.256983 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-68d7e49b-23b6-4a6f-b40f-7ae44dc950b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:37.265146 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4551/9079] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:55:37.270159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de594f-6825-4710-9d82-be09b5f4e5fd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:37.280359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de594f-6825-4710-9d82-be09b5f4e5fd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.285932 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.286597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.286882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.287160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.287922 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:55:37.288227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.289830 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.301571 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4529/9080] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 15:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:55:37.305954 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e49b-23b6-4a6f-b40f-7ae44dc950b2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:37.315416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e49b-23b6-4a6f-b40f-7ae44dc950b2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.320182 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.320836 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.321130 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.321413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.322115 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.324066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.350979 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4552/9081] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:55:37 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:55:37.355217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:37.365628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc895d8-149a-4682-98a0-baffa756d5ca admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.423010 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.423723 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.424009 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.424316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.425017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.426962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.446558 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4530/9082] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:55:37 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:55:37.450670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:37.461497 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f8e1e-3fe8-44b0-9bbd-d468a4908359 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.466117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.466777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.467061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.467374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.468096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.469694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.480191 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4553/9083] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:55:37.484115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:37.494628 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade9134-280c-436d-9a32-54660969a4a6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.499283 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7a624-0024-435a-9ea9-0a3fe724f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.499955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a624-0024-435a-9ea9-0a3fe724f805 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.500251 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a624-0024-435a-9ea9-0a3fe724f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.500536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a624-0024-435a-9ea9-0a3fe724f805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.501263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7a624-0024-435a-9ea9-0a3fe724f805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.503413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7a624-0024-435a-9ea9-0a3fe724f805 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.504718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:37.516171 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4531/9084] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:55:37.520847 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:37.531482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4acba-0134-42df-b79a-903b5e0be1f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.536174 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.537054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.537339 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.537619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] PATH_INFO: `/v3/projects/960af42bfb4f4b3b942d1956051d8510/users/80098f23a80f47f59060eed03bdb3290/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.551958 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960af42bfb4f4b3b942d1956051d8510, user_id=80098f23a80f47f59060eed03bdb3290, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.554618 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.568044 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4554/9085] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:55:37 2022] PUT /identity/v3/projects/960af42bfb4f4b3b942d1956051d8510/users/80098f23a80f47f59060eed03bdb3290/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:55:37.573311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab87f1-6150-4bb8-bcdc-a3e4afe9c5cc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.573606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab87f1-6150-4bb8-bcdc-a3e4afe9c5cc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.573907 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab87f1-6150-4bb8-bcdc-a3e4afe9c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.592769 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-11ab87f1-6150-4bb8-bcdc-a3e4afe9c5cc None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:37.594244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11ab87f1-6150-4bb8-bcdc-a3e4afe9c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:37.656256 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4532/9086] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:55:37.665956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:37.667740 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:37.726065 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c2e92-6d26-410e-aa5f-4c70a29f6bf2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:37.729825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:37.730531 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:37.730770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:37.731051 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:37.740410 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:37.741857 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:37.751381 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4555/9087] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:55:41.804296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0cf09-5315-49ab-b18e-97c1e03a7e95 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:41.804798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0cf09-5315-49ab-b18e-97c1e03a7e95 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:41.805087 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0cf09-5315-49ab-b18e-97c1e03a7e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:41.835834 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7fd0cf09-5315-49ab-b18e-97c1e03a7e95 None None] MFA Rules not processed for user `80098f23a80f47f59060eed03bdb3290`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:41.837065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7fd0cf09-5315-49ab-b18e-97c1e03a7e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:41.927645 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:41.928195 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4533/9088] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:55:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:55:41.939083 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c262-e55e-4b3f-a037-0066884afdcd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:41.944735 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:41.945402 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:41.945694 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:41.945969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:41.946684 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:41.948647 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:41.979539 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4556/9089] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 15:55:41 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:55:41.983436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0cf09-5315-49ab-b18e-97c1e03a7e95 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:41.996117 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0cf09-5315-49ab-b18e-97c1e03a7e95 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:42.058942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:42.059670 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:42.059960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:42.060241 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:42.060961 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:42.062917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:42.086502 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4534/9090] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 15:55:41 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:55:42.090419 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:42.102139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0f23-281c-4baf-a2d1-6995ad9ac16d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:42.107102 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:42.107831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:42.108124 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:42.108409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:42.109242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:42.110770 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:42.123108 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4557/9091] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:55:42.127347 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:42.137836 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219182b-c41e-4c7b-8a3b-ba038375472c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:42.142822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:42.143883 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:42.144175 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:42.144455 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] PATH_INFO: `/v3/projects/be4ea5be94314816badf5d1250c69fae/users/48966dd13ab444c2b08759b55f09ef3d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:42.158427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:42.162497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4ea5be94314816badf5d1250c69fae, user_id=48966dd13ab444c2b08759b55f09ef3d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:42.165293 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:42.182220 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4535/9092] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:55:42 2022] PUT /identity/v3/projects/be4ea5be94314816badf5d1250c69fae/users/48966dd13ab444c2b08759b55f09ef3d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:55:42.186449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:42.197203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac401e-de66-4e97-82d0-f26bc8e9fa36 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:42.224389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:42.266482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca57ebb-524e-45d8-a42f-ef266df14e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:42.267186 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57ebb-524e-45d8-a42f-ef266df14e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:42.267515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57ebb-524e-45d8-a42f-ef266df14e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:42.267808 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57ebb-524e-45d8-a42f-ef266df14e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:42.268672 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca57ebb-524e-45d8-a42f-ef266df14e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:42.270233 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca57ebb-524e-45d8-a42f-ef266df14e93 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:42.282183 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4558/9093] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 15:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:55:42.286955 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:42.298342 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adad95a-1b1d-4a42-af16-06d58cf8bc05 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:42.304618 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:42.305613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:42.305995 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:42.306340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] PATH_INFO: `/v3/projects/be4ea5be94314816badf5d1250c69fae/users/48966dd13ab444c2b08759b55f09ef3d/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:42.308491 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4ea5be94314816badf5d1250c69fae, user_id=48966dd13ab444c2b08759b55f09ef3d, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:42.311320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:42.323815 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4536/9094] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 15:55:42 2022] PUT /identity/v3/projects/be4ea5be94314816badf5d1250c69fae/users/48966dd13ab444c2b08759b55f09ef3d/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:55:46.715632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf0f0d-c41b-43ee-b1ae-99aa79221d9e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:46.717231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf0f0d-c41b-43ee-b1ae-99aa79221d9e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:46.717722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf0f0d-c41b-43ee-b1ae-99aa79221d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:46.760901 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4bbf0f0d-c41b-43ee-b1ae-99aa79221d9e None None] MFA Rules not processed for user `48966dd13ab444c2b08759b55f09ef3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:46.762481 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4bbf0f0d-c41b-43ee-b1ae-99aa79221d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:46.852751 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4559/9095] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:55:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:55:46.880261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:46.881973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:46.943322 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3038096-45bf-4d2b-a7a2-ec644ab49d32 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:46.946917 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:46.947603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:46.947894 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:46.948178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:47.019330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:47.020924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:47.034850 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4537/9096] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:55:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:55:47.153167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226eded-7ca7-4279-86d1-943e38aed03d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:47.153462 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226eded-7ca7-4279-86d1-943e38aed03d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:47.153746 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226eded-7ca7-4279-86d1-943e38aed03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:47.228928 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e226eded-7ca7-4279-86d1-943e38aed03d None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:47.230157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e226eded-7ca7-4279-86d1-943e38aed03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:47.328307 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4560/9097] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:55:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:55:47.389588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:47.391056 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:47.526188 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c6715-636a-41d2-860b-193e44d6f504 service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:47.532244 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccd8d5-c2aa-404a-ab16-0f96ad778b58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:47.532927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd8d5-c2aa-404a-ab16-0f96ad778b58 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:47.533218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd8d5-c2aa-404a-ab16-0f96ad778b58 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:47.533504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd8d5-c2aa-404a-ab16-0f96ad778b58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:47.543784 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccd8d5-c2aa-404a-ab16-0f96ad778b58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:47.545440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccd8d5-c2aa-404a-ab16-0f96ad778b58 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:47.555743 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4538/9098] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:55:57.187719 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425f782-ab12-426d-a1e5-6f1bc6417b0b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:57.188424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425f782-ab12-426d-a1e5-6f1bc6417b0b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:57.188424 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425f782-ab12-426d-a1e5-6f1bc6417b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:57.208126 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0425f782-ab12-426d-a1e5-6f1bc6417b0b None None] MFA Rules not processed for user `80098f23a80f47f59060eed03bdb3290`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:57.209372 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0425f782-ab12-426d-a1e5-6f1bc6417b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:57.216642 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4561/9099] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:55:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:55:57.551520 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:59.317555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:59.318404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:59.318404 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:59.350704 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:55:59.352964 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:59.366088 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4539/9100] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:55:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:55:59.384863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425f782-ab12-426d-a1e5-6f1bc6417b0b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:59.398505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:59.406349 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425f782-ab12-426d-a1e5-6f1bc6417b0b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:59.413373 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:59.414348 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:59.414834 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:59.415358 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:59.429091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:59.430972 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:59.442756 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4562/9101] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:55:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:09.341971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:09.437978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:11.417307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:11.418780 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:11.513330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9b608-cbba-4191-8139-4e33928b55ec None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:11.519076 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:11.519765 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:11.520050 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:11.520340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:11.522160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:11.534828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:11.536498 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:11.547944 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4540/9102] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:56:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:21.543156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=41 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:33.826584 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:33.882351 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b34a5-9a1f-4a54-8b2b-ee99b4bb0f9d service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:33.886218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:33.886886 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.887244 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.887494 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.897868 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:33.899434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:33.910270 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4563/9103] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:56:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:43.904947 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=26 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:06.238839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:06.240463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:06.255630 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee44813-b4e2-4ec0-9cd8-6b2b6c983be0 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:06.261582 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:06.262267 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:06.262705 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:06.263005 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:06.265131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:06.278588 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:06.280260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:06.292209 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4541/9104] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:57:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:16.287417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:49.948236 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:49.957614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3926d2-c361-4296-9f78-612776323b38 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:49.961231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:49.961874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:49.962157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:49.962437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:49.964210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:49.986832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:49.988312 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:49.996540 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4564/9105] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:59.992783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.320962 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:31.332186 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95c64f-a1d1-4932-aa7e-fa4f2694d4b3 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:31.336081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:31.336761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:31.337045 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:31.337360 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:31.339556 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:31.427594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:31.429065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:31.441094 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4542/9106] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:59:31.995999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:31.999438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:32.033614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d893f-0983-45b0-8a39-fcd0a1dbe23d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:32.064166 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683e4f-f80d-4748-aa53-a31d26845c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:32.065917 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683e4f-f80d-4748-aa53-a31d26845c76 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:32.066749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683e4f-f80d-4748-aa53-a31d26845c76 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:32.067583 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683e4f-f80d-4748-aa53-a31d26845c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:32.071638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff683e4f-f80d-4748-aa53-a31d26845c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:32.107568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683e4f-f80d-4748-aa53-a31d26845c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:32.111305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683e4f-f80d-4748-aa53-a31d26845c76 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:32.148082 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4565/9107] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:41.435685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=37 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:42.125697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:43.976315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:43.977778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:43.989857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddd5f4-17b2-48ed-9633-ce4a76df8cdd service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:43.993749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:43.994450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:43.994756 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:43.995035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:43.996910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:44.011127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:44.012536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:44.024306 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4543/9108] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:59:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:46.408071 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4df147-f408-49b8-b0f2-b20e9d789fd4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:46.408641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4df147-f408-49b8-b0f2-b20e9d789fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:46.408641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4df147-f408-49b8-b0f2-b20e9d789fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:46.428032 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0a4df147-f408-49b8-b0f2-b20e9d789fd4 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:46.429249 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a4df147-f408-49b8-b0f2-b20e9d789fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:46.436602 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4566/9109] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:46.483170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:46.495504 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254da71d-b442-4f0c-bcb2-7068bd0be343 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:46.500589 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:46.501245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:46.501525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:46.501803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:46.510427 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:46.512092 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:46.521373 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4544/9110] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:47.034929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b26875-4862-49ca-93e0-ac4dfba4dc14 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:47.035226 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b26875-4862-49ca-93e0-ac4dfba4dc14 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:47.035543 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b26875-4862-49ca-93e0-ac4dfba4dc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:47.053821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b7b26875-4862-49ca-93e0-ac4dfba4dc14 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:47.055091 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7b26875-4862-49ca-93e0-ac4dfba4dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:47.063548 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4567/9111] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:47.076022 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:47.088108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9bb3f-b6ff-45ba-8dda-fe263064bf85 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:47.094126 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:47.095039 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:47.095643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:47.096013 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:47.105878 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:47.107513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:47.116795 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4545/9112] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:55.585633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc1e1-d662-4611-857e-9a876b1e39b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:55.586195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc1e1-d662-4611-857e-9a876b1e39b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:55.586195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc1e1-d662-4611-857e-9a876b1e39b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:55.604911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a13bc1e1-d662-4611-857e-9a876b1e39b8 None None] MFA Rules not processed for user `80098f23a80f47f59060eed03bdb3290`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:55.606147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a13bc1e1-d662-4611-857e-9a876b1e39b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:55.613561 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4568/9113] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:55.878860 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:55.888656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58c69e-6920-4784-9e77-6ce2d52f149b service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:55.892939 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad912c21-7e41-4c62-86d6-b63b8a23a1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:55.893574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad912c21-7e41-4c62-86d6-b63b8a23a1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:55.893857 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad912c21-7e41-4c62-86d6-b63b8a23a1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:55.894137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad912c21-7e41-4c62-86d6-b63b8a23a1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:55.895919 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad912c21-7e41-4c62-86d6-b63b8a23a1e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:55.905503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad912c21-7e41-4c62-86d6-b63b8a23a1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:55.907195 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad912c21-7e41-4c62-86d6-b63b8a23a1e8 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:55.915197 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4546/9114] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:56.226833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bc1e1-d662-4611-857e-9a876b1e39b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:56.239506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bc1e1-d662-4611-857e-9a876b1e39b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:56.249254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:56.249935 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:56.250224 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:56.250504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:56.252355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:56.268767 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:56.270670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:56.281701 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4569/9115] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 15:59:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:57.572921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf0cdc-19e6-424b-a7dd-c8fd6e69a36f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:57.573482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf0cdc-19e6-424b-a7dd-c8fd6e69a36f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:57.573482 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf0cdc-19e6-424b-a7dd-c8fd6e69a36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:57.591844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-67bf0cdc-19e6-424b-a7dd-c8fd6e69a36f None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:57.594004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-67bf0cdc-19e6-424b-a7dd-c8fd6e69a36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:57.606701 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4547/9116] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:57.620775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:57.633277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ad0d-b289-4f71-b631-ca58ed9fa6b0 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:57.638430 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:57.639099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:57.639437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:57.639724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:57.658272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:57.660043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:57.673095 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4570/9117] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 15:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:06.191966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf0cdc-19e6-424b-a7dd-c8fd6e69a36f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:06.202396 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf0cdc-19e6-424b-a7dd-c8fd6e69a36f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:06.206021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:06.206693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:06.206978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:06.207261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:06.209074 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:06.220249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:06.221739 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:06.230356 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4548/9118] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:00:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:06.956706 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:06.958697 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:06.978514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910df39c-9f7d-43bc-8757-d265777da173 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:06.985457 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:06.987597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:06.988052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:06.988504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:06.992281 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:07.009596 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:07.011665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:07.025334 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4571/9119] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:00:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:12.025682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:12.034225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=34 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:12.046162 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b15a9-a966-484d-8c77-824c860e2167 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:12.054058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:12.055160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:12.055474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:12.055760 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:12.057688 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:12.072249 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:12.074080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:12.086103 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4549/9120] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:00:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:17.019455 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=27 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:22.080931 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:49.049056 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:49.060434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28361eaa-8df5-4b8c-aad0-95f6280cb1bd service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:49.066070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af332501-7004-4ee3-8e73-ecb664ef3df0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:49.066711 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332501-7004-4ee3-8e73-ecb664ef3df0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:49.067004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332501-7004-4ee3-8e73-ecb664ef3df0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:49.067292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332501-7004-4ee3-8e73-ecb664ef3df0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:49.075258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af332501-7004-4ee3-8e73-ecb664ef3df0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:49.077371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af332501-7004-4ee3-8e73-ecb664ef3df0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:49.086622 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4572/9121] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:00:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:59.082409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:13.481328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:13.518978 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61965e2-9ab9-4343-b15f-6e78fb94aaa4 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:13.524571 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:13.525448 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:13.526094 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:13.526450 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:13.537054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:13.538889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:13.551087 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4550/9122] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:01:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:23.546065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=17 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:48.154467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b9ef-e84b-4b3c-ab09-742d264cd69f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:48.154964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b9ef-e84b-4b3c-ab09-742d264cd69f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:48.155075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b9ef-e84b-4b3c-ab09-742d264cd69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:48.173067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3059b9ef-e84b-4b3c-ab09-742d264cd69f None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:48.174282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3059b9ef-e84b-4b3c-ab09-742d264cd69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:48.181562 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4573/9123] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 16:01:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:48.223034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:48.235081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11a48-c352-44b6-881e-3a4b3fc826bb service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:48.241526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:48.242197 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:48.242481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:48.242762 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:48.252201 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:48.253805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:48.262237 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4551/9124] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:01:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:48.630269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b9ef-e84b-4b3c-ab09-742d264cd69f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:48.640070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b9ef-e84b-4b3c-ab09-742d264cd69f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:48.643801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:48.644440 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:48.644734 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:48.645015 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:48.709208 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:48.710716 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:48.721976 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4574/9125] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:52.014093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:52.026203 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795ccea-a66f-4165-8414-a86e9892ea0d service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:52.032923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:52.033625 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:52.033901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:52.034179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:52.036065 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:52.048336 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:52.049980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:52.061670 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4552/9126] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:01:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:01:55.458359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:55.473634 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c598197-aa7a-4826-a089-372828c11894 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:55.478449 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:55.479383 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:55.479681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:55.479965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] PATH_INFO: `/v3/users/80098f23a80f47f59060eed03bdb3290` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:55.481239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=80098f23a80f47f59060eed03bdb3290)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:55.483212 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:55.538856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80098f23a80f47f59060eed03bdb3290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.550992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80098f23a80f47f59060eed03bdb3290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.559701 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80098f23a80f47f59060eed03bdb3290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.560401 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80098f23a80f47f59060eed03bdb3290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.569469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80098f23a80f47f59060eed03bdb3290'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.578461 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4575/9127] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:01:55 2022] DELETE /identity/v3/users/80098f23a80f47f59060eed03bdb3290 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:01:55.786966 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:55.799507 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0d5c-1950-4530-b7ea-e275d9f272e4 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:55.883038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:55.884084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:55.884442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:55.884808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] PATH_INFO: `/v3/projects/960af42bfb4f4b3b942d1956051d8510` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:55.886183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] RBAC: Authorizing `identity:delete_project(project_id=960af42bfb4f4b3b942d1956051d8510)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:55.888321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:55.946151 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960af42bfb4f4b3b942d1956051d8510', 'request_id': 'req-d0184b4a-2153-464d-94cd-c68a9637602f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.954924 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960af42bfb4f4b3b942d1956051d8510', 'request_id': 'req-d0184b4a-2153-464d-94cd-c68a9637602f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.963980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960af42bfb4f4b3b942d1956051d8510', 'request_id': 'req-d0184b4a-2153-464d-94cd-c68a9637602f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.982803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] The token cache is being invalidate because project 960af42bfb4f4b3b942d1956051d8510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:01:55.983104 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.983822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:55.985518 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4553/9128] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:01:55 2022] DELETE /identity/v3/projects/960af42bfb4f4b3b942d1956051d8510 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:55.990341 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:55.992546 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:56.007974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec64a-dae3-417c-8788-6734e001aebb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.067612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.068510 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.068801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.069103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] PATH_INFO: `/v3/users/48966dd13ab444c2b08759b55f09ef3d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.070319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=48966dd13ab444c2b08759b55f09ef3d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.072301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.073969 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:56.125411 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48966dd13ab444c2b08759b55f09ef3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.137783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48966dd13ab444c2b08759b55f09ef3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.145651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48966dd13ab444c2b08759b55f09ef3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.146392 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48966dd13ab444c2b08759b55f09ef3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.154500 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b91538cf-ab93-4f0f-b1b1-caded936d9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48966dd13ab444c2b08759b55f09ef3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.161925 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4576/9129] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:01:55 2022] DELETE /identity/v3/users/48966dd13ab444c2b08759b55f09ef3d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:56.362770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.364786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:56.378729 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184b4a-2153-464d-94cd-c68a9637602f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.442284 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.443169 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.443496 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.443775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] PATH_INFO: `/v3/projects/be4ea5be94314816badf5d1250c69fae` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.444984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4ea5be94314816badf5d1250c69fae)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.447595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.455418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:56.501221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4ea5be94314816badf5d1250c69fae', 'request_id': 'req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.509320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4ea5be94314816badf5d1250c69fae', 'request_id': 'req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.517694 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4ea5be94314816badf5d1250c69fae', 'request_id': 'req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.529840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] The token cache is being invalidate because project be4ea5be94314816badf5d1250c69fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:01:56.530136 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.531084 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2ceeeb3c-3017-4db5-8529-f5c3093d12f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:56.532716 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4554/9130] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:01:56 2022] DELETE /identity/v3/projects/be4ea5be94314816badf5d1250c69fae => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:56.537874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38c4d-8a91-4e25-a0e7-7ea3b511d3b6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.538381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38c4d-8a91-4e25-a0e7-7ea3b511d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.538474 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38c4d-8a91-4e25-a0e7-7ea3b511d3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.557285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aba38c4d-8a91-4e25-a0e7-7ea3b511d3b6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:56.558504 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aba38c4d-8a91-4e25-a0e7-7ea3b511d3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:56.618834 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4577/9131] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:56.626856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c61c2-acc1-429e-b06d-a2fa87e442e1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.627157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c61c2-acc1-429e-b06d-a2fa87e442e1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.627558 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c61c2-acc1-429e-b06d-a2fa87e442e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.646552 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e04c61c2-acc1-429e-b06d-a2fa87e442e1 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:56.647803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e04c61c2-acc1-429e-b06d-a2fa87e442e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:56.657128 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4555/9132] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:56.661417 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38c4d-8a91-4e25-a0e7-7ea3b511d3b6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.671216 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38c4d-8a91-4e25-a0e7-7ea3b511d3b6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.676066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.676737 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.677031 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.677319 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.678058 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:01:56.678374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.680035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.692097 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4578/9133] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 16:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:01:56.697706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c61c2-acc1-429e-b06d-a2fa87e442e1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.707749 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c61c2-acc1-429e-b06d-a2fa87e442e1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.712531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.713183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.713472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.713751 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.714438 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.716920 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.742894 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4556/9134] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 16:01:56 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:01:56.747041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.757286 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90767020-5adf-4b3f-9299-bcef72e882f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.815099 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.815830 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.816123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.816408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.817167 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.819107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.829272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:56.842981 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4579/9135] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 16:01:56 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:01:56.847462 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.858067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcde37-3d99-49eb-8a39-4d4d7a588625 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.862763 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.863474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.863770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.864051 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.864782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.866400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.877608 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4557/9136] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:01:56.881832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.892749 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227b47-a4ec-498b-a357-9f33c8cc95e1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.897389 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a2f98-2311-43e6-9931-092b6d1309bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.898045 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2f98-2311-43e6-9931-092b6d1309bd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.898337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2f98-2311-43e6-9931-092b6d1309bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.898614 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2f98-2311-43e6-9931-092b6d1309bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.899371 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a2f98-2311-43e6-9931-092b6d1309bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.900970 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a2f98-2311-43e6-9931-092b6d1309bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.911285 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4580/9137] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:01:56.915320 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.925479 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f03423-4bbb-449a-a3f9-120a096f5dc9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.930180 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.931066 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.931379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.931659 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] PATH_INFO: `/v3/projects/95573e51cb7549d99419265725c74af4/users/aa8dea9b55bf4b5eb4fc0572b936f5b0/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.946786 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95573e51cb7549d99419265725c74af4, user_id=aa8dea9b55bf4b5eb4fc0572b936f5b0, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.950109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.963177 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4558/9138] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:01:56 2022] PUT /identity/v3/projects/95573e51cb7549d99419265725c74af4/users/aa8dea9b55bf4b5eb4fc0572b936f5b0/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:56.973931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fac3f-bb43-4205-bb3a-1069e55c1bd2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.974214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fac3f-bb43-4205-bb3a-1069e55c1bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.974502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fac3f-bb43-4205-bb3a-1069e55c1bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.001180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-755fac3f-bb43-4205-bb3a-1069e55c1bd2 None None] MFA Rules not processed for user `aa8dea9b55bf4b5eb4fc0572b936f5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:57.002413 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-755fac3f-bb43-4205-bb3a-1069e55c1bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:57.067006 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4581/9139] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:01:57.071526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.134319 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd8631-1d5f-4ad1-946f-26ef73d014d2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.139892 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.140611 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.140904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.141190 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.141882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.143852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.169719 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4559/9140] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 16:01:57 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:01:57.174038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fac3f-bb43-4205-bb3a-1069e55c1bd2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.185437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fac3f-bb43-4205-bb3a-1069e55c1bd2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.243052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.243777 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.244066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.244409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.245103 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.247688 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.271719 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4582/9141] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 16:01:57 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:01:57.272933 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.284495 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0af82-a740-4fba-bd1d-2f56cc0c1e94 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.289316 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.289992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.290280 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.290578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.291333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.292942 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.304380 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4560/9142] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:01:57.308646 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.319454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78043fa-611c-44c1-9d46-dadc00d6b6e1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.324148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.325042 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.325332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.325617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] PATH_INFO: `/v3/projects/f09e81eeeed64f049ae7da55d4d60a7f/users/1d3e35a0238c4b2a8496f39064fba3f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.340695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09e81eeeed64f049ae7da55d4d60a7f, user_id=1d3e35a0238c4b2a8496f39064fba3f7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.343316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.357079 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4583/9143] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:01:57 2022] PUT /identity/v3/projects/f09e81eeeed64f049ae7da55d4d60a7f/users/1d3e35a0238c4b2a8496f39064fba3f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:57.361370 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.368155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:57.373040 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746a99-5edd-482d-bf06-edb01cb3cd76 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.440395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e633f-77cd-42a7-8207-081748797c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.441257 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e633f-77cd-42a7-8207-081748797c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.441548 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e633f-77cd-42a7-8207-081748797c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.441831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e633f-77cd-42a7-8207-081748797c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.442637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e633f-77cd-42a7-8207-081748797c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.444376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e633f-77cd-42a7-8207-081748797c7b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.454493 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4561/9144] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:01:57.458676 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.469793 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127f862-d9e0-4d04-aa24-4fd958275689 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.474559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.475473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.475773 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.476055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] PATH_INFO: `/v3/projects/f09e81eeeed64f049ae7da55d4d60a7f/users/1d3e35a0238c4b2a8496f39064fba3f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.478046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09e81eeeed64f049ae7da55d4d60a7f, user_id=1d3e35a0238c4b2a8496f39064fba3f7, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.481343 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.491728 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4584/9145] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:01:57 2022] PUT /identity/v3/projects/f09e81eeeed64f049ae7da55d4d60a7f/users/1d3e35a0238c4b2a8496f39064fba3f7/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:57.503502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.503819 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.504103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.532958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] MFA Rules not processed for user `1d3e35a0238c4b2a8496f39064fba3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:57.534178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:57.603224 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4562/9146] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:01:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:57.618768 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.620532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:57.652229 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:57.696851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffd761-bf60-4cfb-8961-6571e62d21d5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.702547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06d0d8-6936-4423-900d-651733f4ea7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.703209 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06d0d8-6936-4423-900d-651733f4ea7c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.703532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06d0d8-6936-4423-900d-651733f4ea7c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.703816 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06d0d8-6936-4423-900d-651733f4ea7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.764508 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06d0d8-6936-4423-900d-651733f4ea7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.766118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06d0d8-6936-4423-900d-651733f4ea7c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.775146 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4585/9147] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:01:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:00.470772 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:00.472359 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:00.532307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec2f77-5d4e-40e8-8b88-ef4d649c52e5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:00.535977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:00.536641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:00.536927 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:00.537207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:00.546652 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:00.548140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:00.558224 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4563/9148] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:02:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:03.247420 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:03.247925 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:03.248039 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:03.270041 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] MFA Rules not processed for user `aa8dea9b55bf4b5eb4fc0572b936f5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:02:03.271316 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:03.279172 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4586/9149] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:02:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:02:05.527146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:05.529433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:05.564565 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:05.609764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28444455-10df-46a7-804a-885ed54de12a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:05.615134 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:05.615850 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:05.616141 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:05.616426 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:05.618940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:05.635380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:05.637889 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:05.651445 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4564/9150] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:02:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:09.176643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:09.178260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:09.193113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4546-3054-402c-b386-3f8190b788a1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:09.198965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb79e8-3a19-499a-8e1c-27d1d298f9a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:09.198965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb79e8-3a19-499a-8e1c-27d1d298f9a3 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:09.199252 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb79e8-3a19-499a-8e1c-27d1d298f9a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:09.199569 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb79e8-3a19-499a-8e1c-27d1d298f9a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:09.201338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78eb79e8-3a19-499a-8e1c-27d1d298f9a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:09.214595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb79e8-3a19-499a-8e1c-27d1d298f9a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:09.216849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb79e8-3a19-499a-8e1c-27d1d298f9a3 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:09.227936 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4587/9151] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:02:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:15.645806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=19 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:19.223370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=53 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:52.961554 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:52.962994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:52.974821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e500c-155c-46e5-922f-e4f917ea94af service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:52.978480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:52.979137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:52.979993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:52.980277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:52.982112 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:52.991918 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:52.993415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:53.003028 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4565/9152] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:02:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:02.998940 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:07.849072 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911718e-51e5-4133-85e6-0b453eb6175b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:07.850156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911718e-51e5-4133-85e6-0b453eb6175b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:07.850665 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911718e-51e5-4133-85e6-0b453eb6175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:07.878702 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a911718e-51e5-4133-85e6-0b453eb6175b None None] MFA Rules not processed for user `aa8dea9b55bf4b5eb4fc0572b936f5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:07.880195 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a911718e-51e5-4133-85e6-0b453eb6175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:07.892804 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4588/9153] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:03:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:03:17.866057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:41.303669 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:41.305069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:41.386621 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058250-023d-41d7-b3da-a5e4636409d7 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:41.392999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db5d13-8ff9-48c9-ac80-46f41bf4e839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:41.393746 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db5d13-8ff9-48c9-ac80-46f41bf4e839 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:41.394130 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db5d13-8ff9-48c9-ac80-46f41bf4e839 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:41.394480 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db5d13-8ff9-48c9-ac80-46f41bf4e839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:41.396595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b1db5d13-8ff9-48c9-ac80-46f41bf4e839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:41.414497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db5d13-8ff9-48c9-ac80-46f41bf4e839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:41.416221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db5d13-8ff9-48c9-ac80-46f41bf4e839 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:41.434384 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4566/9154] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:41.483517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911718e-51e5-4133-85e6-0b453eb6175b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:41.505541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911718e-51e5-4133-85e6-0b453eb6175b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:41.509329 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:41.510054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:41.510408 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:41.510754 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:41.512631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:41.526760 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:41.528235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:41.540892 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4589/9155] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:51.428038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=26 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:51.535585 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:54.007088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d751f6e-e6f6-4de2-b1cd-e21e286c24d1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:54.007609 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d751f6e-e6f6-4de2-b1cd-e21e286c24d1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:54.007709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d751f6e-e6f6-4de2-b1cd-e21e286c24d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:54.027088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4d751f6e-e6f6-4de2-b1cd-e21e286c24d1 None None] MFA Rules not processed for user `aa8dea9b55bf4b5eb4fc0572b936f5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:54.028441 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d751f6e-e6f6-4de2-b1cd-e21e286c24d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:54.039329 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4567/9156] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:54.085352 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:54.086815 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:54.182574 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e276179-892a-42f4-b027-7c9650487299 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:54.187484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:54.188147 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:54.188438 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:54.188841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:54.190708 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:54.206004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:54.207467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:54.225694 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4590/9157] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:04:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:04.022044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:04.215833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=35 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:41.372138 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d751f6e-e6f6-4de2-b1cd-e21e286c24d1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:41.382545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d751f6e-e6f6-4de2-b1cd-e21e286c24d1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:41.386221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf7db5-7a75-4f0e-8043-d1798c5b3966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:41.386867 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7db5-7a75-4f0e-8043-d1798c5b3966 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:41.387157 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7db5-7a75-4f0e-8043-d1798c5b3966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:41.387471 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7db5-7a75-4f0e-8043-d1798c5b3966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:41.389357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9cdf7db5-7a75-4f0e-8043-d1798c5b3966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:41.399912 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf7db5-7a75-4f0e-8043-d1798c5b3966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:41.401351 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf7db5-7a75-4f0e-8043-d1798c5b3966 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:41.409580 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4568/9158] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:41.550486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:41.561160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0251db9-b1cf-4ef9-84a2-408db61cb628 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:41.565435 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e39662-0986-42e8-a123-fe3d055b1ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:41.566088 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e39662-0986-42e8-a123-fe3d055b1ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:41.566384 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e39662-0986-42e8-a123-fe3d055b1ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:41.566669 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e39662-0986-42e8-a123-fe3d055b1ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:41.568516 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65e39662-0986-42e8-a123-fe3d055b1ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:41.578590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e39662-0986-42e8-a123-fe3d055b1ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:41.580743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e39662-0986-42e8-a123-fe3d055b1ac2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:41.589178 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4591/9159] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:41.708078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea6211-f9a8-486c-aeee-a8f6a5e384e2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:41.708374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea6211-f9a8-486c-aeee-a8f6a5e384e2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:41.708657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea6211-f9a8-486c-aeee-a8f6a5e384e2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:41.710598 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4569/9160] 10.222.0.98 () {54 vars in 921 bytes} [Thu Jul 14 16:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 16:05:41.716376 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b865e0-f3f7-48a8-8b89-d636c23ee07d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:41.716752 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b865e0-f3f7-48a8-8b89-d636c23ee07d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:41.716932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b865e0-f3f7-48a8-8b89-d636c23ee07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:41.765695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-37b865e0-f3f7-48a8-8b89-d636c23ee07d None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:05:41.766915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37b865e0-f3f7-48a8-8b89-d636c23ee07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:41.776546 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4592/9161] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:05:41.799088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea6211-f9a8-486c-aeee-a8f6a5e384e2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:41.814695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea6211-f9a8-486c-aeee-a8f6a5e384e2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:41.819743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:41.820380 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:41.820672 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:41.820957 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:41.830146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:41.831783 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:41.841702 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4570/9162] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:42.000154 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b865e0-f3f7-48a8-8b89-d636c23ee07d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:42.010517 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b865e0-f3f7-48a8-8b89-d636c23ee07d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:42.014202 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:42.014846 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:42.015133 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:42.015443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:42.017277 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:42.031030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:42.032450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:42.043439 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4593/9163] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:42.103773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:42.114815 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59119ef4-dd6e-466a-b98d-9aed8efb019a service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:42.120137 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:42.120774 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:42.121057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:42.121335 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:42.123792 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:42.135382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:42.136971 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:42.146833 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4571/9164] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:05:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:52.038801 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=25 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:52.142601 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=18 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:00.725710 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:06:00.739670 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6d8cb-e45f-433c-b995-8b1e0864cc52 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:06:00.745328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:06:00.746005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:00.746864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:00.746864 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:00.748630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:00.760370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:06:00.761911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:06:00.773650 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4594/9165] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:06:01.231617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:06:01.250077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4567-9421-46be-975c-740bd2704ca0 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:06:01.259371 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:06:01.261973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:01.261973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:01.261973 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:01.265615 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:01.282418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:06:01.284869 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:06:01.303938 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4572/9166] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:06:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:06:07.871210 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:06:07.887311 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff44f-90e1-4bc3-8ee3-d89e4c1b1d8d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:06:07.893288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd61f5f-b482-49c1-85e6-8457af19ea3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:06:07.893964 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd61f5f-b482-49c1-85e6-8457af19ea3d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:07.894253 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd61f5f-b482-49c1-85e6-8457af19ea3d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:07.894538 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd61f5f-b482-49c1-85e6-8457af19ea3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:07.896551 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fd61f5f-b482-49c1-85e6-8457af19ea3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:07.912425 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd61f5f-b482-49c1-85e6-8457af19ea3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:06:07.916035 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd61f5f-b482-49c1-85e6-8457af19ea3d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:06:07.937151 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4595/9167] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:06:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:06:11.295577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:17.588442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:06:17.612555 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa73a7-dfac-4870-ab62-f09e1a608c69 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:06:17.618709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:06:17.619433 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:17.619724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:17.620038 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:17.622030 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:17.655018 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:06:17.656773 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:06:17.670118 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4573/9168] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:06:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:06:17.930885 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:27.664782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=15 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:52.026556 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f412e16-0b0c-40fa-977e-dd3fae1436e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:52.027608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f412e16-0b0c-40fa-977e-dd3fae1436e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:52.028106 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f412e16-0b0c-40fa-977e-dd3fae1436e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:52.060240 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f412e16-0b0c-40fa-977e-dd3fae1436e1 None None] MFA Rules not processed for user `aa8dea9b55bf4b5eb4fc0572b936f5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:06:52.064113 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f412e16-0b0c-40fa-977e-dd3fae1436e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:52.080923 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4596/9169] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:06:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:06:57.619419 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:06:57.630004 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15abe6-87db-44a5-9a05-8262174935ce service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:06:57.633711 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:06:57.634472 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:57.634761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:57.635044 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:57.644884 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:06:57.646357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:06:57.657773 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4574/9170] 10.222.0.98 () {60 vars in 1396 bytes} [Thu Jul 14 16:06:57 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:02.047641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:02.659580 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f412e16-0b0c-40fa-977e-dd3fae1436e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:02.669325 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f412e16-0b0c-40fa-977e-dd3fae1436e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:02.673404 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:02.674047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:02.674331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:02.674607 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:02.683673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:02.685107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:02.695234 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4597/9171] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:07:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:07.652499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:12.691292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:18.219500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:18.231699 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f04f62-1be3-45c5-899e-201624e5ccdc service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:18.236742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62685-db05-455e-bc98-bf7c7bdb0a71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:18.237391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62685-db05-455e-bc98-bf7c7bdb0a71 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:18.237709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62685-db05-455e-bc98-bf7c7bdb0a71 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:18.237965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62685-db05-455e-bc98-bf7c7bdb0a71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:18.247391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc62685-db05-455e-bc98-bf7c7bdb0a71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:18.249015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc62685-db05-455e-bc98-bf7c7bdb0a71 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:18.259154 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4575/9172] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:28.254858 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:34.137322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.149473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57900cf-a201-4a74-a977-4cd8eaac03e1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.155188 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.155874 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.156178 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.156458 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.163160 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:34.176652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.179155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.196057 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4598/9173] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:41.232911 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b778-2678-45ef-8d46-9ed69b16345b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:41.233849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b778-2678-45ef-8d46-9ed69b16345b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:41.234020 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b778-2678-45ef-8d46-9ed69b16345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:41.268901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-04e8b778-2678-45ef-8d46-9ed69b16345b None None] MFA Rules not processed for user `aa8dea9b55bf4b5eb4fc0572b936f5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:41.268901 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-04e8b778-2678-45ef-8d46-9ed69b16345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:41.280141 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4576/9174] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:08:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:44.191235 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:45.287196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:45.298265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89912647-a32b-433c-9bab-edf20379da56 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:45.305162 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:45.306541 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:45.306965 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:45.307405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:45.317268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:45.320335 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:45.332133 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4599/9175] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:08:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:51.256686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:55.326254 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:39.678288 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8b778-2678-45ef-8d46-9ed69b16345b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:39.692742 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8b778-2678-45ef-8d46-9ed69b16345b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:39.699152 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2fc9e-3226-4861-9612-5e44eef4e072 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:39.700185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fc9e-3226-4861-9612-5e44eef4e072 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:39.700478 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fc9e-3226-4861-9612-5e44eef4e072 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:39.700791 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fc9e-3226-4861-9612-5e44eef4e072 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:39.702718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-98f2fc9e-3226-4861-9612-5e44eef4e072 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:39.717131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2fc9e-3226-4861-9612-5e44eef4e072 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:39.718876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2fc9e-3226-4861-9612-5e44eef4e072 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:39.735599 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4577/9176] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:40.023911 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:40.117831 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae3c9-f228-4396-a032-170174ba18d9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:40.122156 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:40.123038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:40.123362 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:40.123648 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] PATH_INFO: `/v3/users/aa8dea9b55bf4b5eb4fc0572b936f5b0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:40.124883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa8dea9b55bf4b5eb4fc0572b936f5b0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:40.126843 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:40.178011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa8dea9b55bf4b5eb4fc0572b936f5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.190201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa8dea9b55bf4b5eb4fc0572b936f5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.209416 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa8dea9b55bf4b5eb4fc0572b936f5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.210073 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa8dea9b55bf4b5eb4fc0572b936f5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.218271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa8dea9b55bf4b5eb4fc0572b936f5b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.226555 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4600/9177] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:09:40 2022] DELETE /identity/v3/users/aa8dea9b55bf4b5eb4fc0572b936f5b0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:40.232578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:40.232809 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:40.233108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:40.276391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:40.277563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:40.345770 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4578/9178] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:09:40.355552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:40.357505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:40.444363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f80ec3-d0a8-4818-98b3-b1ab78895186 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:40.448214 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:40.448892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:40.449269 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:40.449466 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:40.457060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:40.462774 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:40.464985 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:40.478262 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4601/9179] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:40.666261 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:40.667158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:40.681158 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f876d-a24f-449e-acb6-03bf105c3695 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:40.686333 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:40.687417 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:40.687591 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:40.687982 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] PATH_INFO: `/v3/projects/95573e51cb7549d99419265725c74af4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:40.689256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] RBAC: Authorizing `identity:delete_project(project_id=95573e51cb7549d99419265725c74af4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:40.691218 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:40.755497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95573e51cb7549d99419265725c74af4', 'request_id': 'req-dd750263-7fdd-404f-bc80-29c2c01e876a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.764839 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95573e51cb7549d99419265725c74af4', 'request_id': 'req-dd750263-7fdd-404f-bc80-29c2c01e876a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.772619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95573e51cb7549d99419265725c74af4', 'request_id': 'req-dd750263-7fdd-404f-bc80-29c2c01e876a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.784245 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] The token cache is being invalidate because project 95573e51cb7549d99419265725c74af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:40.784541 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.785225 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.787419 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4579/9180] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:09:40 2022] DELETE /identity/v3/projects/95573e51cb7549d99419265725c74af4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:40.791528 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:40.802879 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11996fa0-4932-490b-ac8b-fe53ee3789de service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:40.868997 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:40.869892 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:40.871974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:40.871974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] PATH_INFO: `/v3/users/1d3e35a0238c4b2a8496f39064fba3f7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:40.871974 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3e35a0238c4b2a8496f39064fba3f7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:40.873772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:40.927096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3e35a0238c4b2a8496f39064fba3f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.940379 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3e35a0238c4b2a8496f39064fba3f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.950243 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3e35a0238c4b2a8496f39064fba3f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.950910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3e35a0238c4b2a8496f39064fba3f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.959328 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-424f3b57-5ea2-414a-bcd0-7748efad9b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3e35a0238c4b2a8496f39064fba3f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:40.965536 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4602/9181] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:09:40 2022] DELETE /identity/v3/users/1d3e35a0238c4b2a8496f39064fba3f7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:41.268304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:41.269952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:41.284958 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750263-7fdd-404f-bc80-29c2c01e876a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:41.346144 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:41.356880 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:41.357840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.358127 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.358413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] PATH_INFO: `/v3/projects/f09e81eeeed64f049ae7da55d4d60a7f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.359689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09e81eeeed64f049ae7da55d4d60a7f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:41.361638 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:41.413619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09e81eeeed64f049ae7da55d4d60a7f', 'request_id': 'req-db00cb32-77f1-408f-8c5a-87f9acf55974'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:41.421513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09e81eeeed64f049ae7da55d4d60a7f', 'request_id': 'req-db00cb32-77f1-408f-8c5a-87f9acf55974'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:41.428392 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09e81eeeed64f049ae7da55d4d60a7f', 'request_id': 'req-db00cb32-77f1-408f-8c5a-87f9acf55974'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:41.439391 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] The token cache is being invalidate because project f09e81eeeed64f049ae7da55d4d60a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:41.439691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:41.440415 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-db00cb32-77f1-408f-8c5a-87f9acf55974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:41.442138 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4580/9182] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:09:41 2022] DELETE /identity/v3/projects/f09e81eeeed64f049ae7da55d4d60a7f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:41.448052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9041-9447-49f4-8eeb-782d5255a717 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.448559 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9041-9447-49f4-8eeb-782d5255a717 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.448730 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9041-9447-49f4-8eeb-782d5255a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.492651 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b20f9041-9447-49f4-8eeb-782d5255a717 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:41.493863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b20f9041-9447-49f4-8eeb-782d5255a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:41.547712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:41.559060 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4603/9183] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:41.567683 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362876d-b552-44d2-bb57-76ebbde0e3d6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.567977 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362876d-b552-44d2-bb57-76ebbde0e3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.568263 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362876d-b552-44d2-bb57-76ebbde0e3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.587328 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1362876d-b552-44d2-bb57-76ebbde0e3d6 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:41.588613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1362876d-b552-44d2-bb57-76ebbde0e3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:41.599484 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4581/9184] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:41.604260 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9041-9447-49f4-8eeb-782d5255a717 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:41.615033 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9041-9447-49f4-8eeb-782d5255a717 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:41.620514 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:41.621198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.621486 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.621769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.622509 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:09:41.622822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:41.624473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:41.637778 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4604/9185] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 16:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:09:41.642205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362876d-b552-44d2-bb57-76ebbde0e3d6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:41.652781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362876d-b552-44d2-bb57-76ebbde0e3d6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:41.657748 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:41.658423 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.658706 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.658984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.659745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:41.662165 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:41.702632 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4582/9186] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 16:09:41 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:41.706948 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:41.717909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff5fa-6321-4301-a88c-347ea7157b1b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:41.777139 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:41.777832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.778145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.778377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.779390 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:41.781326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:41.806401 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4605/9187] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 16:09:41 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:09:41.811413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:41.822135 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a064b-0b56-4490-afe8-2f7e4db33934 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:41.827722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:41.828398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.828690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.828975 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.829714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:41.831399 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:41.842308 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4583/9188] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:41.846641 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:41.866181 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f1d55-243c-4303-8eef-cf77a6749823 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:41.871107 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077cbec-3130-4cbb-82d1-005dfa8c436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:41.871824 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077cbec-3130-4cbb-82d1-005dfa8c436b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.872117 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077cbec-3130-4cbb-82d1-005dfa8c436b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.872456 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077cbec-3130-4cbb-82d1-005dfa8c436b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.873201 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077cbec-3130-4cbb-82d1-005dfa8c436b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:41.874825 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077cbec-3130-4cbb-82d1-005dfa8c436b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:41.887667 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4606/9189] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:41.892185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:41.904266 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1d8ac-55d3-49d1-8445-7e5efd647f96 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:41.910172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:41.911641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.912119 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.912515 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] PATH_INFO: `/v3/projects/6fd559ec5b4c4693a19b7730fc4c3820/users/bd16884baf734654860f1c60809f51ac/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.931349 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd559ec5b4c4693a19b7730fc4c3820, user_id=bd16884baf734654860f1c60809f51ac, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:41.934187 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:41.948213 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4584/9190] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:41 2022] PUT /identity/v3/projects/6fd559ec5b4c4693a19b7730fc4c3820/users/bd16884baf734654860f1c60809f51ac/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:41.953639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6c44-925f-48d8-8581-67baf673e657 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:41.953956 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6c44-925f-48d8-8581-67baf673e657 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:41.954272 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6c44-925f-48d8-8581-67baf673e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:41.974621 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-337a6c44-925f-48d8-8581-67baf673e657 None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:41.975962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-337a6c44-925f-48d8-8581-67baf673e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:42.038170 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4607/9191] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:42.048108 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:42.049840 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:42.111155 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05a4c7-2317-4ad5-b14d-4ec2313c448a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:42.115540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:42.116277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:42.116500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:42.116781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:42.126802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:42.128317 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:42.139358 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4585/9192] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:46.615576 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a77a-82e8-483d-8ef3-0f6c646395b3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:46.616363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a77a-82e8-483d-8ef3-0f6c646395b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:46.616363 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a77a-82e8-483d-8ef3-0f6c646395b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:46.648779 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-17c1a77a-82e8-483d-8ef3-0f6c646395b3 None None] MFA Rules not processed for user `bd16884baf734654860f1c60809f51ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:46.650094 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17c1a77a-82e8-483d-8ef3-0f6c646395b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:46.731973 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:46.750515 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4608/9193] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:46.755844 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:46.767176 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f0fa4-6801-429c-b05a-5d11155ab4b4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:46.772397 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:46.773080 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:46.773378 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:46.773661 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:46.774406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:46.776420 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:46.789182 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:46.813829 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4586/9194] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 16:09:46 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:46.819450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a77a-82e8-483d-8ef3-0f6c646395b3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:46.831615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a77a-82e8-483d-8ef3-0f6c646395b3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:46.900374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:46.901145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:46.901433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:46.901717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:46.902427 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:46.907693 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:46.936733 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4609/9195] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 16:09:46 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:46.938829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:46.954161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724c02-6db1-4cba-97c1-458e70e551f9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:46.959001 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:46.959887 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:46.960178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:46.960590 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:46.961192 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:46.962852 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:46.975568 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4587/9196] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:46.979799 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:46.992097 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb243446-f8a6-4983-99b1-0853c1d70408 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:46.998394 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:46.999359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:46.999657 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:46.999945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] PATH_INFO: `/v3/projects/1461508b4d5c4c51a6ba928ff8f74661/users/99de7e1a6cc74618bee78bea872d32aa/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:47.022682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1461508b4d5c4c51a6ba928ff8f74661, user_id=99de7e1a6cc74618bee78bea872d32aa, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:47.025525 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:47.053625 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4610/9197] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:46 2022] PUT /identity/v3/projects/1461508b4d5c4c51a6ba928ff8f74661/users/99de7e1a6cc74618bee78bea872d32aa/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:47.058031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:47.069220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a4b5-128a-4f52-9b51-70b85c837548 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:47.140686 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaf008-843d-4390-9894-cc85056c69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:47.144205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf008-843d-4390-9894-cc85056c69a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:47.144205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf008-843d-4390-9894-cc85056c69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:47.144205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf008-843d-4390-9894-cc85056c69a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:47.144205 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaf008-843d-4390-9894-cc85056c69a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:47.145324 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaf008-843d-4390-9894-cc85056c69a9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:47.157400 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4588/9198] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:47.162023 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:47.172922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c1c-0f1d-4d72-803e-8e3a5bb060da admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:47.181521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:47.182442 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:47.182731 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:47.183020 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] PATH_INFO: `/v3/projects/1461508b4d5c4c51a6ba928ff8f74661/users/99de7e1a6cc74618bee78bea872d32aa/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:47.186100 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1461508b4d5c4c51a6ba928ff8f74661, user_id=99de7e1a6cc74618bee78bea872d32aa, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:47.188945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:47.201543 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4611/9199] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:47 2022] PUT /identity/v3/projects/1461508b4d5c4c51a6ba928ff8f74661/users/99de7e1a6cc74618bee78bea872d32aa/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:52.775146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1ac11-a0f8-4e2f-a9ca-f06e471c0864 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:52.775709 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1ac11-a0f8-4e2f-a9ca-f06e471c0864 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:52.775807 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1ac11-a0f8-4e2f-a9ca-f06e471c0864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:52.815095 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-74c1ac11-a0f8-4e2f-a9ca-f06e471c0864 None None] MFA Rules not processed for user `99de7e1a6cc74618bee78bea872d32aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:52.816864 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74c1ac11-a0f8-4e2f-a9ca-f06e471c0864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:52.909527 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4589/9200] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:52.926268 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:52.928215 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:53.021853 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9365-be83-4017-9db6-fa6e297383ae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:53.028046 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:53.029013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:53.029299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:53.029579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:53.070125 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:53.100152 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:53.101803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:53.112357 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4612/9201] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:54.190436 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:54.190937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:54.191183 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:54.210692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] MFA Rules not processed for user `bd16884baf734654860f1c60809f51ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:54.212032 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:54.223969 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4590/9202] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:09:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:54.260346 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:54.261869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:54.326434 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c808f-2868-4046-ba1a-2e348b7699d8 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:54.331577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:54.332251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:54.332573 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:54.332932 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:54.335003 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:54.349386 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:54.350854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:54.364728 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4613/9203] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:54.998049 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:55.002295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:55.005812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:55.081758 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a01aa-90d3-44af-96bd-69a3d58dd988 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:55.089643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:55.091712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:55.092292 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:55.093524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:55.094775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:55.099661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:55.117904 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69513e4-0d4a-4e79-ac15-cf7fd9f8126b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:55.122155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:55.124674 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:55.133545 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:55.134656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:55.135253 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:55.135806 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:55.138382 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:55.150560 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4614/9204] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:55.156035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:55.157897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:55.175707 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4591/9205] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:05.134818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=63 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.169700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:07.323918 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:07.333682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4f83-e3af-40c6-b090-d8b1a66b9348 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:07.337405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:07.338052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:07.338338 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:07.338622 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:07.348783 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:07.350255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:07.361050 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4615/9206] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:10:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:09.367469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:09.381235 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5645a-83a7-4cbf-9286-5c7b823c70f9 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:09.388689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:09.389379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:09.389663 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:09.389943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:09.391875 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:09.405229 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:09.406845 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:09.418923 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4592/9207] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:10:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:17.356290 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:19.414063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:24.425798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:24.427218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:24.467714 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0850b5-f49f-41b7-8ef0-76800d9a2d45 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:24.472889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06676eb2-a54c-47ad-9545-a8ed0a4b618d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:24.473545 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06676eb2-a54c-47ad-9545-a8ed0a4b618d service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:24.473837 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06676eb2-a54c-47ad-9545-a8ed0a4b618d service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:24.474119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06676eb2-a54c-47ad-9545-a8ed0a4b618d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:24.475906 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06676eb2-a54c-47ad-9545-a8ed0a4b618d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:24.488406 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06676eb2-a54c-47ad-9545-a8ed0a4b618d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:24.490492 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06676eb2-a54c-47ad-9545-a8ed0a4b618d service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:24.501008 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4616/9208] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:33.110295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:33.123513 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01e655-bbb2-4c58-b61d-080fee2e8969 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:33.127220 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:33.127910 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:33.128202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:33.128486 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:33.130297 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:33.140833 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:33.142285 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:33.150959 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4593/9209] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:34.496568 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=17 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:43.146802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=8 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:20.051952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:20.052437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:20.052542 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:20.122759 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:12:20.124011 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:20.193835 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4617/9210] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 16:12:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:12:20.240599 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:20.242101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:20.360110 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722dba4-f0c1-4471-bb9e-988dd2dbf8b9 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:20.366093 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:20.366969 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:20.367256 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:20.367643 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:20.378340 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:20.380649 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:20.394240 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4594/9211] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:12:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:12:21.355330 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:21.359454 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:21.378288 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e72f72-4285-4871-9755-e93abd9cf70b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:21.386322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:21.387005 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:21.387361 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:21.387712 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:21.389524 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:21.404013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:21.405638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:21.431547 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4618/9212] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:24.237291 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:24.252294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5d02-a5fb-4d4b-8e2e-0585ffc20d86 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:24.258623 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a24aeb-a598-4a14-9ace-07b3025ba04f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:24.259523 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a24aeb-a598-4a14-9ace-07b3025ba04f service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:24.259921 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a24aeb-a598-4a14-9ace-07b3025ba04f service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:24.260311 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a24aeb-a598-4a14-9ace-07b3025ba04f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:24.266863 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-93a24aeb-a598-4a14-9ace-07b3025ba04f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:24.285413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a24aeb-a598-4a14-9ace-07b3025ba04f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:24.287379 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a24aeb-a598-4a14-9ace-07b3025ba04f service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:24.299896 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4595/9213] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:31.414873 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=50 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:33.363334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:33.364775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:33.376822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae045b06-0716-4ec6-90e4-6b1cb85d0da7 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:33.381597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:33.382259 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:33.382548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:33.382833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:33.384765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:33.395313 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:33.396765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:33.406326 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4619/9214] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:33.518531 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cefe49-b522-48f3-9a02-96fd6e73f43f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:33.519103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cefe49-b522-48f3-9a02-96fd6e73f43f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:33.519103 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cefe49-b522-48f3-9a02-96fd6e73f43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:33.561075 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-48cefe49-b522-48f3-9a02-96fd6e73f43f None None] MFA Rules not processed for user `eecb3bcddba54aca9316af7a0ec3b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:12:33.562312 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-48cefe49-b522-48f3-9a02-96fd6e73f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:33.572402 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4596/9215] 10.222.0.98 () {58 vars in 1018 bytes} [Thu Jul 14 16:12:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:12:33.583802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:33.594931 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1b28-caab-4d1a-90a0-56d7882f3940 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:33.598910 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ded1996761b4d7d8ec89534d2103dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:33.599617 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:33.599905 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:33.600223 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:33.617609 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:33.619070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:33.631297 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4620/9216] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:33.701503 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cefe49-b522-48f3-9a02-96fd6e73f43f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:33.712156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cefe49-b522-48f3-9a02-96fd6e73f43f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:33.715956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:33.716608 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:33.716895 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:33.717172 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:33.719007 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:33.729821 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:33.731321 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:33.739463 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4597/9217] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:33.815239 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:33.825493 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69232dfc-b88c-4801-8462-12a369b0c460 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:33.830081 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:33.830742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:33.831030 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:33.831332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:33.833110 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:33.847632 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:33.849078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:33.860803 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4621/9218] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:33.924818 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:33.938164 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3fb84-8994-4138-89c6-f6d566ce1f4e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:33.943574 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9523372-ce8f-4df9-8c0d-b7a977e172fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:33.944221 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523372-ce8f-4df9-8c0d-b7a977e172fd service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:33.944506 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523372-ce8f-4df9-8c0d-b7a977e172fd service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:33.944781 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523372-ce8f-4df9-8c0d-b7a977e172fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:33.946538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d9523372-ce8f-4df9-8c0d-b7a977e172fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:33.958754 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9523372-ce8f-4df9-8c0d-b7a977e172fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:33.960442 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9523372-ce8f-4df9-8c0d-b7a977e172fd service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:33.970434 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4598/9219] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:35.571196 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:35.584248 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43d1a-d93a-4f5c-afaa-900f9dc397bd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:35.594811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:35.595463 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:35.595732 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:35.596398 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:35.598630 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:35.616751 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:35.618863 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:35.633865 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4622/9220] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:36.282861 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fcf68-a7c1-4cd0-beb9-c867b10ed431 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:36.283353 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fcf68-a7c1-4cd0-beb9-c867b10ed431 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:36.283474 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fcf68-a7c1-4cd0-beb9-c867b10ed431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:36.301764 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-551fcf68-a7c1-4cd0-beb9-c867b10ed431 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:12:36.302992 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-551fcf68-a7c1-4cd0-beb9-c867b10ed431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:36.311637 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4599/9221] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:12:36.326168 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:36.341068 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aff9e-b5a6-49b4-9c75-0ec3b13636c0 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:36.347764 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:36.348636 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:36.348888 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:36.349222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:36.360009 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:36.361613 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:36.370903 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4623/9222] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:12:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:12:46.296364 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=71 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:46.366860 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=30 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:50.419717 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629910a-32a5-495d-a032-ff1b0df58fa9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:50.420720 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629910a-32a5-495d-a032-ff1b0df58fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:50.421077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629910a-32a5-495d-a032-ff1b0df58fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:50.461577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9629910a-32a5-495d-a032-ff1b0df58fa9 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:12:50.462896 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9629910a-32a5-495d-a032-ff1b0df58fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:50.473436 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4600/9223] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:12:50.492365 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:50.503128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d88f3-4d0c-47ff-a4ac-5a68253dc056 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:50.508662 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5601a-8dd8-43a6-b3b6-fee5312b945b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:50.509327 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5601a-8dd8-43a6-b3b6-fee5312b945b service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:50.509776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5601a-8dd8-43a6-b3b6-fee5312b945b service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:50.510063 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5601a-8dd8-43a6-b3b6-fee5312b945b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:50.518728 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5601a-8dd8-43a6-b3b6-fee5312b945b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:50.520405 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5601a-8dd8-43a6-b3b6-fee5312b945b service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:50.529735 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4624/9224] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:12:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:13:00.445315 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:00.526066 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:04.315856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629910a-32a5-495d-a032-ff1b0df58fa9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:04.326796 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629910a-32a5-495d-a032-ff1b0df58fa9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:04.332943 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:04.333905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:04.334376 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:04.334888 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:04.340536 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:04.356460 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:04.358260 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:04.369069 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4601/9225] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:14:09.113990 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad634-6446-4909-94a7-9e0560768d41 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:09.114506 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad634-6446-4909-94a7-9e0560768d41 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:09.114601 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad634-6446-4909-94a7-9e0560768d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:09.132563 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1fdad634-6446-4909-94a7-9e0560768d41 None None] MFA Rules not processed for user `bd16884baf734654860f1c60809f51ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:09.133841 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fdad634-6446-4909-94a7-9e0560768d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:09.140905 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4625/9226] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:14:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:14:14.364714 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:19.127318 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:24.757306 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:24.766273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4591-f29b-4848-af3e-fbd09fc81a75 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:24.770540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:24.771181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:24.771500 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:24.771782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:24.773562 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:24.783641 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:24.785081 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:24.793100 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4602/9227] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:34.789622 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:30.427803 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad634-6446-4909-94a7-9e0560768d41 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:30.466369 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad634-6446-4909-94a7-9e0560768d41 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:30.471515 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:30.472271 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:30.472566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:30.472854 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:30.482145 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:30.483780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:30.494500 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4626/9228] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:16:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:40.104406 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:40.137440 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea3b1a-0356-452f-af13-17d740df8ae9 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:40.141181 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:40.141822 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:40.142107 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:40.142387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:40.149698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:40.151999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:40.160101 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4603/9229] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:16:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:40.489615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=16 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:43.678429 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:43.701377 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bed3c4-f2a8-4ed1-ac9b-69d173203cf7 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:43.707128 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:43.707802 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:43.708092 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:43.708374 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:43.716550 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:43.718163 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:43.727194 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4627/9230] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:43.902131 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:43.911798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d971-592c-4164-bc16-f7b881e0d0a9 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:43.915829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:43.916499 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:43.916788 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:43.917069 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:43.928905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:43.930277 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:43.941632 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4604/9231] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:45.125444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:45.134978 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6acf16-4da2-4cad-91e2-eebed614d98c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:45.138577 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:45.139218 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:45.139526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:45.139804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:45.149909 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:45.151642 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:45.162258 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4628/9232] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:16:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:53.936540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=22 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:55.157552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=16 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:06.485832 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:06.509282 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d66d-5709-43d6-a534-07f320929be4 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:06.516946 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:06.517635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:06.518079 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:06.518568 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:06.529682 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:06.531906 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:06.544264 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4605/9233] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:17:16.538937 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:27.189936 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:27.201230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef4ef-c1b1-46d7-8a6c-c18860b43a50 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:27.207038 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:27.208255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:27.208547 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:27.208833 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:27.217929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:27.219552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:27.230197 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4629/9234] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:17:37.225959 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:37.586936 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:37.602185 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfc44d-e2de-4ff4-97b3-d43d226fae1e service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:37.608564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:37.611304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:37.611304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:37.611304 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:37.620719 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:37.622330 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:37.632950 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4606/9235] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:18:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:18:43.546070 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:43.560049 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111897a7-b3e2-496b-8990-af8c375887d2 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:43.564055 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:43.564787 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:43.565146 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:43.565499 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:43.641153 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:43.642943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:43.654788 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4630/9236] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:18:46.932578 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:46.946026 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef935241-eb02-4298-8bbd-ca7411d5c8b7 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:46.950956 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:46.951654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:46.951944 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:46.952227 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:46.954059 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:46.998258 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:46.999980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:47.016676 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4607/9237] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:18:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:18:50.416255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:50.427155 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b86a16-edea-424f-87df-3338fe2d4952 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:50.432250 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:50.433149 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:50.433437 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:50.433721 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] PATH_INFO: `/v3/users/bd16884baf734654860f1c60809f51ac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:50.434957 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd16884baf734654860f1c60809f51ac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:50.436943 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:50.484880 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd16884baf734654860f1c60809f51ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.501639 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd16884baf734654860f1c60809f51ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.519832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd16884baf734654860f1c60809f51ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.520658 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd16884baf734654860f1c60809f51ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.540748 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd16884baf734654860f1c60809f51ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.561309 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4631/9238] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:18:50 2022] DELETE /identity/v3/users/bd16884baf734654860f1c60809f51ac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:18:50.744034 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:50.761616 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4acd0-065b-4dfc-bbfd-c2454cf1243c service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:50.821707 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:50.822509 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:50.822789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:50.823067 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] PATH_INFO: `/v3/projects/6fd559ec5b4c4693a19b7730fc4c3820` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:50.824292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd559ec5b4c4693a19b7730fc4c3820)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:50.826207 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:50.872648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd559ec5b4c4693a19b7730fc4c3820', 'request_id': 'req-d415b240-386d-4008-9541-19e12f1a3915'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.879451 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd559ec5b4c4693a19b7730fc4c3820', 'request_id': 'req-d415b240-386d-4008-9541-19e12f1a3915'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.886179 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd559ec5b4c4693a19b7730fc4c3820', 'request_id': 'req-d415b240-386d-4008-9541-19e12f1a3915'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.897432 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] The token cache is being invalidate because project 6fd559ec5b4c4693a19b7730fc4c3820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:18:50.897724 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.898375 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:50.900248 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4608/9239] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:18:50 2022] DELETE /identity/v3/projects/6fd559ec5b4c4693a19b7730fc4c3820 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:18:50.904242 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:50.905633 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:50.918797 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933101d-2bb5-4583-ba5f-0dd5c032d6c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:50.974637 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:50.975552 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:50.975840 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:50.976119 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] PATH_INFO: `/v3/users/99de7e1a6cc74618bee78bea872d32aa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:50.977305 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99de7e1a6cc74618bee78bea872d32aa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:50.979238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:50.984668 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:51.027682 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99de7e1a6cc74618bee78bea872d32aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.040862 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99de7e1a6cc74618bee78bea872d32aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.048265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99de7e1a6cc74618bee78bea872d32aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.048912 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99de7e1a6cc74618bee78bea872d32aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.056150 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-891a7ed5-07d4-44cb-8011-d13dd01f0f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99de7e1a6cc74618bee78bea872d32aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.062060 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4632/9240] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:18:50 2022] DELETE /identity/v3/users/99de7e1a6cc74618bee78bea872d32aa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:18:51.233595 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.235064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:51.248758 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415b240-386d-4008-9541-19e12f1a3915 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.294854 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:51.312715 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.313598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.313882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.314160 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] PATH_INFO: `/v3/projects/1461508b4d5c4c51a6ba928ff8f74661` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.315421 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1461508b4d5c4c51a6ba928ff8f74661)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:51.318035 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:51.365118 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1461508b4d5c4c51a6ba928ff8f74661', 'request_id': 'req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.372521 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1461508b4d5c4c51a6ba928ff8f74661', 'request_id': 'req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.378718 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1461508b4d5c4c51a6ba928ff8f74661', 'request_id': 'req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.389829 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] The token cache is being invalidate because project 1461508b4d5c4c51a6ba928ff8f74661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:18:51.390115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.390753 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02d8ee4c-d208-45c3-a53d-7fd2de35e0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:18:51.392336 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4609/9241] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:18:51 2022] DELETE /identity/v3/projects/1461508b4d5c4c51a6ba928ff8f74661 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:18:51.397597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dbdd7-c3da-4465-87fb-b03a9044e84d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.397921 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dbdd7-c3da-4465-87fb-b03a9044e84d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.398207 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dbdd7-c3da-4465-87fb-b03a9044e84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.428652 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb9dbdd7-c3da-4465-87fb-b03a9044e84d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:18:51.429789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb9dbdd7-c3da-4465-87fb-b03a9044e84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:51.490455 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4633/9242] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:18:51.498603 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ee5b6-1ca5-400d-bd3d-09725b5e6c8e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.498923 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ee5b6-1ca5-400d-bd3d-09725b5e6c8e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.499217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ee5b6-1ca5-400d-bd3d-09725b5e6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.517994 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c03ee5b6-1ca5-400d-bd3d-09725b5e6c8e None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:18:51.519170 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c03ee5b6-1ca5-400d-bd3d-09725b5e6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:51.528417 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4610/9243] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:18:51.532673 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dbdd7-c3da-4465-87fb-b03a9044e84d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.543789 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dbdd7-c3da-4465-87fb-b03a9044e84d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.548468 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.549138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.549409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.549709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.550595 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:18:51.550900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:51.553122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:51.564698 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4634/9244] 10.222.0.98 () {58 vars in 1152 bytes} [Thu Jul 14 16:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:18:51.568952 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ee5b6-1ca5-400d-bd3d-09725b5e6c8e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.578344 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ee5b6-1ca5-400d-bd3d-09725b5e6c8e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.583033 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.583725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.584011 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.584292 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.585015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:51.586925 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:51.621135 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4611/9245] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 16:18:51 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:18:51.623467 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.633929 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0e01-e3cd-4581-9ac3-0a9ea429de0d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.690780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.691415 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.691709 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.691996 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.692855 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:51.694798 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:51.703650 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:51.716787 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4635/9246] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 16:18:51 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:18:51.721365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.732563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d094b37-db01-4c38-bdaf-5748e28c22c3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.737354 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.738021 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.738307 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.738700 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.740027 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:51.741637 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:51.752551 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4612/9247] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:18:51.756675 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.766750 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c79e7d-9055-4a3e-9eca-1dcfbbf4be1e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.771643 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c628c-40f4-4662-8789-6245ec434334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.772301 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c628c-40f4-4662-8789-6245ec434334 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.772590 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c628c-40f4-4662-8789-6245ec434334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.772869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c628c-40f4-4662-8789-6245ec434334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.773599 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c628c-40f4-4662-8789-6245ec434334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:51.775473 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c628c-40f4-4662-8789-6245ec434334 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:51.787363 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4636/9248] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:18:51.792689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.803577 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f514f4-7124-42bf-a7da-56813e9f5dff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.808273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.809159 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.809481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.809793 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] PATH_INFO: `/v3/projects/af641a9a7c3b487db865837958578c66/users/68d145662d434c5f8b7ccd5a0ac9192f/roles/963435a25dbf491c8b345da8e43344c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.824463 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af641a9a7c3b487db865837958578c66, user_id=68d145662d434c5f8b7ccd5a0ac9192f, role_id=963435a25dbf491c8b345da8e43344c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:51.827153 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:51.839903 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4613/9249] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:18:51 2022] PUT /identity/v3/projects/af641a9a7c3b487db865837958578c66/users/68d145662d434c5f8b7ccd5a0ac9192f/roles/963435a25dbf491c8b345da8e43344c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:18:51.845183 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54868e-0980-4568-96ad-5b0a8ab8380d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.845483 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54868e-0980-4568-96ad-5b0a8ab8380d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.845765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54868e-0980-4568-96ad-5b0a8ab8380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:51.864849 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be54868e-0980-4568-96ad-5b0a8ab8380d None None] MFA Rules not processed for user `c8378d889c17447db6fd8aa498751f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:18:51.866080 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be54868e-0980-4568-96ad-5b0a8ab8380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:51.925811 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4637/9250] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:18:51.935494 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:51.937345 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:51.994905 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee251-bfcf-48f3-8a35-35856eab594f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:51.998550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:51.999204 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:51.999526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:51.999811 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:52.009072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:52.010518 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:52.021204 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4614/9251] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:18:56.100123 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8766549-3f5c-4cf8-91d9-b219ec351456 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:56.100785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8766549-3f5c-4cf8-91d9-b219ec351456 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:56.100785 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8766549-3f5c-4cf8-91d9-b219ec351456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:56.131653 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f8766549-3f5c-4cf8-91d9-b219ec351456 None None] MFA Rules not processed for user `68d145662d434c5f8b7ccd5a0ac9192f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:18:56.132883 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8766549-3f5c-4cf8-91d9-b219ec351456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:18:56.208808 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4638/9252] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:18:56.213357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:56.223871 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd63ca-6d80-43a2-9619-f5b9d65863a6 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:56.228725 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:56.229400 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:56.229687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:56.229976 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:56.230693 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:56.232665 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:56.246619 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:56.269722 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4615/9253] 10.222.0.98 () {60 vars in 1152 bytes} [Thu Jul 14 16:18:56 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:18:56.274382 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8766549-3f5c-4cf8-91d9-b219ec351456 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:56.286775 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8766549-3f5c-4cf8-91d9-b219ec351456 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:56.346992 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:56.347726 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:56.348057 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:56.348337 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:56.349118 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:56.351122 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:56.373315 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4639/9254] 10.222.0.98 () {60 vars in 1143 bytes} [Thu Jul 14 16:18:56 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:18:56.377403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:56.389635 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957792f-9dc7-4912-a814-77b0ba9a042a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:56.394687 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:56.395445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:56.395737 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:56.396061 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:56.396789 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:56.398424 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:56.410804 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4616/9255] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:18:56.415138 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:56.420549 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:56.427718 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82e0c1-e1e5-4d5b-ad5d-15ca392a77ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:56.433086 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:56.434025 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:56.434308 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:56.434587 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] PATH_INFO: `/v3/projects/9ae51c1e82f6434f82b391d50eb6ea16/users/d875296af811400b9b83a47323744610/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:56.452067 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae51c1e82f6434f82b391d50eb6ea16, user_id=d875296af811400b9b83a47323744610, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:56.455069 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:56.470490 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4640/9256] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:18:56 2022] PUT /identity/v3/projects/9ae51c1e82f6434f82b391d50eb6ea16/users/d875296af811400b9b83a47323744610/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:18:56.474695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:56.485770 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4bc7f-194f-4a4a-a555-5c138328fdf3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:56.560527 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72884dc-ae76-4e8d-a41a-d3ce832de95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:56.561222 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72884dc-ae76-4e8d-a41a-d3ce832de95e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:56.561511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72884dc-ae76-4e8d-a41a-d3ce832de95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:56.561851 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72884dc-ae76-4e8d-a41a-d3ce832de95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:56.562648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72884dc-ae76-4e8d-a41a-d3ce832de95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:56.564325 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72884dc-ae76-4e8d-a41a-d3ce832de95e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:56.579082 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4617/9257] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 16:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:18:56.580282 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:18:56.591795 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f726d4-53b6-4744-8670-9cc51a72f36a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:18:56.598450 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:18:56.599448 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:18:56.599738 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:18:56.600028 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] PATH_INFO: `/v3/projects/9ae51c1e82f6434f82b391d50eb6ea16/users/d875296af811400b9b83a47323744610/roles/ba3e21bde1be4808aa89ff8df9bbb9be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:18:56.602203 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae51c1e82f6434f82b391d50eb6ea16, user_id=d875296af811400b9b83a47323744610, role_id=ba3e21bde1be4808aa89ff8df9bbb9be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:18:56.604895 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:18:56.616951 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4641/9258] 10.222.0.98 () {60 vars in 1482 bytes} [Thu Jul 14 16:18:56 2022] PUT /identity/v3/projects/9ae51c1e82f6434f82b391d50eb6ea16/users/d875296af811400b9b83a47323744610/roles/ba3e21bde1be4808aa89ff8df9bbb9be => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:19:01.561064 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac004-fbd4-4d93-943b-49eb0203b407 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:19:01.561529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac004-fbd4-4d93-943b-49eb0203b407 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:19:01.561529 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac004-fbd4-4d93-943b-49eb0203b407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:19:01.590140 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e65ac004-fbd4-4d93-943b-49eb0203b407 None None] MFA Rules not processed for user `d875296af811400b9b83a47323744610`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:19:01.591390 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e65ac004-fbd4-4d93-943b-49eb0203b407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:01.673108 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4618/9259] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:19:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:19:01.690423 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:19:01.692776 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:01.788717 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e337e-d2e6-4fca-b859-3fdf7a978c56 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:19:01.794355 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:19:01.795026 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:19:01.795345 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:19:01.795631 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:19:01.856007 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:19:01.857299 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:19:01.867305 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4642/9260] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:19:02.865563 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e95e-1d3d-42b8-996c-dd3dc3f95fb4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:19:02.866057 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e95e-1d3d-42b8-996c-dd3dc3f95fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:19:02.866156 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e95e-1d3d-42b8-996c-dd3dc3f95fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:19:02.884099 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3c46e95e-1d3d-42b8-996c-dd3dc3f95fb4 None None] MFA Rules not processed for user `68d145662d434c5f8b7ccd5a0ac9192f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:19:02.885828 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c46e95e-1d3d-42b8-996c-dd3dc3f95fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:02.894067 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4619/9261] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:19:03.577332 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:19:03.578812 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:03.656171 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:03.675818 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7b02-2071-4eb9-9560-2803fb1f3c80 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:19:03.681999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:19:03.682274 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:19:03.682608 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:19:03.682851 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:19:03.684792 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:03.697258 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:19:03.698875 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:19:03.709620 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4643/9262] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:19:11.421761 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e95e-1d3d-42b8-996c-dd3dc3f95fb4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:19:11.436885 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e95e-1d3d-42b8-996c-dd3dc3f95fb4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:19:11.444029 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d84c3-09b4-4431-94a5-37b9f5d4e7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:19:11.444698 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d84c3-09b4-4431-94a5-37b9f5d4e7c2 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:19:11.445017 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d84c3-09b4-4431-94a5-37b9f5d4e7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:19:11.445295 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d84c3-09b4-4431-94a5-37b9f5d4e7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:19:11.447125 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e7d84c3-09b4-4431-94a5-37b9f5d4e7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:11.469722 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d84c3-09b4-4431-94a5-37b9f5d4e7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:19:11.471697 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d84c3-09b4-4431-94a5-37b9f5d4e7c2 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:19:11.483326 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4620/9263] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:19:13.704869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:14.418180 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:19:14.472805 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ac31-e523-4026-830c-86add0550fce service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:19:14.476507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:19:14.477157 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:19:14.477443 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:19:14.477722 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:19:14.486821 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:19:14.488285 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:19:14.498208 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4644/9264] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:19:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:19:21.483691 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:24.494008 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=26 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:17.951036 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37251-a54f-40c0-a057-958999249d7c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:17.951613 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37251-a54f-40c0-a057-958999249d7c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:17.951738 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37251-a54f-40c0-a057-958999249d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:17.971734 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-24c37251-a54f-40c0-a057-958999249d7c None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:17.972967 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-24c37251-a54f-40c0-a057-958999249d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:18.042792 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4621/9265] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:18.088294 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:18.089695 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:18.160134 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f88d2-266c-4cb4-b568-32bddc0eb619 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:18.165555 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d3de1-45c2-45f9-818e-f46dfa3c4961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:18.166780 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d3de1-45c2-45f9-818e-f46dfa3c4961 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:18.167061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d3de1-45c2-45f9-818e-f46dfa3c4961 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:18.167388 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d3de1-45c2-45f9-818e-f46dfa3c4961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:18.176096 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d3de1-45c2-45f9-818e-f46dfa3c4961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:18.177756 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d3de1-45c2-45f9-818e-f46dfa3c4961 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:18.186997 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4645/9266] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:21:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:21:27.657831 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a778d3-d5a5-4e3d-921d-76cfeb7f2a95 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:27.658485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a778d3-d5a5-4e3d-921d-76cfeb7f2a95 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:27.658485 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a778d3-d5a5-4e3d-921d-76cfeb7f2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:27.678803 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-91a778d3-d5a5-4e3d-921d-76cfeb7f2a95 None None] MFA Rules not processed for user `68d145662d434c5f8b7ccd5a0ac9192f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:27.680058 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-91a778d3-d5a5-4e3d-921d-76cfeb7f2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:27.705809 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4622/9267] 10.222.0.98 () {58 vars in 957 bytes} [Thu Jul 14 16:21:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:28.038930 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b00a-b86a-44e4-985e-738f9e91b43f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:28.039489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b00a-b86a-44e4-985e-738f9e91b43f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:28.039489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b00a-b86a-44e4-985e-738f9e91b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:28.089495 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2328b00a-b86a-44e4-985e-738f9e91b43f None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:28.090696 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2328b00a-b86a-44e4-985e-738f9e91b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:28.097301 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4646/9268] 10.222.0.98 () {58 vars in 1061 bytes} [Thu Jul 14 16:21:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:28.103167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a778d3-d5a5-4e3d-921d-76cfeb7f2a95 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:28.113629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a778d3-d5a5-4e3d-921d-76cfeb7f2a95 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:28.117230 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bc8c7-1436-4aef-bf95-553847862c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:28.117882 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc8c7-1436-4aef-bf95-553847862c37 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:28.118167 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc8c7-1436-4aef-bf95-553847862c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:28.118444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc8c7-1436-4aef-bf95-553847862c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:28.120398 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5c5bc8c7-1436-4aef-bf95-553847862c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:28.130109 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bc8c7-1436-4aef-bf95-553847862c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:28.131581 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bc8c7-1436-4aef-bf95-553847862c37 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:28.139626 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4623/9269] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:28.484832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b00a-b86a-44e4-985e-738f9e91b43f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:28.505822 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b00a-b86a-44e4-985e-738f9e91b43f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:28.510922 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:28.511623 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:28.511915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:28.512198 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:28.514004 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:28.527409 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:28.529052 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:28.541641 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4647/9270] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:21:30.805077 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d208c-36c2-41de-a1ce-7a7c8b14f82b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:30.805804 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d208c-36c2-41de-a1ce-7a7c8b14f82b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:30.805980 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d208c-36c2-41de-a1ce-7a7c8b14f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:30.826357 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e14d208c-36c2-41de-a1ce-7a7c8b14f82b None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:30.827594 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e14d208c-36c2-41de-a1ce-7a7c8b14f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:30.834830 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4624/9271] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:30.847043 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:30.858945 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea265c-6ca8-49b6-a2f0-fb529897df4c service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:30.864141 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a80602-dd02-4f5e-9b12-b49288942958 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:30.864794 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80602-dd02-4f5e-9b12-b49288942958 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:30.865078 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80602-dd02-4f5e-9b12-b49288942958 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:30.865356 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80602-dd02-4f5e-9b12-b49288942958 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:30.875121 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a80602-dd02-4f5e-9b12-b49288942958 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:30.876845 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a80602-dd02-4f5e-9b12-b49288942958 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:30.885686 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4648/9272] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:21:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:21:38.452727 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d208c-36c2-41de-a1ce-7a7c8b14f82b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:38.472647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d208c-36c2-41de-a1ce-7a7c8b14f82b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:38.495648 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:38.496387 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:38.496676 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:38.496965 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:38.498979 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:38.513606 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:38.515629 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:38.530088 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4625/9273] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:39.560444 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7a0d5-c34c-408c-b775-1426c6fbacfd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:39.561266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7a0d5-c34c-408c-b775-1426c6fbacfd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:39.561266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7a0d5-c34c-408c-b775-1426c6fbacfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:39.580164 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f2c7a0d5-c34c-408c-b775-1426c6fbacfd None None] MFA Rules not processed for user `0f0c4ffb0c9a4de08091b6a7493e2fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:39.581395 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2c7a0d5-c34c-408c-b775-1426c6fbacfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:39.588038 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4649/9274] 10.222.0.98 () {58 vars in 1061 bytes} [Thu Jul 14 16:21:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:39.594166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:39.603847 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566908-5f89-4db7-8bf5-675519bd3371 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:39.608015 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:39.608855 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:39.609148 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:39.609524 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:39.611690 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:39.623196 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:39.624740 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:39.633139 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4626/9275] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:44.978743 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7a0d5-c34c-408c-b775-1426c6fbacfd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:44.982852 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=65 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:44.988502 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7a0d5-c34c-408c-b775-1426c6fbacfd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:44.992266 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:44.992944 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:44.993230 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:44.993548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:44.995962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:45.010074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:45.011566 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:45.023623 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4650/9276] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:47.073814 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:47.077897 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=61 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:47.083598 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f7aa-bf60-4264-9860-c1e041fc44ab service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:47.087651 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:47.088313 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:47.088600 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:47.088879 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:47.090647 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:47.100146 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:47.101584 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:47.110404 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4627/9277] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:47.441231 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:47.450666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9552d9-1eab-4a84-a701-4e95d8d3e228 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:47.454627 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75513a9-e12e-40b2-a54e-063a4553c747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0c4ffb0c9a4de08091b6a7493e2fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:47.455322 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75513a9-e12e-40b2-a54e-063a4553c747 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:47.455619 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75513a9-e12e-40b2-a54e-063a4553c747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:47.455900 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75513a9-e12e-40b2-a54e-063a4553c747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:47.457742 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a75513a9-e12e-40b2-a54e-063a4553c747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:47.473962 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75513a9-e12e-40b2-a54e-063a4553c747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:47.475548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75513a9-e12e-40b2-a54e-063a4553c747 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:47.487210 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4651/9278] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:57.106564 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:57.482148 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:32.185511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:32.198232 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d29c7-a863-427a-9a31-691841e871e0 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:32.204401 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff83f22-8e06-49a7-88ea-cebb9d5a6e9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:32.205054 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff83f22-8e06-49a7-88ea-cebb9d5a6e9c service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:32.205338 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff83f22-8e06-49a7-88ea-cebb9d5a6e9c service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:32.205617 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff83f22-8e06-49a7-88ea-cebb9d5a6e9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:32.207394 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ff83f22-8e06-49a7-88ea-cebb9d5a6e9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:32.219549 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff83f22-8e06-49a7-88ea-cebb9d5a6e9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:32.221161 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff83f22-8e06-49a7-88ea-cebb9d5a6e9c service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:32.231837 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4628/9279] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:22:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:22:42.226849 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:21.119397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ba24-d6a8-474d-8dfe-63796a321d14 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:21.119894 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ba24-d6a8-474d-8dfe-63796a321d14 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:21.119999 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ba24-d6a8-474d-8dfe-63796a321d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:21.178407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c27ba24-d6a8-474d-8dfe-63796a321d14 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:23:21.179656 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c27ba24-d6a8-474d-8dfe-63796a321d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:21.196884 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4652/9280] 10.222.0.98 () {58 vars in 1009 bytes} [Thu Jul 14 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:23:21.237525 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a428e-7a74-477d-87dc-644d6227f3ca None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:21.237999 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a428e-7a74-477d-87dc-644d6227f3ca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:21.238310 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a428e-7a74-477d-87dc-644d6227f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:21.289689 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-123a428e-7a74-477d-87dc-644d6227f3ca None None] MFA Rules not processed for user `e4c56829e4af4b609ab6c986b745a4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:23:21.290934 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-123a428e-7a74-477d-87dc-644d6227f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:21.309741 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4629/9281] 10.222.0.98 () {58 vars in 1039 bytes} [Thu Jul 14 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:23:21.316222 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ba24-d6a8-474d-8dfe-63796a321d14 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:21.328359 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ba24-d6a8-474d-8dfe-63796a321d14 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:21.333426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:21.334074 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:21.334396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:21.334681 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:21.342877 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:21.345013 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:21.353313 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4653/9282] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:23:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:30.583681 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:30.584202 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:30.584308 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:30.603248 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:23:30.604502 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:30.612642 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4630/9283] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:23:30.624796 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:30.635381 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511abcd5-f7f4-4de7-a114-aedba0652da4 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:30.640548 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90fbd-b558-4145-99e2-49af780d8ff2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:30.641189 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90fbd-b558-4145-99e2-49af780d8ff2 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:30.641475 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90fbd-b558-4145-99e2-49af780d8ff2 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:30.641763 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90fbd-b558-4145-99e2-49af780d8ff2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:30.650326 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90fbd-b558-4145-99e2-49af780d8ff2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:30.651995 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90fbd-b558-4145-99e2-49af780d8ff2 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:30.660895 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4654/9284] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:23:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:31.789782 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:31.792166 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:31.810365 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42b3e9-bdc5-4e04-895f-40d5471a82bd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:31.819842 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eecb3bcddba54aca9316af7a0ec3b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:31.820802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:31.821323 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:31.821835 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:31.824031 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:31.837418 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:31.839012 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:31.851238 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4631/9285] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:23:35.544482 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b801-801c-45c5-897c-5ee2a6bec8e6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:35.544952 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b801-801c-45c5-897c-5ee2a6bec8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:35.545077 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b801-801c-45c5-897c-5ee2a6bec8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:35.563982 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0a7b801-801c-45c5-897c-5ee2a6bec8e6 None None] MFA Rules not processed for user `4999d3dfc6394f83a0b264434e6a256f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:23:35.565238 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0a7b801-801c-45c5-897c-5ee2a6bec8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:35.572639 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4655/9286] 10.222.0.98 () {58 vars in 967 bytes} [Thu Jul 14 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:23:35.584444 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:35.595526 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6aff4-d0a6-42f9-a246-009afaa5fcb1 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:35.600488 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4c56829e4af4b609ab6c986b745a4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:35.601116 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:35.601403 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:35.601685 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:35.610115 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:35.611743 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:35.619771 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4632/9287] 10.222.0.98 () {60 vars in 1384 bytes} [Thu Jul 14 16:23:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:44.105720 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7b801-801c-45c5-897c-5ee2a6bec8e6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:44.118426 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7b801-801c-45c5-897c-5ee2a6bec8e6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:44.123433 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:44.124104 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:44.124396 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:44.124679 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:44.126469 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:44.138075 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:44.145505 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:44.150641 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4656/9288] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:23:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:23:45.616538 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=33 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:47.316805 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:47.329778 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ab98-fb65-4fd0-b533-bff48d0c1849 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:47.335540 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:47.336385 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:47.336745 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:47.337123 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:47.339223 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:47.359481 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:47.361695 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:47.373595 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4633/9289] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:23:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:23:47.383597 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:47.474265 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f94301-7890-4165-acd3-f68c45118a76 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:47.478856 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:47.479765 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:47.480054 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:47.480334 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] PATH_INFO: `/v3/users/68d145662d434c5f8b7ccd5a0ac9192f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:47.481521 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d145662d434c5f8b7ccd5a0ac9192f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:47.483489 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:47.488014 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=80 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:47.529810 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d145662d434c5f8b7ccd5a0ac9192f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.542526 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d145662d434c5f8b7ccd5a0ac9192f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.553832 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d145662d434c5f8b7ccd5a0ac9192f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.554612 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d145662d434c5f8b7ccd5a0ac9192f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.561772 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d145662d434c5f8b7ccd5a0ac9192f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.567953 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4657/9290] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:23:47 2022] DELETE /identity/v3/users/68d145662d434c5f8b7ccd5a0ac9192f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:23:47.746299 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:47.758602 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f092664-e00d-4af1-9c53-16f21eff7908 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:47.817539 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:47.818413 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:47.818702 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:47.818984 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] PATH_INFO: `/v3/projects/af641a9a7c3b487db865837958578c66` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:47.820214 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af641a9a7c3b487db865837958578c66)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:47.822215 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:47.868802 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af641a9a7c3b487db865837958578c66', 'request_id': 'req-08a5f5a1-2f83-47af-9b12-34f8a12a8111'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.876692 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af641a9a7c3b487db865837958578c66', 'request_id': 'req-08a5f5a1-2f83-47af-9b12-34f8a12a8111'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.883469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af641a9a7c3b487db865837958578c66', 'request_id': 'req-08a5f5a1-2f83-47af-9b12-34f8a12a8111'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.907511 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] The token cache is being invalidate because project af641a9a7c3b487db865837958578c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:23:47.907808 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.908452 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:47.910033 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4634/9291] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:23:47 2022] DELETE /identity/v3/projects/af641a9a7c3b487db865837958578c66 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:23:47.914060 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:47.915484 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:47.928407 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b31b-da14-42c3-9ec0-d9d88b9bf4ec admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:47.983889 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:47.984806 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:47.985090 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:47.985370 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] PATH_INFO: `/v3/users/d875296af811400b9b83a47323744610` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:47.986561 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d875296af811400b9b83a47323744610)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:47.988532 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:48.034690 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd875296af811400b9b83a47323744610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.046811 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd875296af811400b9b83a47323744610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.054915 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd875296af811400b9b83a47323744610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.055666 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd875296af811400b9b83a47323744610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.063241 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd875296af811400b9b83a47323744610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.069127 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4658/9292] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 16:23:47 2022] DELETE /identity/v3/users/d875296af811400b9b83a47323744610 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:23:48.247296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:23:48.247296 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:23:48.262224 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f5a1-2f83-47af-9b12-34f8a12a8111 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:23:48.322490 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8378d889c17447db6fd8aa498751f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8825e26169ac4a448a49e26a9c5f74ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:23:48.323395 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:23:48.323684 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:23:48.323960 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] PATH_INFO: `/v3/projects/9ae51c1e82f6434f82b391d50eb6ea16` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:23:48.325128 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae51c1e82f6434f82b391d50eb6ea16)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:23:48.327072 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:23:48.334856 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:48.373985 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae51c1e82f6434f82b391d50eb6ea16', 'request_id': 'req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.382078 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae51c1e82f6434f82b391d50eb6ea16', 'request_id': 'req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.389550 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae51c1e82f6434f82b391d50eb6ea16', 'request_id': 'req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.400178 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] The token cache is being invalidate because project 9ae51c1e82f6434f82b391d50eb6ea16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:23:48.400469 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.401111 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:23:48.402689 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4635/9293] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 16:23:48 2022] DELETE /identity/v3/projects/9ae51c1e82f6434f82b391d50eb6ea16 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:23:58.065638 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:58.396876 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:46.402375 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:26:46.403869 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:26:46.498064 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89074c1-2e08-4a6c-a2d4-eb1d4976af3a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:26:46.557809 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5210f61-d006-4494-b06c-74622d12a27d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:26:46.558397 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5210f61-d006-4494-b06c-74622d12a27d service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:26:46.558687 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5210f61-d006-4494-b06c-74622d12a27d service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:26:46.558967 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5210f61-d006-4494-b06c-74622d12a27d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:26:46.560769 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5210f61-d006-4494-b06c-74622d12a27d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:26:46.572724 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5210f61-d006-4494-b06c-74622d12a27d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:26:46.574321 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5210f61-d006-4494-b06c-74622d12a27d service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:26:46.584095 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4659/9294] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:26:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:26:56.580001 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=69 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:27:39.196143 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:27:39.197597 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:27:39.212580 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3771-c9bc-4840-a61f-65f5ee2ae223 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:27:39.219106 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:27:39.219798 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:27:39.220088 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:27:39.220374 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:27:39.222211 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:27:39.234657 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:27:39.236294 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:27:39.248040 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4636/9295] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:27:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:27:49.244063 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:28:47.342251 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597c2b0-83e7-4c04-864c-a591fb0a0362 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:28:47.342827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597c2b0-83e7-4c04-864c-a591fb0a0362 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:28:47.342827 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597c2b0-83e7-4c04-864c-a591fb0a0362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:28:47.403903 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a597c2b0-83e7-4c04-864c-a591fb0a0362 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:28:47.405105 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a597c2b0-83e7-4c04-864c-a591fb0a0362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:28:47.413815 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4660/9296] 10.222.0.110 () {58 vars in 1016 bytes} [Thu Jul 14 16:28:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:28:47.426445 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:28:47.427870 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:28:47.463171 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c560e0-c253-4272-a4ac-3c8e59a5714c service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:28:47.468273 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2a40-576b-4bfd-afcc-1e87fdf79f7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:28:47.468928 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2a40-576b-4bfd-afcc-1e87fdf79f7d service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:28:47.469217 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2a40-576b-4bfd-afcc-1e87fdf79f7d service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:28:47.469497 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2a40-576b-4bfd-afcc-1e87fdf79f7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:28:47.479654 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2a40-576b-4bfd-afcc-1e87fdf79f7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:28:47.481255 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2a40-576b-4bfd-afcc-1e87fdf79f7d service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:28:47.492078 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4637/9297] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:28:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:28:57.401575 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=18 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:28:57.487775 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=15 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:29:41.168507 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0854-f503-4058-ace1-fe8b35938317 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:29:41.169227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0854-f503-4058-ace1-fe8b35938317 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:29:41.169227 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0854-f503-4058-ace1-fe8b35938317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:29:41.200579 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-869c0854-f503-4058-ace1-fe8b35938317 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:29:41.201804 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-869c0854-f503-4058-ace1-fe8b35938317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:29:41.211150 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4661/9298] 10.222.0.104 () {58 vars in 1016 bytes} [Thu Jul 14 16:29:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:29:41.223993 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d092854-a5e1-49b6-8c7e-e51deeaeb916 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:29:41.224656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d092854-a5e1-49b6-8c7e-e51deeaeb916 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:29:41.224656 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d092854-a5e1-49b6-8c7e-e51deeaeb916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:29:41.249101 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8d092854-a5e1-49b6-8c7e-e51deeaeb916 None None] MFA Rules not processed for user `5d5da8901f9d44d884119c66f4b813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:29:41.250559 n-d-768852-23 devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8d092854-a5e1-49b6-8c7e-e51deeaeb916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:29:41.259605 n-d-768852-23 devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4638/9299] 10.222.0.98 () {58 vars in 1057 bytes} [Thu Jul 14 16:29:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:29:41.266255 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c0854-f503-4058-ace1-fe8b35938317 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:29:41.278047 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c0854-f503-4058-ace1-fe8b35938317 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:29:41.284336 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af410c80-6c33-459b-9ee5-da4f22c6cbdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5da8901f9d44d884119c66f4b813ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d7042d8cdce4651a115e79a914930c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:29:41.285036 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af410c80-6c33-459b-9ee5-da4f22c6cbdb service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:29:41.285331 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af410c80-6c33-459b-9ee5-da4f22c6cbdb service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:29:41.285615 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af410c80-6c33-459b-9ee5-da4f22c6cbdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:29:41.295017 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af410c80-6c33-459b-9ee5-da4f22c6cbdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:29:41.296661 n-d-768852-23 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af410c80-6c33-459b-9ee5-da4f22c6cbdb service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:29:41.307998 n-d-768852-23 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4662/9300] 10.222.0.98 () {60 vars in 1365 bytes} [Thu Jul 14 16:29:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:29:51.238269 n-d-768852-23 devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:29:51.303061 n-d-768852-23 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=13 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}